LeaderRebalancerTest.AddTserver: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:435: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260925 16:46:40.700502  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
I20260925 16:46:40.634027 17804 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.702781 17804 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:40.705508 18036 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260925 16:46:40.705991  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.707204 18036 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:40.708882  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.709896 17979 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:40.709363 18036 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:40.711254 17902 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.712890 17931 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.713340 18036 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.715231  9120 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:40.674383 17759 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:40.718395 17759 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:40.718714  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.718914  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.719599  9042 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:40.711254 17787 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.720753 17625 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:40.721521  9042 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:40.719466  9044 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:40.670063 17583 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.723855 17601 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.666658 17642 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.709641  9115 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:40.725356  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.725817 17642 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.726446  9046 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:40.726555  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.727306  9115 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:40.729053  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.688283  9124 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:40.709601  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 87861.3us
I20260925 16:46:40.718773 17759 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:40.730003  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.748073  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:40.733708  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.733847  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.708266  9123 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:40.691485 17980 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.676122 17942 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.735642  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.736589  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.762012  9695 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:40.756368  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82423.4us
I20260925 16:46:40.739979  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:40.737381  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:40.762995  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.736542  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.750010  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.756333  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.756650  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.661496 17910 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.749224  9696 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:40.761880  9049 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:40.769593  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.772462  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.774391  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:40.774610  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.775995  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.777222  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.780812  9124 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 FOLLOWER]: Advancing to term 32
I20260925 16:46:40.783175  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:40.783425  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:40.784067  9118 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:40.784242  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.784551  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.785943  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.784572  9048 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:40.771056 18034 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:40.793430  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.790102 17743 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:40.771250 18025 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:40.800869  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.810410  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.811717  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.813524  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.808552  9122 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:40.788858 18007 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:40.788691 17642 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:40.793637 17625 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:40.819564  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:40.818523  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55686.4us
I20260925 16:46:40.824942  9123 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:40.797935 17845 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:40.801739 17743 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.876151  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:40.876241  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.876996  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.815181 17325 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.014s
I20260925 16:46:40.877349  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.896185  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:40.828663 17845 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.896391  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.806856 17797 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:40.814848 17583 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.827409 17625 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:40.829671 17642 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:46:40.890018 18013 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:40.806725 17971 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.895159 17755 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:40.889652 17601 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.899569 17845 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:40.953846  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45167us
I20260925 16:46:40.954715  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.908432 17625 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:40.947072  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.898272 18034 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260925 16:46:40.959220  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83078.4us
I20260925 16:46:40.914137 17583 raft_consensus.cc:2741] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:46:40.911489 17797 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.912678 17743 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:40.958458  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.964157 17726 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.947073 17668 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:40.962946  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53420.1us
I20260925 16:46:40.967239  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:40.961824  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.920643 18046 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:40.971031  9702 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:40.967847  9090 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.952049 17755 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:40.962198 17980 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:40.980958  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 245662us
W20260925 16:46:40.987128  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 206623us
I20260925 16:46:40.989717  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.907207 17979 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260925 16:46:40.969355 18034 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.999513  9118 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:40.993111  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.983294 17917 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:40.983690 18044 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.994848  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.000314 17761 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:41.001154 17726 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.003391 17907 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.972983 17797 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:41.036864  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.004182 18045 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.206s
I20260925 16:46:41.011104 17803 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:41.012575  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.013921 17971 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.014988  8967 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260925 16:46:41.016510 17764 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:41.017818  9702 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:41.019506 17910 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:40.979240 18007 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:41.021238  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.021986  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.021682 18017 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.957782 17700 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:41.028047  9047 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:41.029261  9116 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:41.027501  9122 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:41.035355  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.033888  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.040570  9124 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 32 index: 18. (term mismatch)
I20260925 16:46:41.043900  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.992199 17755 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:40.962023 17601 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.058014  9124 pending_rounds.cc:76] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 17
I20260925 16:46:41.044901  9694 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:41.064455  9124 pending_rounds.cc:97] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 31.18
I20260925 16:46:41.046756  9123 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:41.052212  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.033128 18034 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:41.033321 17917 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.042078 17583 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:41.061427 17642 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.049168 18007 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.063863  9120 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
W20260925 16:46:41.080469  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 114834us
I20260925 16:46:41.088133  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.080650  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.044461 17899 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Stepping down as leader of term 28
I20260925 16:46:41.044520 17803 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:41.084131  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 91484us
I20260925 16:46:41.048683 17764 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:41.064782  9044 raft_consensus.cc:2354] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:41.096572  9700 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: []
I20260925 16:46:41.091744  9047 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:41.098276  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.093997  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.060915 18046 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.047993 17907 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:41.087057 17917 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:41.092855  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.064827  9124 raft_consensus.cc:2866] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:41.111773  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.061586 17942 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.116201  9665 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.119006  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.127394  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.128121  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.042460 17761 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.087792 17876 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.090034 17899 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:41.131444  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.089738 18007 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:46:41.133342  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89854.1us
I20260925 16:46:41.132880  9122 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:41.138998  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.139808 17718 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.050s
I20260925 16:46:41.140115 17970 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:41.140625 17726 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.140848 17939 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.026572 17668 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.102187 17787 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:41.200050 17787 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.200510 17787 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.192598 17971 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:41.141574 17803 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.124532 17988 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:41.132781 17934 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:41.205900 17803 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:41.189422  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 166240us
I20260925 16:46:41.208595  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.210165 17942 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:41.210330  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.125197 18036 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.211966 18036 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.214051 17718 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Stepping down as leader of term 27
I20260925 16:46:41.214164 18036 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.193094 17970 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.215524 17970 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:41.211319 17979 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:41.210848 17942 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260925 16:46:41.214526 17718 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.218338 17718 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.219851 17718 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:41.139451 17876 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.220335 18046 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.222836 17764 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.223400 18023 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260925 16:46:41.224191 17764 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.225535 17601 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.133810 17864 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:41.191073  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.130371 17583 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.097517 18044 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.197628 17939 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:41.197575 17953 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.106s
I20260925 16:46:41.198402 17666 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:41.199586 17668 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.186370  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.227780  9089 leader_election.cc:398] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:41.239348  9089 leader_election.cc:401] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260925 16:46:41.194957  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56101.5us
I20260925 16:46:41.240489  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:41.242164 17601 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:41.242642 17601 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.243021  9122 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:41.243542 17601 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.195875  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62873us
I20260925 16:46:41.228057  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:41.192902  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53549us
I20260925 16:46:41.189071 17836 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:41.233990 17939 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.249404  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.251048  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.245599 17934 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:41.247859  9702 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:41.243335 17797 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.255861  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 367513us
I20260925 16:46:41.260957 17759 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:41.262473  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50849.5us
I20260925 16:46:41.263087 17804 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:41.235208 17876 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.264544 18007 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.248548  9121 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:41.272090 17583 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.340099 17952 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:41.348237 18002 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:41.316285 17911 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:41.348944 18002 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:41.312611  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.242807 18045 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260925 16:46:41.349881 18002 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.348546 17952 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.292341 18017 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.298190 17666 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:41.351372 17952 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.349197 17911 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.352913 17952 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:41.295975 17899 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.354905 17899 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:41.354807  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.355276  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.355741 17911 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.356148 18017 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.356312  9700 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:41.356590 18017 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.315145  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.357450  9694 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:41.252193 18023 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:41.358462 18023 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:41.358868 18007 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:41.359201 18023 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.359350 17880 consensus_queue.cc:1159] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 29 status { last_received { term: 28 index: 20 } last_committed_idx: 20 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:41.360711 18023 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.351863 18045 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:41.361292 18045 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.314306  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:41.363023  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 112082us
I20260925 16:46:41.364144  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.357007 18017 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:41.192727 17701 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:41.273124 17787 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.364001  9124 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
W20260925 16:46:41.376650  9695 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260925 16:46:41.252928  9048 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:41.380687  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.378928  9120 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:41.386456  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:41.384542  9695 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:41.392249  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.297638 18044 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.410176 17759 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.416186  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:41.420684 17797 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.334787 17788 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:41.421343 17788 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.422168 17788 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.432569 17761 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.284459 17743 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.440889 17743 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.383675 18045 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.442762 18045 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:41.444149 17755 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.313730 17971 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.397646  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.381244 17980 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260925 16:46:41.452064  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54490.7us
I20260925 16:46:41.388880 17910 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:41.366834 18034 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.399281 17911 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.464682  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.300755 17845 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.463205  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47106.7us
I20260925 16:46:41.449620 17788 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.471987  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.450335 17757 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:41.473424  9696 raft_consensus.cc:2354] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:46:41.449514 17755 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.486089  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.495947  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.498030  9694 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:41.498031  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.499169  9701 raft_consensus.cc:2354] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:41.499457  9700 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:41.499504  9698 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:41.460676 17931 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.026s	sys 0.059s
I20260925 16:46:41.457419 17325 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.464977 17911 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.472246 17804 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:46:41.485651 17880 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:41.502594 17931 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.026s	sys 0.059s
I20260925 16:46:41.454823 17971 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.514487  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.518685  9696 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:41.499796 17757 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.507076 17325 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.523742  9090 leader_election.cc:398] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:46:41.508338 17911 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.528316  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.528755  8941 leader_election.cc:398] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:41.529209  8941 leader_election.cc:401] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:46:41.526227  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.531800  9700 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:41.510540 17917 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.538995  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.539750  9696 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.528331 17325 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.522378 17804 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.535326 17787 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.560534 17845 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:41.560418 17804 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.561486 18034 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:41.564479 17625 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260925 16:46:41.565042 17787 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:41.565619 17787 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.566439 17666 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:41.544215 17970 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.545207  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:41.568325  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:41.561705  9696 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:41.569937  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.549129 17907 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:41.516963 17880 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.576406 17880 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.537616 17988 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:41.578183 17988 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.578559 17988 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.551862 17759 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:41.535778 17743 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.580119  9120 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:41.579931  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.555243 18017 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.592022  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.592792  9700 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:41.594385  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:41.590878  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 457722us
I20260925 16:46:41.580499 17931 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:41.595734  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.596669 17700 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260925 16:46:41.590149  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.010s	sys 0.022s
W20260925 16:46:41.599409  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.010s	sys 0.022s
W20260925 16:46:41.599789  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 98862.4us
I20260925 16:46:41.603717  9089 leader_election.cc:398] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.604418  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.564925 17625 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.601569 17759 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:41.599174 17907 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:41.579089 17787 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.616559 17682 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.602792 17931 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.596817 17757 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.620486  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.612358 17759 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.633683  9700 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:41.615902 17880 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:41.634779  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.612658 17917 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:41.630836  9666 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.027s	sys 0.010s
W20260925 16:46:41.638757  9666 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.027s	sys 0.010s
W20260925 16:46:41.636384  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 500993us
W20260925 16:46:41.639086  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 553151us
I20260925 16:46:41.596362 17939 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.644227  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.635808 17759 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:41.651811  9118 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.006s	sys 0.037s
I20260925 16:46:41.652712  9123 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:41.636617 17880 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:41.652987  9118 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.006s	sys 0.037s
I20260925 16:46:41.649883 18046 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:41.655435  8868 catalog_manager.cc:5042] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: aborting the task: latest config opid_index 14; task opid_index 4
I20260925 16:46:41.676517  9123 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:41.680338  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.686105  9050 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260925 16:46:41.682309  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.684268  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.687747  9042 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:41.688330  9048 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:41.687644  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.690012  9044 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:41.653322 17601 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:41.653527 17917 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.654187 17876 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.674407 17668 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:41.698621  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63967.2us
I20260925 16:46:41.679352 17971 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:41.704680  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.729372  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.653363 18002 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260925 16:46:41.731361  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.739107  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.643612 17931 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.708082 17700 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:41.754714  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.694280  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.764304  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:41.710538 17876 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.730762 18017 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.738200 17910 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:41.777453 17876 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:41.766920 17718 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.001s
I20260925 16:46:41.741283 18007 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:41.790532  9700 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260925 16:46:41.791517  9116 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260925 16:46:41.729868 17917 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.764329 17971 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.728628 17668 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.809859  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.791975  9116 pending_rounds.cc:76] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 11
I20260925 16:46:41.811450  9116 pending_rounds.cc:97] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260925 16:46:41.811803  9116 raft_consensus.cc:2866] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:41.710748 17601 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.788509 17803 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:41.807673  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2246) took 1092 ms. Trace:
I20260925 16:46:41.772723 17907 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.751658 17880 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.791255 18059 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260925 16:46:41.783581 17325 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.828246  9696 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:41.878254  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.842644  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.930231  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.930651  9701 raft_consensus.cc:2354] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.928941  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:41.932879  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54740us
W20260925 16:46:41.857003  8861 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.510s	user 0.004s	sys 0.017s
I20260925 16:46:41.827798  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.853274  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:41.832315  8868 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 342) took 48971 ms (client timeout 15000 ms). Trace:
W20260925 16:46:41.798118  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 103955us
I20260925 16:46:41.950381  9042 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
W20260925 16:46:41.900136 17583 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.032s	sys 0.041s
I20260925 16:46:41.965798  9090 leader_election.cc:398] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.966269  9043 raft_consensus.cc:2354] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:41.798195 17902 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:41.775215 17911 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.974414  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.827798 17409 raft_consensus.cc:2741] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260925 16:46:41.969656  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.850199 17917 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.971237  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.971956  9090 leader_election.cc:401] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260925 16:46:41.981287  9700 raft_consensus.cc:2354] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26.
I20260925 16:46:41.981534  9048 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:41.972311  9050 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:41.805203 17682 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.975561  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.976629  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.815351 17803 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.970497  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.985759  8941 leader_election.cc:398] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26.
I20260925 16:46:41.986063  8941 leader_election.cc:401] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260925 16:46:41.806849 17970 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.820191 17788 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.848645 17625 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.876912 17718 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.933740 17743 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:41.798547 17971 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.965975 17761 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:41.980332 17932 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:41.830364 17934 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.832080 17939 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.990655  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.936754 18017 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:41.976225 17583 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.037s	sys 0.044s
I20260925 16:46:41.986791  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.966382 17952 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.830633 17836 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.154s
I20260925 16:46:41.974097 18045 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:41.815479  9118 rpcz_store.cc:276] 0925 16:46:40.715024 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:41.040845 (+325821us) service_pool.cc:227] Handling call
0925 16:46:41.043003 (+  2158us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:41.048130 (+  5127us) raft_consensus.cc:1520] Early marking committed up to index 21
0925 16:46:41.654326 (+606196us) log.cc:842] Serialized 14 byte log entry
0925 16:46:41.806097 (+151771us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:41.806461 (+   364us) raft_consensus.cc:1631] Marking committed up to 21
0925 16:46:41.806668 (+   207us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:41.806980 (+   312us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:41.807456 (+   476us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":735708,"raft.queue_time_us":18442,"thread_start_us":715451,"threads_started":2}
I20260925 16:46:42.021154  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.985949 17682 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:41.957592  8868 rpcz_store.cc:269] 0925 16:45:52.861307 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:52.861527 (+   220us) service_pool.cc:227] Handling call
0925 16:46:41.832181 (+48970654us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:38.858993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:38.956351 (+ 97358us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:38.956385 (+    34us) write_op.cc:435] Acquired schema lock
0925 16:46:38.956400 (+    15us) tablet.cc:660] Decoding operations
0925 16:46:38.957342 (+   942us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:38.957428 (+    86us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:38.957454 (+    26us) tablet.cc:683] Acquiring locks for 11 operations
0925 16:46:38.958374 (+   920us) tablet.cc:699] Row locks acquired
0925 16:46:38.958402 (+    28us) write_op.cc:260] PREPARE: finished
0925 16:46:38.958550 (+   148us) write_op.cc:270] Start()
0925 16:46:38.958682 (+   132us) write_op.cc:276] Timestamp: P: 1790354798958511 usec, L: 0
0925 16:46:38.958706 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:46:38.961900 (+  3194us) log.cc:842] Serialized 4382 byte log entry
0925 16:46:39.264625 (+302725us) op_driver.cc:444] REPLICATION: finished
0925 16:46:39.272783 (+  8158us) write_op.cc:301] APPLY: starting
0925 16:46:39.272888 (+   105us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:39.282549 (+  9661us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:39.282660 (+   111us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:39.865469 (+582809us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:39.866004 (+   535us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=44,mrs_lookups=0
0925 16:46:39.866065 (+    61us) write_op.cc:312] APPLY: finished
0925 16:46:39.866709 (+   644us) log.cc:842] Serialized 105 byte log entry
0925 16:46:39.866945 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:39.892928 (+ 25983us) write_op.cc:454] Released schema lock
0925 16:46:39.892996 (+    68us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:39.893370 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:39.893412 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4384108,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":7788,"apply.run_cpu_time_us":20898,"apply.run_wall_time_us":621206,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50041,"cfile_init":1,"lbm_read_time_us":478,"lbm_reads_lt_1ms":4,"num_ops":11,"prepare.queue_time_us":592477,"prepare.run_cpu_time_us":4071,"prepare.run_wall_time_us":155833,"replication_time_us":305799,"thread_start_us":290674,"threads_started":2}]]}
I20260925 16:46:42.073277 17988 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.027415 17625 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.075239 18036 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:42.064783 17804 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.993495 17917 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:42.077127  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.077704  9124 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:41.974889 17902 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:42.079895 17902 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:41.989852 17803 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:42.079195 17682 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.081578  8867 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 28 to 29, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 29 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:42.083878 17682 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.086862  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4410) took 1373 ms. Trace:
I20260925 16:46:42.065146 17939 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:42.087237  9115 rpcz_store.cc:276] 0925 16:46:40.713548 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:40.877756 (+164208us) service_pool.cc:227] Handling call
0925 16:46:40.895110 (+ 17354us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:40.958412 (+ 63302us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:40.958457 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:40.968714 (+ 10257us) log.cc:842] Serialized 26 byte log entry
0925 16:46:41.472593 (+503879us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:41.472630 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:41.472698 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:42.086648 (+613950us) raft_consensus.cc:1671] finished
0925 16:46:42.086672 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:42.086809 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":38820,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7968,"thread_start_us":488783,"threads_started":1,"wal-append.queue_time_us":661017}
I20260925 16:46:42.089211  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.089242 17902 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.090452  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.090600  9123 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:42.093417  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51484.6us
I20260925 16:46:42.095284  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.095985  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.000380  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.971885 17907 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.103626  9041 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260925 16:46:42.104043  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.978103 17642 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260925 16:46:42.108668  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.107517  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.060268  9122 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
W20260925 16:46:42.035845  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:42.112550  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76779.1us
I20260925 16:46:42.065974  9117 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:42.070138 17666 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:42.070241  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.116292  9118 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.098335  9042 raft_consensus.cc:2354] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23.
I20260925 16:46:42.091302 17902 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.099188  9120 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:42.139302  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.097599  9124 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:42.029538 17932 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.108522 18025 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.144069 17932 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.022922 17971 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:42.103497  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.160421  9050 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:42.091740 17952 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.113152  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.114132  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.075367 17988 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:42.116881  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.185912  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.186882  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73746.3us
W20260925 16:46:42.187544  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:42.188087  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.188418  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.189369  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.032905 17761 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:42.139000  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 81301.6us
W20260925 16:46:42.192725  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79645us
I20260925 16:46:42.144140 18025 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.115975 17743 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.030999 18017 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.090986  9115 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.115814 17666 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:42.152724  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.326529  9047 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.148452  9118 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:42.154385  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.025641 17718 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.023211 17788 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:42.160254  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 421179us
W20260925 16:46:42.154408 18023 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.003s
I20260925 16:46:42.099601 18045 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.161442  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.191404  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.029947 17934 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.260955  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2256) took 1287 ms. Trace:
I20260925 16:46:42.311071  9116 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:42.320361  9698 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:42.319676  9123 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:42.195086 17978 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:42.157366  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.255254 17325 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.259001 17932 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:46:42.353566 18061 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260925 16:46:42.354871  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4089) took 1765 ms. Trace:
I20260925 16:46:42.334718  9666 leader_election.cc:398] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:42.260362 18065 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.308439 18044 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:42.337065  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.319272 17836 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.342157  9117 rpcz_store.cc:276] 0925 16:46:40.976482 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:41.057452 (+ 80970us) service_pool.cc:227] Handling call
0925 16:46:41.086876 (+ 29424us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:42.116094 (+1029218us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:42.260709 (+144615us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:42.260895 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2251123968}
I20260925 16:46:42.327893 17911 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.319658 17601 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.341225  9701 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:42.321386 17953 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.377902  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:42.320102 18046 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:42.381997 17876 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.001s
I20260925 16:46:42.382339 18046 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.356587  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.353585 17952 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.350498  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:42.383881 18075 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260925 16:46:42.384778 18074 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260925 16:46:42.386126  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.377087  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.326557 17701 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.348457  9050 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:42.376494 17836 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.381008 17666 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.382515 17876 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.383572  9698 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:42.358090 17700 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.335424 17788 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:42.356300 18067 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260925 16:46:42.355193  9119 rpcz_store.cc:276] 0925 16:46:40.589942 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:40.596443 (+  6501us) service_pool.cc:227] Handling call
0925 16:46:40.627660 (+ 31217us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:40.703197 (+ 75537us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:40.703227 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:40.703656 (+   429us) log.cc:842] Serialized 26 byte log entry
0925 16:46:41.599855 (+896199us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:41.599892 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:41.599998 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:42.354671 (+754673us) raft_consensus.cc:1671] finished
0925 16:46:42.354701 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:42.354821 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2948,"raft.queue_time_us":18939,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":868064,"threads_started":1,"wal-append.queue_time_us":1294531}
I20260925 16:46:42.388420  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.413759  9121 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 20
I20260925 16:46:42.387517  9049 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:42.339152 17743 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.389693 17911 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:42.359562 18078 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:42.408880  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.399596 17701 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.440858 17934 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.441462 17701 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.411580  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:42.414455 17700 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.442694  9666 leader_election.cc:398] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:42.442914 17625 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26.
I20260925 16:46:42.443470 17325 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:42.443747 17700 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.443867  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.444977 18078 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.446882 18078 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.450369 17971 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.376408 17757 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260925 16:46:42.420344 17666 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:42.420892 17836 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:42.421279 18069 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260925 16:46:42.422083 17876 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.423425 18077 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:42.423740 17743 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.423959  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.476212 18077 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:42.402091 17761 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.476815 18077 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:42.423586  9049 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:42.424786 18017 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.425197 18025 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.426415 18045 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.262269  8867 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 17 to 23, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 23 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:42.377852 17978 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260925 16:46:42.390571 17953 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.358717 17980 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260925 16:46:42.429451 17718 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.430614 18046 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.430514 17803 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.404419 17907 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.420888  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.442981  9666 leader_election.cc:401] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:46:42.413638  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.444012 17325 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:42.356839 18065 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.352468 17668 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.452584 17880 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:42.455149 18076 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260925 16:46:42.504061 17917 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260925 16:46:42.396139  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45726us
I20260925 16:46:42.431565 17911 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:42.459945  9118 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
W20260925 16:46:42.464468  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 490089us
I20260925 16:46:42.465798  9047 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:42.469993 17971 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.471951  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.472911  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.473753  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.475566  9695 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 23: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:42.462909 17759 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.805s	user 0.002s	sys 0.007s
I20260925 16:46:42.549507  9047 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:42.499557  9115 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
W20260925 16:46:42.549752  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:42.512463  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 69915.2us
I20260925 16:46:42.522033 17666 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:42.457558  9120 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260925 16:46:42.543363  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.537416  9121 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
W20260925 16:46:42.517396  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 554457us
I20260925 16:46:42.567338  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.539741 17911 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:42.598120  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:42.598618  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.573367  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.593118  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.525074 17718 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:42.605459  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.601497  9044 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
W20260925 16:46:42.636087  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 285692us
W20260925 16:46:42.640676  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 450824us
W20260925 16:46:42.641645  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 296390us
W20260925 16:46:42.643357  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 299653us
I20260925 16:46:42.647262  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.649317  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.650086  9121 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:42.652187  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.574677 18017 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:42.656149  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.653265  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.560127 17759 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.663070  9694 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260925 16:46:42.666752  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117043us
I20260925 16:46:42.666399  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.661427  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.596081 18002 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.058s
I20260925 16:46:42.621795 17718 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.692925 18044 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260925 16:46:42.653064 17836 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:42.703276  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.657617 17325 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.692167 17907 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:42.698931  9699 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:42.671233  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.657188 18078 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:42.705066  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.698173 17803 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.717208  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.718333  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.717338 18084 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.723930 18084 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:42.727459  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.733309  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.733862  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.733920  9047 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:46:42.667519 18017 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.741145  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.749495  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.728616 18078 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:42.706594 18082 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260925 16:46:42.703631 17836 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.740043 17953 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.766147  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:42.766287  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.739293 18091 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:42.811547  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.812826  9699 raft_consensus.cc:2396] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:46:42.815348  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.815953  9042 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.732282 18045 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260925 16:46:42.818447  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.819113  9047 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:42.822672  9049 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:42.827472  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:42.830049  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64006.4us
I20260925 16:46:42.831580  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:42.834570  9044 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:42.787846 18065 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.850620  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.812486 17743 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.790745 17899 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.856482  9048 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:42.861786  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 191018us
I20260925 16:46:42.692360  8867 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:42.862712  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 194100us
I20260925 16:46:42.863624  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.873538  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.834267 17953 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:42.825155 17788 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.881829 18084 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.883090 17788 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.883850  9124 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:42.884752  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2544) took 1157 ms. Trace:
I20260925 16:46:42.885152  9695 rpcz_store.cc:276] 0925 16:46:41.727804 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:41.728002 (+   198us) service_pool.cc:227] Handling call
0925 16:46:42.884534 (+1156532us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540048b2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:42.884667 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1630466304}
I20260925 16:46:42.886224  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2269) took 1276 ms. Trace:
I20260925 16:46:42.886471 17911 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.886569  9124 rpcz_store.cc:276] 0925 16:46:41.609945 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:42.195885 (+585940us) service_pool.cc:227] Handling call
0925 16:46:42.256152 (+ 60267us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:42.884235 (+628083us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:42.886011 (+  1776us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400041ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:42.886157 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1443096832}
I20260925 16:46:42.884430 18077 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.866273 17743 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.889328 18077 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.889670 17743 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.874989  9042 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
W20260925 16:46:42.894629  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.898325  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.900911  9120 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:42.905134  9118 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:42.905540  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.906649  9121 raft_consensus.cc:2396] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:46:42.906808  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.907137  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.908183  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:42.895633  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.910316  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.910919  9697 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:42.921481  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.921753  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.948432  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.948800  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.879171 17700 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:42.879874 17953 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:42.951821  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.952761  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.909852 18084 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:42.955469  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.963016  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:42.879908 17759 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.866065 17899 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.930595 17743 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.973119  8940 leader_election.cc:398] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23.
I20260925 16:46:42.948192 17788 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:42.994686  9697 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:42.976239  8940 leader_election.cc:401] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:42.971998  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.976928  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.954514 17625 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:43.005875  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:43.002740  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:42.962239 17953 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:42.963850 17718 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.020740  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:43.023106  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60170us
I20260925 16:46:43.026921  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.954368 18045 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260925 16:46:42.948916 17761 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
W20260925 16:46:43.017481  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:43.002554 17911 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.028195 17741 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election won for term 26
W20260925 16:46:43.049124  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.951509 18090 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.060s
I20260925 16:46:43.032618  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:42.991394 18091 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.004753 17907 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.072754 17907 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.074940 17907 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.009279 18086 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 23
W20260925 16:46:43.076829 18089 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260925 16:46:43.005548 18082 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:43.080401 18045 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.080955 18045 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.028855 17625 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:46:43.059099 18059 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260925 16:46:43.010317 17970 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.002413 17743 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.011880 18066 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:43.016858 17788 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:42.975000 18084 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.911765 18078 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.076195 18094 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260925 16:46:43.050034  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.099287 17409 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
W20260925 16:46:43.095464  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.119978  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.029307 18108 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:43.099625  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67124.5us
I20260925 16:46:43.107070 18025 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:43.107285  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4112) took 1499 ms. Trace:
I20260925 16:46:43.051483  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:43.092343 17741 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.121150  9123 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:43.116267 18082 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:43.009145 17700 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:43.108559 18112 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.109261 17788 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:43.114341 17836 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.092250 18091 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.119015 18077 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.114461 18066 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.133229  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.118556 17409 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:43.124575  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.106441 17970 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.138446  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:43.131409 18082 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:43.156544  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.136823 17788 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:43.157374  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.158797  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:43.161343  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.162125  9695 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:43.162423 18066 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.163872 17836 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:43.164837 18046 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:43.165297 18046 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:43.165830 18082 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.166165 18046 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.167261 18082 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:43.160220 17700 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:43.168890 17970 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.170153  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.170764  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.170833  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:43.180258  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:43.182204  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.134296 18002 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260925 16:46:43.167448 18046 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:43.196615  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.149434 17899 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:43.206418  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55776.8us
I20260925 16:46:43.163916 18084 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.181466 17625 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:43.145565 18077 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.199767 17970 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260925 16:46:43.251614  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55077.9us
I20260925 16:46:43.201499 17700 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:43.249258 17911 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:43.255039 18096 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260925 16:46:43.115557  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 4.135s	user 0.116s	sys 0.072s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":27141,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"lbm_read_time_us":2460,"lbm_reads_lt_1ms":21,"lbm_write_time_us":66768,"lbm_writes_1-10_ms":4,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":708327,"threads_started":3,"update_count":238,"wal-append.queue_time_us":480452,"wal-append.run_cpu_time_us":474,"wal-append.run_wall_time_us":1031559}
I20260925 16:46:43.303313  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.108914  8867 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 21 to 25, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.140173 18112 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.295876 18065 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.297801 17970 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.324538  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.327389  9047 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:43.329350  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:43.310619 18087 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:43.322077 17880 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
W20260925 16:46:43.331823  8921 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.348235 18083 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:43.348774 18083 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.349143 18083 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:43.349301 18120 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:43.358223 18017 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:43.361370 17666 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.002s
I20260925 16:46:43.362370 17666 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
W20260925 16:46:43.363037  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:43.363476  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 452931us
W20260925 16:46:43.364500  9666 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.366771 18091 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.330027 17970 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:43.326879 18045 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.378342 17978 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:43.381253 17978 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.381527  9048 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:43.381708 17978 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:43.383473  8862 maintenance_manager.cc:419] P ba21ddca249c4cf39e72526cc8696c60: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260925 16:46:43.389555 18112 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.390753 18077 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.391319  8867 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 27, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 27 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.392349  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260925 16:46:43.393112  8867 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 14 to 16, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.257002 17409 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.397545  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.336956 17743 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:43.399121  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 96553.6us
I20260925 16:46:43.403144  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.295236 17741 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:43.405936  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 151043us
I20260925 16:46:43.419028  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.420233  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:43.329553 18065 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.423615  9117 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
W20260925 16:46:43.425844  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 325125us
I20260925 16:46:43.429124  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.430374  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.445485  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.446146  9701 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:43.402364 18002 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.426113 17899 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:43.476650  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:43.478927  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.443387 17880 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:43.479688  9701 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:43.497530  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.501889  9048 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:43.502928  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.454807 17743 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.508766 17668 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.509289 17668 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.425029 18084 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 27.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.054s
I20260925 16:46:43.474499 18087 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:43.471271 17625 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.532660  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.536615  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.541049  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.544356  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.511849 17761 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:43.504155 17880 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.549578  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:43.552194  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.468394 18002 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.556267  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.527020 18044 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:43.527207 18017 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260925 16:46:43.590807  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:43.564143 18110 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260925 16:46:43.521961 17743 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.559082 17761 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:43.564124 18123 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260925 16:46:43.593513  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.562511 17718 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:43.619607  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:43.621701  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.624862  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:43.557714 17880 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.656576  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.657193  9042 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:43.527315  8867 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:43.663255  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:43.647625 17642 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:43.625398 18087 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.660017 17836 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:43.649475 17911 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:43.674429  8867 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 12 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.652231 17625 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.684944 18130 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:43.651003 17668 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.658620 18121 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.664634 18088 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.700022 18130 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:43.702857 18126 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260925 16:46:43.703569 18127 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260925 16:46:43.703840 18036 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:43.697795 17899 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:43.724521 17899 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.724895 17899 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:43.713963 18036 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.728616 18036 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.729585 17700 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:43.729655 18036 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:43.696730 18086 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.004s
I20260925 16:46:43.687585 17642 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:43.666389 18066 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.702874  8867 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:43.701264 17978 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.724050 18002 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.706346 18065 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.762146 18086 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23.
I20260925 16:46:43.710781 18130 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:43.771266 17642 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.772658 17642 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:43.774578 17970 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.710961 18121 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.712692 18088 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.777985 17880 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.764022 18046 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.765978 18087 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.766165 17761 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.769064 17953 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.003s
W20260925 16:46:43.798817  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 332550us
I20260925 16:46:43.127851  9122 rpcz_store.cc:276] 0925 16:46:41.607754 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:42.192137 (+584383us) service_pool.cc:227] Handling call
0925 16:46:42.259770 (+ 67633us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:42.260084 (+   314us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:42.260112 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:42.342150 (+ 82038us) log.cc:842] Serialized 26 byte log entry
0925 16:46:42.759159 (+417009us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:42.967261 (+208102us) log.cc:842] Serialized 14 byte log entry
0925 16:46:43.106874 (+139613us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:43.106944 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:43.106991 (+    47us) raft_consensus.cc:1671] finished
0925 16:46:43.107003 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:43.107229 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3855,"prepare.queue_time_us":369425,"raft.queue_time_us":57221,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":7579,"thread_start_us":603672,"threads_started":3,"wal-append.queue_time_us":572075}
W20260925 16:46:43.806411  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 182359us
W20260925 16:46:43.881342 17788 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.004s
I20260925 16:46:43.881784 17788 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.885146 17899 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.825893  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.890820 17788 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.837006 17978 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:43.850960 18083 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260925 16:46:43.894240 18083 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.834501  8867 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 16 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 17 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:43.885984 18116 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:43.886643  9119 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260925 16:46:43.837774 18084 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:43.921339 18084 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.813602 18046 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.826363 17953 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.926234 18116 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.926964 17953 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.928318  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.813297 18002 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.892367 18078 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.929291  9048 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:43.929455 18078 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.806183 18082 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260925 16:46:43.852149  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.937350 18083 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.940812 17601 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:43.814795 17743 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.897053  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:43.764814  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 288248us
I20260925 16:46:43.954459  9047 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260925 16:46:43.955719  9120 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:43.958003  9696 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:43.842777 18088 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.797494 18066 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.967141  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.966027  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.969699  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.973578  9044 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:43.964463  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.959453 17409 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:43.984520  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:43.988570  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.929353 18002 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.995036  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:43.995327  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:43.995805  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.974809 18083 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.997145 18108 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:43.996595 18083 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.997555 18108 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.997951 18108 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:43.999089 18083 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.001206 18002 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.003146 17803 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:44.003547 17803 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:44.003890 17803 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:44.006729  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.962829 18046 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.958542 17970 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.007531  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.978885 18084 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:44.014549  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:43.979897 18121 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.976956 18112 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.015799  9699 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:44.023490 18112 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.026171 18112 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:44.027769  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.012s	sys 0.005s
W20260925 16:46:44.028237  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.013s	sys 0.006s
I20260925 16:46:44.029333 18023 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.029793 18023 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.030516  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.031672 18023 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.032951  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.924369  8867 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:44.035888 18115 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Stepping down as leader of term 27
I20260925 16:46:43.983510 17743 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260925 16:46:44.036497 18115 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.038909 18115 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.041049 18115 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:44.045316  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.046159  9701 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 30: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:44.048403  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.990058 18082 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.049263 18082 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.052167  9701 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:44.055075 18082 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.036092  9048 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:44.056427 18108 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.052975 18152 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260925 16:46:44.063900  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:44.064890 17899 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.034626  8867 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 11 to 13, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 13 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.061118  9699 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260925 16:46:44.056846  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.074241  9045 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:44.079857 17880 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:44.080341 17880 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:44.080838 17880 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:44.080971  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:44.080260  8867 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 18, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 18 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:44.082379  8867 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 22, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 22 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.084110 18149 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:44.092162  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.090512  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.097886  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.099332  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.099985  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.100780  9699 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:44.101792  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:44.108338  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53443.8us
I20260925 16:46:44.012030 18087 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.087869 17880 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.107795  9090 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.112658  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.114873  9044 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
W20260925 16:46:44.165861  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.121256  9042 raft_consensus.cc:2396] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
W20260925 16:46:44.166657  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.167476  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:44.167804  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55233.2us
I20260925 16:46:44.123670  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.120026  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.125980  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.170214  9048 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:44.169803  9118 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 30
I20260925 16:46:44.125699  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:44.175979  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 68334.5us
I20260925 16:46:44.117573  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:44.177920  9701 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 21
I20260925 16:46:44.168854  9119 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:44.179387  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.157387 18078 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:44.106549 17743 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:44.184283 17409 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:44.108233 18116 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:44.106468 17787 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:44.183852 18087 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.196233 17409 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.219303 17409 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:44.117022 18112 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election won for term 26
W20260925 16:46:44.208241  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 998312us
I20260925 16:46:44.222039  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.185042 18082 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:44.181995 18046 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:44.181424 18088 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:44.218770 17787 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.117192 18083 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260925 16:46:44.246140  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.227566  9120 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:44.227964  9118 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 30.
I20260925 16:46:44.217131  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.248580  9043 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:46:44.249825  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.250037  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.250723  9115 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 30: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:44.213967 17668 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.251524  9117 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:44.253703  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.264149  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.265228  9696 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:46:44.209826 18023 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.040s
I20260925 16:46:44.270131  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.271994  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.247062 18088 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.248025 17787 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:44.275501  9043 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:44.274894  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.250622 18147 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.115780  8867 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.276942  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.276377  9041 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 24
I20260925 16:46:44.277652  9050 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260925 16:46:44.256233 18112 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.279515  9049 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:44.255584 17759 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:44.260624 18066 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.284030  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.261224 17971 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader election won for term 30
I20260925 16:46:44.261579 18044 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.270664 17907 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.274650 17953 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.304807  9124 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:44.278649 18088 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:44.277323 18082 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.284623 17934 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.309131  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.312872  9124 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.326716  9124 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.328899  9124 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:44.309502  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.329620  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.262284 17668 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.309602  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:44.328936  9122 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:44.327235  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.328088 17971 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:44.292022 18147 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.352079  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.354530  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.343875  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.359421  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.341218  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:44.361363  9695 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:44.314671 18108 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.307955 18148 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:44.342749 18130 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.002s
I20260925 16:46:44.390450  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.293545 17759 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.371500 18156 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:46:44.329757 17880 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.394428 17701 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.397313  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.369297 17902 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:44.345919 18147 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:44.419155  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 168077us
I20260925 16:46:44.340976 17668 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:44.372188 18154 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:44.312243 18044 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.380671 17743 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:44.316076 17907 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.318766 17953 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.333897 17761 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260925 16:46:44.428973  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.364437  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:44.351732 17934 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.433103  9695 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:44.436120  9124 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260925 16:46:44.422935  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 193490us
W20260925 16:46:44.441323  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:44.447046  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.447428  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.444044  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:44.420179  9666 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.448441  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.448946  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.448999  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:44.454193  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:44.454893  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.455192  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.456111  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:44.456398  9089 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.459479  9042 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:44.459637  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.460079  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.336212 18082 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.461290  9089 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.333819 17971 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.463881  9089 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.464339  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.409672 18130 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.452560  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:44.459192 18045 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260925 16:46:44.464951 17952 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.468586 17668 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.472842  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.407469 18112 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.498381 18087 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.497016  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.499068  9695 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:44.499949  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.500077 17668 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.500061  8867 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.502635 17668 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.502040  8867 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 25, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 25 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:44.504875 18044 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.505575 18044 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:44.424306 17701 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.523197 17701 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.525607 17759 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:44.526362 18143 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:44.527958 18155 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:44.533828  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61048.2us
I20260925 16:46:44.535472 17700 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:44.537196  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.537636 17700 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:44.538317  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.539121  9695 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:44.472997 17907 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.467507  9048 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
W20260925 16:46:44.490337  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.557874  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67577.6us
W20260925 16:46:44.558540  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.558946  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.558027  9701 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
W20260925 16:46:44.559999  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.456285 17980 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:44.457460 18119 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.418725 17803 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.457170 18083 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:46:44.480381  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51518.9us
I20260925 16:46:44.464424  9047 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
W20260925 16:46:44.497010  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.550170  9041 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:44.574911  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.575205  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.496613 17880 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.561565 17666 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.496393 18147 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:44.575809  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78819.6us
W20260925 16:46:44.581046  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.581519  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:44.582788  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.583268  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.560385  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.578254  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.538887 17700 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.586051  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.576799  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.580493 18155 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.590597  9122 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260925 16:46:44.579428 18102 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260925 16:46:44.585121  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.596671  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.598155  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.599004 18155 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:44.598608  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:44.601730  9089 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
I20260925 16:46:44.603749  8867 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 16 to 20, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:44.612948 18158 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:46:44.616428 18115 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.617146 18115 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.619879 18115 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.620867  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.621148 18115 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.621543  9701 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:44.621959 18115 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.622642  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.623440 17788 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:44.623855 17788 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:44.623934 18115 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:44.624153 18162 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260925 16:46:44.624248 17788 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:44.588771 17952 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:44.588661 18078 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.586081 18083 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:44.638257  8867 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.592783 17668 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:44.644583  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.646378  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.598280 18148 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:44.647770  9123 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:44.595875 18147 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:44.659081  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 159192us
I20260925 16:46:44.661700  8867 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 19 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:44.632236 18155 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.594337 18087 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.052s
I20260925 16:46:44.635859 17953 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.668871  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.709794  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:44.713850 18164 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260925 16:46:44.715179  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.715785  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:44.716326  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.716521  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.717139  9044 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260925 16:46:44.716840 17787 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.717614  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:44.718160 18167 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:46:44.718969 17787 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.664855 17668 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:44.722522 17668 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.725605 17409 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260925 16:46:44.678270 18087 consensus_queue.cc:1225] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260925 16:46:44.726033 17409 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.742585  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.760244  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.760699  9050 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:44.763332  8867 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 19 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:44.764495 17409 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.765249  8867 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 23 to 24, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:44.729054 17761 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.773293 17761 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.776157  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 327698us
I20260925 16:46:44.779036  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.781406  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.782428  9117 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:46:44.794940  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.795492  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.796329  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 203563us
I20260925 16:46:44.647101 18066 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260925 16:46:44.800900  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.802196  9116 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 16
I20260925 16:46:44.808735  9116 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260925 16:46:44.809209  9116 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:44.803066  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.803406  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.810868  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.767086  8867 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 23 to 24, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 24 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:44.813236  9015 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.813771  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:44.815261  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.816507  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.817970  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.818490  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.779855 17761 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.824054  8867 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:44.796988 18084 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.837949  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.842289  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 282283us
W20260925 16:46:44.843134  9666 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.841625  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.821269 17701 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:44.843603  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.822580 17642 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:44.822737 18121 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:44.851138  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.825578 17601 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.785815 18088 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.876909  9048 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260925 16:46:44.860834  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:44.861212  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:44.865636  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:44.882794  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.883219  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.873489 18134 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.879801  9695 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:44.841388 17803 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.841078 18172 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:44.852016 18169 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:44.867193 17409 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:44.863102 18148 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.898762  9695 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:44.860948 17907 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260925 16:46:44.877947 18115 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.842403 18084 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.907234 18046 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.002s
I20260925 16:46:44.837291 18147 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.887873 17701 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260925 16:46:44.911607  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:44.920938  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77561us
W20260925 16:46:44.945663  9089 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.899436 18174 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:44.951812  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.952925  9089 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.956089  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.956805  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.958801 18082 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:44.964465  9117 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260925 16:46:44.964980  9117 pending_rounds.cc:76] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 12
I20260925 16:46:44.965260  9117 pending_rounds.cc:97] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260925 16:46:44.965543  9117 raft_consensus.cc:2866] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:44.965703 18084 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:44.962510  9089 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.969460  9089 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.970649  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.971391  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.972918  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.973522  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.957154 18046 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:44.983234  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:44.949257 17743 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260925 16:46:45.000523  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.954641 18083 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:44.904577 18134 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.001390  9043 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:45.008508  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.014379 18130 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.023679 18102 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.033294  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.980367 18155 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:46:45.004149 17902 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260925 16:46:44.985877 18084 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.922998 18115 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.068944 18115 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.920328 18148 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.073556 18148 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.074373 17788 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.075052  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.994858 17668 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.999830 18149 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:45.004801 17743 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260925 16:46:45.099808  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 263220us
I20260925 16:46:45.050613  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.062063 17755 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.049913 18132 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:45.064973 17902 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:45.044715 18102 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:45.088778  9115 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:45.093730  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:45.098237  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:45.101135  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50612us
I20260925 16:46:45.110406  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.115203  9118 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:45.103817  9695 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:45.103943  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.107296 17788 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:45.119463  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 86304.5us
I20260925 16:46:45.089257 18129 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.122771 18129 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.124801  9041 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260925 16:46:45.095880 17803 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:45.128965  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.129577  9120 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:45.130438  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:45.130797  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.131592  9695 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:45.102854 18132 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.135928 18132 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.145510  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.142154 17934 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.165164  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.165113  9116 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:45.125960 17803 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.122043 18083 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:45.119014 18148 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:45.180173  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.172266  9695 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:45.126927 18179 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:45.175340  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.125487 18129 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.159893 18088 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.163409 17902 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:45.101645 17668 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.102845 18149 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.168967 18172 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:45.195601  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.199512 18108 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.177017 17803 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:45.212685  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85178.1us
I20260925 16:46:45.195768 18174 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:45.220221  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:45.178743 18098 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260925 16:46:45.221536 17668 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.223750 18083 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.235433 18088 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.234642  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.236023 18088 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.237685 17743 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:45.237962 18088 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.238291 17743 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260925 16:46:45.238467 18179 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:45.240106 18088 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:45.240473 18088 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.240906  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.227459 18116 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:45.241250 18088 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.242156 18116 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:45.242810 18088 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:45.243063 18116 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.209707 18066 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260925 16:46:45.229142 18132 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.231755  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.184931 18193 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260925 16:46:45.214032 18082 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.230060 18149 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:45.209165 18172 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.226492  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:45.198272 18148 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.228586 18189 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.247248  9050 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:45.245890 18134 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.251245  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.257568  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.258798  9043 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260925 16:46:45.259397 18066 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:45.259737  9046 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260925 16:46:45.255028  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.261972  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:45.270335  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43942.4us
I20260925 16:46:45.279912  9697 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260925 16:46:45.215725 18108 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.273931 18179 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.289523 18185 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:45.290140 18188 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:46:45.293653  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.297421  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.300638 17899 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.312027 17899 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.300791 18148 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:45.281068 18190 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260925 16:46:45.264560 18172 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:45.277351 17668 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:45.272660 18066 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.317973  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.267922 18082 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.322686 17741 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.027s
I20260925 16:46:45.351636 18205 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:45.355670 18082 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.314989 18185 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.351804 18108 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.270854 18189 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.371915  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:45.372507  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45773.3us
I20260925 16:46:45.382059  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:45.383718  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60918.9us
I20260925 16:46:45.384724  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.382933  9047 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 28.
W20260925 16:46:45.387861 18183 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:46:45.310645 18179 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.379604 17668 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.388984 17899 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:45.450963  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59159.6us
I20260925 16:46:45.453624  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.383250 18087 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260925 16:46:45.476852  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.477057  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.478170  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.444237 18134 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:45.481325  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.390692 18066 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.471304 18082 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.448760 18088 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260925 16:46:45.518028 17899 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:45.541101 18176 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:45.541507 18176 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.542697  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 4146) took 1313 ms. Trace:
I20260925 16:46:45.543071  9119 rpcz_store.cc:276] 0925 16:46:44.229350 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:44.229515 (+   165us) service_pool.cc:227] Handling call
0925 16:46:45.542532 (+1313017us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540007d354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:45.542648 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1991338240}
W20260925 16:46:45.544895 18170 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.631s	user 0.006s	sys 0.005s
I20260925 16:46:45.546574  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2303) took 1025 ms. Trace:
I20260925 16:46:45.546909  9124 rpcz_store.cc:276] 0925 16:46:44.521420 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:44.521569 (+   149us) service_pool.cc:227] Handling call
0925 16:46:44.521900 (+   331us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:44.529052 (+  7152us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:44.529101 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:44.529715 (+   614us) log.cc:842] Serialized 26 byte log entry
0925 16:46:44.647376 (+117661us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:44.647415 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:44.647484 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:45.544354 (+896870us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:45.546309 (+  1955us) raft_consensus.cc:1671] finished
0925 16:46:45.546329 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:45.546522 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6690,"raft.queue_time_us":8346,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":242273664,"thread_start_us":117251,"threads_started":1,"wal-append.queue_time_us":320832}
W20260925 16:46:45.549695 18171 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.661s	user 0.005s	sys 0.001s
W20260925 16:46:45.553714  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:45.554248  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 673820us
W20260925 16:46:45.554847  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.555209  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.521216 18108 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.542273 18176 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.471645 18149 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:45.558408 18082 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:45.514743 18196 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260925 16:46:45.495087 18086 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.536096 18132 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.537880 18189 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:45.569576  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 88747.3us
W20260925 16:46:45.561313 18197 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.235s	user 0.005s	sys 0.000s
W20260925 16:46:45.576651  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95383.3us
I20260925 16:46:45.482219 17743 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260925 16:46:45.484499 17625 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.088s
W20260925 16:46:45.611537 18207 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260925 16:46:45.587916  8921 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.614217 18185 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.593601 18108 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.616182 18179 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.597142 18149 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.619078 18082 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.619235 18149 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.526335 17668 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.586690 18102 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:45.622093 18198 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260925 16:46:45.576257 17934 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.601545  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.605064  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.617746 18108 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:45.608733  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53906.6us
I20260925 16:46:45.623172 17934 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:45.626897  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.632810  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.629863  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.630705  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:45.634522  9123 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.632551 17761 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:45.641309  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.641516  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.643260  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.644731  9119 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:45.645772  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:45.646898  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:45.647675  9043 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.634056 18108 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:45.653257  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:45.670372  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43496.8us
I20260925 16:46:45.643620 18179 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.674134  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:45.677059  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.681047  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.681829  9045 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:45.683259  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.658082 18189 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:45.701923  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.703970  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.702433 18102 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.709547 18065 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:45.667820 18172 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.714702 18172 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.701674 17761 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:45.720139  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.723011  9701 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:45.726928  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:45.727710  9123 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:45.746275 17934 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.746815  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:45.749317 17803 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260925 16:46:45.749904 17803 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:45.750459  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 362862us
I20260925 16:46:45.751991 18193 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260925 16:46:45.752388 18209 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:45.702370 18189 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.753247 18189 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:45.752396 18193 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.755774 18193 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:45.765364  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.769196  9121 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260925 16:46:45.772208  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50615us
I20260925 16:46:45.780972  9043 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:45.782984  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.784893  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.788792  9701 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
W20260925 16:46:45.792078  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 166895us
I20260925 16:46:45.793129  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.793334  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.717612 18179 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:45.796408  9123 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 28.
I20260925 16:46:45.807360  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.808135  9695 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:45.809639  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.806756  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.810366  9697 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:45.810632  9696 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.814548 17788 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.816792  9701 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260925 16:46:45.815200  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146291us
W20260925 16:46:45.845321  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 174116us
I20260925 16:46:45.845606  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.777158 18119 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:45.783018 17934 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:45.850560  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:45.851465  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.792068 18102 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.815186 17788 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.817107 18174 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:45.856645  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.862886  9695 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:45.850307 18179 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:45.868208 17971 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.005s	sys 0.024s
W20260925 16:46:45.868656 17971 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.005s	sys 0.024s
I20260925 16:46:45.870000  9696 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
W20260925 16:46:45.870877 17970 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.006s	sys 0.029s
W20260925 16:46:45.871299 17970 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.006s	sys 0.029s
I20260925 16:46:45.867333 18174 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:45.880633 18174 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.861402 17803 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:45.856159 17934 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.898515 17934 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.859232 18212 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260925 16:46:45.901990  9696 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:45.804842 18193 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.909416  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.911374  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.859058 18121 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:45.916425  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 212549us
I20260925 16:46:45.914096  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:45.906029  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.920540  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.928493  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.856333 18119 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.933568  9124 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:45.934401  8941 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.933312  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.910377 18149 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:45.945256  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.951742  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:45.931777 18170 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:45.923306 17803 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:45.931777 18172 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:45.931375 18090 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:45.912873 18179 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.944036 18132 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:45.931538 17876 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260925 16:46:45.975040  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 54792us
I20260925 16:46:45.947481 18135 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:45.921835 18121 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.972108 18147 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:45.973479 18090 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.997009 18090 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:45.973629 18108 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:45.977703 18172 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:45.955060 18149 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:46.002967  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72262.5us
I20260925 16:46:45.974200 18116 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260925 16:46:45.995304 17978 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:45.966238 18219 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
W20260925 16:46:46.017853  9727 heartbeater.cc:644] Failed to heartbeat to 127.7.158.254:39187 (7 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.158.254:39187 timed out after 15.000s (SENT)
W20260925 16:46:46.018153 18224 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260925 16:46:46.018963 18217 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260925 16:46:46.012243 18132 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:46.020049 18216 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260925 16:46:46.020145 18132 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:46.021450 18214 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:46:46.022451 18132 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.980657 17803 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260925 16:46:46.028270 18193 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.030553 18121 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.008687 18147 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.014783 17978 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.034634  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.047089  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.047672  9042 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:46.047906  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.048918  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:46.050688  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 145563us
I20260925 16:46:46.053768  9123 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
W20260925 16:46:46.058872  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46610.4us
W20260925 16:46:46.063613  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 135938us
W20260925 16:46:46.065225  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.065476  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.065665  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.066496  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.067091  9050 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:46:46.068781  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.069463  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.070066  9699 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 29
I20260925 16:46:46.070963  9121 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260925 16:46:46.062184 18193 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:46.062703 17788 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:46.087570  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:46.089102 18232 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260925 16:46:46.060400 17409 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.021s
I20260925 16:46:46.073642 18179 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:46.094806  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.105993  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:46.113884  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.114439  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.071929 17978 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.115927 17978 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:46.117385 18231 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:46.120883 18147 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.127272  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.130613  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60973.3us
W20260925 16:46:46.130810  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.131636  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.137153  9695 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:46.137072  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:46.152827  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.26264e+06us
W20260925 16:46:46.153956  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.151057  9042 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 29.
W20260925 16:46:46.154495  9089 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.110365 18119 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.104487 18235 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:46.154898  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.157078  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52048.1us
I20260925 16:46:46.160414  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:46.160203  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.073850 18172 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.129341 18229 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:46.152290 18174 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:46.169867  9042 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260925 16:46:46.176256  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.178663  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.156163 18149 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.169306 18235 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:46.214699 17668 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:46.206318 17625 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:46.216398 17625 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:46.216790 17625 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:46.218287 18189 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.219836 18144 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:46.221772 18090 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.230244 18090 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.240327  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.240960  9050 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.239681  9699 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 29.
I20260925 16:46:46.209411 18121 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:46.249351  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87308.9us
I20260925 16:46:46.250564  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.254145  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:46.256326  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:46.256803  9119 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:46.260407  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 79705.9us
I20260925 16:46:46.265211  9121 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:46.267379  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.268052  9700 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.257462 18116 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader election won for term 29
I20260925 16:46:46.270318 18116 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:46.271131 18116 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.258415 18147 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:46.278260 18147 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260925 16:46:46.284498  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:46.268420  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.286326  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.286691  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:46.264096  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110494us
I20260925 16:46:46.288932  9119 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:46.290177  9700 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:46.290961  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:46.300930  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:46.252375 18121 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.287843 18229 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:46.295634 18189 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.311985 18229 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.308640 18185 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:46.318902 18185 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.319800 18185 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.308737 18249 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:46.326359 18121 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.327975  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.329622 18176 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.332497  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.333192  9695 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.333256  9697 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:46.333822  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.303736 17978 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:46.337152  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.343331  9700 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:46.297132 17625 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.349085  9695 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
W20260925 16:46:46.350634  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d3ff365de6e84921a6af19e793363f70, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:46.358405  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d3ff365de6e84921a6af19e793363f70, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:46.362542  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.354894 17931 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260925 16:46:46.367411  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.368229  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.350567 18184 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:46.347605 17978 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.377033 18184 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.377565 18184 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.379786 18184 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.380496  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.380748  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.382200  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.382589  9042 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260925 16:46:46.374509  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.383967 18184 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:46.383919  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.384727  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.386235  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.387008  9043 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:46.387409 18193 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:46.396621  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.399156  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.400111  9046 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:46.373713 18082 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:46.423467 17625 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:46.432268 18250 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260925 16:46:46.437557  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.439152 18229 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:46.354884 17953 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260925 16:46:46.446470  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.446699 17978 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.456274  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.460866  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.461727  9042 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:46:46.464850 17788 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:46.376545 18121 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:46.466233 18121 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.465394 17788 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.458986  9050 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
W20260925 16:46:46.470599  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.471040  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:46.483837  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.485023  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:46.487897 17788 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.488849 18121 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.491189  9665 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:46.491499  9665 leader_election.cc:401] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:46.492666  9042 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:46.493975  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.496795  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.501910  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:46.507054  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.499353 18229 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:46.499505 18239 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:46.484020 18116 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:46.509980 18229 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.512054 18229 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:46.515129 18211 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:46.515918 18211 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.517441 17899 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.517925 17899 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.520330 17899 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.521725  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:46.524075  9089 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.526916  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.529192  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.502792 18119 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:46.538919  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.553917  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.546416 18116 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:46.564025  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.572587  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.516882 18211 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:46.531674  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.576493 18112 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:46.593530 18086 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.594100 18086 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.596689 18086 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.597576  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:46.629568  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48339.2us
I20260925 16:46:46.560212  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:46.637116  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:46.637950  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:46.650375  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.648653 18205 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:46.677876  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.704955  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 173277us
W20260925 16:46:46.707067  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47623.1us
I20260925 16:46:46.704926  9042 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260925 16:46:46.712031  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.703377 18205 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:46.727252  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.728739  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.706350 18121 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:46.710067 18144 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:46.789299 18268 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260925 16:46:46.790160 18186 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.729809 18205 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
W20260925 16:46:46.791029 18226 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:46:46.791728 17899 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.727233 18148 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
W20260925 16:46:46.805733  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:46.856431  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 499525us
W20260925 16:46:46.857204  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.814484 18066 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:46.835232  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105452us
I20260925 16:46:46.838419  9701 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260925 16:46:46.851212  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.830250 18256 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260925 16:46:46.857630  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:46.861044  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.863583  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.864245  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.865872  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.866525  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.852625 18258 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260925 16:46:46.859067 18088 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:46.869741  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.890327  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.890929  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.870157 18098 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:46.854581 18186 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.873097 17899 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.888712  9042 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260925 16:46:46.904290  9702 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260925 16:46:46.911507  9041 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:46.889365 18169 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:46.884051 18121 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:46.905196 18090 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260925 16:46:46.912410 17788 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.022s
I20260925 16:46:46.939864 18082 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260925 16:46:46.903482 18088 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.950915 17899 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.952178 18212 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:46.955531 18108 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.957324 18186 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.958600  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.961018 17931 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.974820  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.985733 17931 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.988243  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.989609  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.997500 18088 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.994765 18090 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:46.991109 18108 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.003505 18090 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.011104 18090 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.011925  9119 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260925 16:46:47.013042 17931 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.013443  9115 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260925 16:46:47.014055 18088 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.014528 18088 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.016281 18088 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.016526  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.017202  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.017252 18088 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:47.017634 18212 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:47.019654  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.026372  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.030305 17755 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.031219  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.032021  9115 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:47.033388  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:47.034377 17978 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:47.034845 17978 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:47.035235 17978 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:46.994932 18205 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.037551 18205 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.038655  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.040726 18108 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.041082  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.043221 18088 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:47.043408  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.047664  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.048934  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.050984  9702 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:47.051303  9702 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:47.052155  9702 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.053923 18088 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:47.054057  9696 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:47.054613  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:47.055155  9115 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 27
I20260925 16:46:47.087667  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:47.088476  9042 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:47.086882 18108 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.092743  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.096069  9702 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:46:47.110553  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:47.115849  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.116699  9700 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:47.127796  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.134626  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.134799  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:47.142262  9115 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:47.100803 17902 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.154775  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
W20260925 16:46:47.155094 18279 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260925 16:46:47.157779 18088 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260925 16:46:47.141613 18176 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:47.143761 18234 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:47.144536 18223 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.098740 18108 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.147017 18186 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260925 16:46:47.151427 17902 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:47.219985  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 328479us
I20260925 16:46:47.199860 18234 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:47.230754  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.231210  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:47.232002 17409 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:46:47.238016  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.238451  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:47.239490  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:47.240033  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:47.240236  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 105523us
I20260925 16:46:47.228567 18176 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:47.247393 18176 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:47.264287  9046 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 17. Ops: []
I20260925 16:46:47.267242  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.267798 18108 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.269388  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.270092  9702 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:47.272979 17409 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:47.287317  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.300647  9046 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:47.286298 17902 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.285071 18108 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260925 16:46:47.313758  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.327463  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.327685 17409 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:47.289561 18176 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.328007  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:47.330619  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 3c0923848b9b426eade76023fdecc31c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:47.332330  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 3c0923848b9b426eade76023fdecc31c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.332697 17409 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:47.337503  9666 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:47.337357  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.336651  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.342315  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.345134 17409 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:47.346987 18281 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260925 16:46:47.320160 18177 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260925 16:46:47.358616 17978 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.353667 18132 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260925 16:46:47.349979 17907 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:47.369349  9124 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260925 16:46:47.373215  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.373852  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:47.379981 18098 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:47.380016 17931 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.006s
I20260925 16:46:47.388532  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:47.388607  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:47.389312  9700 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:47.389488  9116 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 20
I20260925 16:46:47.398609  9700 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:47.387379 17978 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.391270 17743 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:47.404903 18290 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260925 16:46:47.407675 17743 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:47.431177  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:47.431636  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 140853us
I20260925 16:46:47.433087 17743 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.433025  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.449806  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.468607  9116 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:47.472824  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.473907  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:47.478235 18148 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:47.478773 18148 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:47.479609 18148 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.470451 17625 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.481029 17625 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.482961 17625 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:47.484998  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:47.469622 18293 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260925 16:46:47.492100 18234 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.493448 17931 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:47.493968 17931 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.494593  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.502790  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.503611  9119 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:47.476580 18297 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:46:47.497354  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.497655  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.495889 17931 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.521148 18066 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:47.522027 18066 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.524509 18066 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.525152  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.534399  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.538084  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.542938  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:47.521373  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.546654  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.555099  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:47.550628  8868 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 15, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 15 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.560798  8868 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 22 to 23, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:47.562709  8868 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 25, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 25 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.567513  8868 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.569677  8868 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 18, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.572567  8868 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 20 to 22, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.580981  8868 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 23 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:47.583469  8868 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:47.579869 18299 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260925 16:46:47.559686 17788 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:47.591620  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.574579 18172 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:47.560297 18297 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:47.593638  8868 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:47.596949  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.601310  8868 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:47.602880  8868 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 22 to 25, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 25 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.605099  8868 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.603969 18223 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.605532 17978 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.622321  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:47.630438  8868 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.637887  8868 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 19, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 19 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.641458  8868 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:47.653046  8867 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 346) took 17334 ms (client timeout 15000 ms). Trace:
W20260925 16:46:47.673190  7803 thread.cc:536] Waited for 1000ms trying to join with heartbeat (tid 9000)
I20260925 16:46:47.673414 18066 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:47.673895 18066 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.678767  8868 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 20 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:47.653561  8867 rpcz_store.cc:269] 0925 16:46:30.318775 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:30.318950 (+   175us) service_pool.cc:227] Handling call
0925 16:46:47.652948 (+17333998us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:45.378599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:45.575712 (+197113us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:45.585762 (+ 10050us) write_op.cc:435] Acquired schema lock
0925 16:46:45.588331 (+  2569us) tablet.cc:660] Decoding operations
0925 16:46:45.746123 (+157792us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:45.746228 (+   105us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:45.746255 (+    27us) tablet.cc:683] Acquiring locks for 24 operations
0925 16:46:45.748208 (+  1953us) tablet.cc:699] Row locks acquired
0925 16:46:45.748253 (+    45us) write_op.cc:260] PREPARE: finished
0925 16:46:45.748406 (+   153us) write_op.cc:270] Start()
0925 16:46:45.748547 (+   141us) write_op.cc:276] Timestamp: P: 1790354805748350 usec, L: 0
0925 16:46:45.748568 (+    21us) op_driver.cc:331] REPLICATION: starting
0925 16:46:45.901166 (+152598us) log.cc:842] Serialized 9440 byte log entry
0925 16:46:46.264910 (+363744us) op_driver.cc:444] REPLICATION: finished
0925 16:46:46.379721 (+114811us) write_op.cc:301] APPLY: starting
0925 16:46:46.379821 (+   100us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:46.594924 (+215103us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:46.595107 (+   183us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:47.052982 (+457875us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:47.053302 (+   320us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0925 16:46:47.053343 (+    41us) write_op.cc:312] APPLY: finished
0925 16:46:47.053742 (+   399us) log.cc:842] Serialized 212 byte log entry
0925 16:46:47.053906 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:47.054111 (+   205us) write_op.cc:454] Released schema lock
0925 16:46:47.054171 (+    60us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:47.054509 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:47.054542 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":110403,"apply.run_cpu_time_us":35091,"apply.run_wall_time_us":675604,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104303,"cfile_init":1,"lbm_read_time_us":452,"lbm_reads_lt_1ms":4,"num_ops":24,"prepare.queue_time_us":53540,"prepare.run_cpu_time_us":26309,"prepare.run_wall_time_us":660063,"raft.queue_time_us":161232,"raft.run_cpu_time_us":27051,"raft.run_wall_time_us":118512,"replication_time_us":511670,"thread_start_us":238707,"threads_started":4,"wal-append.queue_time_us":148596}]]}
I20260925 16:46:47.710165  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.693435  8868 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 29 to 32, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 32 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:47.714241  8868 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 24 to 27, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 27 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.729231  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.735316  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.720266 18172 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:47.721555 18066 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:47.748360  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 105774us
W20260925 16:46:47.747135  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 111795us
I20260925 16:46:47.741487 17755 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:47.784055  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:46:47.827322 18205 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.828040 18205 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.830127 18205 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.831374  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.832224  9047 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:47.833127  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:47.837754 18066 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:47.838142 18066 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:47.838472 18066 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:47.839571  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.842872  9116 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:47.846640 18066 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.849175  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:47.849777  9046 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:47.856438 18066 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.860576  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:47.861222  9116 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:47.862816  9046 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:47.863957  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:47.864723 18066 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:47.865211 18066 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:47.866015 18066 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.883461  9116 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:47.890964  9700 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:47.892812 18205 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:47.899804  9116 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:47.902393 18177 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260925 16:46:47.923880  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:47.916612 18066 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.931988 18066 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.934342 18066 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.934850  9047 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:47.937776  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.941043 18177 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260925 16:46:47.944796  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.949975  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.955225 18205 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:47.959281  9116 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:47.984906 17743 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:48.077059  8868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 348) took 4569 ms. Trace:
I20260925 16:46:48.078684  8871 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 20 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.086436  8871 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.100596  8871 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.103399  8871 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 21, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.084321  8868 rpcz_store.cc:276] 0925 16:46:43.507584 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:43.507939 (+   355us) service_pool.cc:227] Handling call
0925 16:46:48.076957 (+4569018us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:47.844319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:47.844894 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:47.844920 (+    26us) write_op.cc:435] Acquired schema lock
0925 16:46:47.844930 (+    10us) tablet.cc:660] Decoding operations
0925 16:46:47.846255 (+  1325us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:47.846326 (+    71us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:47.846363 (+    37us) tablet.cc:683] Acquiring locks for 18 operations
0925 16:46:47.869760 (+ 23397us) tablet.cc:699] Row locks acquired
0925 16:46:47.869782 (+    22us) write_op.cc:260] PREPARE: finished
0925 16:46:47.869934 (+   152us) write_op.cc:270] Start()
0925 16:46:47.870050 (+   116us) write_op.cc:276] Timestamp: P: 1790354807869879 usec, L: 0
0925 16:46:47.870072 (+    22us) op_driver.cc:331] REPLICATION: starting
0925 16:46:47.871974 (+  1902us) log.cc:842] Serialized 7083 byte log entry
0925 16:46:47.919820 (+ 47846us) op_driver.cc:444] REPLICATION: finished
0925 16:46:47.968211 (+ 48391us) write_op.cc:301] APPLY: starting
0925 16:46:47.968296 (+    85us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:47.993614 (+ 25318us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:47.993717 (+   103us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.012241 (+ 18524us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.012580 (+   339us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.012632 (+    52us) write_op.cc:312] APPLY: finished
0925 16:46:48.013066 (+   434us) log.cc:842] Serialized 164 byte log entry
0925 16:46:48.023884 (+ 10818us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.024074 (+   190us) write_op.cc:454] Released schema lock
0925 16:46:48.024136 (+    62us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.024474 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.024504 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87255,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":48102,"apply.run_cpu_time_us":22074,"apply.run_wall_time_us":56837,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79259,"num_ops":18,"prepare.queue_time_us":12193,"prepare.run_cpu_time_us":4791,"prepare.run_wall_time_us":29429,"replication_time_us":49648,"thread_start_us":39538,"threads_started":2}]]}
I20260925 16:46:48.110981  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:46:48.112300  7803 tablet_replica.cc:330] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.113202  7803 raft_consensus.cc:2229] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.113732  7803 raft_consensus.cc:2258] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.105257  8871 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.126045  8871 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.127945  8871 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 27, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 27 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.132247  8871 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 17, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 17 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.137801  7803 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.137279  8871 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 19 to 21, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.138844  7803 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.139884  7803 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.142576  7803 tablet_replica.cc:330] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.143770  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 23 to 25, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.149713  8871 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 23, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.148527  7803 raft_consensus.cc:2229] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.152370  7803 pending_rounds.cc:62] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.152643  7803 pending_rounds.cc:68] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 27 index: 17 } timestamp: 7333293233795870720 op_type: NO_OP noop_request { }
I20260925 16:46:48.153085  7803 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.153815  8871 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.155221  8871 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 27 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.156169  7803 raft_consensus.cc:2258] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.157784  8871 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 29. New cstate: current_term: 29 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.179796  7803 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.184572  7803 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.185213  7803 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.192581  7803 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.193491  7803 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.194036  7803 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.196774  7803 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.197552  7803 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.198644  7803 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.201511  7803 tablet_replica.cc:330] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.202277  7803 raft_consensus.cc:2229] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.202847  7803 pending_rounds.cc:62] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.203066  7803 pending_rounds.cc:68] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7333293229069107200 op_type: NO_OP noop_request { }
I20260925 16:46:48.203389  7803 raft_consensus.cc:2866] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.204258  7803 raft_consensus.cc:2258] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.220141  7803 tablet_replica.cc:330] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.228984  7803 raft_consensus.cc:2229] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.229840  7803 pending_rounds.cc:62] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.230101  7803 pending_rounds.cc:68] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7333293293027586048 op_type: NO_OP noop_request { }
I20260925 16:46:48.230476  7803 raft_consensus.cc:2866] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.230808  7803 raft_consensus.cc:2258] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.233842  7803 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.234634  7803 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.236145  7803 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.238548  7803 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.239256  7803 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.239801  7803 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.246624  7803 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.248459  7803 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.248939  7803 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.251478  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.252180  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.252674  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.255666  7803 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.256974  7803 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.258224  7803 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.260747 17743 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:48.261219 17743 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:48.263146 17743 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:48.264978  7803 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.266381  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:48.267639  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:48.277601  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:48.278775 17743 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:48.304119  7803 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.305635  7803 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.332461  8871 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 344) took 4020 ms. Trace:
I20260925 16:46:48.332978  8871 rpcz_store.cc:276] 0925 16:46:44.311910 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:44.317565 (+  5655us) service_pool.cc:227] Handling call
0925 16:46:48.332372 (+4014807us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:48.187968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:48.188491 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:48.188522 (+    31us) write_op.cc:435] Acquired schema lock
0925 16:46:48.188541 (+    19us) tablet.cc:660] Decoding operations
0925 16:46:48.189849 (+  1308us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:48.189918 (+    69us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:48.189947 (+    29us) tablet.cc:683] Acquiring locks for 14 operations
0925 16:46:48.190927 (+   980us) tablet.cc:699] Row locks acquired
0925 16:46:48.190943 (+    16us) write_op.cc:260] PREPARE: finished
0925 16:46:48.191073 (+   130us) write_op.cc:270] Start()
0925 16:46:48.191182 (+   109us) write_op.cc:276] Timestamp: P: 1790354808191027 usec, L: 0
0925 16:46:48.191197 (+    15us) op_driver.cc:331] REPLICATION: starting
0925 16:46:48.205288 (+ 14091us) log.cc:842] Serialized 5546 byte log entry
0925 16:46:48.207644 (+  2356us) op_driver.cc:444] REPLICATION: finished
0925 16:46:48.208082 (+   438us) write_op.cc:301] APPLY: starting
0925 16:46:48.208157 (+    75us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:48.219298 (+ 11141us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:48.219390 (+    92us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.250556 (+ 31166us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.250902 (+   346us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.259626 (+  8724us) write_op.cc:312] APPLY: finished
0925 16:46:48.265652 (+  6026us) log.cc:842] Serialized 129 byte log entry
0925 16:46:48.266420 (+   768us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.266581 (+   161us) write_op.cc:454] Released schema lock
0925 16:46:48.266638 (+    57us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.266963 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.266998 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17323,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":17185,"apply.run_wall_time_us":59329,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58436,"num_ops":14,"prepare.queue_time_us":1744,"prepare.run_cpu_time_us":4334,"prepare.run_wall_time_us":17601,"replication_time_us":16345}]]}
I20260925 16:46:48.335258  7803 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.340718  7803 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.352487  7803 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.370879  8865 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 14 to 16, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.373278  8865 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.385219  7803 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.386404  7803 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.386920  7803 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.401250  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.402148  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.403383  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.415951  7803 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:46:48.416026  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.416795  7803 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.418601  7803 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.420678  7803 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.421415  7803 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.422353  7803 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.436633  7803 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.437431  7803 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.438385  7803 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.441500  7803 tablet_replica.cc:330] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.442176  7803 raft_consensus.cc:2229] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.442749  7803 raft_consensus.cc:2258] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.445139  7803 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.445829  7803 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.446327  7803 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.448889  7803 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.449555  7803 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.450500  7803 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.464773  7803 tablet_replica.cc:330] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.467387  7803 raft_consensus.cc:2229] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.468369  7803 raft_consensus.cc:2258] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.470803  7803 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.471558  7803 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.472514  7803 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.487155  7803 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.487917  7803 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.488956  7803 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.492635  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.493309  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.493803  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.496187  7803 tablet_replica.cc:330] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.496939  7803 raft_consensus.cc:2229] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.497475  7803 raft_consensus.cc:2258] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.507831  7803 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.516516  7803 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.525334  7803 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.527827  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.528541  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.529043  7803 pending_rounds.cc:62] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.529268  7803 pending_rounds.cc:68] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7333293276713717760 op_type: NO_OP noop_request { }
I20260925 16:46:48.529603  7803 raft_consensus.cc:2866] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.529901  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.532224  7803 tablet_replica.cc:330] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.532862  7803 raft_consensus.cc:2229] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.533305  7803 raft_consensus.cc:2258] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.543073  9046 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:48.547379  7803 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.548275  7803 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.549324  7803 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.537405  8865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 343) took 28701 ms (client timeout 15000 ms). Trace:
I20260925 16:46:48.551843  7803 tablet_replica.cc:330] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.552632  7803 raft_consensus.cc:2229] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.553751  7803 raft_consensus.cc:2258] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.556483  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.557224  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.558218  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.559446  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.561344  7803 tablet_replica.cc:330] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.562103  7803 raft_consensus.cc:2229] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.562659  7803 raft_consensus.cc:2258] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.565186  7803 tablet_replica.cc:330] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.565860  7803 raft_consensus.cc:2229] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.566637  7803 raft_consensus.cc:2258] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.569298  7803 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.570019  7803 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.570981  7803 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.566057  8871 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.574579  7803 tablet_replica.cc:330] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:46:48.575174  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.576308  7803 raft_consensus.cc:2229] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.576391  8871 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 21 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.577517  7803 raft_consensus.cc:2258] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.578202  8871 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:48.579422  9016 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c756d218cfc0470183a9fe1cc08a22ab. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:48.582471  9123 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:48.585300 18284 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:48.586905  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:48.550904  8865 rpcz_store.cc:269] 0925 16:46:19.836078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:20.004056 (+167978us) service_pool.cc:227] Handling call
0925 16:46:48.537338 (+28533282us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:48.402868 (+     0us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5400002728. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a244be91 00007f71a244aafc 00007f719f94d7cc 00007f719f939603 00007f719f9392b8 00007f719f93dba1 00007f719f93db59 00007f719f93dae9 00007f719f93dab1 00007f719f93cdad 00007f71a2266204
0925 16:46:48.402950 (+    82us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:48.403410 (+   460us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:48.403441 (+    31us) write_op.cc:435] Acquired schema lock
0925 16:46:48.403453 (+    12us) tablet.cc:660] Decoding operations
0925 16:46:48.403925 (+   472us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:48.403976 (+    51us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:48.404005 (+    29us) tablet.cc:683] Acquiring locks for 2 operations
0925 16:46:48.404298 (+   293us) tablet.cc:699] Row locks acquired
0925 16:46:48.404333 (+    35us) write_op.cc:260] PREPARE: finished
0925 16:46:48.408130 (+  3797us) write_op.cc:270] Start()
0925 16:46:48.409982 (+  1852us) write_op.cc:276] Timestamp: P: 1790354808407894 usec, L: 0
0925 16:46:48.411372 (+  1390us) op_driver.cc:331] REPLICATION: starting
0925 16:46:48.423991 (+ 12619us) log.cc:842] Serialized 924 byte log entry
0925 16:46:48.435183 (+ 11192us) op_driver.cc:444] REPLICATION: finished
0925 16:46:48.437586 (+  2403us) write_op.cc:301] APPLY: starting
0925 16:46:48.437659 (+    73us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:48.438836 (+  1177us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:48.438872 (+    36us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.440000 (+  1128us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.440177 (+   177us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.440221 (+    44us) write_op.cc:312] APPLY: finished
0925 16:46:48.440411 (+   190us) log.cc:842] Serialized 33 byte log entry
0925 16:46:48.441982 (+  1571us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.442067 (+    85us) write_op.cc:454] Released schema lock
0925 16:46:48.442108 (+    41us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.442406 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.442433 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":473131,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2143,"apply.run_cpu_time_us":3664,"apply.run_wall_time_us":5082,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":8585,"prepare.run_cpu_time_us":11368,"prepare.run_wall_time_us":41818,"replication_time_us":23714,"spinlock_wait_cycles":2489728}]]}
I20260925 16:46:48.580168  7803 tablet_replica.cc:330] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.599427  7803 raft_consensus.cc:2229] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.579757  8871 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 21 to 26. New cstate: current_term: 26 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.600382  7803 raft_consensus.cc:2258] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.600811  8871 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 27 to 28, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.602792  8871 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 26, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 26 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.603734  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.604480  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.604135  8871 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.605077  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.605546  8871 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.607510  7803 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.612147  8870 catalog_manager.cc:5042] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: aborting the task: latest config opid_index 8; task opid_index 5
I20260925 16:46:48.606980  8871 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 15 to 17, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 17 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.616951 18284 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:48.616962  8871 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 15 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 24 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.618974  8871 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 23 to 26, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.620496  8871 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.628921  8871 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.630520  8871 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.628981  9123 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:48.632510  8871 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:48.627554  8870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 341) took 79358 ms (client timeout 15000 ms). Trace:
W20260925 16:46:48.633987  8870 rpcz_store.cc:269] 0925 16:45:29.269313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.274329 (+  5016us) service_pool.cc:227] Handling call
0925 16:45:29.733638 (+459309us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:46:48.627458 (+78893820us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":858,"reported_tablets":47,"spinlock_wait_cycles":356358016}
I20260925 16:46:48.638943  7803 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.641139  7803 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.643814  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.645783  8921 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:48.648921  7803 tablet_replica.cc:330] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.645155  8871 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 27, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 27 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:48.650251  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.650707  7803 raft_consensus.cc:2229] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.650261  8871 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 22 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.652352  7803 raft_consensus.cc:2258] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.654392  8871 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.657622  7803 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.658321  7803 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.659528  7803 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.669863  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:48.670224  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:48.674595  7803 tablet_replica.cc:330] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.675431  7803 raft_consensus.cc:2229] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.675979  7803 raft_consensus.cc:2258] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.683069  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:48.685094  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:48.689357  7803 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.690225  7803 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.690876  7803 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.693663  7803 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.694389  7803 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Raft consensus shutting down.
W20260925 16:46:48.694473  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.699805  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:48.704726  7803 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.704902  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:48.707885  7803 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:46:48.704698  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.708621  7803 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.709322  7803 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.717757  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.720556  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.759083  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.814558  8871 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:48.833194  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.833280  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.837901  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.882918  8873 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 16 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.901137  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:48.901044  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:43368
W20260925 16:46:48.913070  8872 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 344) took 70746 ms (client timeout 15000 ms). Trace:
W20260925 16:46:48.914808  8872 rpcz_store.cc:269] 0925 16:45:38.166837 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:38.167113 (+   276us) service_pool.cc:227] Handling call
0925 16:46:48.912884 (+70745771us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3654,"reported_tablets":47}
I20260925 16:46:48.932090  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet c694676902c54ad8bfe8e7fd5a725e33 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:46:48.937726  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:48.946225  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.969527  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.981035  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.999842  8873 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 224) took 19243 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.012545  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): ChangeConfig:REMOVE_PEER RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:49.000253  8873 rpcz_store.cc:269] 0925 16:46:29.755989 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:29.756295 (+   306us) service_pool.cc:227] Handling call
0925 16:46:48.999387 (+19243092us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:48.915737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:48.916240 (+   503us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:48.916290 (+    50us) write_op.cc:435] Acquired schema lock
0925 16:46:48.916309 (+    19us) tablet.cc:660] Decoding operations
0925 16:46:48.916655 (+   346us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:48.916713 (+    58us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:48.916743 (+    30us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:46:48.916921 (+   178us) tablet.cc:699] Row locks acquired
0925 16:46:48.916940 (+    19us) write_op.cc:260] PREPARE: finished
0925 16:46:48.917077 (+   137us) write_op.cc:270] Start()
0925 16:46:48.917183 (+   106us) write_op.cc:276] Timestamp: P: 1790354808917036 usec, L: 0
0925 16:46:48.917205 (+    22us) op_driver.cc:331] REPLICATION: starting
0925 16:46:48.917768 (+   563us) log.cc:842] Serialized 536 byte log entry
0925 16:46:48.919611 (+  1843us) op_driver.cc:444] REPLICATION: finished
0925 16:46:48.920087 (+   476us) write_op.cc:301] APPLY: starting
0925 16:46:48.920165 (+    78us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:48.920949 (+   784us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:48.921047 (+    98us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.921735 (+   688us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.921928 (+   193us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.921980 (+    52us) write_op.cc:312] APPLY: finished
0925 16:46:48.922148 (+   168us) log.cc:842] Serialized 25 byte log entry
0925 16:46:48.922295 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.922370 (+    75us) write_op.cc:454] Released schema lock
0925 16:46:48.922413 (+    43us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.922709 (+   296us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.922735 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":166261,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":273,"apply.run_cpu_time_us":2871,"apply.run_wall_time_us":2870,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":4045,"prepare.run_cpu_time_us":2294,"prepare.run_wall_time_us":2301,"replication_time_us":2321}]]}
I20260925 16:46:49.021629 18323 ts_tablet_manager.cc:927] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.030318 18323 tablet_copy_client.cc:316] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:46:49.032397  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet c756d218cfc0470183a9fe1cc08a22ab from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:46:49.032927  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet c756d218cfc0470183a9fe1cc08a22ab from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-c756d218cfc0470183a9fe1cc08a22ab
I20260925 16:46:49.045712  9059 tablet_copy_source_session.cc:205] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:49.051893 18323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c756d218cfc0470183a9fe1cc08a22ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:46:49.074148  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:49.075853  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:49.156384  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:49.157286  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:49.159010  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet c694676902c54ad8bfe8e7fd5a725e33 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:49.164582  8864 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 345) took 40883 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.167271  8864 rpcz_store.cc:269] 0925 16:46:08.281381 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.287388 (+  6007us) service_pool.cc:227] Handling call
0925 16:46:49.164476 (+40877088us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61797,"reported_tablets":47}
I20260925 16:46:49.208443 18323 tablet_copy_client.cc:791] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:49.209196 18323 tablet_copy_client.cc:655] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:49.222862  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60245.8us
I20260925 16:46:49.229568 18282 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.230072 18282 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.236927  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.245505 18282 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.262974  8866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 223) took 40788 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.272521  8866 rpcz_store.cc:269] 0925 16:46:08.474104 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.169513 (+3695409us) service_pool.cc:227] Handling call
0925 16:46:49.262768 (+37093255us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27882,"reported_tablets":39}
I20260925 16:46:49.276288  8867 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.279599  8867 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 13 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 17 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:49.280751 18323 tablet_copy_client.cc:531] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:49.281611  8867 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:49.286023  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:49.289537  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.291728 18284 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:49.292387  8869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 222) took 75889 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.294332  8869 rpcz_store.cc:269] 0925 16:45:33.402838 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:33.403814 (+   976us) service_pool.cc:227] Handling call
0925 16:46:49.292187 (+75888373us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1348913,"reported_tablets":39}
I20260925 16:46:49.293208  8867 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 22 to 30, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 30 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.296613  8867 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:49.304529 17788 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.305094 17788 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.306932 17788 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.312995  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.314177 18098 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.314697 18098 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.316753 18098 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.319602  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.320246  9047 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:49.322914  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.326181 17409 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:49.326588 17409 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.327020 17409 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:49.333233 18284 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.333832 18284 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.368290 18284 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.369940  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:49.388654  8939 connection.cc:441] server connection from 127.0.0.1:41948 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1928) could send its response
W20260925 16:46:49.390100  9089 connection.cc:535] client connection to 127.7.158.193:40071 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 16:46:49.412814  9015 connection.cc:535] client connection to 127.7.158.193:40071 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 16:46:49.423996  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.380870 17409 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.439301  9701 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:49.439610 17409 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:49.441993  9666 connection.cc:698] client connection to 127.7.158.193:40071 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260925 16:46:49.442487  9016 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.444265 18284 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:49.445508  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:49.453647 17409 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.454272 17409 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.455634 17409 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.456328 18323 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:46:49.457522  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 125357us
W20260925 16:46:49.462072  9089 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.462694  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.463382  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.464473 17788 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:49.468660 18284 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:49.524547 17788 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.528129 18327 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.529340 18327 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.531985 18326 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.532111 18282 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.535662 18325 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.536695 18325 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.540470 18098 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.526785 17788 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.541640 18098 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.542361 18325 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.545099 17788 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.533169 18326 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.564563 17788 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.565433 17788 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.533174 18282 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:49.577648  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:49.578349  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.580099  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.586889 18327 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.587903 18098 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.592947 18326 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:49.593289  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.593484 17788 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.595520  9046 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:49.596005 18282 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.603534 18282 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.605909 18282 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.610319 18282 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.604501  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.615252  9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 196 similar messages]
I20260925 16:46:49.616068  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.617035  9047 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:49.621592  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.623234  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:49.623867  9015 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.623973  9696 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:49.626437 18326 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.634650  9016 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:49.636904  9089 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.638041  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.639653 18284 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:49.635803 18326 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.640398 18284 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:49.640781 18284 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.642333 18284 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:49.627223 17788 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.643405 18326 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.644161 17788 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.647035 17788 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.648483 18169 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.647641 17788 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.664297 18169 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.667127 18337 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.668075 18337 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.670719 18337 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.676391  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.677706 18338 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.678539 18338 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.683261 18338 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.686789 18337 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:49.688553 18337 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:49.689383 18169 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.664286 17788 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.690630 18337 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.701555 18335 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.702315 18335 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.701859 17788 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.709451  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.710414  9696 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:49.711884 18325 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.712759 18325 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.715660 18325 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.720599  8867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 347) took 2785 ms. Trace:
I20260925 16:46:49.723939  8867 rpcz_store.cc:276] 0925 16:46:46.934898 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:47.738855 (+803957us) service_pool.cc:227] Handling call
0925 16:46:49.720376 (+1981521us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:49.301256 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:49.301752 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:49.301789 (+    37us) write_op.cc:435] Acquired schema lock
0925 16:46:49.301810 (+    21us) tablet.cc:660] Decoding operations
0925 16:46:49.302484 (+   674us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:49.302553 (+    69us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:49.302587 (+    34us) tablet.cc:683] Acquiring locks for 5 operations
0925 16:46:49.303164 (+   577us) tablet.cc:699] Row locks acquired
0925 16:46:49.303185 (+    21us) write_op.cc:260] PREPARE: finished
0925 16:46:49.303324 (+   139us) write_op.cc:270] Start()
0925 16:46:49.303462 (+   138us) write_op.cc:276] Timestamp: P: 1790354809303277 usec, L: 0
0925 16:46:49.303486 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:46:49.304042 (+   556us) log.cc:842] Serialized 2065 byte log entry
0925 16:46:49.305952 (+  1910us) op_driver.cc:444] REPLICATION: finished
0925 16:46:49.306379 (+   427us) write_op.cc:301] APPLY: starting
0925 16:46:49.306451 (+    72us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:49.309064 (+  2613us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:49.309149 (+    85us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:49.336350 (+ 27201us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:49.336570 (+   220us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0925 16:46:49.336617 (+    47us) write_op.cc:312] APPLY: finished
0925 16:46:49.336917 (+   300us) log.cc:842] Serialized 57 byte log entry
0925 16:46:49.337949 (+  1032us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:49.338048 (+    99us) write_op.cc:454] Released schema lock
0925 16:46:49.338090 (+    42us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:49.367257 (+ 29167us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:49.367289 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34339,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":7284,"apply.run_wall_time_us":61209,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":3033,"prepare.run_wall_time_us":3034,"replication_time_us":2393}]]}
I20260925 16:46:49.721403 18335 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.728865 18284 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.731783 18284 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.733942  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:49.696722  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.742216  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.742653  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.743058  9696 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:49.745041  9090 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.753193 18335 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:49.753825 18335 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.754436 18335 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.756845 18335 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.760507  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.761499 18334 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.762037 18334 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.762653 18327 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.763597 18327 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.766803  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.766757 18327 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.769219 18325 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:49.772303 18325 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.772343  8868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 225) took 2504 ms. Trace:
I20260925 16:46:49.772835 18325 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:49.773674  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.772985  8868 rpcz_store.cc:276] 0925 16:46:47.267324 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:48.110643 (+843319us) service_pool.cc:227] Handling call
0925 16:46:49.772077 (+1661434us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":171177,"reported_tablets":39}
W20260925 16:46:49.768326  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56389.6us
I20260925 16:46:49.780766 18284 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.780994 18339 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:49.781370 18284 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.781688 18339 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.783942 18169 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.784086  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.785075  9047 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:49.784837 18169 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.783496 18284 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.779868 18326 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.786480  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.787158 18169 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.787285  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:49.789572  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.767544 18334 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.791290  9700 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:49.796062 18169 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.796692 18169 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.797199  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.797847  9701 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:49.798728  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.798982 18169 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.800567  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.800711  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.801182  9041 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:49.801456  9046 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:49.802169  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.802780  9048 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
W20260925 16:46:49.804122  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.804711  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:49.804721  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.805867  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.806231  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.808612  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.807904 18336 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.812038 18339 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.812297  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.812798 18336 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.812515 18337 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:49.814800  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.815461  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:49.816383 18282 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:49.786541 18326 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.816949 18282 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.817442 18282 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:49.818737 18326 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.819909  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.823462 18340 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.824486 18339 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.829596  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.830412  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:49.825006  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.826421 18337 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:49.825135  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.832671 18337 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.833156 18337 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:49.823789  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:49.830021 18339 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.834487 17788 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.834843 17788 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.835215 17788 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.814829 18336 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.835858 18339 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.810626 18169 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.838160 18169 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.839586  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.828663  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.848054  9696 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:49.840641  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.843324  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.848707  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.849526 18327 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:49.849879  9116 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:49.845515  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.846298  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.845997 17788 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.825587 18340 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.852937  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.853439 17788 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.828644 18325 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.853487 18340 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.853802 18335 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:49.850528 18326 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.849957 18327 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.854487 18335 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.854537  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.855114 18327 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:49.855244 18335 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:49.855579 18325 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.855772  9046 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 25 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260925 16:46:49.859889  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.860450  9701 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:49.861222 18334 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.863811 18326 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:49.866339  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.850696  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.901472 18326 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.901786  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.902515 18284 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:49.902674  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52020.9us
W20260925 16:46:49.903450  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.904131  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.863300 18327 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.872051  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.905912  9119 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:49.865201  9700 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:49.870601  9701 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
W20260925 16:46:49.876660  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.906826 18327 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.907130  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:49.908061  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.901549  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:49.908581  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:49.909015  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.909628  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.910351  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.910998  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.884212 18337 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.888478 18282 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.889061 18338 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.891422 18325 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.912441 18338 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.912516 18325 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.892868 18334 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.913530 18337 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.913911 18334 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:49.913563 18282 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.894253 18336 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.914568 18338 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.915009 18336 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.895988  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.917083  9696 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.914765 18325 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.918149  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:49.918746  9048 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.900413 17409 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.919979 17409 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.921082 18325 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.921620 18325 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.922415 17409 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.923208  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.923650 18327 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:49.923888  9041 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 32.
I20260925 16:46:49.928643 18282 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.928591 18335 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.929376 18282 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.929734 18336 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.872393 18169 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.931505 18282 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.920550  9666 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.932683  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.933017  9666 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.933158  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:49.933996  9089 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.923972 18325 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.937222  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.932165  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:49.937484  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.934762  9696 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:49.937763  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.938257  9700 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 25: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:49.935091 17788 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:49.939527  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.940203 17788 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:49.940855 17788 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:49.941776 17788 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.942894  8868 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.957855  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.957376  8868 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 19 to 20, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.958761  9123 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:49.962481  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.944061 18326 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.964141  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.964800  9123 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:49.966670  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.967754  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.967839  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.968806 18334 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.969373 18284 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:49.970512 18327 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:49.970654 18098 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:49.970933 18327 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.971395 18327 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:49.975685 18340 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.964803  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.976784  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.948545  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.977118  9116 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:49.976271 18339 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:49.934664  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.948815 18325 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:49.978929  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:49.979147 18325 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:49.969373 18334 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.980113 18325 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.981029 18282 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:49.981534 18282 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:49.980187  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.950024  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.949800 18169 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.984412 18169 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.982432 18282 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:49.954149  9015 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.963152  9115 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 32.
I20260925 16:46:49.976253 18340 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.986408  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.987100 18336 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:49.988080 18340 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.980070 18341 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:49.978212 18339 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.982599  9121 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:49.982896  9700 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:49.991035 18339 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.985774  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.991856  9701 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:49.994635  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.996340 18338 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:49.996665  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:49.997442  9046 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:49.997327  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.950387 18335 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.948382  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:49.999069  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50788.5us
W20260925 16:46:49.999521  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.999940  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.000360  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.003726 18338 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.004263 18338 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.006126 18338 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.006316 18327 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.006982 18169 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:49.982458 18334 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:50.009615  9666 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.009773 18327 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.010442 18326 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.010625  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.011274  9701 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:50.012454  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.014351  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.015087 18336 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:50.015360  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.020112  9701 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:50.020820 18336 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.023810  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:50.018582  9700 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:50.021606 18284 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:50.022713  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.021608 18326 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.024473  9123 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:50.025250  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:50.026222  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.021970  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.025943 18337 raft_consensus.cc:2741] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260925 16:46:50.024996 18284 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.028139 18284 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.028784  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.029651 18282 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260925 16:46:50.029732 17788 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:50.030207 18282 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.030400 17788 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.030817 18282 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Advancing to term 33
I20260925 16:46:50.027513 18334 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.031958 18334 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.030877 17788 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.032393 18334 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.025485 18326 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.036015 18326 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.036755  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.037340  9123 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:50.041370 17788 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.047925  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.048743  9048 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:50.053575  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.053941 18284 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.054577  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.055243  9048 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:50.024092 18336 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
W20260925 16:46:50.061054  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 126398us
W20260925 16:46:50.062484  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.062732  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.063498  9041 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:50.046458  9123 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:50.064865  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.066068 18327 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.066480 18327 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.067102 18327 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.071861 18169 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.071986 18284 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.072506 18169 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.073472  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.075265  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.076061 18335 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:50.076601 18335 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.077606 18335 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.076159 18346 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:50.071421 18334 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.085772  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.086319  9123 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.086757  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.088212  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.097909 18326 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.098479 18326 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.074512 18169 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.088748 18346 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260925 16:46:50.092764  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:50.095434 18337 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:50.099081  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.108431  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.108848  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:50.100485 18335 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:50.110217 18335 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.110607 18336 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.111138 18335 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.112133 18334 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.100539 18326 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.113972  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.100628 18337 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.115558  9123 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:50.117184 18337 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.097178  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.097002 18282 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.118218 18339 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:50.118587 18339 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.118925 18339 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:50.119297 18282 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.065454  9046 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:50.096418  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.099956  9116 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
W20260925 16:46:50.120698  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.100122 18346 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.121508 18346 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Advancing to term 33
I20260925 16:46:50.117274 18336 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.100924  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:50.123524  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.123785  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.124521 18350 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260925 16:46:50.125962  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.126513  9089 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.126920  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.127451  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.127955  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:50.128245  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.102157 17788 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.135867 17788 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.138135  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.138321  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.138700  9116 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:50.141907 17788 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.146004  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.146584  9700 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.136053 18337 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:50.152249 18337 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.153092 18337 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.158562 18346 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.160539  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.166646  9116 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:50.160991 17788 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.149259  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.161474  9700 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
W20260925 16:46:50.168550  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.168988  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:50.172744  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:50.173322  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.173740  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:50.177809  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.179075  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.181784  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.183915  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.185454  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.186800  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.191092 18169 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:50.194712 18340 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.195371 18340 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.172001 18282 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.196866 18330 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.197314 18330 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.196552 18340 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.197090 18282 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.197669 18330 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.199110 18282 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.177738 18325 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:50.201840  9048 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:50.202037  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.200577 18098 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:50.105142 18327 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.205497  9123 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 33: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:50.206007  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.202842  9700 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 28.
W20260925 16:46:50.205632  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.206127  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.205395 17409 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260925 16:46:50.210935  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.211024  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.211658  9047 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
W20260925 16:46:50.211668  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.212457  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.213172  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.210086  9041 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:50.217731  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.217746  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.218894 17788 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.219242 17788 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.219640  9696 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 28: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:50.219612 17788 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.208794 18325 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.207645 18098 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.177320 18339 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.223549  9046 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:50.217044 18282 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:50.227578  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.225610  8869 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 19 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.222345 18169 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:50.228998  8869 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 21 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.228299  9042 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:50.224550 18098 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:50.224932 18336 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:50.231639 18169 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.235476 18169 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:50.240217  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.240578 18327 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.227066 18282 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.241523 18282 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:50.244282 18346 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.243278  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.245580 18336 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.256574  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.257422  9050 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 33: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:50.259666 18282 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.265560 18336 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.273542 18282 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.274397 17788 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.261297  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:50.275501  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.276441  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.277210  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.278038  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.278504  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:50.284324 17788 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.285317  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75260.1us
I20260925 16:46:50.286079  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.287453  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.288383 17409 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:50.288410  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.288731 17409 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.289119 17409 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:50.271003 18323 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:50.283217 18325 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.290773  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.286331 18282 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260925 16:46:50.294718  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.295310  9047 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.291003 18338 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:50.296517  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.293241 18327 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:50.316164 18338 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260925 16:46:50.326472  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.327101  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.308508 18337 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:50.333845 18338 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.336402 18338 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.326153 18327 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.340924 18327 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.354719  9047 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 28.
I20260925 16:46:50.360087 18339 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.361057 18098 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.335809 18337 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.363967 18337 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:50.365025  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.317255 18169 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.372700 18098 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.372692 18169 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.374354  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.384343 18339 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:50.385152 18339 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.386315 18339 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.388181 18323 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:50.389207 18323 ts_tablet_manager.cc:1397] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.933s	user 0.052s	sys 0.021s
I20260925 16:46:50.389111 17409 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.334720 18340 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260925 16:46:50.394809 18338 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:50.335409  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 108624us
I20260925 16:46:50.391894  9696 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 29: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:50.398029  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.398242  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:50.398715  9123 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 28: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:50.399300 17788 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:50.394829 18323 raft_consensus.cc:348] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:50.400753 18323 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:50.401639 18323 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:50.403899  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.410691 17409 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.408959  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.409523  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 115281us
W20260925 16:46:50.414391  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.418723  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.419301  9124 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:50.443368  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:50.316447 18330 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.451315 18330 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.445703  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.456073  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.458348  9696 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:50.462677 18284 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
W20260925 16:46:50.468701  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.442536 18338 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.471616  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.476452  9701 raft_consensus.cc:1203] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260925 16:46:50.497751 18284 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.477706  9695 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260925 16:46:50.502200 18284 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.486297  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.504169 18352 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:50.506132  9700 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:50.507395 17788 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:50.507619 18323 ts_tablet_manager.cc:1428] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.006s
I20260925 16:46:50.505038  9123 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.513420 18337 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.515329 18337 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.391112 18325 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.519101  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.522243  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:50.522889  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:50.523942  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:50.530315  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 220033us
I20260925 16:46:50.531399  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:50.532371  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.528887 18169 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260925 16:46:50.535184  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.536643 17788 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:50.537163 17788 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.538002 17788 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.518584 18364 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:50.547053  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:50.547552  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.548427  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.551610  9701 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:50.554759  9050 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:50.554811  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.555569  9047 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:50.558810 18364 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.561760 18340 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:50.562139 18364 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.564275  9047 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:50.564713  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:50.565354  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:50.568831  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.571743  9050 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 29: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:50.578701  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.578998  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.579442  9047 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.579733  9048 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.583491  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.584661 18336 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:50.585026 18336 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:50.585318 18336 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:50.591756  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57712.1us
I20260925 16:46:50.605594 18336 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.606673  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.615969  9047 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
W20260925 16:46:50.623908  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:50.615557  9048 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:50.635620  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:50.640026  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.640690  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.641228  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.642490  9666 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.643133  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.643784  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:50.634848  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): ChangeConfig:REMOVE_PEER RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.641240  8867 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 17 to 18, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:50.653450  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c756d218cfc0470183a9fe1cc08a22ab received from {username='slave'} at 127.0.0.1:43114
I20260925 16:46:50.654049  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c756d218cfc0470183a9fe1cc08a22ab on tablet c756d218cfc0470183a9fe1cc08a22ab with peer e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:50.654501  7803 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:50.641638 18327 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:50.667043  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.667605  9047 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:50.674553 18373 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260925 16:46:50.681470  9047 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:50.696725 18337 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:50.718710  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260925 16:46:50.720711  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.721378  9123 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.722790 18334 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260925 16:46:50.726444  9701 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:46:50.718663 18336 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.730665  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:50.763648 18336 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:50.763799  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.766914  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.779712  8869 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.787168  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.788262  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.790359  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.791570 17409 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election won for term 28
W20260925 16:46:50.793151  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.778666 18364 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.783164 18337 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:50.795895  8869 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 26 to 27, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 27 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.792862 18098 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260925 16:46:50.806176  9048 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260925 16:46:50.820039  8869 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 22 to 23, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:50.839439  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47349.1us
I20260925 16:46:50.804822 18364 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.843010  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.821228 18337 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.843525 17788 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260925 16:46:50.850914 18326 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:50.884996  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.888664 17409 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:50.896607  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.897372  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.898007  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:50.883486 18326 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:50.896847 18379 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260925 16:46:50.918696  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.926642 17409 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:50.931759  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.944202  9115 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:50.940681 18364 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.923309 18337 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.913946 18360 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.950810 18326 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.978478  9123 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260925 16:46:50.968644 18360 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.980669 18360 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.983587 18338 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:51.003929  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.046492  9115 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:51.070179  9042 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260925 16:46:51.073673 18361 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260925 16:46:51.075116 18385 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:51.078449 18350 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260925 16:46:51.176690 18393 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260925 16:46:51.181280  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.192646  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.193558 18392 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260925 16:46:51.200904  9699 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:46:51.203714  9042 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 28 index: 22. (index mismatch)
I20260925 16:46:51.218540 18334 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260925 16:46:51.227129 18339 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.032s
W20260925 16:46:51.277663  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55079.7us
W20260925 16:46:51.281893  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62532.7us
W20260925 16:46:51.343592  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60252.2us
W20260925 16:46:51.368314  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 86101.3us
I20260925 16:46:51.374564  9124 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260925 16:46:51.349740  8867 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 27 to 28, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:46:51.385396  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.389880 18398 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260925 16:46:51.401876  8867 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 24 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 25 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:51.408457  8867 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:51.410380  8867 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.420539  8867 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 25 to 26, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.430217  8867 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.450379 18336 raft_consensus.cc:1050] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:51.471150  9119 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260925 16:46:51.425011  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.480554  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55601us
I20260925 16:46:51.408123 18325 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
W20260925 16:46:51.512857  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.521991  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.522300  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74607.9us
I20260925 16:46:51.523594  9121 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260925 16:46:51.529374  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.532786  9047 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260925 16:46:51.536000  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.542833 18336 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:51.552512  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.562714 18360 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:51.519603 18390 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
W20260925 16:46:51.573093  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.581058  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.587373  9050 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:51.603432  9047 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260925 16:46:51.581756  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.606658  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.611506  9045 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
W20260925 16:46:51.610193  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.617653 18412 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260925 16:46:51.620620  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.621723 18330 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:51.622037 18369 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:46:51.623749  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.646152  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.654908  7803 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:51.660221 18338 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260925 16:46:51.662544  9701 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:51.648557 18385 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260925 16:46:51.665743 18364 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260925 16:46:51.669437  9121 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:51.674157 18282 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260925 16:46:51.667074  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.684202  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.719206  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.765842 18282 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:51.769228  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.770283  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.772524  9124 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:51.823736  9700 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:51.842007  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.889955 17409 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:51.890578 17409 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:51.892488 17409 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:51.901047  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:51.901707  9042 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:51.910647  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:51.917810 17409 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:51.918183 17409 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:51.918475 17409 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:51.937884  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:51.926175 17409 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:51.940810 17409 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:51.942804  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:51.946609  9048 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:51.947008  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:51.952208  8868 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 19 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 20 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.954923  9048 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:51.954790  8868 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 27 to 28, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.966355  8867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 349) took 1052 ms. Trace:
I20260925 16:46:51.966977  8867 rpcz_store.cc:276] 0925 16:46:50.913574 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:50.913722 (+   148us) service_pool.cc:227] Handling call
0925 16:46:51.966279 (+1052557us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:51.564589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:51.565186 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:51.565238 (+    52us) write_op.cc:435] Acquired schema lock
0925 16:46:51.565258 (+    20us) tablet.cc:660] Decoding operations
0925 16:46:51.566160 (+   902us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:51.566218 (+    58us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:51.566241 (+    23us) tablet.cc:683] Acquiring locks for 6 operations
0925 16:46:51.566756 (+   515us) tablet.cc:699] Row locks acquired
0925 16:46:51.566770 (+    14us) write_op.cc:260] PREPARE: finished
0925 16:46:51.566911 (+   141us) write_op.cc:270] Start()
0925 16:46:51.567020 (+   109us) write_op.cc:276] Timestamp: P: 1790354811566870 usec, L: 0
0925 16:46:51.567044 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:46:51.598181 (+ 31137us) log.cc:842] Serialized 2462 byte log entry
0925 16:46:51.736105 (+137924us) op_driver.cc:444] REPLICATION: finished
0925 16:46:51.856764 (+120659us) write_op.cc:301] APPLY: starting
0925 16:46:51.856846 (+    82us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:51.860822 (+  3976us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:51.860910 (+    88us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:51.930085 (+ 69175us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:51.930313 (+   228us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0925 16:46:51.930355 (+    42us) write_op.cc:312] APPLY: finished
0925 16:46:51.930643 (+   288us) log.cc:842] Serialized 65 byte log entry
0925 16:46:51.930790 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:51.930895 (+   105us) write_op.cc:454] Released schema lock
0925 16:46:51.930939 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":9704,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":114259,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":95695,"prepare.run_cpu_time_us":3705,"prepare.run_wall_time_us":42738,"replication_time_us":161875,"thread_start_us":151188,"threads_started":2}]]}
I20260925 16:46:51.962180  8868 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 21 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 22 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.969992  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:46:51.980641  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.972621  8868 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 17 to 18, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:51.987572  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 87170.6us
I20260925 16:46:51.991072 18385 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
W20260925 16:46:51.991127  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): ChangeConfig:REMOVE_PEER RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:51.991648 18385 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:51.992537 18385 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.012876  8869 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 20 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:52.046027  8867 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.088716  8869 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 24 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 25 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:52.099884  8869 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 19 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 20 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:52.110915  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.115679  8869 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 24 to 26, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 26 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:52.196475  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.200150  9042 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.214226  9700 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260925 16:46:52.215479  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.219163 18361 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:52.227311  9124 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:52.235508 18325 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.242857 18336 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:52.242722  9700 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.259902  9121 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.270654  8869 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.308988 18282 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.309521 18282 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.311299  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c756d218cfc0470183a9fe1cc08a22ab with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:46:52.316962  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:52.318305  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:52.311648 18282 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.326068  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:52.328513 18364 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:52.334154 18364 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.334506 18364 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:52.342496  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:52.376194  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.409610 18364 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.419977  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:52.420655  9700 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:52.421605  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.448040  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:52.448688 18364 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.470266  9042 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:52.475631 18385 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260925 16:46:52.484488  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.485688 18364 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:52.486176 18364 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:52.486960 18364 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.493988 18361 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.494692 18361 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:52.498818  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 34 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:52.499607  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 33.
I20260925 16:46:52.501479  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:52.502518 18390 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260925 16:46:52.502945 18390 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.503326 18390 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Advancing to term 34
W20260925 16:46:52.530028  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.543546 18361 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:52.562904  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:52.590523 18390 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:52.604418 18390 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:52.605976  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 34 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:52.606779  9123 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Advancing to term 34
W20260925 16:46:52.616504  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.623522 18341 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.624269 18341 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.629566  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:52.630373  9700 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 28.
I20260925 16:46:52.635560  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:52.636653 18408 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:52.637056 18408 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.637370 18408 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:52.640297  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.640609 18341 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.646507  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 34.
W20260925 16:46:52.655506  7803 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:52.649394  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.660446  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.661548 18408 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.664846  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:52.665439  9700 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:52.670387 18361 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 FOLLOWER]: Leader election won for term 34
I20260925 16:46:52.668344 18364 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.672505 18364 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:52.674149  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.673844  8868 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 20 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:52.677245  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.676575  9700 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 29.
I20260925 16:46:52.670770 18408 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.677453 18361 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:52.683353 18361 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 32.18, Last appended by leader: 18, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:52.686739  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.687651 18408 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader election won for term 29
I20260925 16:46:52.702803 18364 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:52.700974  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.705770  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:52.706744  9700 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 29.
I20260925 16:46:52.707729  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.709798 18390 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260925 16:46:52.710251 18390 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.710616 18390 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:52.688724 18408 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:52.711514 18408 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.741582  8868 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 32 to 34, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 34 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:52.781683 18390 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:52.784423  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:52.801460  8868 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 27 to 29, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 29 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:52.802175  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:52.803153  9700 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:52.803493 18390 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:52.803511  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.816123  9700 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 30.
I20260925 16:46:52.818492  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.819738 18390 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Leader election won for term 30
I20260925 16:46:52.820266 18390 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:52.821163 18390 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.855362  8868 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 28 to 30, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 30 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:52.878420  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:52.953004  9700 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:52.954528 18390 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:46:52.967597  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.043846  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.117849  9700 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260925 16:46:53.119808 18445 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260925 16:46:53.184540  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:53.190397  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:53.302070  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.317652  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.366077  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.367955  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.370414  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:53.370967  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.370807  9119 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 32 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
W20260925 16:46:53.371543  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.372929 18325 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260925 16:46:53.398011  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.445380  9700 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260925 16:46:53.453576 18352 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260925 16:46:53.518028  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.519279  9121 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:53.524196  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.539853  9090 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb346a4d887940099443a0219edadef0. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.540035  9048 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:53.541880 18445 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260925 16:46:53.555032  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:53.559110  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.587363 18445 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index -1 to 19, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.592319  9048 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index -1 to 19, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:53.603276  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:53.616703  9121 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 28.22, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:53.633852  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:53.632714  8868 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 19, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:53.647414  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.655982  7803 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:53.659271  9090 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eaf0bf4e06942b0b3b3684cfa1f3cc6. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.662109  9048 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 22. Preceding OpId from leader: term: 28 index: 23. (index mismatch)
I20260925 16:46:53.663750 18341 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
W20260925 16:46:53.677030  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.706849 18341 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Committing config change with OpId 28.23: config changed from index -1 to 23, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.737538  9048 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.23: config changed from index -1 to 23, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.750145  9121 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:53.756181  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.755290  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:53.765731  8869 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 23, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:53.828410  9090 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c0923848b9b426eade76023fdecc31c. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.829895  9048 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260925 16:46:53.831990 18445 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260925 16:46:53.841256  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.858116 18445 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.866154  9047 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:53.891489  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.896499  9048 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:53.900945  8868 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 15, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:53.910511  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:53.921293  9016 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6030f186a664452b127609fadec766b. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.923534  9124 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260925 16:46:53.925308 18364 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:53.926034  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.953212 18336 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.954571  9124 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:53.975180  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:53.980670  8868 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:54.022416  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.026178  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.028198  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:54.033223  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:54.045190 18469 ts_tablet_manager.cc:927] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:54.064627  9699 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:54.074785 18469 tablet_copy_client.cc:316] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:46:54.076591  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet eb346a4d887940099443a0219edadef0 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:46:54.077143  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet eb346a4d887940099443a0219edadef0 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-eb346a4d887940099443a0219edadef0
I20260925 16:46:54.121862  9134 tablet_copy_source_session.cc:205] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.130831 18469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb346a4d887940099443a0219edadef0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:46:54.153067  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.165113  9124 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260925 16:46:54.166962 18466 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:54.165134  9048 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260925 16:46:54.170689 18466 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:54.229614 18469 tablet_copy_client.cc:791] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.230260 18469 tablet_copy_client.cc:655] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:46:54.234879  9048 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.230057 18388 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Committing config change with OpId 28.17: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.254437  9124 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.260187 18473 ts_tablet_manager.cc:927] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:54.271111 18469 tablet_copy_client.cc:531] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.277393  8868 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.284694  8860 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 12359c2bff0b46de91daa934c219103c with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260925 16:46:54.317757 18473 tablet_copy_client.cc:316] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:46:54.323100  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:46:54.323683  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-6eaf0bf4e06942b0b3b3684cfa1f3cc6
I20260925 16:46:54.351220  9134 tablet_copy_source_session.cc:205] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.353729 18469 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:46:54.356141 18473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:46:54.391506  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:54.400224  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.414911 18473 tablet_copy_client.cc:791] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.415475 18473 tablet_copy_client.cc:655] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:54.424106  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.461993  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:54.485882  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.496204 18483 ts_tablet_manager.cc:927] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:54.499221 18485 ts_tablet_manager.cc:927] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:54.510051 18473 tablet_copy_client.cc:531] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.519477 18485 tablet_copy_client.cc:316] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:46:54.520330 18483 tablet_copy_client.cc:316] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:46:54.521685  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet c6030f186a664452b127609fadec766b from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:46:54.522239  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet c6030f186a664452b127609fadec766b from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-c6030f186a664452b127609fadec766b
I20260925 16:46:54.522264  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 3c0923848b9b426eade76023fdecc31c from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:46:54.522966  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 3c0923848b9b426eade76023fdecc31c from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-3c0923848b9b426eade76023fdecc31c
I20260925 16:46:54.532568  9134 tablet_copy_source_session.cc:205] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.535477 18483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0923848b9b426eade76023fdecc31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:46:54.548954 18473 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:46:54.561718  9059 tablet_copy_source_session.cc:205] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.567090 18485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6030f186a664452b127609fadec766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:46:54.600801 18483 tablet_copy_client.cc:791] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.601428 18483 tablet_copy_client.cc:655] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:54.635447  9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 470 similar messages]
I20260925 16:46:54.611783 18483 tablet_copy_client.cc:531] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.652843 18485 tablet_copy_client.cc:791] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.653575 18485 tablet_copy_client.cc:655] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:54.655668  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:54.656522  7803 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:54.665532 18485 tablet_copy_client.cc:531] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.716499 18485 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:46:54.724072  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.735904 18483 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:46:54.777495  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.784116  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.852423 18469 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=21 overwritten=2 applied=19 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:54.853466 18469 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:54.868713 18469 ts_tablet_manager.cc:1397] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.515s	user 0.053s	sys 0.016s
I20260925 16:46:54.872424 18469 raft_consensus.cc:348] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:54.876883 18469 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:54.877537 18469 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:54.899978  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.926069 18469 ts_tablet_manager.cc:1428] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260925 16:46:54.937907  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-eb346a4d887940099443a0219edadef0 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:46:54.938324  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-eb346a4d887940099443a0219edadef0 on tablet eb346a4d887940099443a0219edadef0 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:54.980810 18473 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=23 overwritten=0 applied=23 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:54.981770 18473 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:54.982518 18473 ts_tablet_manager.cc:1397] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.435s	user 0.051s	sys 0.019s
I20260925 16:46:55.040203 18473 raft_consensus.cc:348] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:55.045743  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:55.048130 18485 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:55.058025 18473 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:55.058389 18485 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:55.062179 18485 ts_tablet_manager.cc:1397] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.346s	user 0.036s	sys 0.018s
I20260925 16:46:55.058840 18473 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 23, Last appended: 28.23, Last appended by leader: 23, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.071098 18483 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:55.072163 18483 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:55.072934 18483 ts_tablet_manager.cc:1397] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.347s	user 0.045s	sys 0.015s
I20260925 16:46:55.077082 18473 ts_tablet_manager.cc:1428] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.001s
I20260925 16:46:55.082280  9701 raft_consensus.cc:1203] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Deduplicated request from leader. Original: 28.22->[28.23-28.23]   Dedup: 28.23->[]
I20260925 16:46:55.083065 18485 raft_consensus.cc:348] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.085420 18485 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:55.086124 18485 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.091241  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-6eaf0bf4e06942b0b3b3684cfa1f3cc6 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:46:55.092427  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-6eaf0bf4e06942b0b3b3684cfa1f3cc6 on tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:55.096274 18485 ts_tablet_manager.cc:1428] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260925 16:46:55.098580  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c6030f186a664452b127609fadec766b received from {username='slave'} at 127.0.0.1:43114
I20260925 16:46:55.099018  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c6030f186a664452b127609fadec766b on tablet c6030f186a664452b127609fadec766b with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:55.113600 18483 raft_consensus.cc:348] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.114823 18483 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:55.116775 18483 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.117686  9701 raft_consensus.cc:1203] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Deduplicated request from leader. Original: 26.18->[26.19-26.19]   Dedup: 26.19->[]
I20260925 16:46:55.119551 18483 ts_tablet_manager.cc:1428] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.001s
I20260925 16:46:55.137092  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3c0923848b9b426eade76023fdecc31c received from {username='slave'} at 127.0.0.1:43572
I20260925 16:46:55.137581  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3c0923848b9b426eade76023fdecc31c on tablet 3c0923848b9b426eade76023fdecc31c with peer e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:55.189525  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:55.379937  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:55.656960  7803 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:55.731832  9701 raft_consensus.cc:1203] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260925 16:46:55.868785  9701 raft_consensus.cc:1203] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Deduplicated request from leader. Original: 24.14->[24.15-24.15]   Dedup: 24.15->[]
W20260925 16:46:55.872713  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:55.956952  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:55.974144 18503 raft_consensus.cc:1050] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:55.981359 18503 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 17, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:55.992691 18445 raft_consensus.cc:1050] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
W20260925 16:46:56.000077  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.002668  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.006791 18445 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 28.23, Last appended by leader: 21, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:56.026667 18499 raft_consensus.cc:1050] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:56.042058 18499 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:56.079213  9701 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:46:56.080492  9042 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:46:56.080804 18500 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260925 16:46:56.083590 18500 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260925 16:46:56.087021  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:56.098167  9700 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 23. Preceding OpId from leader: term: 28 index: 24. (index mismatch)
I20260925 16:46:56.103116  9048 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 23. Preceding OpId from leader: term: 28 index: 24. (index mismatch)
I20260925 16:46:56.104609 18476 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260925 16:46:56.106169 18476 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
W20260925 16:46:56.117025  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:56.139212  9124 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:46:56.142005 18497 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:56.140430  9701 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:46:56.149602 18499 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
W20260925 16:46:56.187620  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.193640 18445 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Committing config change with OpId 26.20: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.197155  9042 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Committing config change with OpId 26.20: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.208789  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:56.209370  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46834.1us
W20260925 16:46:56.209867  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:56.210409  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.214803  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:56.226115  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260925 16:46:56.224962 18499 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.229076  9700 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.251864  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260925 16:46:56.234863 18476 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Committing config change with OpId 28.24: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.236744  9699 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Committing config change with OpId 28.24: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.258419  9701 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Committing config change with OpId 26.20: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.260387  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.265739  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.273661  8868 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.277269  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.283663  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.292186  9124 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.306843  9045 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.24: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.310293  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.340977  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:56.360481  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:56.400408  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.440060 18503 raft_consensus.cc:1050] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:56.442864 18503 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:56.451327  8869 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:56.459636  8869 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.493625  9121 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 28.24, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:56.495718  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.500195  9700 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 24. Preceding OpId from leader: term: 28 index: 25. (index mismatch)
I20260925 16:46:56.502533 18445 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 16:46:56.514941  9045 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 24. Preceding OpId from leader: term: 28 index: 25. (index mismatch)
I20260925 16:46:56.517267 18476 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 16:46:56.529034  9045 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:56.530856  9699 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:56.535530 18500 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:56.536270 18501 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:56.538830 18445 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Committing config change with OpId 28.25: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.542886  9699 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Committing config change with OpId 28.25: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.562958  9048 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.25: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.564636  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 with cas_config_opid_index 24: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260925 16:46:56.569386  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:56.574669  8867 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.584132  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:56.610412 18445 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.611438  9045 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.630837  9699 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.649416  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.657596  7803 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:56.662406  8867 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:56.706619  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.740687  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08003355e0 after lost signal to thread 7806
W20260925 16:46:56.741930  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08003627e0 after lost signal to thread 8907
W20260925 16:46:56.743258  9723 debug-util.cc:398] Leaking SignalData structure 0x7b0800370280 after lost signal to thread 9074
W20260925 16:46:56.744414  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2d00 after lost signal to thread 9148
W20260925 16:46:56.745656  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08002c17e0 after lost signal to thread 9726
W20260925 16:46:56.750540  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.772652  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.805395  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.834182  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.860075  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.910075  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.910454  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:57.027207  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:57.041932  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.102695  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:57.111449  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.329131  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.369786  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.590102  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.658049  7803 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:57.792562  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.821094  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:57.903354  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.930056  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:57.936285  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.962109  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:58.076334  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:58.128289  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:58.438336  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.438819  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.446875  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:58.542366  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:58.603518  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:58.604288  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.619534  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.629009  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:58.658519  7803 thread.cc:536] Waited for 9000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:58.689980  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.703488  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.733548  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.829584  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.842803  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:58.863649  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.915657  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52060.7us
W20260925 16:46:58.937669  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.939105  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.030159  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52901.3us
W20260925 16:46:59.082059  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:59.111155  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.159301  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:59.183068  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.268246  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.265918  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.347514  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.436690  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.553272  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.566746  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76448.4us
W20260925 16:46:59.585872  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.596861  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.597566  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.597982  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.667946  7803 thread.cc:536] Waited for 10000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:59.746060  9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 401 similar messages]
W20260925 16:46:59.761569  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.789655  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.894748  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 89034.7us
W20260925 16:46:59.951427  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.983875  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:00.123421  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.281334  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.304939  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.403571  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.598673  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.614475  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.620843  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:00.647027  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:00.668972  7803 thread.cc:536] Waited for 11000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:00.745507  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.023785  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:01.119482  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 203119us
W20260925 16:47:01.178469  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.209646  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 311015us
W20260925 16:47:01.231053  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.232520  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:01.237944  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.263886  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:01.311358  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.312565  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.336524  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.337136  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.343152  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.359925  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.372474  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.373059  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.420328  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.456229  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.516546  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.593842  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.620942  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.626143  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.670096  7803 thread.cc:536] Waited for 12000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:01.725512  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.760679  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.797322  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.840672  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:01.849951  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.875397  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.934966  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08003d30e0 after lost signal to thread 7806
W20260925 16:47:01.936259  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800341e60 after lost signal to thread 8907
W20260925 16:47:01.937685  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800303fa0 after lost signal to thread 9074
W20260925 16:47:01.938890  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08003d17a0 after lost signal to thread 9148
W20260925 16:47:01.940501  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800270b80 after lost signal to thread 9726
W20260925 16:47:01.988538  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.150028  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.193483  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.218565  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.218920  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.265734  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.275393  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.277953  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.440948  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.670643  7803 thread.cc:536] Waited for 13000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:02.731850  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.740752  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.747674  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.857928  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.901554  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.140923  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.173547  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.240566  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.282320  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:03.380673  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.424815  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.567607  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.665174  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:03.671097  7803 thread.cc:536] Waited for 14000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:03.688489  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:03.720340  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.813181  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.818146  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.827809  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.829137  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.855569  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.870508  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.871965  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.892748  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.903453  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.958280  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.984484  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.003353  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:04.039425  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:04.088951  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.121546  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.212450  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:04.230886  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:04.412516  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:04.440266  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72117.2us
W20260925 16:47:04.463210  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:04.465927  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52385.1us
W20260925 16:47:04.547988  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.554663  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.561818  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.604121  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:04.671586  7803 thread.cc:536] Waited for 15000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:04.731817  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.752346  9089 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 432 similar messages]
W20260925 16:47:04.776021  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.827373  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.844260  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:04.887858  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:05.061591  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.062386  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.150381  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.242648  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.410262  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.458516  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.465903  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:05.607292  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:05.672127  7803 thread.cc:536] Waited for 16000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:05.776561  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:05.790017  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.951224  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:05.963342  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:05.984755  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.013170  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.086997  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:06.148872  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.171327  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.211330  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:06.224658  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.383602  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.407981  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.442850  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.473594  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.485651  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.504439  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.506589  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.529356  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.602787  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.661893  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.673028  7803 thread.cc:536] Waited for 17000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:06.686462  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:06.703845  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.727540  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.803339  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.804845  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.898479  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.969731  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:07.039577  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:07.083627  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.134152  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.147176  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.148881  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.151520  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.164865  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.370256  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.423147  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.529165  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.529580  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45267.9us
W20260925 16:47:07.772329  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.784970  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.825477  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.914283  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.902276  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.948072  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45833.6us
I20260925 16:47:08.056759  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
W20260925 16:47:08.063215  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:08.236773  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:08.311966  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:08.387756  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:47:08.390859  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:08.395368  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.406002  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.427109  9666 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.435892  9666 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.441694  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:08.442102  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:08.486351  9666 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.499527  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.549708  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.558154  9666 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.559106  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:08.575454  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:08.577826  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.604665  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.605799  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.612655  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:08.620065  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.624822  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:08.626001  7803 tablet_replica.cc:330] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.627624  7803 raft_consensus.cc:2229] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.628618  7803 raft_consensus.cc:2258] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.634011  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.634722  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:08.640230  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:08.634827  7803 tablet_replica.cc:330] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.644327  7803 raft_consensus.cc:2229] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.645615  7803 raft_consensus.cc:2258] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.648450  7803 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.649367  7803 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:08.649812  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260925 16:47:08.650025  7803 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.654722  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.655165  7803 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
W20260925 16:47:08.655512  9666 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.663239  7803 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.664511  7803 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.666965  9089 consensus_peers.cc:487] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.667487  7803 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.668524  7803 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.669243  7803 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.672235  7803 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.673142  7803 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.673892  7803 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.676734  7803 tablet_replica.cc:330] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.677814  7803 raft_consensus.cc:2229] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.678987  7803 raft_consensus.cc:2258] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.681846  7803 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.682706  7803 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.683873  7803 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.686525  7803 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.687376  7803 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.688127  7803 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.690799  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
W20260925 16:47:08.690958  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.691723  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.693439  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.696249  7803 tablet_replica.cc:330] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.697115  7803 raft_consensus.cc:2229] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.698256  7803 raft_consensus.cc:2258] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.701175  7803 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.702162  7803 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.703280  7803 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.706125  7803 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.707008  7803 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.707782  7803 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.710642  7803 tablet_replica.cc:330] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.711498  7803 raft_consensus.cc:2229] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.712913  7803 raft_consensus.cc:2258] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.715454  7803 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.716328  7803 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.716966  7803 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.719542  7803 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.720340  7803 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.720984  7803 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.723621  7803 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.724444  7803 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:08.725126  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260925 16:47:08.725113  7803 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.728375  7803 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.729260  7803 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.729948  7803 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.732738  7803 tablet_replica.cc:330] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.733678  7803 raft_consensus.cc:2229] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.735114  7803 raft_consensus.cc:2258] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.737941  7803 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.738749  7803 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.740018  7803 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.742671  7803 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.743573  7803 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.744280  7803 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.746758  7803 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.747342  7803 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.747911  7803 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.750387  7803 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.751169  7803 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.752298  7803 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.755533  7803 tablet_replica.cc:330] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.756282  7803 raft_consensus.cc:2229] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.758167  7803 raft_consensus.cc:2258] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.760877  7803 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.761647  7803 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.762264  7803 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.764776  7803 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.766316  7803 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.767004  7803 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.770165  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.771736  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.773458  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.777278  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.778029  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.779098  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.787894  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.789260  7803 tablet_replica.cc:330] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.790138  7803 raft_consensus.cc:2229] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.791224  7803 raft_consensus.cc:2258] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.796530  7803 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.797880  7803 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.798523  7803 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.801105  7803 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.801841  7803 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:08.802001  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.802663  7803 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.805173  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.806070  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.806996  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.808601  9666 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.809791  7803 tablet_replica.cc:330] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.810585  7803 raft_consensus.cc:2229] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.811628  7803 raft_consensus.cc:2258] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.814229  7803 tablet_replica.cc:330] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.814978  7803 raft_consensus.cc:2229] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.816036  7803 raft_consensus.cc:2258] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.818535  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.819270  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.820175  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.822556  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.822676  7803 tablet_replica.cc:330] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.823559  7803 raft_consensus.cc:2229] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.824754  7803 raft_consensus.cc:2258] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.827176  7803 tablet_replica.cc:330] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.827930  7803 raft_consensus.cc:2229] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.828553  7803 raft_consensus.cc:2258] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.831123  7803 tablet_replica.cc:330] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.831924  7803 raft_consensus.cc:2229] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.832764  7803 raft_consensus.cc:2258] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.835004  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.835685  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.836681  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.839994  7803 tablet_replica.cc:330] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.840785  7803 raft_consensus.cc:2229] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.842152  7803 raft_consensus.cc:2258] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.842831  9089 consensus_peers.cc:487] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.844779  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260925 16:47:08.845619  7803 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.846504  7803 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.848392  7803 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.849148  9666 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.851502  7803 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.852308  7803 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.853420  7803 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.869637  7803 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.870414  7803 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.871482  7803 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.873858  7803 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.875015  7803 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.875739  7803 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.878283  7803 tablet_replica.cc:330] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.878959  7803 raft_consensus.cc:2229] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.880080  7803 raft_consensus.cc:2258] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.882532  7803 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.883172  7803 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.884186  7803 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.886516  7803 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.887168  7803 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.887894  7803 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.925184  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:08.941171  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.019028  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.022964  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:09.024192  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:09.045291  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
==================
WARNING: ThreadSanitizer: data race (pid=7803)
  Write of size 8 at 0x7ba0000005f0 by main thread:
    #0 close /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1679:3 (auto_leader_rebalancer-test+0x2b9183)
    #1 kudu::DiagnosticSocket::Close() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:104:3 (libkudu_util.so+0x3d2f0f)
    #2 kudu::rpc::AcceptorPool::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/acceptor_pool.cc:203:3 (libkrpc.so+0x120dd3)
    #3 kudu::rpc::Messenger::ShutdownInternal(kudu::rpc::Messenger::ShutdownMode) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:233:8 (libkrpc.so+0x160847)
    #4 kudu::rpc::Messenger::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:200:3 (libkrpc.so+0x160dfb)
    #5 kudu::kserver::KuduServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:192:17 (libkserver.so+0x13b65)
    #6 kudu::tserver::TabletServer::ShutdownImpl() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:193:17 (libtserver.so+0x2556df)
    #7 kudu::tserver::TabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.h:67:5 (libtserver.so+0x25ae89)
    #8 kudu::tserver::MiniTabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:124:14 (libtserver.so+0x311fb2)
    #9 kudu::cluster::InternalMiniCluster::ShutdownNodes(kudu::cluster::ClusterNodes) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:242:22 (libmini_cluster.so+0xd5f37)
    #10 kudu::cluster::MiniCluster::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/mini_cluster.h:84:5 (auto_leader_rebalancer-test+0x35b954)
    #11 kudu::master::LeaderRebalancerTest::TearDown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:113:17 (auto_leader_rebalancer-test+0x348292)
    #12 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #13 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #14 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2682:3 (libgtest.so.1.12.1+0x42b02)
    #15 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #16 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #17 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #18 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #19 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #20 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #21 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #22 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Previous read of size 8 at 0x7ba0000005f0 by thread T57:
    [failed to restore the stack]

  Location is file descriptor 95 created by main thread at:
    #0 socket /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1638:3 (auto_leader_rebalancer-test+0x2bc13f)
    #1 kudu::DiagnosticSocket::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:87:13 (libkudu_util.so+0x3d301f)
    #2 kudu::rpc::AcceptorPool::Start(int) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/acceptor_pool.cc:159:3 (libkrpc.so+0x121305)
    #3 kudu::RpcServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/rpc_server.cc:297:5 (libserver_process.so+0x1336a9)
    #4 kudu::server::ServerBase::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1333:3 (libserver_process.so+0x145bc5)
    #5 kudu::kserver::KuduServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13b10)
    #6 kudu::tserver::TabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:160:3 (libtserver.so+0x2563a7)
    #7 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x3120f9)
    #8 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #10 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #11 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #12 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #13 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #14 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #15 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #16 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #17 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #18 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #19 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #20 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #21 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #22 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #23 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Thread T57 'diag-logger-907' (tid=9071, running) created by main thread at:
    #0 pthread_create /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966:3 (auto_leader_rebalancer-test+0x29f4e2)
    #1 kudu::Thread::StartThread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, unsigned long, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:638:15 (libkudu_util.so+0x43d62a)
    #2 kudu::Thread::Create(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.h:146:12 (libmaster.so+0x2d3a39)
    #3 kudu::server::DiagnosticsLog::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/diagnostics_log.cc:144:14 (libserver_process.so+0x1167ed)
    #4 kudu::server::ServerBase::StartMetricsLogging() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1185:3 (libserver_process.so+0x145294)
    #5 kudu::server::ServerBase::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1324:3 (libserver_process.so+0x145b34)
    #6 kudu::kserver::KuduServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13b10)
    #7 kudu::tserver::TabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:160:3 (libtserver.so+0x2563a7)
    #8 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x3120f9)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #11 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #12 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #13 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #14 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #15 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #16 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #17 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #18 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #19 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #20 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #21 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #22 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #23 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #24 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

SUMMARY: ThreadSanitizer: data race /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:104:3 in kudu::DiagnosticSocket::Close()
==================
==================
WARNING: ThreadSanitizer: data race (pid=7803)
  Write of size 4 at 0x7b40001c3cd8 by main thread:
    #0 kudu::DiagnosticSocket::Close() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:109:7 (libkudu_util.so+0x3d2f39)
    #1 kudu::rpc::AcceptorPool::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/acceptor_pool.cc:203:3 (libkrpc.so+0x120dd3)
    #2 kudu::rpc::Messenger::ShutdownInternal(kudu::rpc::Messenger::ShutdownMode) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:233:8 (libkrpc.so+0x160847)
    #3 kudu::rpc::Messenger::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:200:3 (libkrpc.so+0x160dfb)
    #4 kudu::kserver::KuduServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:192:17 (libkserver.so+0x13b65)
    #5 kudu::tserver::TabletServer::ShutdownImpl() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:193:17 (libtserver.so+0x2556df)
    #6 kudu::tserver::TabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.h:67:5 (libtserver.so+0x25ae89)
    #7 kudu::tserver::MiniTabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:124:14 (libtserver.so+0x311fb2)
    #8 kudu::cluster::InternalMiniCluster::ShutdownNodes(kudu::cluster::ClusterNodes) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:242:22 (libmini_cluster.so+0xd5f37)
    #9 kudu::cluster::MiniCluster::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/mini_cluster.h:84:5 (auto_leader_rebalancer-test+0x35b954)
    #10 kudu::master::LeaderRebalancerTest::TearDown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:113:17 (auto_leader_rebalancer-test+0x348292)
    #11 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #12 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #13 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2682:3 (libgtest.so.1.12.1+0x42b02)
    #14 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #15 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #16 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #17 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #18 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #19 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #20 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #21 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Previous read of size 4 at 0x7b40001c3cd8 by thread T57:
    [failed to restore the stack]

  Location is heap block of size 248 at 0x7b40001c3c00 allocated by main thread:
    #0 operator new(unsigned long) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_new_delete.cpp:64:3 (auto_leader_rebalancer-test+0x33ee9e)
    #1 std::__1::__libcpp_allocate(unsigned long, unsigned long) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/new:253:10 (libkrpc.so+0x126806)
    #2 std::__1::allocator<std::__1::__shared_ptr_emplace<kudu::rpc::AcceptorPool, std::__1::allocator<kudu::rpc::AcceptorPool> > >::allocate(unsigned long) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1789:34 (libkrpc.so+0x16d651)
    #3 std::__1::enable_if<!(is_array<kudu::rpc::AcceptorPool>::value), std::__1::shared_ptr<kudu::rpc::AcceptorPool> >::type std::__1::make_shared<kudu::rpc::AcceptorPool, kudu::rpc::Messenger*, kudu::Socket*, kudu::Sockaddr&, int const&>(kudu::rpc::Messenger*&&, kudu::Socket*&&, kudu::Sockaddr&, int const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:4290:45 (libkrpc.so+0x165e05)
    #4 kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:269:34 (libkrpc.so+0x16100d)
    #5 kudu::RpcServer::Bind() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/rpc_server.cc:262:5 (libserver_process.so+0x1331cb)
    #6 kudu::server::ServerBase::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1003:23 (libserver_process.so+0x142feb)
    #7 kudu::kserver::KuduServer::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:144:3 (libkserver.so+0x13181)
    #8 kudu::tserver::TabletServer::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:106:3 (libtserver.so+0x255b62)
    #9 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:106:3 (libtserver.so+0x3120bb)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #11 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #12 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #13 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #14 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #15 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #16 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #17 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #18 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #19 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #20 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #21 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #22 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #23 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #24 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #25 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Thread T57 'diag-logger-907' (tid=9071, running) created by main thread at:
    #0 pthread_create /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966:3 (auto_leader_rebalancer-test+0x29f4e2)
    #1 kudu::Thread::StartThread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, unsigned long, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:638:15 (libkudu_util.so+0x43d62a)
    #2 kudu::Thread::Create(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.h:146:12 (libmaster.so+0x2d3a39)
    #3 kudu::server::DiagnosticsLog::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/diagnostics_log.cc:144:14 (libserver_process.so+0x1167ed)
    #4 kudu::server::ServerBase::StartMetricsLogging() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1185:3 (libserver_process.so+0x145294)
    #5 kudu::server::ServerBase::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1324:3 (libserver_process.so+0x145b34)
    #6 kudu::kserver::KuduServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13b10)
    #7 kudu::tserver::TabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:160:3 (libtserver.so+0x2563a7)
    #8 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x3120f9)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #11 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #12 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #13 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #14 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #15 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #16 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #17 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #18 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #19 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #20 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #21 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #22 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #23 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #24 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

SUMMARY: ThreadSanitizer: data race /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:109:7 in kudu::DiagnosticSocket::Close()
==================
W20260925 16:47:09.101786  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.102504  9666 connection.cc:698] client connection to 127.7.158.194:45245 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260925 16:47:09.721315  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:09.731164 18608 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.731820 18608 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.734932 18608 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:09.758816  9666 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111) [suppressed 435 similar messages]
W20260925 16:47:09.764148  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:09.764734  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:09.765223  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.777781  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.780475 18609 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.780890 18605 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.781032 18609 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.781417 18605 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.783327 18609 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.784083 18605 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:09.787673 18592 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.787921 18610 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.789192 18592 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.790050 18610 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.791356 18592 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.792773 18610 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:09.795737  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:47:09.796419  9666 leader_election.cc:334] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.797132 18614 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.797638 18614 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.799871 18614 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:09.804932  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.805389  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.822000 18610 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260925 16:47:09.827736  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:09.834661  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:09.835201  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:09.835677  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:09.837203  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.837626  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.838474 18618 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260925 16:47:09.839391  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.839794  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.840534 18618 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:47:09.841202  9089 leader_election.cc:334] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.841660  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.842026  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.842694 18618 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:47:09.845386  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:09.848505  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:09.849174  9123 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
W20260925 16:47:09.862737  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:09.863560  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.864593 18603 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:47:09.864960 18603 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.865274 18603 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:47:09.865727  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:47:09.868163 18598 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.868757 18598 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.871560 18598 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:09.875887  9666 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.900892  8859 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104783us
W20260925 16:47:09.910470  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.915233 18603 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.918838  9702 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:47:09.920153 18603 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.922143 18614 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.922988 18614 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:09.928118  9666 leader_election.cc:334] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.930932 18603 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.932255 18603 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.937290 18592 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.938308 18592 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.939643 18598 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.941152 18592 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.941265  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:47:09.942139  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.942513 18598 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.943228 18618 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.943364  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:47:09.944335  9119 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:47:09.944183 18618 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.945034 18603 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.946875  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:47:09.952740  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.947001 18618 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:09.954582  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:09.956382  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.957059 18601 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:09.957985  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:47:09.958655  9696 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:47:09.954603 18614 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.946997 18598 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:09.961925  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.962513  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.963418 18598 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:09.963572  9666 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.964138  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.965075  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.965668  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.966610 18598 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:47:09.968370  9090 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.972656 18614 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:47:09.973160 18614 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.973625 18614 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:47:09.979151 18603 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.980034 18603 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.986284 18598 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.987054 18598 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:09.987890  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.989899 18598 leader_election.cc:288] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.990724 18618 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.970324  9119 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:47:09.991439 18618 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.992337 18607 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:09.992735  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:09.993697 18618 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.991683  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:09.995215  9123 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:47:09.996433  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.997161 18603 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.997712 18603 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:47:09.998287 18603 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:47:09.998124 18614 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.002313 18614 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:10.004101  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:47:10.004856  9696 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:47:10.004259  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.009212  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:10.010192  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.010704  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.011420 18598 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:47:10.003216  9121 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:47:10.011574  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.014885  9665 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.018896 18614 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:10.019495  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.020871  9666 leader_election.cc:302] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.018959 18603 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.018309  9696 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:47:10.022565 18598 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:47:10.023910 18598 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:10.025215  9090 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:47:10.026099  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.026858 18614 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:47:10.027765 18614 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:47:10.029474  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.030027  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.030932 18607 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:10.030094 18614 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:10.032960  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.044116  8869 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 25 to 26, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 26 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:47:10.066047 18614 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.066354 18607 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.066979 18614 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.067167 18607 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.069633 18607 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:10.072786  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:47:10.082408 18601 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:47:10.082701  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.082083  8867 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 21, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:10.083101 18601 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:10.084324  9089 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.084749  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:47:10.085691 18607 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:47:10.086094 18614 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.090154  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.090827  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.091192 18603 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.091784 18614 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:10.091879 18603 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.085917 18601 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.094478  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.096671 18603 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.096784  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.097270  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.097393 18614 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.098366 18607 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.098147 18614 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.099162 18607 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.100574 18618 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.101435 18603 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:47:10.101179 18618 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:10.106657  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.107415 18614 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.109015 18618 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.109751 18607 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.112882  7803 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 9071)
W20260925 16:47:10.118468  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:10.119495  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.121893 18607 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.122571 18607 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:10.121912  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.125053 18607 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.121475  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.125013  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:10.126415  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:10.126869  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.127044 18618 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:10.127539  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.128007  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.127938 18603 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:10.129004  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.129403  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.130611 18614 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:47:10.130609 18618 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:47:10.141758  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:10.143277  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.143684  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:10.144032  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:10.144433 18618 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:10.161139 18601 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.161839 18601 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.164780 18601 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:10.166050  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:10.166725  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:47:10.167549  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:47:10.168280 18601 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:47:10.168625 18601 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.168932 18601 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
W20260925 16:47:10.170076  9666 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.178059 18601 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.180845 18601 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:10.181535  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:47:10.182104  9123 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
W20260925 16:47:10.185293  9666 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.189816  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:47:10.191195  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.194350 18603 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:47:10.194792 18603 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:47:10.196003 18603 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.211951  8867 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 27 to 28, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:47:10.234000 18614 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.234562 18614 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.236603 18614 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.247874 18618 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.248430 18618 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.250428 18618 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:47:10.247596  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.251407  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:47:10.251914  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.252312  9696 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:47:10.252327  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.253983 18618 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:10.254779  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:47:10.256348 18618 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:47:10.256748 18618 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.257102 18618 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:47:10.274399 18618 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.277525  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:47:10.278110  9696 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:47:10.284745  9089 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.287684  9696 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:47:10.288748  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:47:10.290007 18618 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:10.290577 18618 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:47:10.291071 18618 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:47:10.294927 18618 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:10.296949  9089 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.300940 18607 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.301528 18607 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.303366 18607 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.314658  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:10.315311  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.315686  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.316504 18607 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:10.340427 18592 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.341055 18592 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.343259 18592 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.354169  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.355763 18618 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.358829 18618 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:10.361756  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.364017  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.364826 18603 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260925 16:47:10.363169  8867 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 23 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:10.365935 18618 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.381464  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:10.382165  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.382575  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.383235 18618 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:47:10.424098  9666 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:10.437636  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:10.561348  9089 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:10.632289  9121 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:47:10.633805 18592 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260925 16:47:10.634842  9702 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:47:10.636279 18618 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260925 16:47:10.713965  9666 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:10.724586  9121 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260925 16:47:10.726385 18603 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260925 16:47:10.801349  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:10.806766  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003a61e0 after lost signal to thread 7806
W20260925 16:47:10.808274  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08001eeec0 after lost signal to thread 8907
W20260925 16:47:10.809904  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003786a0 after lost signal to thread 9148
W20260925 16:47:10.811033  9145 debug-util.cc:398] Leaking SignalData structure 0x7b080043ff00 after lost signal to thread 9726
W20260925 16:47:10.838181  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:10.850757  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:10.883798  9666 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:10.924000  9089 consensus_peers.cc:487] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:10.925452  9702 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:47:10.927734 18614 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260925 16:47:10.937126  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:11.055939  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:11.058575  9666 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.065871  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.104087  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.113406  7803 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 9071)
W20260925 16:47:11.122695  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.172677  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:11.230170  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:11.232715  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.254878  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.256482  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.285049  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.306874  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.314811  9666 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.321693  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.330442  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.432561  9666 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.439026  9666 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.449746  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260925 16:47:11.495159 18603 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.495759 18603 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:11.497928 18603 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.515261  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:11.517285  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:11.519160  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.532491 18603 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:11.540307  9666 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.544778  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:11.546025 18618 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.546492 18618 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.548100 18618 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.551754  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.552428  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.552832  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.553619 18618 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:47:11.576864  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:11.601822  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:11.610680  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:11.718940 18618 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.719503 18618 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.721333 18618 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.730401  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:11.731094  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:11.731511  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.734989 18618 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260925 16:47:11.737747  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.738348  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.747332  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:11.798269 18618 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.798815 18618 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.800864 18618 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:11.809101 18607 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.809688 18607 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.811822 18607 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.819928  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.824064  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:11.825726  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.826213  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.827059 18618 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:11.833477  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.835738  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.836126  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.837612 18638 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:47:11.851295  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260925 16:47:11.863571 18638 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.864316 18638 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.866559 18638 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:11.873481 18603 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.874020 18603 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:11.876016 18603 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.883131  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.883853  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.884279  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.885293 18603 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:11.886425  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.887897  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.888304  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.889019 18638 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260925 16:47:11.925076  9089 consensus_peers.cc:487] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.926553  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:11.964921 18638 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.965570 18638 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.967752 18638 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:11.970003 18603 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.970556 18603 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:11.973572 18603 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.978027  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:11.994457  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:11.995817  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.006042  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.010015  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.016180 18638 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:47:12.012545  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:12.019351  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:12.024780 18607 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:47:12.024962  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:12.025365  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.025324 18607 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.026150 18603 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:12.027681  9666 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:12.042275 18618 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.045728 18607 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:12.049297 18618 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.058674 18607 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.059312 18607 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.061496 18607 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:12.058310 18618 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.068516  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:12.069142  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.072155  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.072582  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.075217 18618 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:12.082644  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.083210  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.083801  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.084189  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.084904 18618 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:47:12.085836  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.086272  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.087072 18618 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:12.087874  9089 consensus_peers.cc:487] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:12.096834  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:12.129994 18637 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.130601 18637 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.134239  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:12.134886  9124 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:47:12.140311 18603 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.140799 18603 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.143004 18603 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.143913  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.145687 18637 leader_election.cc:288] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:12.147868  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.197580 18637 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.198199 18637 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.202293 18637 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.207054  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:12.215919  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260925 16:47:12.282541 18618 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.283064 18618 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.284919 18618 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.302913  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.303488  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.303830  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.304489 18607 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:12.360782 18607 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.361258 18607 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.363029 18607 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.367658  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.368371  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.368721  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.370386 18607 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:12.423604 18603 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.424160 18603 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.426214 18603 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.433261  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:12.442950  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.485697 18607 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.486217 18607 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.488094 18607 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.494194  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.495220  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.495579  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.498643 18607 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:12.571866  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:47:12.616132 18607 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.616657 18607 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.618835 18607 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.624462  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.633040  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.633530  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.634232 18607 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:12.714257  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
W20260925 16:47:12.721733  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.722119  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.734726  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.735030  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.744271  9665 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:12.755115  9665 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:12.776046  9665 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.788862  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:12.789978  7803 tablet_replica.cc:330] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.790716  7803 raft_consensus.cc:2229] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.791235  7803 raft_consensus.cc:2258] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.793846  7803 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.794705  7803 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.795177  7803 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.797784  7803 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.798609  7803 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.799350  7803 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.801776  7803 tablet_replica.cc:330] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.802469  7803 raft_consensus.cc:2229] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.803563  7803 raft_consensus.cc:2258] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.806366  7803 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.807088  7803 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.807837  7803 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.810191  7803 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.811040  7803 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.812132  7803 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.814532  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.815302  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.816443  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.818553  7803 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.819077  7803 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.819836  7803 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.821990  7803 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.822636  7803 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.823254  7803 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.825870  7803 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.826423  7803 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.827059  7803 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.831360  7803 tablet_replica.cc:330] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.832031  7803 raft_consensus.cc:2229] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:12.832333  9666 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:12.833014  7803 raft_consensus.cc:2258] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.835947  9665 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.837165  7803 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.837895  7803 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.838477  7803 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.840816  7803 tablet_replica.cc:330] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.841398  7803 raft_consensus.cc:2229] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.842151  7803 raft_consensus.cc:2258] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.844615  7803 tablet_replica.cc:330] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.845359  7803 raft_consensus.cc:2229] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.846067  7803 raft_consensus.cc:2258] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.848538  7803 tablet_replica.cc:330] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.849291  7803 raft_consensus.cc:2229] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.850381  7803 raft_consensus.cc:2258] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.852334  7803 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.852913  7803 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.853832  7803 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.855743  7803 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.856259  7803 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.857020  7803 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.858880  7803 tablet_replica.cc:330] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.859417  7803 raft_consensus.cc:2229] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.859922  7803 raft_consensus.cc:2258] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.861845  7803 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.862360  7803 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.862787  7803 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.864549  7803 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.865058  7803 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.866006  7803 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.867978  7803 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.868459  7803 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.869170  7803 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.871618  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.872217  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:12.872265  9665 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.873711  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.876425  7803 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.877110  7803 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.877951  7803 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.880458  7803 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.880945  7803 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.881966  7803 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.885406  7803 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.886116  7803 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Raft consensus shutting down.
W20260925 16:47:12.886319  9665 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.887223  7803 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.889705  7803 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.890342  7803 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.891345  7803 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.893735  7803 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.894374  7803 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.895448  7803 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.897862  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.898500  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.899919  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.900085  9665 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.902107  7803 tablet_replica.cc:330] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.902949  7803 raft_consensus.cc:2229] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.903445  7803 raft_consensus.cc:2258] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.905827  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.906538  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.908257  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.910888  7803 tablet_replica.cc:330] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.911652  7803 raft_consensus.cc:2229] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.912448  7803 raft_consensus.cc:2258] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.915004  7803 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.915642  7803 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.916324  7803 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.918587  7803 tablet_replica.cc:330] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.919248  7803 raft_consensus.cc:2229] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.919767  7803 raft_consensus.cc:2258] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.922262  7803 tablet_replica.cc:330] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.922922  7803 raft_consensus.cc:2229] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.923612  7803 raft_consensus.cc:2258] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.925872  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.926574  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.927628  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.929981  7803 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.930640  7803 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.931651  7803 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.933995  7803 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.934630  7803 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.935624  7803 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.937915  7803 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.938632  7803 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.939220  7803 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.941428  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.942097  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.944061  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.946538  7803 tablet_replica.cc:330] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.947190  7803 raft_consensus.cc:2229] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.947765  7803 raft_consensus.cc:2258] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.950042  7803 tablet_replica.cc:330] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.950767  7803 raft_consensus.cc:2229] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.951412  7803 raft_consensus.cc:2258] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.953823  7803 tablet_replica.cc:330] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.954408  7803 raft_consensus.cc:2229] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.954965  7803 raft_consensus.cc:2258] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.956641  9665 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.957327  7803 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
W20260925 16:47:12.957520  9665 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.958218  7803 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.959839  7803 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.960696  9665 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.962349  7803 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.963007  7803 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.963505  7803 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.965835  7803 tablet_replica.cc:330] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.966426  7803 raft_consensus.cc:2229] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.967031  7803 raft_consensus.cc:2258] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.998648  9665 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.039016  9665 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.086069  9665 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.138885  9665 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.157887  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.158360  9666 leader_election.cc:302] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.159061 18637 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:47:13.159384  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.159900  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.160516 18637 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:13.160804  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.161264  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.161886 18637 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:13.162312  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.163093  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.163398  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.164012 18637 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260925 16:47:13.164331  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.246841  9665 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.300647  9666 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:13.350050  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:13.392684  9666 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.397997  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.540997  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.551671  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.561851  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.605515  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.647568  9666 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.698015  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:13.750305  9666 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:13.751686 18637 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:13.752171 18637 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.753870 18637 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:13.758191  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:13.758651  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:13.758953  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.759508 18637 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:13.775764  9666 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:13.789054 18637 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.789573 18637 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.795042 18637 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.795485  9665 leader_election.cc:334] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.797003  9666 leader_election.cc:334] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:13.797439  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.798139 18637 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260925 16:47:13.820564  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.821506  8921 auto_rebalancer.cc:254] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.826228  8921 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.826519  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.830880  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet cdef8e15863049f59c35fc47250d99ee, TS 8dc3391062084f45a6ba62d28d340722 -> TS 225d3432101a4758bb9a6b0efeae09c5 move failed, destination replica disappeared from tablet's Raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:13.831182  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet cdef8e15863049f59c35fc47250d99ee, TS 8dc3391062084f45a6ba62d28d340722 -> TS 225d3432101a4758bb9a6b0efeae09c5 move failed, destination replica disappeared from tablet's Raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:13.883737  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.921000  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:13.940241 18637 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.940922 18637 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.943580 18637 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.946265  9665 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.946970  9666 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.947283  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:47:13.947825 18637 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:13.955842 18637 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.956284 18637 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.958122 18637 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.962448  9665 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
I20260925 16:47:13.963037 18637 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.963935  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:47:13.963587 18637 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.965256 18637 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.967674  9666 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:13.968298  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.969033 18642 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:47:13.969646  9665 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
I20260925 16:47:13.969748 18642 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:47:13.971038  9666 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.970676 18642 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.971580  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:47:13.972563 18637 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:47:13.973590 18642 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.977212  9665 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.978418  9666 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.978801  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:47:13.979429 18637 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:47:13.984300  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260925 16:47:14.048034  7803 tablet_server.cc:178] TabletServer@127.7.158.196:0 shutting down...
W20260925 16:47:14.053243  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:14.057370  9666 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:14.057529 18642 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:14.058103 18642 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:14.059700 18642 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:14.063004  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:14.063630  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:14.064065  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:14.064815 18637 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:47:14.095429  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:14.096437  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.097515  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.098215  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.100540  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.101140  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.101778  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.103940  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.104485  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.105226  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.107326  7803 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.107904  7803 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.108824  7803 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:14.110867  9666 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:14.111151  7803 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.111850  7803 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.112352  7803 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.114219  7803 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.114768  7803 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.115504  7803 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.117295  7803 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.117832  7803 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.118633  7803 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.120590  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.121141  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.121569 18637 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:14.121822  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.122078 18637 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:14.123867 18637 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:14.124478  7803 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.125336  7803 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.126420  7803 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:14.127439  9665 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:14.127929  9666 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:14.128270  9666 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:14.128820 18637 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:14.128990  7803 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.129720  7803 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.130467  7803 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.132458  7803 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.132946  7803 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.133340  7803 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.135103  7803 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.135743  7803 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.136243  7803 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.138082  7803 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.138604  7803 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.139025  7803 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.140770  7803 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.141336  7803 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.142192  7803 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.144070  7803 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.144616  7803 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.145417  7803 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.147840  7803 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.148619  7803 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.149222  7803 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.151285  7803 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.151867  7803 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.152642  7803 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.154371  7803 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.154860  7803 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.155373  7803 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.157529  7803 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.158140  7803 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.158672  7803 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.160650  7803 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.161154  7803 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.161726  7803 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.164290  7803 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.164878  7803 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.165966  7803 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.168503  7803 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.169090  7803 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.169534  7803 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.171317  7803 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.171876  7803 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.172730  7803 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.174476  7803 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.174985  7803 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.175793  7803 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.177629  7803 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.178138  7803 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.178880  7803 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.180761  7803 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.181267  7803 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.181679  7803 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.183470  7803 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.184005  7803 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.184681  7803 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.186484  7803 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.186931  7803 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.187587  7803 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.189822  7803 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.190531  7803 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.191448  7803 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.193287  7803 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.193784  7803 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.194595  7803 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.196358  7803 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.196822  7803 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.197536  7803 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.199224  7803 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.199771  7803 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.200480  7803 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.202201  7803 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.202664  7803 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.203068  7803 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.204999  7803 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.205013 18637 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:14.205595  7803 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.205586 18637 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:14.206270  7803 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.207655 18637 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:14.209547  7803 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.210101  7803 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.210685  7803 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:14.211254  9665 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
I20260925 16:47:14.212929  7803 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
W20260925 16:47:14.213253  9666 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:14.213590  7803 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.213826  9666 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:14.214229  7803 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.214504 18637 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:47:14.214643  9666 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:14.216257  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.216833  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.217374  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.219264  7803 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.219785  7803 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.220202  7803 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.221897  7803 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.222368  7803 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.223176  7803 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.225046  7803 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.225570  7803 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.226224  7803 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.228112  7803 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.228576  7803 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.229327  7803 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.231199  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.231742  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.232236  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.234064  7803 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.234519  7803 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.235368  7803 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.237066  7803 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.237491  7803 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.238200  7803 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.570350  7803 tablet_server.cc:194] TabletServer@127.7.158.196:0 shutdown complete.
I20260925 16:47:14.633877  7803 master.cc:537] Master@127.7.158.254:39187 shutting down...
W20260925 16:47:26.343786  8859 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 554 similar messages]
W20260925 16:47:26.346998  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:27.968436  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:30.130761  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:31.671859  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:31.673975  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:31.674378  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: stopping tablet replica
I20260925 16:47:31.862498  7803 master.cc:552] Master@127.7.158.254:39187 shutdown complete.
I20260925 16:47:31.919056  7803 test_util.cc:175] -----------------------------------------------
I20260925 16:47:31.919247  7803 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0

FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1: /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:596: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20260925 16:48:44.364614  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
W20260925 16:48:44.394400 20658 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260925 16:48:44.402277 20658 consensus_peers.cc:487] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:44.403996 20732 consensus_peers.cc:487] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.414422  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:44.415400  7803 tablet_replica.cc:330] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.416392  7803 raft_consensus.cc:2229] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.417172  7803 raft_consensus.cc:2258] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.420598  7803 tablet_replica.cc:330] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.421243  7803 raft_consensus.cc:2229] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.422242  7803 raft_consensus.cc:2258] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.425303  7803 tablet_replica.cc:330] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.426232  7803 raft_consensus.cc:2229] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.427372  7803 raft_consensus.cc:2258] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.431447  7803 tablet_replica.cc:330] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.433866  7803 raft_consensus.cc:2229] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.436408  7803 raft_consensus.cc:2258] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.438308 20658 consensus_peers.cc:487] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:44.440590 20732 consensus_peers.cc:487] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.440713  7803 tablet_replica.cc:330] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.441936  7803 raft_consensus.cc:2229] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.442760  7803 raft_consensus.cc:2258] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.445351 20658 consensus_peers.cc:487] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.446405  7803 tablet_replica.cc:330] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.447070  7803 raft_consensus.cc:2229] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.447898  7803 raft_consensus.cc:2258] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.450592  7803 tablet_replica.cc:330] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.451216  7803 raft_consensus.cc:2229] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.452103  7803 raft_consensus.cc:2258] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.454972  7803 tablet_replica.cc:330] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.455754  7803 raft_consensus.cc:2229] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260925 16:48:44.455842 20658 consensus_peers.cc:487] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.456482  7803 raft_consensus.cc:2258] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.459124  7803 tablet_replica.cc:330] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.459951  7803 raft_consensus.cc:2229] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.460654  7803 raft_consensus.cc:2258] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.461867 20732 consensus_peers.cc:487] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.463860  7803 tablet_replica.cc:330] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.464461  7803 raft_consensus.cc:2229] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.465284  7803 raft_consensus.cc:2258] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.467789  7803 tablet_replica.cc:330] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.468552  7803 raft_consensus.cc:2229] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.469630  7803 raft_consensus.cc:2258] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.472280  7803 tablet_replica.cc:330] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.472903  7803 raft_consensus.cc:2229] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.473363  7803 raft_consensus.cc:2258] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.475867  7803 tablet_replica.cc:330] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.476750  7803 raft_consensus.cc:2229] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.477703  7803 raft_consensus.cc:2258] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.480345  7803 tablet_replica.cc:330] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.480937  7803 raft_consensus.cc:2229] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.481643  7803 raft_consensus.cc:2258] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.483884 20658 consensus_peers.cc:487] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.484807  7803 tablet_replica.cc:330] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.485489  7803 raft_consensus.cc:2229] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.486109  7803 raft_consensus.cc:2258] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.488792  7803 tablet_replica.cc:330] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.489341  7803 raft_consensus.cc:2229] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.489884  7803 raft_consensus.cc:2258] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.492328  7803 tablet_replica.cc:330] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.492882  7803 raft_consensus.cc:2229] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.493363  7803 raft_consensus.cc:2258] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.495915  7803 tablet_replica.cc:330] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.496444  7803 raft_consensus.cc:2229] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.496927  7803 raft_consensus.cc:2258] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.547803  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
I20260925 16:48:44.595155  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:48:44.606195 20732 consensus_peers.cc:487] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:44.625967 20658 consensus_peers.cc:487] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.631037  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:44.631850  7803 tablet_replica.cc:330] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.632854  7803 raft_consensus.cc:2229] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.633615  7803 raft_consensus.cc:2258] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.637188  7803 tablet_replica.cc:330] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
W20260925 16:48:44.637404 20733 consensus_peers.cc:487] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f -> Peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Couldn't send request to peer cdd45a4da6b84bd1a3f73af6485ec02f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.637881  7803 raft_consensus.cc:2229] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.638854  7803 raft_consensus.cc:2258] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.641270  7803 tablet_replica.cc:330] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.641837  7803 raft_consensus.cc:2229] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.642767  7803 raft_consensus.cc:2258] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.645032  7803 tablet_replica.cc:330] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.645673  7803 raft_consensus.cc:2229] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.646559  7803 raft_consensus.cc:2258] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.648936  7803 tablet_replica.cc:330] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.649520  7803 raft_consensus.cc:2229] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.650349  7803 raft_consensus.cc:2258] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.652496  7803 tablet_replica.cc:330] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.653112  7803 raft_consensus.cc:2229] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.653613  7803 raft_consensus.cc:2258] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.655817  7803 tablet_replica.cc:330] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.656358  7803 raft_consensus.cc:2229] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.656920  7803 raft_consensus.cc:2258] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.659066  7803 tablet_replica.cc:330] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.659584  7803 raft_consensus.cc:2229] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.660142  7803 raft_consensus.cc:2258] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.662216  7803 tablet_replica.cc:330] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.662739  7803 raft_consensus.cc:2229] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.663612  7803 raft_consensus.cc:2258] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.665879  7803 tablet_replica.cc:330] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.666401  7803 raft_consensus.cc:2229] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.667263  7803 raft_consensus.cc:2258] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.669661  7803 tablet_replica.cc:330] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.670200  7803 raft_consensus.cc:2229] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.671049  7803 raft_consensus.cc:2258] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.673223  7803 tablet_replica.cc:330] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.673942  7803 raft_consensus.cc:2229] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.674373  7803 raft_consensus.cc:2258] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.676734  7803 tablet_replica.cc:330] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.677284  7803 raft_consensus.cc:2229] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.677731  7803 raft_consensus.cc:2258] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.679787  7803 tablet_replica.cc:330] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.680246  7803 raft_consensus.cc:2229] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.680647  7803 raft_consensus.cc:2258] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.682552  7803 tablet_replica.cc:330] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.682998  7803 raft_consensus.cc:2229] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.683449  7803 raft_consensus.cc:2258] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.685478  7803 tablet_replica.cc:330] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.686026  7803 raft_consensus.cc:2229] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.687000  7803 raft_consensus.cc:2258] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.689324  7803 tablet_replica.cc:330] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.689837  7803 raft_consensus.cc:2229] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.690237  7803 raft_consensus.cc:2258] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.692298  7803 tablet_replica.cc:330] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.692829  7803 raft_consensus.cc:2229] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.693286  7803 raft_consensus.cc:2258] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.737293  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:48:44.775091  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
I20260925 16:48:44.809592  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:44.810361  7803 tablet_replica.cc:330] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.811149  7803 raft_consensus.cc:2229] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.811955  7803 raft_consensus.cc:2258] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.814419  7803 tablet_replica.cc:330] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.815029  7803 raft_consensus.cc:2229] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.815586  7803 raft_consensus.cc:2258] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.817827  7803 tablet_replica.cc:330] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.818352  7803 raft_consensus.cc:2229] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.818861  7803 raft_consensus.cc:2258] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.820982  7803 tablet_replica.cc:330] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.821569  7803 raft_consensus.cc:2229] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.822041  7803 raft_consensus.cc:2258] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.824124  7803 tablet_replica.cc:330] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.824667  7803 raft_consensus.cc:2229] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.825493  7803 raft_consensus.cc:2258] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.827426  7803 tablet_replica.cc:330] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.828027  7803 raft_consensus.cc:2229] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.828531  7803 raft_consensus.cc:2258] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.830513  7803 tablet_replica.cc:330] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.831044  7803 raft_consensus.cc:2229] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.831548  7803 raft_consensus.cc:2258] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.833638  7803 tablet_replica.cc:330] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.834141  7803 raft_consensus.cc:2229] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.834805  7803 raft_consensus.cc:2258] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.837015  7803 tablet_replica.cc:330] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.837551  7803 raft_consensus.cc:2229] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.837931  7803 raft_consensus.cc:2258] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.839938  7803 tablet_replica.cc:330] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.840389  7803 raft_consensus.cc:2229] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.841166  7803 raft_consensus.cc:2258] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.843119  7803 tablet_replica.cc:330] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.843613  7803 raft_consensus.cc:2229] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.844067  7803 raft_consensus.cc:2258] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.845880  7803 tablet_replica.cc:330] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.846307  7803 raft_consensus.cc:2229] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.847098  7803 raft_consensus.cc:2258] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.849150  7803 tablet_replica.cc:330] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.849639  7803 raft_consensus.cc:2229] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.850059  7803 raft_consensus.cc:2258] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.851994  7803 tablet_replica.cc:330] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.852442  7803 raft_consensus.cc:2229] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.853184  7803 raft_consensus.cc:2258] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.855293  7803 tablet_replica.cc:330] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.855798  7803 raft_consensus.cc:2229] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.856194  7803 raft_consensus.cc:2258] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.858039  7803 tablet_replica.cc:330] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.858470  7803 raft_consensus.cc:2229] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.858894  7803 raft_consensus.cc:2258] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.860852  7803 tablet_replica.cc:330] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.861243  7803 raft_consensus.cc:2229] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.861613  7803 raft_consensus.cc:2258] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.863432  7803 tablet_replica.cc:330] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.863843  7803 raft_consensus.cc:2229] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.864274  7803 raft_consensus.cc:2258] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.906908  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:48:44.947517  7803 master.cc:537] Master@127.7.158.254:33515 shutting down...
I20260925 16:48:44.970469  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.971091  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.971429  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: stopping tablet replica
I20260925 16:48:44.991104  7803 master.cc:552] Master@127.7.158.254:33515 shutdown complete.
I20260925 16:48:45.027029  7803 test_util.cc:175] -----------------------------------------------
I20260925 16:48:45.027245  7803 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0

[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260925 16:41:15.092502  7803 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.158.254:39379
I20260925 16:41:15.093832  7803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260925 16:41:15.094851  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:15.115123  7812 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:15.115319  7809 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:15.116106  7803 server_base.cc:1034] running on GCE node
W20260925 16:41:15.115114  7810 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:16.314651  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:16.314894  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:16.315037  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354476315025 us; error 0 us; skew 500 ppm
I20260925 16:41:16.315918  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:16.325848  7803 webserver.cc:460] Webserver started at http://127.7.158.254:46001/ using document root <none> and password file <none>
I20260925 16:41:16.326689  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:16.326886  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:16.327287  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:16.333534  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/master-0-root/instance:
uuid: "afdf4f6022df42a08a7e1bfe92fe2827"
format_stamp: "Formatted at 2026-09-25 16:41:16 on dist-test-slave-fknp"
I20260925 16:41:16.341645  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.005s	sys 0.004s
I20260925 16:41:16.346644  7818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:16.347859  7803 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.000s
I20260925 16:41:16.348176  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/master-0-root
uuid: "afdf4f6022df42a08a7e1bfe92fe2827"
format_stamp: "Formatted at 2026-09-25 16:41:16 on dist-test-slave-fknp"
I20260925 16:41:16.348477  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:16.404981  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:16.406785  7803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260925 16:41:16.407188  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:16.487044  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.254:39379
I20260925 16:41:16.487152  7869 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.254:39379 every 8 connection(s)
I20260925 16:41:16.494381  7870 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:16.520840  7870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827: Bootstrap starting.
I20260925 16:41:16.527275  7870 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:16.529263  7870 log.cc:824] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827: Log is configured to *not* fsync() on all Append() calls
I20260925 16:41:16.534246  7870 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827: No bootstrap required, opened a new log
I20260925 16:41:16.559037  7870 raft_consensus.cc:348] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" member_type: VOTER }
I20260925 16:41:16.559588  7870 raft_consensus.cc:374] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:16.559803  7870 raft_consensus.cc:729] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: afdf4f6022df42a08a7e1bfe92fe2827, State: Initialized, Role: FOLLOWER
I20260925 16:41:16.560658  7870 consensus_queue.cc:260] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" member_type: VOTER }
I20260925 16:41:16.561110  7870 raft_consensus.cc:388] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 16:41:16.561350  7870 raft_consensus.cc:482] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 16:41:16.561615  7870 raft_consensus.cc:3037] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:16.565750  7870 raft_consensus.cc:504] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" member_type: VOTER }
I20260925 16:41:16.566367  7870 leader_election.cc:302] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: afdf4f6022df42a08a7e1bfe92fe2827; no voters: 
I20260925 16:41:16.567953  7870 leader_election.cc:288] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260925 16:41:16.568373  7873 raft_consensus.cc:2781] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:16.571542  7873 raft_consensus.cc:686] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 1 LEADER]: Becoming Leader. State: Replica: afdf4f6022df42a08a7e1bfe92fe2827, State: Running, Role: LEADER
I20260925 16:41:16.572468  7873 consensus_queue.cc:237] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" member_type: VOTER }
I20260925 16:41:16.573544  7870 sys_catalog.cc:564] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 16:41:16.585568  7874 sys_catalog.cc:455] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [sys.catalog]: SysCatalogTable state changed. Reason: New leader afdf4f6022df42a08a7e1bfe92fe2827. Latest consensus state: current_term: 1 leader_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" member_type: VOTER } }
I20260925 16:41:16.585477  7875 sys_catalog.cc:455] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "afdf4f6022df42a08a7e1bfe92fe2827" member_type: VOTER } }
I20260925 16:41:16.586334  7875 sys_catalog.cc:458] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [sys.catalog]: This master's current role is: LEADER
I20260925 16:41:16.586326  7874 sys_catalog.cc:458] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [sys.catalog]: This master's current role is: LEADER
I20260925 16:41:16.589167  7883 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 16:41:16.600965  7883 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 16:41:16.603217  7803 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260925 16:41:16.619454  7883 catalog_manager.cc:1347] Generated new cluster ID: dd78194a21924c81bad762ab6c476ae2
I20260925 16:41:16.619768  7883 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 16:41:16.652550  7883 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 16:41:16.655191  7883 catalog_manager.cc:1504] Loading token signing keys...
I20260925 16:41:16.669494  7883 catalog_manager.cc:5868] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827: Generated new TSK 0
I20260925 16:41:16.670473  7883 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 16:41:16.734979  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:16.746053  7892 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:16.748719  7893 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:16.755686  7895 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:16.756707  7803 server_base.cc:1034] running on GCE node
I20260925 16:41:16.757575  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:16.757838  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:16.758033  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354476758018 us; error 0 us; skew 500 ppm
I20260925 16:41:16.758792  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:16.763132  7803 webserver.cc:460] Webserver started at http://127.7.158.193:40423/ using document root <none> and password file <none>
I20260925 16:41:16.763824  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:16.764074  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:16.764403  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:16.765991  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-0-root/instance:
uuid: "c84c24d7432b4c5199e5279df1ede07f"
format_stamp: "Formatted at 2026-09-25 16:41:16 on dist-test-slave-fknp"
I20260925 16:41:16.773223  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:41:16.778203  7900 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:16.779069  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260925 16:41:16.779402  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "c84c24d7432b4c5199e5279df1ede07f"
format_stamp: "Formatted at 2026-09-25 16:41:16 on dist-test-slave-fknp"
I20260925 16:41:16.779781  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:16.801342  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:16.802917  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:16.805570  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:41:16.811297  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:41:16.811579  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:16.811900  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:41:16.812124  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:16.909060  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:42361
I20260925 16:41:16.909126  7962 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:42361 every 8 connection(s)
I20260925 16:41:16.917152  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:16.926394  7967 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:16.929597  7968 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:16.938197  7970 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:16.943194  7803 server_base.cc:1034] running on GCE node
I20260925 16:41:16.944258  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:16.944521  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:16.944727  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354476944710 us; error 0 us; skew 500 ppm
I20260925 16:41:16.945456  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:16.947918  7963 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39379
I20260925 16:41:16.948379  7963 heartbeater.cc:464] Registering TS with master...
I20260925 16:41:16.949380  7803 webserver.cc:460] Webserver started at http://127.7.158.194:36741/ using document root <none> and password file <none>
I20260925 16:41:16.949873  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:16.950079  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:16.950024  7963 heartbeater.cc:511] Master 127.7.158.254:39379 requested a full tablet report, sending...
I20260925 16:41:16.950446  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:16.951606  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-1-root/instance:
uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
format_stamp: "Formatted at 2026-09-25 16:41:16 on dist-test-slave-fknp"
I20260925 16:41:16.953621  7835 ts_manager.cc:194] Registered new tserver with Master: c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361)
I20260925 16:41:16.956822  7835 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48288
I20260925 16:41:16.957834  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.002s
I20260925 16:41:16.963172  7975 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.001s	user 0.000s	sys 0.000s
I20260925 16:41:16.964062  7803 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.002s	sys 0.001s
I20260925 16:41:16.964334  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-1-root
uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
format_stamp: "Formatted at 2026-09-25 16:41:16 on dist-test-slave-fknp"
I20260925 16:41:16.964574  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:16.988483  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:16.989705  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:16.992301  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:41:16.995976  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:41:16.996146  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:16.996377  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:41:16.996508  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:17.104738  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.194:36681
I20260925 16:41:17.104807  8037 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.194:36681 every 8 connection(s)
I20260925 16:41:17.113092  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:17.123864  8042 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:17.124393  8041 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:17.131377  8038 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39379
I20260925 16:41:17.131824  8038 heartbeater.cc:464] Registering TS with master...
I20260925 16:41:17.132784  8038 heartbeater.cc:511] Master 127.7.158.254:39379 requested a full tablet report, sending...
W20260925 16:41:17.132879  8044 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:17.134855  7835 ts_manager.cc:194] Registered new tserver with Master: eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:17.136092  7803 server_base.cc:1034] running on GCE node
I20260925 16:41:17.136940  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260925 16:41:17.136993  7835 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48294
W20260925 16:41:17.137152  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:17.137413  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354477137391 us; error 0 us; skew 500 ppm
I20260925 16:41:17.138123  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:17.141099  7803 webserver.cc:460] Webserver started at http://127.7.158.195:33055/ using document root <none> and password file <none>
I20260925 16:41:17.141628  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:17.141819  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:17.142094  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:17.143090  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-2-root/instance:
uuid: "5bb1ea128eb14737a6bd37572c8fc277"
format_stamp: "Formatted at 2026-09-25 16:41:17 on dist-test-slave-fknp"
I20260925 16:41:17.148000  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260925 16:41:17.151437  8049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:17.152374  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260925 16:41:17.152696  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-2-root
uuid: "5bb1ea128eb14737a6bd37572c8fc277"
format_stamp: "Formatted at 2026-09-25 16:41:17 on dist-test-slave-fknp"
I20260925 16:41:17.153014  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1790354474930402-7803-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:17.172220  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:17.173502  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:17.175635  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:41:17.178159  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:41:17.178339  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:17.178619  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:41:17.178752  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:17.284329  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.195:43999
I20260925 16:41:17.284529  8111 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.195:43999 every 8 connection(s)
I20260925 16:41:17.305222  8112 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39379
I20260925 16:41:17.305624  8112 heartbeater.cc:464] Registering TS with master...
I20260925 16:41:17.306480  8112 heartbeater.cc:511] Master 127.7.158.254:39379 requested a full tablet report, sending...
I20260925 16:41:17.308590  7835 ts_manager.cc:194] Registered new tserver with Master: 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:17.309365  7803 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.017057924s
I20260925 16:41:17.310611  7835 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:48302
I20260925 16:41:17.312955  7803 test_util.cc:268] Using random seed: 1654942630
I20260925 16:41:17.378302  7835 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48316:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:41:17.382402  7835 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:41:17.492309  8077 tablet_service.cc:1467] Processing CreateTablet for tablet 25ad7d21572a4747bf0ed3ef12e17298 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:41:17.494036  8077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ad7d21572a4747bf0ed3ef12e17298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.495654  8071 tablet_service.cc:1467] Processing CreateTablet for tablet 2e833e58421e46a6853b25a01b8f4c22 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:41:17.504506  8072 tablet_service.cc:1467] Processing CreateTablet for tablet 37d399e7636147219d5ac732820d6db1 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:41:17.502244  8076 tablet_service.cc:1467] Processing CreateTablet for tablet ac3eebd810d04ede904996ec2e155b36 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:41:17.507211  8069 tablet_service.cc:1467] Processing CreateTablet for tablet 9d93a2fc10e64345bacd9f34783a4824 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:41:17.504436  8075 tablet_service.cc:1467] Processing CreateTablet for tablet 53f2492fa3a8440a8b1ac90f8d82ab2b (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:41:17.503002  8074 tablet_service.cc:1467] Processing CreateTablet for tablet e350b23835b34ebf8ec454fc59172d64 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:41:17.510326  8071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e833e58421e46a6853b25a01b8f4c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.510594  8073 tablet_service.cc:1467] Processing CreateTablet for tablet 66d4643efd024a70926479d8c6ca279a (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:41:17.511341  8070 tablet_service.cc:1467] Processing CreateTablet for tablet a8eabf5c51c24475aacfa3f5bba75918 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:41:17.515291  8072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d399e7636147219d5ac732820d6db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.524091  8076 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3eebd810d04ede904996ec2e155b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.525344  8070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8eabf5c51c24475aacfa3f5bba75918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.526144  8069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d93a2fc10e64345bacd9f34783a4824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.528918  8074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e350b23835b34ebf8ec454fc59172d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.530576  8075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53f2492fa3a8440a8b1ac90f8d82ab2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.543067  8073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66d4643efd024a70926479d8c6ca279a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.577911  8003 tablet_service.cc:1467] Processing CreateTablet for tablet 25ad7d21572a4747bf0ed3ef12e17298 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:41:17.592070  8001 tablet_service.cc:1467] Processing CreateTablet for tablet 53f2492fa3a8440a8b1ac90f8d82ab2b (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:41:17.588553  8000 tablet_service.cc:1467] Processing CreateTablet for tablet e350b23835b34ebf8ec454fc59172d64 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:41:17.586603  7998 tablet_service.cc:1467] Processing CreateTablet for tablet 37d399e7636147219d5ac732820d6db1 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:41:17.607390  8001 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53f2492fa3a8440a8b1ac90f8d82ab2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.604542  7997 tablet_service.cc:1467] Processing CreateTablet for tablet 2e833e58421e46a6853b25a01b8f4c22 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:41:17.596944  8002 tablet_service.cc:1467] Processing CreateTablet for tablet ac3eebd810d04ede904996ec2e155b36 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:41:17.615281  7995 tablet_service.cc:1467] Processing CreateTablet for tablet 9d93a2fc10e64345bacd9f34783a4824 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:41:17.619207  7925 tablet_service.cc:1467] Processing CreateTablet for tablet e350b23835b34ebf8ec454fc59172d64 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:41:17.619903  8002 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3eebd810d04ede904996ec2e155b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.622498  7995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d93a2fc10e64345bacd9f34783a4824. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.622382  7928 tablet_service.cc:1467] Processing CreateTablet for tablet 25ad7d21572a4747bf0ed3ef12e17298 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:41:17.622493  7925 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e350b23835b34ebf8ec454fc59172d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.609501  7999 tablet_service.cc:1467] Processing CreateTablet for tablet 66d4643efd024a70926479d8c6ca279a (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:41:17.628206  7926 tablet_service.cc:1467] Processing CreateTablet for tablet 53f2492fa3a8440a8b1ac90f8d82ab2b (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:41:17.648383  7996 tablet_service.cc:1467] Processing CreateTablet for tablet a8eabf5c51c24475aacfa3f5bba75918 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:41:17.647807  7927 tablet_service.cc:1467] Processing CreateTablet for tablet ac3eebd810d04ede904996ec2e155b36 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
W20260925 16:41:17.649266  7882 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:41:17.645057  7924 tablet_service.cc:1467] Processing CreateTablet for tablet 66d4643efd024a70926479d8c6ca279a (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:41:17.671808  7997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e833e58421e46a6853b25a01b8f4c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.671491  7928 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ad7d21572a4747bf0ed3ef12e17298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.681345  7926 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53f2492fa3a8440a8b1ac90f8d82ab2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.682375  7998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d399e7636147219d5ac732820d6db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.688704  7924 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66d4643efd024a70926479d8c6ca279a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.688843  8000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e350b23835b34ebf8ec454fc59172d64. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.695988  8003 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 25ad7d21572a4747bf0ed3ef12e17298. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.692462  7923 tablet_service.cc:1467] Processing CreateTablet for tablet 37d399e7636147219d5ac732820d6db1 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:41:17.708917  7927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ac3eebd810d04ede904996ec2e155b36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.712065  7923 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37d399e7636147219d5ac732820d6db1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.715314  7999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66d4643efd024a70926479d8c6ca279a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.720657  7996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8eabf5c51c24475aacfa3f5bba75918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.724730  7922 tablet_service.cc:1467] Processing CreateTablet for tablet 2e833e58421e46a6853b25a01b8f4c22 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:41:17.737839  7920 tablet_service.cc:1467] Processing CreateTablet for tablet 9d93a2fc10e64345bacd9f34783a4824 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:41:17.740409  7921 tablet_service.cc:1467] Processing CreateTablet for tablet a8eabf5c51c24475aacfa3f5bba75918 (DEFAULT_TABLE table=test-workload [id=fc32d76a12c44ea295ab31e07d720a76]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:41:17.744622  7922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e833e58421e46a6853b25a01b8f4c22. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.758555  7921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8eabf5c51c24475aacfa3f5bba75918. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:17.778502  8129 tablet_bootstrap.cc:492] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:17.795548  7920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9d93a2fc10e64345bacd9f34783a4824. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:41:17.825363  7819 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.158.195:43999, user_credentials={real_user=slave}} blocked reactor thread for 47562.4us
I20260925 16:41:17.883679  8130 tablet_bootstrap.cc:492] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:17.900372  8129 tablet_bootstrap.cc:654] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:17.917577  8131 tablet_bootstrap.cc:492] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:17.930512  8131 tablet_bootstrap.cc:654] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:17.939435  8129 tablet_bootstrap.cc:492] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:17.942446  8129 ts_tablet_manager.cc:1397] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.210s	user 0.006s	sys 0.021s
I20260925 16:41:17.949849  8129 raft_consensus.cc:348] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:17.951108  8129 raft_consensus.cc:374] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:17.952586  8130 tablet_bootstrap.cc:654] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:17.952311  8129 raft_consensus.cc:729] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:17.954918  8131 tablet_bootstrap.cc:492] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:17.954454  8129 consensus_queue.cc:260] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:17.955468  8131 ts_tablet_manager.cc:1397] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.016s
I20260925 16:41:17.959194  8131 raft_consensus.cc:348] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:17.959975  8131 raft_consensus.cc:374] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:17.960462  8131 raft_consensus.cc:729] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:17.961184  7963 heartbeater.cc:503] Master 127.7.158.254:39379 was elected leader, sending a full tablet report...
I20260925 16:41:17.961299  8131 consensus_queue.cc:260] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:17.965585  8129 ts_tablet_manager.cc:1428] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.023s	user 0.016s	sys 0.000s
I20260925 16:41:17.966135  8112 heartbeater.cc:503] Master 127.7.158.254:39379 was elected leader, sending a full tablet report...
I20260925 16:41:17.967095  8130 tablet_bootstrap.cc:492] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:17.967568  8130 ts_tablet_manager.cc:1397] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.085s	user 0.012s	sys 0.009s
I20260925 16:41:17.970674  8130 raft_consensus.cc:348] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:17.971453  8130 raft_consensus.cc:374] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:17.971786  8130 raft_consensus.cc:729] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:17.972481  8130 consensus_queue.cc:260] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:17.974263  8038 heartbeater.cc:503] Master 127.7.158.254:39379 was elected leader, sending a full tablet report...
I20260925 16:41:17.975257  8131 ts_tablet_manager.cc:1428] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.006s
I20260925 16:41:17.977466  8131 tablet_bootstrap.cc:492] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:17.977505  8129 tablet_bootstrap.cc:492] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:17.983875  8131 tablet_bootstrap.cc:654] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:17.985728  8129 tablet_bootstrap.cc:654] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:17.987884  8130 ts_tablet_manager.cc:1428] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260925 16:41:17.989235  8130 tablet_bootstrap.cc:492] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:17.995886  8130 tablet_bootstrap.cc:654] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:17.997076  8129 tablet_bootstrap.cc:492] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:17.998011  8129 ts_tablet_manager.cc:1397] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.010s
I20260925 16:41:18.001027  8129 raft_consensus.cc:348] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.001730  8129 raft_consensus.cc:374] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.002187  8129 raft_consensus.cc:729] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.003099  8129 consensus_queue.cc:260] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.004693  8131 tablet_bootstrap.cc:492] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.005151  8131 ts_tablet_manager.cc:1397] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.028s	user 0.005s	sys 0.006s
I20260925 16:41:18.005697  8129 ts_tablet_manager.cc:1428] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260925 16:41:18.006564  8129 tablet_bootstrap.cc:492] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.008260  8131 raft_consensus.cc:348] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.009097  8131 raft_consensus.cc:374] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.009405  8131 raft_consensus.cc:729] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.010717  8134 raft_consensus.cc:482] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.011840  8134 raft_consensus.cc:504] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.010006  8131 consensus_queue.cc:260] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.015618  8131 ts_tablet_manager.cc:1428] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.006s
I20260925 16:41:18.016711  8131 tablet_bootstrap.cc:492] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.020102  8129 tablet_bootstrap.cc:654] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.021426  8134 leader_election.cc:288] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.022830  8130 tablet_bootstrap.cc:492] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.023720  8130 ts_tablet_manager.cc:1397] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.035s	user 0.008s	sys 0.003s
I20260925 16:41:18.025662  8131 tablet_bootstrap.cc:654] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.027644  8130 raft_consensus.cc:348] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.028637  8130 raft_consensus.cc:374] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.029057  8130 raft_consensus.cc:729] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.029908  8130 consensus_queue.cc:260] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
W20260925 16:41:18.043797  8113 tablet.cc:2369] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 16:41:18.044951  8130 ts_tablet_manager.cc:1428] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.021s	user 0.008s	sys 0.000s
I20260925 16:41:18.046290  8130 tablet_bootstrap.cc:492] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.053610  8130 tablet_bootstrap.cc:654] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.075611  8130 tablet_bootstrap.cc:492] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.076254  8130 ts_tablet_manager.cc:1397] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.030s	user 0.011s	sys 0.006s
I20260925 16:41:18.079677  8130 raft_consensus.cc:348] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.088255  8130 raft_consensus.cc:374] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.088642  8130 raft_consensus.cc:729] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.089497  8130 consensus_queue.cc:260] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.092453  8130 ts_tablet_manager.cc:1428] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.001s
I20260925 16:41:18.093472  8130 tablet_bootstrap.cc:492] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.101120  8130 tablet_bootstrap.cc:654] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.129168  8129 tablet_bootstrap.cc:492] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.129480  8131 tablet_bootstrap.cc:492] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.129633  8129 ts_tablet_manager.cc:1397] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.123s	user 0.032s	sys 0.067s
I20260925 16:41:18.129915  8131 ts_tablet_manager.cc:1397] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.113s	user 0.043s	sys 0.063s
I20260925 16:41:18.132359  8129 raft_consensus.cc:348] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.133070  8129 raft_consensus.cc:374] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.133368  8129 raft_consensus.cc:729] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.133167  8131 raft_consensus.cc:348] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.133931  8131 raft_consensus.cc:374] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.134230  8131 raft_consensus.cc:729] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.134042  8129 consensus_queue.cc:260] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.134889  8131 consensus_queue.cc:260] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.135569  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.136425  7938 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.138058  8131 ts_tablet_manager.cc:1428] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:41:18.138227  8050 leader_election.cc:302] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:18.139640  8134 raft_consensus.cc:2781] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.140192  8134 raft_consensus.cc:482] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.140491  8134 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.144934  8129 ts_tablet_manager.cc:1428] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260925 16:41:18.147136  8129 tablet_bootstrap.cc:492] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.148270  8131 tablet_bootstrap.cc:492] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.147446  8134 raft_consensus.cc:504] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.149748  8134 leader_election.cc:288] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.155136  8131 tablet_bootstrap.cc:654] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.163911  8129 tablet_bootstrap.cc:654] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.173391  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.174048  7938 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.177928  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.179435  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.180431  8013 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.183820  8147 raft_consensus.cc:482] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.184950  8131 tablet_bootstrap.cc:492] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.185680  8131 ts_tablet_manager.cc:1397] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.006s
I20260925 16:41:18.185587  8147 raft_consensus.cc:504] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.193642  8147 leader_election.cc:288] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361)
I20260925 16:41:18.194036  8131 raft_consensus.cc:348] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.190789  7938 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.195659  8130 tablet_bootstrap.cc:492] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.195464  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.196933  8012 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.196956  8130 ts_tablet_manager.cc:1397] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.104s	user 0.007s	sys 0.011s
I20260925 16:41:18.197008  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.197794  7937 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.198835  8050 leader_election.cc:302] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:18.199592  8130 raft_consensus.cc:348] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.200349  8130 raft_consensus.cc:374] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.200474  8147 raft_consensus.cc:2781] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.200659  8130 raft_consensus.cc:729] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.196985  8131 raft_consensus.cc:374] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.201920  8131 raft_consensus.cc:729] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.200055  8050 leader_election.cc:302] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.202786  8134 raft_consensus.cc:2781] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.201401  8147 raft_consensus.cc:686] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:18.202594  8131 consensus_queue.cc:260] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.203110  8134 raft_consensus.cc:482] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.203425  8134 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.203620  8130 consensus_queue.cc:260] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.203743  8147 consensus_queue.cc:237] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.207393  8137 raft_consensus.cc:482] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.207865  8137 raft_consensus.cc:504] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.210472  8137 leader_election.cc:288] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.211246  8129 tablet_bootstrap.cc:492] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.207650  8131 ts_tablet_manager.cc:1428] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.002s
I20260925 16:41:18.211766  8129 ts_tablet_manager.cc:1397] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.065s	user 0.008s	sys 0.018s
I20260925 16:41:18.212843  8130 ts_tablet_manager.cc:1428] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260925 16:41:18.213476  8136 raft_consensus.cc:482] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.212865  8131 tablet_bootstrap.cc:492] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.213667  8134 raft_consensus.cc:504] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.216250  8136 raft_consensus.cc:504] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.219403  8130 tablet_bootstrap.cc:492] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.222900  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.232128  8136 leader_election.cc:288] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.232292  8012 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.237092  8129 raft_consensus.cc:348] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.237848  8129 raft_consensus.cc:374] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.219475  8134 leader_election.cc:288] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361)
I20260925 16:41:18.238413  8129 raft_consensus.cc:729] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.239655  8134 raft_consensus.cc:482] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.240590  8134 raft_consensus.cc:504] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.243075  8134 leader_election.cc:288] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.243820  8129 consensus_queue.cc:260] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.247057  8129 ts_tablet_manager.cc:1428] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.035s	user 0.007s	sys 0.000s
I20260925 16:41:18.248212  8129 tablet_bootstrap.cc:492] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.249711  8131 tablet_bootstrap.cc:654] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.268059  8130 tablet_bootstrap.cc:654] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.271255  8012 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.277760  7835 catalog_manager.cc:5495] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:18.284183  8129 tablet_bootstrap.cc:654] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.301297  8131 tablet_bootstrap.cc:492] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.301857  8131 ts_tablet_manager.cc:1397] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.089s	user 0.009s	sys 0.012s
I20260925 16:41:18.307750  8136 raft_consensus.cc:482] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.308398  8136 raft_consensus.cc:504] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.310949  8136 leader_election.cc:288] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.304713  8131 raft_consensus.cc:348] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.313033  8131 raft_consensus.cc:374] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.313364  8131 raft_consensus.cc:729] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.317553  8131 consensus_queue.cc:260] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.322146  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.322754  7937 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.325582  8050 leader_election.cc:302] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.325644  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.326334  8012 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.326416  8147 raft_consensus.cc:2781] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.326957  8147 raft_consensus.cc:686] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:18.328006  8147 consensus_queue.cc:237] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:18.331461  7937 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.333841  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
W20260925 16:41:18.335857  8050 leader_election.cc:341] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.336763  8050 leader_election.cc:302] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:18.337162  8129 tablet_bootstrap.cc:492] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.337890  8129 ts_tablet_manager.cc:1397] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.090s	user 0.011s	sys 0.005s
I20260925 16:41:18.337847  8147 raft_consensus.cc:2781] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.338429  8147 raft_consensus.cc:482] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.338961  8147 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.340571  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.340950  8086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.343952  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.346709  8085 raft_consensus.cc:2454] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 0.
I20260925 16:41:18.348224  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
W20260925 16:41:18.348594  7976 leader_election.cc:341] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.354019  8129 raft_consensus.cc:348] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.354867  8129 raft_consensus.cc:374] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.355163  8129 raft_consensus.cc:729] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.360618  8130 tablet_bootstrap.cc:492] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.361124  8130 ts_tablet_manager.cc:1397] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.144s	user 0.008s	sys 0.017s
I20260925 16:41:18.365409  8131 ts_tablet_manager.cc:1428] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.002s
I20260925 16:41:18.370167  7901 leader_election.cc:302] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:18.371420  8130 raft_consensus.cc:348] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.372359  8137 raft_consensus.cc:2781] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.369546  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.372773  8137 raft_consensus.cc:482] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.373142  8137 raft_consensus.cc:3037] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.365685  8129 consensus_queue.cc:260] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
W20260925 16:41:18.374836  7976 leader_election.cc:341] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.375331  7976 leader_election.cc:302] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:18.372195  8147 raft_consensus.cc:504] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.376463  8129 ts_tablet_manager.cc:1428] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.038s	user 0.007s	sys 0.001s
I20260925 16:41:18.376668  8087 raft_consensus.cc:2379] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb839cfc0c4440cea6c2cfc648cc74ad in current term 1: Already voted for candidate 5bb1ea128eb14737a6bd37572c8fc277 in this term.
I20260925 16:41:18.376801  8136 raft_consensus.cc:2726] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:18.377431  8129 tablet_bootstrap.cc:492] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.369427  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.372201  8130 raft_consensus.cc:374] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.380125  8130 raft_consensus.cc:729] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.380833  8130 consensus_queue.cc:260] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.381788  8137 raft_consensus.cc:504] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.382339  7937 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 0.
I20260925 16:41:18.384424  8147 leader_election.cc:288] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
W20260925 16:41:18.382758  7901 leader_election.cc:341] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.370795  8131 tablet_bootstrap.cc:492] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.386006  8137 leader_election.cc:288] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.386678  7976 leader_election.cc:302] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277
I20260925 16:41:18.387207  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.387671  7937 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.388321  8136 raft_consensus.cc:2781] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.388664  8136 raft_consensus.cc:482] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.388964  8136 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.392045  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.392738  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.394127  8131 tablet_bootstrap.cc:654] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.394934  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:18.395500  8087 raft_consensus.cc:3037] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.399715  8130 ts_tablet_manager.cc:1428] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.038s	user 0.003s	sys 0.006s
I20260925 16:41:18.401075  8130 tablet_bootstrap.cc:492] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.400853  7834 catalog_manager.cc:5495] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:18.402953  8087 raft_consensus.cc:2454] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 1.
I20260925 16:41:18.404083  7901 leader_election.cc:302] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:18.392129  7937 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.405565  8137 raft_consensus.cc:482] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.405673  8165 raft_consensus.cc:2781] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.406075  8137 raft_consensus.cc:504] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.409614  8137 leader_election.cc:288] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
W20260925 16:41:18.410252  7901 leader_election.cc:341] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.414002  8050 leader_election.cc:302] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:18.415328  8147 raft_consensus.cc:2781] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.416414  8129 tablet_bootstrap.cc:654] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.416406  8147 raft_consensus.cc:686] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:18.418497  8147 consensus_queue.cc:237] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.418699  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
W20260925 16:41:18.420707  7901 leader_election.cc:341] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.424495  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
W20260925 16:41:18.425686  7901 leader_election.cc:341] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.426095  7901 leader_election.cc:302] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f; no voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:18.429190  8137 raft_consensus.cc:2726] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:18.430977  8136 raft_consensus.cc:504] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.444342  8012 raft_consensus.cc:2379] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5bb1ea128eb14737a6bd37572c8fc277 in current term 1: Already voted for candidate eb839cfc0c4440cea6c2cfc648cc74ad in this term.
I20260925 16:41:18.444351  8130 tablet_bootstrap.cc:654] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.438349  8165 raft_consensus.cc:686] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:18.447805  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.448777  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:18.449575  7937 raft_consensus.cc:2379] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate eb839cfc0c4440cea6c2cfc648cc74ad in current term 1: Already voted for candidate 5bb1ea128eb14737a6bd37572c8fc277 in this term.
I20260925 16:41:18.450696  7976 leader_election.cc:302] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:18.448007  8136 leader_election.cc:288] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.457450  8136 raft_consensus.cc:2726] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:41:18.461895  7834 catalog_manager.cc:5495] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:18.462733  8129 tablet_bootstrap.cc:492] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.463446  8129 ts_tablet_manager.cc:1397] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.086s	user 0.010s	sys 0.012s
I20260925 16:41:18.464023  8131 tablet_bootstrap.cc:492] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.464473  8131 ts_tablet_manager.cc:1397] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.094s	user 0.023s	sys 0.016s
I20260925 16:41:18.457813  8165 consensus_queue.cc:237] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.468181  8129 raft_consensus.cc:348] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.471158  8129 raft_consensus.cc:374] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.471478  8129 raft_consensus.cc:729] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.472329  8129 consensus_queue.cc:260] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.473097  8130 tablet_bootstrap.cc:492] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.473531  8130 ts_tablet_manager.cc:1397] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.073s	user 0.009s	sys 0.004s
I20260925 16:41:18.474857  8129 ts_tablet_manager.cc:1428] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.011s	user 0.000s	sys 0.006s
I20260925 16:41:18.473117  8131 raft_consensus.cc:348] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.475735  8131 raft_consensus.cc:374] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.476080  8131 raft_consensus.cc:729] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.475818  8129 tablet_bootstrap.cc:492] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.476678  8130 raft_consensus.cc:348] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.476873  8131 consensus_queue.cc:260] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.477394  8130 raft_consensus.cc:374] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.477713  8130 raft_consensus.cc:729] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.478859  8130 consensus_queue.cc:260] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.481997  8130 ts_tablet_manager.cc:1428] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:41:18.482920  8129 tablet_bootstrap.cc:654] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.486969  8130 tablet_bootstrap.cc:492] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.486851  8131 ts_tablet_manager.cc:1428] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.022s	user 0.000s	sys 0.007s
I20260925 16:41:18.501238  8131 tablet_bootstrap.cc:492] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.508430  8130 tablet_bootstrap.cc:654] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.508139  7833 catalog_manager.cc:5495] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 0 to 1, leader changed from <none> to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:18.512624  8131 tablet_bootstrap.cc:654] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.517788  8129 tablet_bootstrap.cc:492] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.518262  8129 ts_tablet_manager.cc:1397] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.005s
I20260925 16:41:18.520612  8130 tablet_bootstrap.cc:492] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.521102  8130 ts_tablet_manager.cc:1397] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.008s
I20260925 16:41:18.521982  8129 raft_consensus.cc:348] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.522922  8129 raft_consensus.cc:374] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.523252  8129 raft_consensus.cc:729] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.524111  8129 consensus_queue.cc:260] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.524467  8130 raft_consensus.cc:348] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.525260  8130 raft_consensus.cc:374] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.525593  8130 raft_consensus.cc:729] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.526271  8130 consensus_queue.cc:260] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.528957  8130 ts_tablet_manager.cc:1428] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:41:18.529151  8129 ts_tablet_manager.cc:1428] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.003s
I20260925 16:41:18.529940  8130 tablet_bootstrap.cc:492] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.529940  8129 tablet_bootstrap.cc:492] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.537817  8129 tablet_bootstrap.cc:654] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.538952  8130 tablet_bootstrap.cc:654] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.545738  8131 tablet_bootstrap.cc:492] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.546211  8131 ts_tablet_manager.cc:1397] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.008s
I20260925 16:41:18.548696  8131 raft_consensus.cc:348] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.549401  8131 raft_consensus.cc:374] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.549685  8131 raft_consensus.cc:729] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.550330  8131 consensus_queue.cc:260] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.552523  8131 ts_tablet_manager.cc:1428] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.007s
I20260925 16:41:18.553397  8131 tablet_bootstrap.cc:492] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.563392  8131 tablet_bootstrap.cc:654] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.565517  8129 tablet_bootstrap.cc:492] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.565999  8129 ts_tablet_manager.cc:1397] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.013s
I20260925 16:41:18.567129  8130 tablet_bootstrap.cc:492] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.567552  8130 ts_tablet_manager.cc:1397] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.038s	user 0.008s	sys 0.019s
I20260925 16:41:18.569676  8129 raft_consensus.cc:348] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.570187  8129 raft_consensus.cc:374] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.570423  8129 raft_consensus.cc:729] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.570273  8130 raft_consensus.cc:348] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.571002  8130 raft_consensus.cc:374] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.571002  8129 consensus_queue.cc:260] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.571399  8130 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.572482  8130 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.575028  8130 ts_tablet_manager.cc:1428] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:41:18.575959  8130 tablet_bootstrap.cc:492] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f: Bootstrap starting.
I20260925 16:41:18.581187  8130 tablet_bootstrap.cc:654] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.587785  8147 raft_consensus.cc:482] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.588310  8147 raft_consensus.cc:504] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.590142  8147 leader_election.cc:288] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.590776  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.591053  8170 raft_consensus.cc:482] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.591305  8129 ts_tablet_manager.cc:1428] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.001s
I20260925 16:41:18.591410  7937 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.591498  8170 raft_consensus.cc:504] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.592562  8050 leader_election.cc:302] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:18.593659  8147 raft_consensus.cc:2781] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.593983  8147 raft_consensus.cc:482] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.594447  8147 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.594691  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.596901  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
W20260925 16:41:18.598420  8050 leader_election.cc:341] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.599046  8129 tablet_bootstrap.cc:492] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: Bootstrap starting.
I20260925 16:41:18.593951  8170 leader_election.cc:288] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.600082  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.600780  8087 raft_consensus.cc:2379] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb839cfc0c4440cea6c2cfc648cc74ad in current term 1: Already voted for candidate c84c24d7432b4c5199e5279df1ede07f in this term.
I20260925 16:41:18.600478  8147 raft_consensus.cc:504] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.601848  7976 leader_election.cc:302] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:18.602193  8147 leader_election.cc:288] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.602926  8170 raft_consensus.cc:3037] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.605248  8130 tablet_bootstrap.cc:492] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f: No bootstrap required, opened a new log
I20260925 16:41:18.605350  8129 tablet_bootstrap.cc:654] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.605693  8130 ts_tablet_manager.cc:1397] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f: Time spent bootstrapping tablet: real 0.030s	user 0.006s	sys 0.008s
I20260925 16:41:18.607887  8130 raft_consensus.cc:348] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.608497  8130 raft_consensus.cc:374] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.608741  8130 raft_consensus.cc:729] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.609028  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.609412  8130 consensus_queue.cc:260] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.611984  8130 ts_tablet_manager.cc:1428] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260925 16:41:18.609778  7937 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.615906  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
W20260925 16:41:18.619582  8050 leader_election.cc:341] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:18.622232  8129 tablet_bootstrap.cc:492] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: No bootstrap required, opened a new log
I20260925 16:41:18.622643  8129 ts_tablet_manager.cc:1397] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: Time spent bootstrapping tablet: real 0.024s	user 0.007s	sys 0.009s
I20260925 16:41:18.625236  8129 raft_consensus.cc:348] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.625913  8129 raft_consensus.cc:374] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.626197  8129 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.626890  8129 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.627261  8170 raft_consensus.cc:2726] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:18.629694  8131 tablet_bootstrap.cc:492] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.630124  8131 ts_tablet_manager.cc:1397] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.077s	user 0.014s	sys 0.005s
I20260925 16:41:18.631081  8129 ts_tablet_manager.cc:1428] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:41:18.632390  8131 raft_consensus.cc:348] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.633068  8131 raft_consensus.cc:374] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.633337  8131 raft_consensus.cc:729] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
I20260925 16:41:18.634378  7937 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.635550  8050 leader_election.cc:302] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:18.636793  8147 raft_consensus.cc:2781] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.637248  8147 raft_consensus.cc:686] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:18.637287  8131 consensus_queue.cc:260] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.638077  8147 consensus_queue.cc:237] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.639400  8131 ts_tablet_manager.cc:1428] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260925 16:41:18.644243  8131 tablet_bootstrap.cc:492] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: Bootstrap starting.
I20260925 16:41:18.650620  8131 tablet_bootstrap.cc:654] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:18.655377  8170 raft_consensus.cc:482] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.655892  8170 raft_consensus.cc:504] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.655812  7835 catalog_manager.cc:5495] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:18.658067  8170 leader_election.cc:288] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.659762  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.660111  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.660392  7937 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 0.
I20260925 16:41:18.660696  8087 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 0.
I20260925 16:41:18.661504  7976 leader_election.cc:302] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.662567  8170 raft_consensus.cc:2781] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.663093  8170 raft_consensus.cc:482] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.663426  8170 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.668134  8131 tablet_bootstrap.cc:492] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: No bootstrap required, opened a new log
I20260925 16:41:18.668447  8131 ts_tablet_manager.cc:1397] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.003s
I20260925 16:41:18.670282  8131 raft_consensus.cc:348] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.670756  8170 raft_consensus.cc:504] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.672613  8170 leader_election.cc:288] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.670750  8131 raft_consensus.cc:374] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:18.673321  8131 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Initialized, Role: FOLLOWER
W20260925 16:41:18.673750  7882 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:41:18.673660  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.674281  7937 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.673883  8131 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.675861  8131 ts_tablet_manager.cc:1428] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:41:18.678346  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:18.678900  8087 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.680286  8147 consensus_queue.cc:1035] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:18.684532  7937 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 1.
I20260925 16:41:18.685681  7976 leader_election.cc:302] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.686512  8170 raft_consensus.cc:2781] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.687057  8170 raft_consensus.cc:686] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:18.687933  8170 consensus_queue.cc:237] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.689651  8087 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 1.
I20260925 16:41:18.697229  7833 catalog_manager.cc:5495] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 0 to 1, leader changed from <none> to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 1 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:18.715499  8012 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.722412  8134 consensus_queue.cc:1035] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:18.739248  8165 raft_consensus.cc:482] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.739756  8165 raft_consensus.cc:504] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.742441  8165 leader_election.cc:288] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.743408  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.743808  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.744045  8012 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 0.
I20260925 16:41:18.744438  8087 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 0.
I20260925 16:41:18.745657  7901 leader_election.cc:302] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.746403  8165 raft_consensus.cc:2781] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.746778  8165 raft_consensus.cc:482] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.747143  8165 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.747182  8134 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:18.754067  8165 raft_consensus.cc:504] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.756680  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.757211  8013 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.764436  8147 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:18.772414  8013 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 1.
I20260925 16:41:18.774205  8165 leader_election.cc:288] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.774684  7901 leader_election.cc:302] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.775131  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:18.775415  8165 raft_consensus.cc:2781] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.775734  8087 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.776065  8165 raft_consensus.cc:686] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:18.776850  8165 consensus_queue.cc:237] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.778676  8187 raft_consensus.cc:482] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.779102  8187 raft_consensus.cc:504] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.781474  8187 leader_election.cc:288] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.783291  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.783481  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.783921  8013 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.784024  7937 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 0.
I20260925 16:41:18.785043  8050 leader_election.cc:302] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.785389  8087 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 1.
I20260925 16:41:18.787495  8147 raft_consensus.cc:2781] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.787868  8147 raft_consensus.cc:482] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.788203  8147 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.787887  8170 raft_consensus.cc:482] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.792168  8170 raft_consensus.cc:504] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.794081  8170 leader_election.cc:288] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.796746  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.797524  7938 raft_consensus.cc:2379] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb839cfc0c4440cea6c2cfc648cc74ad in current term 1: Already voted for candidate 5bb1ea128eb14737a6bd37572c8fc277 in this term.
I20260925 16:41:18.796624  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.798743  7976 leader_election.cc:302] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:18.799502  8170 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.801726  8147 raft_consensus.cc:504] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.805300  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.805863  8013 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.805811  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.806273  8170 raft_consensus.cc:2726] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:18.806494  7938 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.811264  7833 catalog_manager.cc:5495] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 0 to 1, leader changed from <none> to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:18.812707  7938 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.812938  8013 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 1.
I20260925 16:41:18.813679  8050 leader_election.cc:302] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:18.814524  8187 raft_consensus.cc:2781] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.814958  8187 raft_consensus.cc:686] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:18.815295  8147 leader_election.cc:288] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:18.815682  8187 consensus_queue.cc:237] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.822270  8165 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.822700  8165 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.824610  8165 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.826567  8170 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:18.826519  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:18.827977  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.827857  8170 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.828627  8087 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 0.
I20260925 16:41:18.828987  8013 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 0.
I20260925 16:41:18.829823  8187 consensus_queue.cc:1035] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:18.830600  7901 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.831403  8165 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.831632  8170 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.831784  8165 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.825443  7833 catalog_manager.cc:5495] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:18.832135  8165 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.833752  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:18.834316  8087 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 0.
I20260925 16:41:18.835114  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:18.835325  7976 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:18.836638  8170 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:18.836973  8170 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:18.837268  8170 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.844691  8170 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.847431  7936 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:18.850871  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:18.851439  8087 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:18.852952  8165 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.854547  7937 raft_consensus.cc:2379] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate eb839cfc0c4440cea6c2cfc648cc74ad in current term 1: Already voted for candidate c84c24d7432b4c5199e5279df1ede07f in this term.
I20260925 16:41:18.857932  8087 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 1.
I20260925 16:41:18.859359  7976 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:18.860163  8136 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:18.860061  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:18.862015  8165 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.862557  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:18.863313  8085 raft_consensus.cc:2379] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c84c24d7432b4c5199e5279df1ede07f in current term 1: Already voted for candidate eb839cfc0c4440cea6c2cfc648cc74ad in this term.
I20260925 16:41:18.878597  8170 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 1 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:18.878371  8147 consensus_queue.cc:1035] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:18.885391  8136 raft_consensus.cc:686] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:18.886258  8136 consensus_queue.cc:237] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:18.898921  7901 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f; no voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:18.899833  8165 raft_consensus.cc:2726] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:41:18.901975  7833 catalog_manager.cc:5495] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 0 to 1, leader changed from <none> to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 1 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:18.942643  8165 consensus_queue.cc:1035] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:18.957286  8165 consensus_queue.cc:1035] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.090195  8136 consensus_queue.cc:1035] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.100751  8170 consensus_queue.cc:1035] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.134755  8087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:19.135326  8087 raft_consensus.cc:595] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:19.150354  8013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:54510
I20260925 16:41:19.150866  8013 raft_consensus.cc:595] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:19.156225  8013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:54510
I20260925 16:41:19.156759  8013 raft_consensus.cc:595] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:19.158078  8196 raft_consensus.cc:979] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.158488  8196 raft_consensus.cc:1067] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.160401  7938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48116
I20260925 16:41:19.160976  7938 raft_consensus.cc:482] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.161321  7938 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.166188  8087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:19.166814  8087 raft_consensus.cc:595] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:19.168081  7938 raft_consensus.cc:504] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:19.170252  7938 leader_election.cc:288] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Requested vote from peers 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:19.172646  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.173115  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:19.173245  8087 raft_consensus.cc:3032] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.173700  8087 raft_consensus.cc:729] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:19.173700  8013 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.174630  8087 consensus_queue.cc:260] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:19.176016  8087 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.181615  8013 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.182821  7901 leader_election.cc:302] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.183831  8165 raft_consensus.cc:2781] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.183833  8087 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.185137  8165 raft_consensus.cc:686] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:19.186156  8165 consensus_queue.cc:237] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:19.189298  7938 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:48122
I20260925 16:41:19.189884  7938 raft_consensus.cc:595] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:19.194554  7835 catalog_manager.cc:5495] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 1 to 2, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:19.196326  8087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37d399e7636147219d5ac732820d6db1"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:19.196837  8087 raft_consensus.cc:595] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:19.206606  8087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:19.207719  8196 raft_consensus.cc:979] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.207310  8134 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.208102  8196 raft_consensus.cc:1067] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.209165  8087 raft_consensus.cc:595] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:19.210081  8013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37d399e7636147219d5ac732820d6db1"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54502
I20260925 16:41:19.210664  8013 raft_consensus.cc:482] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.211055  8013 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.217860  8087 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:19.219962  8087 raft_consensus.cc:595] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:19.220867  8187 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.222591  8013 raft_consensus.cc:504] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.225015  8013 leader_election.cc:288] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.225473  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:19.226099  7937 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.229741  7938 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
mode: GRACEFUL
new_leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:48122
I20260925 16:41:19.230265  7938 raft_consensus.cc:595] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Received request to transfer leadership to TS 5bb1ea128eb14737a6bd37572c8fc277
I20260925 16:41:19.232594  7937 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.233143  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.233896  8087 raft_consensus.cc:3032] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.234261  8087 raft_consensus.cc:729] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:19.237059  7976 leader_election.cc:302] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.237866  8195 raft_consensus.cc:2781] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.238282  8195 raft_consensus.cc:686] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:19.239024  8195 consensus_queue.cc:237] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.243052  8087 consensus_queue.cc:260] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.247891  8167 consensus_queue.cc:1035] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.248943  8187 raft_consensus.cc:979] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.249349  8187 raft_consensus.cc:1067] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.252187  8010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54502
I20260925 16:41:19.253566  8010 raft_consensus.cc:482] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.253929  8010 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.263312  8010 raft_consensus.cc:504] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.266126  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:19.266863  7938 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.271013  8087 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.273403  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.273979  8085 raft_consensus.cc:3032] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.274281  8085 raft_consensus.cc:729] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:19.275010  8085 consensus_queue.cc:260] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.276140  8085 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.280857  8087 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.286023  8085 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.288452  8167 consensus_queue.cc:1035] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.284355  8010 leader_election.cc:288] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.291752  7938 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.292820  7976 leader_election.cc:302] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.292862  7835 catalog_manager.cc:5495] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 1 to 2, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 2 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.294169  8195 raft_consensus.cc:2781] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.294852  8195 raft_consensus.cc:686] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:19.295377  8165 raft_consensus.cc:979] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.296330  8167 raft_consensus.cc:1067] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.295991  8195 consensus_queue.cc:237] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.299026  8147 consensus_queue.cc:1035] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.303670  8010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54508
I20260925 16:41:19.305811  8010 raft_consensus.cc:482] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.307473  8010 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.323732  8187 consensus_queue.cc:1035] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:19.333868  8010 raft_consensus.cc:504] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.337198  8147 raft_consensus.cc:979] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.337623  8147 raft_consensus.cc:1067] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:19.340791  8010 leader_election.cc:288] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.342072  8012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54502
I20260925 16:41:19.342264  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:19.342645  8012 raft_consensus.cc:482] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.342866  7937 raft_consensus.cc:3032] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.343032  8012 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.343227  7937 raft_consensus.cc:729] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:19.344646  7937 consensus_queue.cc:260] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.345065  7833 catalog_manager.cc:5495] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 1 to 2, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 2 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.345865  7937 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.348799  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.349372  8085 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.354580  7937 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.355350  8085 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.356638  7976 leader_election.cc:302] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.359004  8170 raft_consensus.cc:2781] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.359521  8170 raft_consensus.cc:686] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:19.360347  8170 consensus_queue.cc:237] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.360685  8012 raft_consensus.cc:504] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.364466  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.364816  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:19.365149  8085 raft_consensus.cc:3032] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.365334  7937 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.365495  8085 raft_consensus.cc:729] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:19.364048  8012 leader_election.cc:288] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.366416  8085 consensus_queue.cc:260] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.367599  8085 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.373807  7937 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.374097  8085 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 2.
I20260925 16:41:19.374909  7976 leader_election.cc:302] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.375918  8170 raft_consensus.cc:2781] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.375504  7833 catalog_manager.cc:5495] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 1 to 2, leader changed from c84c24d7432b4c5199e5279df1ede07f (127.7.158.193) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 2 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.376363  8170 raft_consensus.cc:686] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:19.377120  8170 consensus_queue.cc:237] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.381151  8170 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.389808  7833 catalog_manager.cc:5495] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 1 to 2, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 2 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.393292  8136 raft_consensus.cc:979] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.393723  8195 raft_consensus.cc:1067] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.399504  8195 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:19.396178  7937 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48118
I20260925 16:41:19.402585  7937 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.403017  7937 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.409464  7937 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.412772  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:19.413360  8012 raft_consensus.cc:3032] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.413636  8012 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:19.414305  8012 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.415479  8012 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.422746  8012 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.424642  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.424957  7901 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.425226  8085 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.425910  8210 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.426357  8210 raft_consensus.cc:686] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:19.427107  8210 consensus_queue.cc:237] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.431417  8085 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.423926  7937 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.438184  7833 catalog_manager.cc:5495] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 1 to 2, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.478434  8167 raft_consensus.cc:979] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: : Instructing follower 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:19.478921  8167 raft_consensus.cc:1067] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Signalling peer 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:19.480997  8085 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:40394
I20260925 16:41:19.481737  8085 raft_consensus.cc:482] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.482674  8085 raft_consensus.cc:3037] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.488179  8085 raft_consensus.cc:504] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.489903  8085 leader_election.cc:288] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 2 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:19.490875  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:19.491460  8012 raft_consensus.cc:3037] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.491770  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:19.492326  7938 raft_consensus.cc:3032] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.492391  8187 raft_consensus.cc:979] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.492667  7938 raft_consensus.cc:729] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:19.492870  8187 raft_consensus.cc:1067] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.493495  7938 consensus_queue.cc:260] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.494690  7938 raft_consensus.cc:3037] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.498276  8012 raft_consensus.cc:2454] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 2.
I20260925 16:41:19.499562  8050 leader_election.cc:302] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.499778  7937 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48116
I20260925 16:41:19.500341  7937 raft_consensus.cc:482] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.500435  8134 raft_consensus.cc:2781] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.500697  7937 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.501019  7938 raft_consensus.cc:2454] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 2.
I20260925 16:41:19.501063  8134 raft_consensus.cc:686] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:19.502005  8134 consensus_queue.cc:237] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.507027  7937 raft_consensus.cc:504] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.508641  7937 leader_election.cc:288] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.509528  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.509673  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:19.510136  8085 raft_consensus.cc:3032] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.510217  8012 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.510517  8085 raft_consensus.cc:729] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:19.511468  7833 catalog_manager.cc:5495] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 1 to 2, leader changed from c84c24d7432b4c5199e5279df1ede07f (127.7.158.193) to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:19.511817  8085 consensus_queue.cc:260] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.513033  8085 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.516863  8012 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.517889  7901 leader_election.cc:302] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:19.518816  8210 raft_consensus.cc:2781] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.519428  8210 raft_consensus.cc:686] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:19.520212  8210 consensus_queue.cc:237] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.521386  8085 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.528012  7833 catalog_manager.cc:5495] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 1 to 2, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.604120  8195 raft_consensus.cc:979] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.604606  8170 raft_consensus.cc:1067] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:19.606165  7937 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48118
I20260925 16:41:19.606643  7937 raft_consensus.cc:482] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:19.606899  7937 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.611498  7937 raft_consensus.cc:504] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.613127  7937 leader_election.cc:288] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:19.613991  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:19.614212  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:19.614667  8012 raft_consensus.cc:3032] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:19.614857  8085 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.615056  8012 raft_consensus.cc:729] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:19.616402  8012 consensus_queue.cc:260] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.617755  8012 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:19.621068  8085 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.621989  7901 leader_election.cc:302] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:19.622639  8210 raft_consensus.cc:2781] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:19.623037  8210 raft_consensus.cc:686] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:19.623612  8012 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 2.
I20260925 16:41:19.623855  8210 consensus_queue.cc:237] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:19.631767  7833 catalog_manager.cc:5495] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 1 to 2, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:19.633893  7937 raft_consensus.cc:1261] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.635219  8170 consensus_queue.cc:1035] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.646833  8085 raft_consensus.cc:1261] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.648440  8136 consensus_queue.cc:1035] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.735452  8087 raft_consensus.cc:1261] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.736347  7938 raft_consensus.cc:1261] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.736845  8210 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.737780  8136 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.747504  8087 raft_consensus.cc:1261] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.749150  8012 raft_consensus.cc:1261] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.751052  8136 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.753360  8210 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.774991  8087 raft_consensus.cc:1261] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.776448  8136 consensus_queue.cc:1035] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.778501  7938 raft_consensus.cc:1261] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.780586  8136 consensus_queue.cc:1035] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:41:19.786967  7938 raft_consensus.cc:1261] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.788473  8136 consensus_queue.cc:1035] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.796586  8087 raft_consensus.cc:1261] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.798094  8216 consensus_queue.cc:1035] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.918138  7937 raft_consensus.cc:1261] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.919528  8134 consensus_queue.cc:1035] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.927680  8012 raft_consensus.cc:1261] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.929749  8217 consensus_queue.cc:1035] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.966729  8012 raft_consensus.cc:1261] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.968065  8165 consensus_queue.cc:1035] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.969633  8012 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.970857  8165 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:19.992040  8087 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:19.994112  8222 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:20.001039  8087 raft_consensus.cc:1261] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:20.002631  8219 consensus_queue.cc:1035] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:20.012410  8013 raft_consensus.cc:1261] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:20.014397  8223 consensus_queue.cc:1035] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:41:20.028390  8087 raft_consensus.cc:1261] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:20.030085  8219 consensus_queue.cc:1035] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:22.261128  7803 auto_leader_rebalancer-test.cc:269] The leader distribution is 
I20260925 16:41:22.262054  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:22.284925  7937 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
mode: GRACEFUL
new_leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:45788
I20260925 16:41:22.285401  7937 raft_consensus.cc:595] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Received request to transfer leadership to TS 5bb1ea128eb14737a6bd37572c8fc277
I20260925 16:41:22.298535  8013 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:48832
I20260925 16:41:22.299021  8013 raft_consensus.cc:595] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Received request to transfer leadership to TS 5bb1ea128eb14737a6bd37572c8fc277
I20260925 16:41:22.299998  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:41:22.300469  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:22.334682  8216 raft_consensus.cc:979] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:22.335112  8233 raft_consensus.cc:1067] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Signalling peer 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:22.336614  8087 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:40404
I20260925 16:41:22.337061  8087 raft_consensus.cc:482] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:22.337364  8087 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:22.343185  8087 raft_consensus.cc:504] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:22.345266  8087 leader_election.cc:288] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 3 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:22.347046  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:22.346987  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:22.347681  7937 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:22.347734  8013 raft_consensus.cc:3032] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:22.348341  8013 raft_consensus.cc:729] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:22.349078  8013 consensus_queue.cc:260] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:22.350193  8013 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:22.353494  7937 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 3.
I20260925 16:41:22.354605  8050 leader_election.cc:302] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:22.355384  8226 raft_consensus.cc:2781] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:22.356649  8226 raft_consensus.cc:686] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:22.356760  8013 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 3.
I20260925 16:41:22.357470  8226 consensus_queue.cc:237] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:22.366967  7834 catalog_manager.cc:5495] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 2 to 3, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:22.705382  8240 raft_consensus.cc:979] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: : Instructing follower 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:22.705900  8240 raft_consensus.cc:1067] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Signalling peer 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:22.707432  8085 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:40394
I20260925 16:41:22.707907  8085 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:22.708199  8085 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:22.712466  8085 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:22.713964  8085 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 3 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:22.714888  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:22.715134  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:22.715521  7937 raft_consensus.cc:3032] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:22.715756  8013 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:22.715961  7937 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:22.716740  7937 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:22.717780  7937 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:22.721621  7937 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 3.
I20260925 16:41:22.722225  8013 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 3.
I20260925 16:41:22.722477  8050 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:22.723237  8226 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:22.723733  8226 raft_consensus.cc:686] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:22.724488  8226 consensus_queue.cc:237] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:22.731101  7834 catalog_manager.cc:5495] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 2 to 3, leader changed from c84c24d7432b4c5199e5279df1ede07f (127.7.158.193) to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:22.774297  8013 raft_consensus.cc:1261] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:22.775743  8226 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:22.785619  7937 raft_consensus.cc:1261] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:22.787456  8226 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:23.191079  8013 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:23.192621  8226 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:23.200829  7937 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:23.202975  8226 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:23.301234  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:23.306403  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:23.306830  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:24.307597  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:24.312675  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:24.313117  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:25.314103  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:25.319767  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:25.320178  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:26.320966  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:26.325911  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:26.326352  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:27.327029  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:27.331851  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:27.332237  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:28.333005  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:28.339172  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:28.339581  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:29.340282  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:29.344986  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:29.345351  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:30.346135  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:30.350903  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:30.351301  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:31.352057  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:31.357118  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:31.357635  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:32.382665  7803 auto_leader_rebalancer-test.cc:288] The leader distribution is 
I20260925 16:41:32.386792  7937 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:48122
I20260925 16:41:32.387466  7937 raft_consensus.cc:595] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:32.392091  7937 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:48122
I20260925 16:41:32.392477  7937 raft_consensus.cc:595] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:32.397024  8085 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:32.397423  8085 raft_consensus.cc:595] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:32.401633  7937 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:48122
I20260925 16:41:32.402029  7937 raft_consensus.cc:595] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:32.413007  8085 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
mode: GRACEFUL
new_leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:40418
I20260925 16:41:32.413431  8085 raft_consensus.cc:595] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Received request to transfer leadership to TS eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:32.464716  8255 raft_consensus.cc:979] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.465232  8257 raft_consensus.cc:1067] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.466607  8013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54502
I20260925 16:41:32.467048  8013 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:32.467372  8013 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:32.472860  8013 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.474534  8013 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 4 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:32.475438  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:32.475647  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:32.476082  7937 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:32.476174  8085 raft_consensus.cc:3032] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:41:32.476511  8085 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:32.477074  8085 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.477926  8085 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:32.480338  7937 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 4.
I20260925 16:41:32.481438  7976 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:32.482203  8254 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:41:32.482632  8254 raft_consensus.cc:686] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:32.483328  8085 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 4.
I20260925 16:41:32.483301  8254 consensus_queue.cc:237] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.489886  7834 catalog_manager.cc:5495] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 3 to 4, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 4 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:32.523675  8240 raft_consensus.cc:979] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.524135  8240 raft_consensus.cc:1067] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.525517  8013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54508
I20260925 16:41:32.525923  8013 raft_consensus.cc:482] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:32.526139  8013 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.530164  8013 raft_consensus.cc:504] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:32.531352  8013 leader_election.cc:288] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 election: Requested vote from peers 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999), c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361)
I20260925 16:41:32.532191  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:32.532320  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:32.532610  8085 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.532799  7937 raft_consensus.cc:3032] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:32.533084  7937 raft_consensus.cc:729] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:32.533681  7937 consensus_queue.cc:260] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:32.534552  7937 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.536578  8085 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 3.
I20260925 16:41:32.537325  7976 leader_election.cc:302] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:32.537919  8254 raft_consensus.cc:2781] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:32.538311  8254 raft_consensus.cc:686] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:32.538719  7937 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 3.
I20260925 16:41:32.539039  8254 consensus_queue.cc:237] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:32.546044  7834 catalog_manager.cc:5495] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 2 to 3, leader changed from c84c24d7432b4c5199e5279df1ede07f (127.7.158.193) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 3 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:32.707553  8263 raft_consensus.cc:979] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.708024  8240 raft_consensus.cc:1067] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.709385  8013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54508
I20260925 16:41:32.709789  8013 raft_consensus.cc:482] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:32.710003  8013 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.714097  8013 raft_consensus.cc:504] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.715555  8013 leader_election.cc:288] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:32.716426  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:32.716538  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ac3eebd810d04ede904996ec2e155b36" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:32.716913  7937 raft_consensus.cc:3032] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:32.717022  8085 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.717188  7937 raft_consensus.cc:729] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:32.717857  7937 consensus_queue.cc:260] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.718649  7937 raft_consensus.cc:3037] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.721302  8085 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 3.
I20260925 16:41:32.722137  7976 leader_election.cc:302] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:32.722718  7937 raft_consensus.cc:2454] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 3.
I20260925 16:41:32.722864  8254 raft_consensus.cc:2781] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:32.723371  8254 raft_consensus.cc:686] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:32.724131  8254 consensus_queue.cc:237] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.730326  7834 catalog_manager.cc:5495] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 2 to 3, leader changed from c84c24d7432b4c5199e5279df1ede07f (127.7.158.193) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 3 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:32.900657  8085 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:41:32.901813  8254 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:41:32.905593  8255 raft_consensus.cc:979] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.906037  8257 raft_consensus.cc:1067] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.907406  8013 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54502
I20260925 16:41:32.908483  8013 raft_consensus.cc:482] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:32.908885  8013 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:32.911446  8240 raft_consensus.cc:979] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: : Instructing follower eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.911870  8240 raft_consensus.cc:1067] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Signalling peer eb839cfc0c4440cea6c2cfc648cc74ad to start an election
I20260925 16:41:32.913336  8012 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
 from {username='slave'} at 127.0.0.1:54508
I20260925 16:41:32.913978  8012 raft_consensus.cc:482] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:32.914317  8012 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.920012  8013 raft_consensus.cc:504] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.920974  8012 raft_consensus.cc:504] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.922179  8013 leader_election.cc:288] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 4 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:32.922327  7937 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:41:32.922861  8012 leader_election.cc:288] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:32.923321  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:32.923688  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8eabf5c51c24475aacfa3f5bba75918" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:32.923918  7938 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:32.924347  8087 raft_consensus.cc:3032] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:41:32.924674  8087 raft_consensus.cc:729] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:32.925235  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:32.925701  7937 raft_consensus.cc:3032] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:32.925387  8087 consensus_queue.cc:260] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.925985  7937 raft_consensus.cc:729] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:32.926636  8086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e350b23835b34ebf8ec454fc59172d64" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:32.926725  8087 raft_consensus.cc:3037] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:32.926724  7937 consensus_queue.cc:260] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.927222  8086 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.927925  7937 raft_consensus.cc:3037] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:32.929271  8254 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:41:32.932510  7938 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 4.
I20260925 16:41:32.934264  7937 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 3.
I20260925 16:41:32.935810  8086 raft_consensus.cc:2454] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 3.
I20260925 16:41:32.936718  7976 leader_election.cc:302] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:32.937374  7976 leader_election.cc:302] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 
I20260925 16:41:32.937456  8256 raft_consensus.cc:2781] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:41:32.938087  8254 raft_consensus.cc:2781] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:32.938503  8087 raft_consensus.cc:2454] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb839cfc0c4440cea6c2cfc648cc74ad in term 4.
I20260925 16:41:32.944617  8256 raft_consensus.cc:686] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:32.946144  8256 consensus_queue.cc:237] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.947981  8254 raft_consensus.cc:686] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Becoming Leader. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:32.949095  8254 consensus_queue.cc:237] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:32.957149  7834 catalog_manager.cc:5495] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 3 to 4, leader changed from 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 4 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:32.958272  7834 catalog_manager.cc:5495] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad reported cstate change: term changed from 2 to 3, leader changed from c84c24d7432b4c5199e5279df1ede07f (127.7.158.193) to eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194). New cstate: current_term: 3 leader_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:33.069790  7937 raft_consensus.cc:1261] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:33.070799  8254 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:33.078759  8087 raft_consensus.cc:1261] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:33.079980  8272 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:33.184214  7937 raft_consensus.cc:1261] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:33.185518  8272 consensus_queue.cc:1035] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:33.193457  8086 raft_consensus.cc:1261] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:33.194715  8254 consensus_queue.cc:1035] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:33.348815  7937 raft_consensus.cc:1261] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:33.350045  8272 consensus_queue.cc:1035] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:33.359766  8086 raft_consensus.cc:1261] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:33.360973  8254 consensus_queue.cc:1035] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:33.457782  8086 raft_consensus.cc:1261] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:41:33.458853  8256 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:41:33.462105  7937 raft_consensus.cc:1261] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Refusing update from remote peer eb839cfc0c4440cea6c2cfc648cc74ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:41:33.463749  8256 consensus_queue.cc:1035] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:41:35.447342  7803 auto_leader_rebalancer-test.cc:303] The leader distribution is 
I20260925 16:41:35.448068  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:35.455602  8012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:48832
I20260925 16:41:35.456466  8012 raft_consensus.cc:595] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Received request to transfer leadership to TS 5bb1ea128eb14737a6bd37572c8fc277
I20260925 16:41:35.458986  8012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48832
I20260925 16:41:35.459448  8012 raft_consensus.cc:595] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:35.461714  8012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37d399e7636147219d5ac732820d6db1"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48832
I20260925 16:41:35.462198  8012 raft_consensus.cc:595] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:35.464488  8012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:48832
I20260925 16:41:35.465277  8012 raft_consensus.cc:595] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Received request to transfer leadership to TS 5bb1ea128eb14737a6bd37572c8fc277
I20260925 16:41:35.467754  8012 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a"
dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
mode: GRACEFUL
new_leader_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48832
I20260925 16:41:35.468236  8012 raft_consensus.cc:595] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Received request to transfer leadership to TS c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:35.469293  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:41:35.469754  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:35.519980  8271 raft_consensus.cc:979] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:35.520498  8287 raft_consensus.cc:1067] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:35.521884  7938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48118
I20260925 16:41:35.522421  7938 raft_consensus.cc:482] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:35.522780  7938 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:35.529786  7938 raft_consensus.cc:504] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.531889  7938 leader_election.cc:288] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 3 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:35.533025  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:35.533378  8086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:35.533864  8012 raft_consensus.cc:3032] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:35.533962  8086 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:35.534272  8012 raft_consensus.cc:729] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:35.535097  8012 consensus_queue.cc:260] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.536847  8012 raft_consensus.cc:3037] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:35.541733  8086 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 3.
I20260925 16:41:35.543052  7901 leader_election.cc:302] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:35.544219  8012 raft_consensus.cc:2454] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 3.
I20260925 16:41:35.544880  8288 raft_consensus.cc:2781] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:35.545893  8288 raft_consensus.cc:686] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 3 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:35.546705  8288 consensus_queue.cc:237] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.553189  7834 catalog_manager.cc:5495] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 2 to 3, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 3 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:35.735474  8287 raft_consensus.cc:979] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:35.735898  8271 raft_consensus.cc:1067] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Signalling peer 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:35.737293  8086 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:40404
I20260925 16:41:35.737775  8086 raft_consensus.cc:482] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:35.738036  8086 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:35.742969  8086 raft_consensus.cc:504] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:35.744938  8086 leader_election.cc:288] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 4 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361)
I20260925 16:41:35.745880  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:35.746049  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:35.746403  8012 raft_consensus.cc:3032] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:41:35.746613  7938 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:35.746789  8012 raft_consensus.cc:729] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:35.747546  8012 consensus_queue.cc:260] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:35.749042  8012 raft_consensus.cc:3037] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:41:35.751570  7938 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 4.
I20260925 16:41:35.752686  8050 leader_election.cc:302] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:35.753712  8257 raft_consensus.cc:2781] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:41:35.754619  8012 raft_consensus.cc:2454] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 4.
I20260925 16:41:35.755125  8257 raft_consensus.cc:686] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:35.756106  8257 consensus_queue.cc:237] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:35.763439  7834 catalog_manager.cc:5495] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 3 to 4, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 4 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:35.795099  8287 raft_consensus.cc:979] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:35.795517  8271 raft_consensus.cc:1067] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:35.796844  7938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48118
I20260925 16:41:35.797233  7938 raft_consensus.cc:482] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:35.797446  7938 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:35.801227  7938 raft_consensus.cc:504] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.802457  7938 leader_election.cc:288] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 3 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:35.803304  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:35.803519  8086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e833e58421e46a6853b25a01b8f4c22" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:35.803885  8012 raft_consensus.cc:3032] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:35.804116  8086 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:35.804226  8012 raft_consensus.cc:729] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:35.804903  8012 consensus_queue.cc:260] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.805787  8012 raft_consensus.cc:3037] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:35.809157  8086 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 3.
I20260925 16:41:35.810202  7901 leader_election.cc:302] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:35.810925  8288 raft_consensus.cc:2781] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:35.811328  8288 raft_consensus.cc:686] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 3 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:35.811409  8012 raft_consensus.cc:2454] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 3.
I20260925 16:41:35.812095  8288 consensus_queue.cc:237] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.819828  7834 catalog_manager.cc:5495] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 2 to 3, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 3 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:35.910702  8287 raft_consensus.cc:979] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:35.911234  8271 raft_consensus.cc:1067] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Signalling peer 5bb1ea128eb14737a6bd37572c8fc277 to start an election
I20260925 16:41:35.912534  8086 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b"
dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
 from {username='slave'} at 127.0.0.1:40404
I20260925 16:41:35.913079  8086 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:35.913347  8086 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:41:35.918108  8086 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.919531  8086 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 5 election: Requested vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:35.920599  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:35.920521  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
I20260925 16:41:35.921283  8012 raft_consensus.cc:3032] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:41:35.921301  7938 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:41:35.921800  8012 raft_consensus.cc:729] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:35.922627  8012 consensus_queue.cc:260] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.923946  8012 raft_consensus.cc:3037] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:41:35.928285  7938 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 5.
I20260925 16:41:35.929455  8050 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:35.930261  8257 raft_consensus.cc:2781] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:41:35.930652  8257 raft_consensus.cc:686] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 5 LEADER]: Becoming Leader. State: Replica: 5bb1ea128eb14737a6bd37572c8fc277, State: Running, Role: LEADER
I20260925 16:41:35.930955  8012 raft_consensus.cc:2454] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5bb1ea128eb14737a6bd37572c8fc277 in term 5.
I20260925 16:41:35.931511  8257 consensus_queue.cc:237] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:35.937868  7834 catalog_manager.cc:5495] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 reported cstate change: term changed from 4 to 5, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195). New cstate: current_term: 5 leader_uuid: "5bb1ea128eb14737a6bd37572c8fc277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:36.042752  8287 raft_consensus.cc:979] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: : Instructing follower c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:36.043231  8271 raft_consensus.cc:1067] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Signalling peer c84c24d7432b4c5199e5279df1ede07f to start an election
I20260925 16:41:36.044785  7938 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37d399e7636147219d5ac732820d6db1"
dest_uuid: "c84c24d7432b4c5199e5279df1ede07f"
 from {username='slave'} at 127.0.0.1:48118
I20260925 16:41:36.045336  7938 raft_consensus.cc:482] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:36.045642  7938 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:36.046348  8086 raft_consensus.cc:1261] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:36.047741  8288 consensus_queue.cc:1035] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:36.052045  7938 raft_consensus.cc:504] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:36.053676  7938 leader_election.cc:288] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 3 election: Requested vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:36.054966  8086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277"
I20260925 16:41:36.056118  8086 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:36.060340  8013 raft_consensus.cc:1261] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:36.054987  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad"
I20260925 16:41:36.062521  8012 raft_consensus.cc:3032] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:36.062884  8012 raft_consensus.cc:729] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eb839cfc0c4440cea6c2cfc648cc74ad, State: Running, Role: LEADER
I20260925 16:41:36.064082  8086 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 3.
I20260925 16:41:36.064899  8288 consensus_queue.cc:1035] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:36.065934  7901 leader_election.cc:302] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f; no voters: 
I20260925 16:41:36.065557  8012 consensus_queue.cc:260] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:36.066936  8289 raft_consensus.cc:2781] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:36.067772  8012 raft_consensus.cc:3037] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:36.069568  8289 raft_consensus.cc:686] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 3 LEADER]: Becoming Leader. State: Replica: c84c24d7432b4c5199e5279df1ede07f, State: Running, Role: LEADER
I20260925 16:41:36.070549  8289 consensus_queue.cc:237] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:36.075219  8012 raft_consensus.cc:2454] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c84c24d7432b4c5199e5279df1ede07f in term 3.
I20260925 16:41:36.087630  7833 catalog_manager.cc:5495] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f reported cstate change: term changed from 2 to 3, leader changed from eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194) to c84c24d7432b4c5199e5279df1ede07f (127.7.158.193). New cstate: current_term: 3 leader_uuid: "c84c24d7432b4c5199e5279df1ede07f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:36.223896  7938 raft_consensus.cc:1261] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:41:36.224951  8257 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:41:36.232915  8013 raft_consensus.cc:1261] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:41:36.234385  8307 consensus_queue.cc:1035] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:41:36.313560  8013 raft_consensus.cc:1261] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:36.314631  8289 consensus_queue.cc:1035] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:36.323329  8086 raft_consensus.cc:1261] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:36.324913  8288 consensus_queue.cc:1035] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:36.470522  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:36.475485  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:36.475895  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:36.536334  8013 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 5 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260925 16:41:36.537786  8307 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:41:36.546306  7938 raft_consensus.cc:1261] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Refusing update from remote peer 5bb1ea128eb14737a6bd37572c8fc277: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260925 16:41:36.547919  8307 consensus_queue.cc:1035] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:41:36.571025  8013 raft_consensus.cc:1261] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:36.572235  8302 consensus_queue.cc:1035] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:36.580314  8086 raft_consensus.cc:1261] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Refusing update from remote peer c84c24d7432b4c5199e5279df1ede07f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:36.581983  8302 consensus_queue.cc:1035] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [LEADER]: Connected to new peer: Peer: permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:37.476735  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:37.482013  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:37.482340  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:39.084880  8318 raft_consensus.cc:482] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c84c24d7432b4c5199e5279df1ede07f)
I20260925 16:41:39.085829  8318 raft_consensus.cc:504] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:39.092456  8318 leader_election.cc:288] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:39.168099  8319 raft_consensus.cc:482] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 5bb1ea128eb14737a6bd37572c8fc277)
I20260925 16:41:39.168648  8319 raft_consensus.cc:504] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:39.170653  8319 leader_election.cc:288] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:39.186226  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
W20260925 16:41:39.188993  7976 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:42361, user_credentials={real_user=slave}} blocked reactor thread for 100597us
I20260925 16:41:39.190464  8323 raft_consensus.cc:482] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 5bb1ea128eb14737a6bd37572c8fc277)
I20260925 16:41:39.190869  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:39.190975  8323 raft_consensus.cc:504] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:39.193137  8323 leader_election.cc:288] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999)
I20260925 16:41:39.193697  7938 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:39.206683  8085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53f2492fa3a8440a8b1ac90f8d82ab2b" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:39.214020  8321 raft_consensus.cc:482] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader c84c24d7432b4c5199e5279df1ede07f)
I20260925 16:41:39.214589  8321 raft_consensus.cc:504] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } }
I20260925 16:41:39.219681  7901 leader_election.cc:302] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f; no voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:39.220480  8319 raft_consensus.cc:2726] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:41:39.221576  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37d399e7636147219d5ac732820d6db1" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:39.223763  8087 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9d93a2fc10e64345bacd9f34783a4824" candidate_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:39.226403  8321 leader_election.cc:288] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:39.227597  7976 leader_election.cc:302] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:39.228528  7976 leader_election.cc:302] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eb839cfc0c4440cea6c2cfc648cc74ad; no voters: 5bb1ea128eb14737a6bd37572c8fc277, c84c24d7432b4c5199e5279df1ede07f
I20260925 16:41:39.229087  8323 raft_consensus.cc:2726] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:41:39.229439  8317 raft_consensus.cc:2726] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:41:39.230790  8012 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:39.232026  7937 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66d4643efd024a70926479d8c6ca279a" candidate_uuid: "5bb1ea128eb14737a6bd37572c8fc277" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "c84c24d7432b4c5199e5279df1ede07f" is_pre_election: true
I20260925 16:41:39.233067  8050 leader_election.cc:302] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5bb1ea128eb14737a6bd37572c8fc277; no voters: c84c24d7432b4c5199e5279df1ede07f, eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:39.233651  8322 raft_consensus.cc:2726] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:41:39.302908  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:39.307571  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:39.308115  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:39.611482  8319 raft_consensus.cc:482] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 5bb1ea128eb14737a6bd37572c8fc277)
I20260925 16:41:39.612097  8319 raft_consensus.cc:504] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5bb1ea128eb14737a6bd37572c8fc277" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43999 } } peers { permanent_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 36681 } } peers { permanent_uuid: "c84c24d7432b4c5199e5279df1ede07f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 42361 } }
I20260925 16:41:39.613855  8319 leader_election.cc:288] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 5bb1ea128eb14737a6bd37572c8fc277 (127.7.158.195:43999), eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681)
I20260925 16:41:39.614560  8086 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "5bb1ea128eb14737a6bd37572c8fc277" is_pre_election: true
I20260925 16:41:39.615309  8013 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "25ad7d21572a4747bf0ed3ef12e17298" candidate_uuid: "c84c24d7432b4c5199e5279df1ede07f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "eb839cfc0c4440cea6c2cfc648cc74ad" is_pre_election: true
I20260925 16:41:39.616322  7901 leader_election.cc:302] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c84c24d7432b4c5199e5279df1ede07f; no voters: 5bb1ea128eb14737a6bd37572c8fc277, eb839cfc0c4440cea6c2cfc648cc74ad
I20260925 16:41:39.616865  8319 raft_consensus.cc:2726] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:41:39.984220  8108 debug-util.cc:398] Leaking SignalData structure 0x7b0800174060 after lost signal to thread 7806
W20260925 16:41:39.985046  8108 debug-util.cc:398] Leaking SignalData structure 0x7b0800174740 after lost signal to thread 7869
W20260925 16:41:39.985845  8108 debug-util.cc:398] Leaking SignalData structure 0x7b080014c7a0 after lost signal to thread 7962
W20260925 16:41:39.986531  8108 debug-util.cc:398] Leaking SignalData structure 0x7b08000cb5a0 after lost signal to thread 8037
W20260925 16:41:39.987272  8108 debug-util.cc:398] Leaking SignalData structure 0x7b080014d420 after lost signal to thread 8111
I20260925 16:41:40.309542  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:40.317292  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:40.317852  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:41.319037  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:41.325455  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:41.325879  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:42.326761  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:42.332118  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:42.332556  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:43.333405  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:43.339031  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:43.339617  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:44.340770  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:44.345631  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:44.346071  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:45.356599  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:45.362006  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:45.362430  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260925 16:41:45.944746  7866 debug-util.cc:398] Leaking SignalData structure 0x7b0800060060 after lost signal to thread 7806
W20260925 16:41:45.946118  7866 debug-util.cc:398] Leaking SignalData structure 0x7b0800060740 after lost signal to thread 7869
W20260925 16:41:45.947247  7866 debug-util.cc:398] Leaking SignalData structure 0x7b0800200920 after lost signal to thread 7962
W20260925 16:41:45.948458  7866 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf4c0 after lost signal to thread 8037
W20260925 16:41:45.949608  7866 debug-util.cc:398] Leaking SignalData structure 0x7b0800099fc0 after lost signal to thread 8111
I20260925 16:41:46.393697  7803 auto_leader_rebalancer-test.cc:314] The leader distribution is 
I20260925 16:41:46.394361  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
I20260925 16:41:46.443037  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:41:46.444074  7803 tablet_replica.cc:330] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.445216  7803 raft_consensus.cc:2229] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.446645  7803 raft_consensus.cc:2258] T 66d4643efd024a70926479d8c6ca279a P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.450464  7803 tablet_replica.cc:330] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.451229  7803 raft_consensus.cc:2229] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.452337  7803 raft_consensus.cc:2258] T 2e833e58421e46a6853b25a01b8f4c22 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.454696  7803 tablet_replica.cc:330] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.455384  7803 raft_consensus.cc:2229] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.455991  7803 raft_consensus.cc:2258] T 53f2492fa3a8440a8b1ac90f8d82ab2b P c84c24d7432b4c5199e5279df1ede07f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.458330  7803 tablet_replica.cc:330] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.459014  7803 raft_consensus.cc:2229] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.459539  7803 raft_consensus.cc:2258] T e350b23835b34ebf8ec454fc59172d64 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.462059  7803 tablet_replica.cc:330] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.462798  7803 raft_consensus.cc:2229] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.463343  7803 raft_consensus.cc:2258] T 9d93a2fc10e64345bacd9f34783a4824 P c84c24d7432b4c5199e5279df1ede07f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.465719  7803 tablet_replica.cc:330] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.466379  7803 raft_consensus.cc:2229] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.466974  7803 raft_consensus.cc:2258] T 25ad7d21572a4747bf0ed3ef12e17298 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.469342  7803 tablet_replica.cc:330] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.470060  7803 raft_consensus.cc:2229] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.470631  7803 raft_consensus.cc:2258] T a8eabf5c51c24475aacfa3f5bba75918 P c84c24d7432b4c5199e5279df1ede07f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.472930  7803 tablet_replica.cc:330] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.473564  7803 raft_consensus.cc:2229] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.474207  7803 raft_consensus.cc:2258] T ac3eebd810d04ede904996ec2e155b36 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.476691  7803 tablet_replica.cc:330] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f: stopping tablet replica
I20260925 16:41:46.477327  7803 raft_consensus.cc:2229] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.478307  7803 raft_consensus.cc:2258] T 37d399e7636147219d5ac732820d6db1 P c84c24d7432b4c5199e5279df1ede07f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:41:46.573163  8050 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:42361: connect: Connection refused (error 111)
I20260925 16:41:46.576365  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
W20260925 16:41:46.579201  8050 consensus_peers.cc:487] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 -> Peer c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361): Couldn't send request to peer c84c24d7432b4c5199e5279df1ede07f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:42361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:41:46.579777  8050 consensus_peers.cc:487] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 -> Peer c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361): Couldn't send request to peer c84c24d7432b4c5199e5279df1ede07f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:42361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:41:46.604666  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
I20260925 16:41:46.645673  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:41:46.646394  7803 tablet_replica.cc:330] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.646950  7803 raft_consensus.cc:2229] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.647459  7803 raft_consensus.cc:2258] T 9d93a2fc10e64345bacd9f34783a4824 P eb839cfc0c4440cea6c2cfc648cc74ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.649199  7803 tablet_replica.cc:330] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.649657  7803 raft_consensus.cc:2229] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.650416  7803 raft_consensus.cc:2258] T a8eabf5c51c24475aacfa3f5bba75918 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.652047  7803 tablet_replica.cc:330] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.652508  7803 raft_consensus.cc:2229] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.653475  7803 raft_consensus.cc:2258] T ac3eebd810d04ede904996ec2e155b36 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.655831  7803 tablet_replica.cc:330] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.656512  7803 raft_consensus.cc:2229] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.657402  7803 raft_consensus.cc:2258] T 53f2492fa3a8440a8b1ac90f8d82ab2b P eb839cfc0c4440cea6c2cfc648cc74ad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.659001  7803 tablet_replica.cc:330] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.659437  7803 raft_consensus.cc:2229] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.660241  7803 raft_consensus.cc:2258] T e350b23835b34ebf8ec454fc59172d64 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.662035  7803 tablet_replica.cc:330] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.662500  7803 raft_consensus.cc:2229] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.662904  7803 raft_consensus.cc:2258] T 2e833e58421e46a6853b25a01b8f4c22 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.664827  7803 tablet_replica.cc:330] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.665653  7803 raft_consensus.cc:2229] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.666101  7803 raft_consensus.cc:2258] T 25ad7d21572a4747bf0ed3ef12e17298 P eb839cfc0c4440cea6c2cfc648cc74ad [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.668196  7803 tablet_replica.cc:330] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
W20260925 16:41:46.668411  8050 consensus_peers.cc:487] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 -> Peer c84c24d7432b4c5199e5279df1ede07f (127.7.158.193:42361): Couldn't send request to peer c84c24d7432b4c5199e5279df1ede07f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:42361: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:41:46.668833  7803 raft_consensus.cc:2229] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.669350  7803 raft_consensus.cc:2258] T 37d399e7636147219d5ac732820d6db1 P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.671058  7803 tablet_replica.cc:330] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad: stopping tablet replica
I20260925 16:41:46.671471  7803 raft_consensus.cc:2229] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.671880  7803 raft_consensus.cc:2258] T 66d4643efd024a70926479d8c6ca279a P eb839cfc0c4440cea6c2cfc648cc74ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.701961  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:41:46.719352  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
I20260925 16:41:46.755815  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:41:46.757503  7803 tablet_replica.cc:330] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.758527  7803 raft_consensus.cc:2229] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.759207  7803 raft_consensus.cc:2258] T 66d4643efd024a70926479d8c6ca279a P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:41:46.759733  8050 consensus_peers.cc:487] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 -> Peer eb839cfc0c4440cea6c2cfc648cc74ad (127.7.158.194:36681): Couldn't send request to peer eb839cfc0c4440cea6c2cfc648cc74ad. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:36681: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:41:46.761889  7803 tablet_replica.cc:330] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.762683  7803 raft_consensus.cc:2229] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.763224  7803 raft_consensus.cc:2258] T ac3eebd810d04ede904996ec2e155b36 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.765590  7803 tablet_replica.cc:330] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.766314  7803 raft_consensus.cc:2229] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.766898  7803 raft_consensus.cc:2258] T a8eabf5c51c24475aacfa3f5bba75918 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.769405  7803 tablet_replica.cc:330] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.770156  7803 raft_consensus.cc:2229] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 5 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.771174  7803 raft_consensus.cc:2258] T 53f2492fa3a8440a8b1ac90f8d82ab2b P 5bb1ea128eb14737a6bd37572c8fc277 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.773447  7803 tablet_replica.cc:330] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.774194  7803 raft_consensus.cc:2229] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.774781  7803 raft_consensus.cc:2258] T 2e833e58421e46a6853b25a01b8f4c22 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.777079  7803 tablet_replica.cc:330] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.777779  7803 raft_consensus.cc:2229] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.778342  7803 raft_consensus.cc:2258] T e350b23835b34ebf8ec454fc59172d64 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.780797  7803 tablet_replica.cc:330] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.781481  7803 raft_consensus.cc:2229] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:41:46.782030  7803 raft_consensus.cc:2258] T 37d399e7636147219d5ac732820d6db1 P 5bb1ea128eb14737a6bd37572c8fc277 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.784420  7803 tablet_replica.cc:330] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.785068  7803 raft_consensus.cc:2229] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.786057  7803 raft_consensus.cc:2258] T 9d93a2fc10e64345bacd9f34783a4824 P 5bb1ea128eb14737a6bd37572c8fc277 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.788349  7803 tablet_replica.cc:330] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277: stopping tablet replica
I20260925 16:41:46.788964  7803 raft_consensus.cc:2229] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 LEADER]: Raft consensus shutting down.
I20260925 16:41:46.789911  7803 raft_consensus.cc:2258] T 25ad7d21572a4747bf0ed3ef12e17298 P 5bb1ea128eb14737a6bd37572c8fc277 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:46.828364  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:41:46.847265  7803 master.cc:537] Master@127.7.158.254:39379 shutting down...
I20260925 16:41:46.903075  7890 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Closing
I20260925 16:41:47.009692  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:41:47.010528  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:41:47.010890  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P afdf4f6022df42a08a7e1bfe92fe2827: stopping tablet replica
W20260925 16:41:48.027319  7803 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 7866)
I20260925 16:41:48.105130  7803 master.cc:552] Master@127.7.158.254:39379 shutdown complete.
5bb1ea128eb14737a6bd37572c8fc277  1
c84c24d7432b4c5199e5279df1ede07f  4
eb839cfc0c4440cea6c2cfc648cc74ad  4
5bb1ea128eb14737a6bd37572c8fc277  3
c84c24d7432b4c5199e5279df1ede07f  3
eb839cfc0c4440cea6c2cfc648cc74ad  3
5bb1ea128eb14737a6bd37572c8fc277  1
c84c24d7432b4c5199e5279df1ede07f  0
eb839cfc0c4440cea6c2cfc648cc74ad  8
5bb1ea128eb14737a6bd37572c8fc277  3
c84c24d7432b4c5199e5279df1ede07f  3
eb839cfc0c4440cea6c2cfc648cc74ad  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (33056 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260925 16:41:48.145885  7803 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.158.254:34215
I20260925 16:41:48.146919  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:48.152325  8336 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.152792  8337 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.154731  8339 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:48.155128  7803 server_base.cc:1034] running on GCE node
I20260925 16:41:48.156589  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:48.156766  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:48.156970  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354508156957 us; error 0 us; skew 500 ppm
I20260925 16:41:48.157524  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:48.160010  7803 webserver.cc:460] Webserver started at http://127.7.158.254:41947/ using document root <none> and password file <none>
I20260925 16:41:48.160485  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:48.160663  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:48.160954  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:48.162101  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/master-0-root/instance:
uuid: "e6c54614a66b491fb8424d51ded64631"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.166451  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260925 16:41:48.169596  8344 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.170452  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260925 16:41:48.170676  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/master-0-root
uuid: "e6c54614a66b491fb8424d51ded64631"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.170900  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:48.203050  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:48.204309  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:48.242887  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.254:34215
I20260925 16:41:48.242995  8395 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.254:34215 every 8 connection(s)
I20260925 16:41:48.247006  8396 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.255796  8396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631: Bootstrap starting.
I20260925 16:41:48.260052  8396 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:48.264002  8396 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631: No bootstrap required, opened a new log
I20260925 16:41:48.265949  8396 raft_consensus.cc:348] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c54614a66b491fb8424d51ded64631" member_type: VOTER }
I20260925 16:41:48.266368  8396 raft_consensus.cc:374] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:48.266542  8396 raft_consensus.cc:729] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e6c54614a66b491fb8424d51ded64631, State: Initialized, Role: FOLLOWER
I20260925 16:41:48.267058  8396 consensus_queue.cc:260] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c54614a66b491fb8424d51ded64631" member_type: VOTER }
I20260925 16:41:48.267457  8396 raft_consensus.cc:388] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 16:41:48.267632  8396 raft_consensus.cc:482] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 16:41:48.267863  8396 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:48.271435  8396 raft_consensus.cc:504] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c54614a66b491fb8424d51ded64631" member_type: VOTER }
I20260925 16:41:48.271901  8396 leader_election.cc:302] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e6c54614a66b491fb8424d51ded64631; no voters: 
I20260925 16:41:48.273131  8396 leader_election.cc:288] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260925 16:41:48.273542  8399 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:48.274819  8399 raft_consensus.cc:686] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 1 LEADER]: Becoming Leader. State: Replica: e6c54614a66b491fb8424d51ded64631, State: Running, Role: LEADER
I20260925 16:41:48.275439  8399 consensus_queue.cc:237] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c54614a66b491fb8424d51ded64631" member_type: VOTER }
I20260925 16:41:48.275856  8396 sys_catalog.cc:564] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 16:41:48.281273  8400 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e6c54614a66b491fb8424d51ded64631" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c54614a66b491fb8424d51ded64631" member_type: VOTER } }
I20260925 16:41:48.281342  8401 sys_catalog.cc:455] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e6c54614a66b491fb8424d51ded64631. Latest consensus state: current_term: 1 leader_uuid: "e6c54614a66b491fb8424d51ded64631" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e6c54614a66b491fb8424d51ded64631" member_type: VOTER } }
I20260925 16:41:48.282050  8400 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [sys.catalog]: This master's current role is: LEADER
I20260925 16:41:48.282135  8401 sys_catalog.cc:458] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [sys.catalog]: This master's current role is: LEADER
I20260925 16:41:48.285607  8407 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 16:41:48.291517  8407 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 16:41:48.292490  7803 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260925 16:41:48.299827  8407 catalog_manager.cc:1347] Generated new cluster ID: 1107db39578e41e3b0fdd67dad16261a
I20260925 16:41:48.300098  8407 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 16:41:48.331374  8407 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 16:41:48.332904  8407 catalog_manager.cc:1504] Loading token signing keys...
I20260925 16:41:48.343039  8407 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631: Generated new TSK 0
I20260925 16:41:48.343665  8407 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 16:41:48.359103  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:48.364923  8417 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.366513  8418 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:48.368474  7803 server_base.cc:1034] running on GCE node
W20260925 16:41:48.368629  8420 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:48.369598  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:48.369771  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:48.369927  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354508369918 us; error 0 us; skew 500 ppm
I20260925 16:41:48.370373  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:48.373291  7803 webserver.cc:460] Webserver started at http://127.7.158.193:32959/ using document root <none> and password file <none>
I20260925 16:41:48.373716  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:48.373864  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:48.374059  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:48.375078  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-0-root/instance:
uuid: "aa2cc69f88224272b81308853b221104"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.379525  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260925 16:41:48.382730  8425 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.383456  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260925 16:41:48.383773  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "aa2cc69f88224272b81308853b221104"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.384032  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:48.402089  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:48.403203  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:48.404636  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:41:48.407116  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:41:48.407366  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.407613  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:41:48.407819  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260925 16:41:48.450929  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:39923
I20260925 16:41:48.451035  8487 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:39923 every 8 connection(s)
I20260925 16:41:48.477859  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:48.485176  8491 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.486176  8492 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.506208  8494 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:48.507180  7803 server_base.cc:1034] running on GCE node
I20260925 16:41:48.509114  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:48.509398  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:48.509601  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354508509587 us; error 0 us; skew 500 ppm
I20260925 16:41:48.510365  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:48.514146  7803 webserver.cc:460] Webserver started at http://127.7.158.194:34691/ using document root <none> and password file <none>
I20260925 16:41:48.514814  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:48.515089  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:48.515447  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:48.517405  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-1-root/instance:
uuid: "35c23059c70d46b09a2e26c3589aa4ab"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.524338  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:41:48.530030  8499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.531536  7803 fs_manager.cc:725] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260925 16:41:48.531944  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-1-root
uuid: "35c23059c70d46b09a2e26c3589aa4ab"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.532361  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:48.557235  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:48.558375  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:48.560042  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:41:48.562566  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:41:48.562872  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.563146  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:41:48.563313  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.566588  8488 heartbeater.cc:347] Connected to a master server at 127.7.158.254:34215
I20260925 16:41:48.566951  8488 heartbeater.cc:464] Registering TS with master...
I20260925 16:41:48.567567  8488 heartbeater.cc:511] Master 127.7.158.254:34215 requested a full tablet report, sending...
I20260925 16:41:48.569512  8361 ts_manager.cc:194] Registered new tserver with Master: aa2cc69f88224272b81308853b221104 (127.7.158.193:39923)
I20260925 16:41:48.571516  8361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51596
I20260925 16:41:48.606056  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.194:45477
I20260925 16:41:48.606295  8562 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.194:45477 every 8 connection(s)
I20260925 16:41:48.610437  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:41:48.618980  8566 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.619856  8567 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:41:48.620630  8569 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:41:48.620682  7803 server_base.cc:1034] running on GCE node
I20260925 16:41:48.621806  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:41:48.622066  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:41:48.622304  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354508622288 us; error 0 us; skew 500 ppm
I20260925 16:41:48.622921  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:41:48.625288  8563 heartbeater.cc:347] Connected to a master server at 127.7.158.254:34215
I20260925 16:41:48.625685  8563 heartbeater.cc:464] Registering TS with master...
I20260925 16:41:48.625805  7803 webserver.cc:460] Webserver started at http://127.7.158.195:39497/ using document root <none> and password file <none>
I20260925 16:41:48.626281  8563 heartbeater.cc:511] Master 127.7.158.254:34215 requested a full tablet report, sending...
I20260925 16:41:48.626366  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:41:48.626643  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:41:48.626914  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:41:48.628078  8361 ts_manager.cc:194] Registered new tserver with Master: 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:48.628216  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-2-root/instance:
uuid: "1768714aa483470592b88b8f4d4b95de"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.629462  8361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51608
I20260925 16:41:48.632740  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260925 16:41:48.636646  8574 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.637598  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260925 16:41:48.637883  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-2-root
uuid: "1768714aa483470592b88b8f4d4b95de"
format_stamp: "Formatted at 2026-09-25 16:41:48 on dist-test-slave-fknp"
I20260925 16:41:48.638123  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1790354474930402-7803-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:41:48.648281  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:41:48.649333  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:41:48.650671  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:41:48.652719  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:41:48.652932  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.653147  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:41:48.653304  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:41:48.693583  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.195:39249
I20260925 16:41:48.693674  8636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.195:39249 every 8 connection(s)
I20260925 16:41:48.708792  8637 heartbeater.cc:347] Connected to a master server at 127.7.158.254:34215
I20260925 16:41:48.709194  8637 heartbeater.cc:464] Registering TS with master...
I20260925 16:41:48.709759  8637 heartbeater.cc:511] Master 127.7.158.254:34215 requested a full tablet report, sending...
I20260925 16:41:48.711483  8361 ts_manager.cc:194] Registered new tserver with Master: 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:48.712584  7803 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015849764s
I20260925 16:41:48.712965  8361 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:51612
I20260925 16:41:48.715077  7803 test_util.cc:268] Using random seed: 1686344749
I20260925 16:41:48.737823  8361 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:51614:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:41:48.740935  8361 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:41:48.823335  8600 tablet_service.cc:1467] Processing CreateTablet for tablet d46f9745813a4ce4bf0aa8c579ce6b19 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260925 16:41:48.823659  8599 tablet_service.cc:1467] Processing CreateTablet for tablet a3d80556614546209830bdea088a94f0 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260925 16:41:48.824858  8600 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d46f9745813a4ce4bf0aa8c579ce6b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.824700  8602 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6ab8102cb34b178f2316fde12cb4af (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260925 16:41:48.825924  8602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6ab8102cb34b178f2316fde12cb4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.827566  8599 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d80556614546209830bdea088a94f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.828884  8601 tablet_service.cc:1467] Processing CreateTablet for tablet 3fb34bad4cee4832805bb62a4ff53dd1 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260925 16:41:48.830129  8601 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fb34bad4cee4832805bb62a4ff53dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.832437  8598 tablet_service.cc:1467] Processing CreateTablet for tablet 78176a1c4b6742029eb85d03fa7a50ad (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260925 16:41:48.833678  8598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78176a1c4b6742029eb85d03fa7a50ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.836853  8597 tablet_service.cc:1467] Processing CreateTablet for tablet a68afe3dc3e14f7297388fc4ab5710fe (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260925 16:41:48.838179  8597 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a68afe3dc3e14f7297388fc4ab5710fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.838418  8527 tablet_service.cc:1467] Processing CreateTablet for tablet 3fb34bad4cee4832805bb62a4ff53dd1 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260925 16:41:48.839672  8527 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fb34bad4cee4832805bb62a4ff53dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.840830  8596 tablet_service.cc:1467] Processing CreateTablet for tablet 9e49655387224b6fa47a374a4e8f425f (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260925 16:41:48.842053  8596 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e49655387224b6fa47a374a4e8f425f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.848776  8451 tablet_service.cc:1467] Processing CreateTablet for tablet d46f9745813a4ce4bf0aa8c579ce6b19 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260925 16:41:48.848951  8526 tablet_service.cc:1467] Processing CreateTablet for tablet d46f9745813a4ce4bf0aa8c579ce6b19 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260925 16:41:48.849202  8447 tablet_service.cc:1467] Processing CreateTablet for tablet 9e49655387224b6fa47a374a4e8f425f (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260925 16:41:48.850059  8451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d46f9745813a4ce4bf0aa8c579ce6b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.850236  8526 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d46f9745813a4ce4bf0aa8c579ce6b19. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.851166  8446 tablet_service.cc:1467] Processing CreateTablet for tablet 63e128a1932f4ff893465dae9787f44a (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260925 16:41:48.851475  8450 tablet_service.cc:1467] Processing CreateTablet for tablet a3d80556614546209830bdea088a94f0 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260925 16:41:48.852432  8446 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63e128a1932f4ff893465dae9787f44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.852772  8448 tablet_service.cc:1467] Processing CreateTablet for tablet a68afe3dc3e14f7297388fc4ab5710fe (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260925 16:41:48.853571  8449 tablet_service.cc:1467] Processing CreateTablet for tablet 78176a1c4b6742029eb85d03fa7a50ad (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260925 16:41:48.853999  8448 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a68afe3dc3e14f7297388fc4ab5710fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.854768  8449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78176a1c4b6742029eb85d03fa7a50ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.838207  8528 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6ab8102cb34b178f2316fde12cb4af (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260925 16:41:48.849905  8453 tablet_service.cc:1467] Processing CreateTablet for tablet 1c6ab8102cb34b178f2316fde12cb4af (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260925 16:41:48.856467  8453 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6ab8102cb34b178f2316fde12cb4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.847383  8452 tablet_service.cc:1467] Processing CreateTablet for tablet 3fb34bad4cee4832805bb62a4ff53dd1 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260925 16:41:48.857494  8452 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fb34bad4cee4832805bb62a4ff53dd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.856467  8528 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1c6ab8102cb34b178f2316fde12cb4af. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.861415  8525 tablet_service.cc:1467] Processing CreateTablet for tablet a3d80556614546209830bdea088a94f0 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260925 16:41:48.861455  8445 tablet_service.cc:1467] Processing CreateTablet for tablet 080e93645b724ef6a5c06f691d2a20e7 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260925 16:41:48.862713  8525 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d80556614546209830bdea088a94f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.864225  8444 tablet_service.cc:1467] Processing CreateTablet for tablet ebd8f07f558b4fcc8c6c1af896753cae (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260925 16:41:48.865391  8595 tablet_service.cc:1467] Processing CreateTablet for tablet 63e128a1932f4ff893465dae9787f44a (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260925 16:41:48.866671  8595 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63e128a1932f4ff893465dae9787f44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.860018  8450 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3d80556614546209830bdea088a94f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.869632  8594 tablet_service.cc:1467] Processing CreateTablet for tablet 080e93645b724ef6a5c06f691d2a20e7 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260925 16:41:48.871999  8447 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e49655387224b6fa47a374a4e8f425f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.872439  8593 tablet_service.cc:1467] Processing CreateTablet for tablet ebd8f07f558b4fcc8c6c1af896753cae (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260925 16:41:48.873548  8653 tablet_bootstrap.cc:492] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:48.871138  8594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080e93645b724ef6a5c06f691d2a20e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.875982  8445 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080e93645b724ef6a5c06f691d2a20e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.876648  8593 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebd8f07f558b4fcc8c6c1af896753cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.879987  8444 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebd8f07f558b4fcc8c6c1af896753cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.884908  8524 tablet_service.cc:1467] Processing CreateTablet for tablet 78176a1c4b6742029eb85d03fa7a50ad (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260925 16:41:48.885993  8653 tablet_bootstrap.cc:654] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:48.886336  8524 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 78176a1c4b6742029eb85d03fa7a50ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.893859  8523 tablet_service.cc:1467] Processing CreateTablet for tablet a68afe3dc3e14f7297388fc4ab5710fe (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260925 16:41:48.895474  8523 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a68afe3dc3e14f7297388fc4ab5710fe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.906168  8522 tablet_service.cc:1467] Processing CreateTablet for tablet 9e49655387224b6fa47a374a4e8f425f (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260925 16:41:48.907814  8522 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9e49655387224b6fa47a374a4e8f425f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.922016  8521 tablet_service.cc:1467] Processing CreateTablet for tablet 63e128a1932f4ff893465dae9787f44a (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260925 16:41:48.923672  8521 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 63e128a1932f4ff893465dae9787f44a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.929883  8520 tablet_service.cc:1467] Processing CreateTablet for tablet 080e93645b724ef6a5c06f691d2a20e7 (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260925 16:41:48.931456  8520 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 080e93645b724ef6a5c06f691d2a20e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.941125  8519 tablet_service.cc:1467] Processing CreateTablet for tablet ebd8f07f558b4fcc8c6c1af896753cae (DEFAULT_TABLE table=test-workload [id=06adb098334b47a38b181c7b16734efb]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260925 16:41:48.942534  8519 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebd8f07f558b4fcc8c6c1af896753cae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:41:48.958921  8652 tablet_bootstrap.cc:492] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:48.988637  8652 tablet_bootstrap.cc:654] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:48.996075  8653 tablet_bootstrap.cc:492] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:48.996508  8653 ts_tablet_manager.cc:1397] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.123s	user 0.023s	sys 0.016s
I20260925 16:41:48.999449  8653 raft_consensus.cc:348] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.006821  8653 raft_consensus.cc:374] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.007117  8653 raft_consensus.cc:729] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.007802  8653 consensus_queue.cc:260] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.010149  8655 tablet_bootstrap.cc:492] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.014005  8488 heartbeater.cc:503] Master 127.7.158.254:34215 was elected leader, sending a full tablet report...
I20260925 16:41:49.018291  8655 tablet_bootstrap.cc:654] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.019752  8653 ts_tablet_manager.cc:1428] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260925 16:41:49.020704  8653 tablet_bootstrap.cc:492] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.026782  8653 tablet_bootstrap.cc:654] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.027043  8652 tablet_bootstrap.cc:492] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.028050  8652 ts_tablet_manager.cc:1397] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.070s	user 0.007s	sys 0.020s
I20260925 16:41:49.031028  8652 raft_consensus.cc:348] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.032073  8652 raft_consensus.cc:374] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.032501  8652 raft_consensus.cc:729] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.033552  8652 consensus_queue.cc:260] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.038818  8637 heartbeater.cc:503] Master 127.7.158.254:34215 was elected leader, sending a full tablet report...
I20260925 16:41:49.039031  8655 tablet_bootstrap.cc:492] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.039484  8655 ts_tablet_manager.cc:1397] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.007s
I20260925 16:41:49.039623  8652 ts_tablet_manager.cc:1428] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.001s
I20260925 16:41:49.040619  8652 tablet_bootstrap.cc:492] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.042075  8655 raft_consensus.cc:348] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.042801  8655 raft_consensus.cc:374] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.043148  8655 raft_consensus.cc:729] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.044474  8653 tablet_bootstrap.cc:492] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.044951  8653 ts_tablet_manager.cc:1397] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.008s
I20260925 16:41:49.044014  8655 consensus_queue.cc:260] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.047441  8653 raft_consensus.cc:348] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.048233  8653 raft_consensus.cc:374] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.048548  8653 raft_consensus.cc:729] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.049018  8652 tablet_bootstrap.cc:654] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.049365  8653 consensus_queue.cc:260] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.051537  8653 ts_tablet_manager.cc:1428] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:41:49.058089  8653 tablet_bootstrap.cc:492] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.058820  8563 heartbeater.cc:503] Master 127.7.158.254:34215 was elected leader, sending a full tablet report...
I20260925 16:41:49.059003  8655 ts_tablet_manager.cc:1428] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.019s	user 0.011s	sys 0.005s
I20260925 16:41:49.059991  8655 tablet_bootstrap.cc:492] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.064146  8652 tablet_bootstrap.cc:492] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.064688  8652 ts_tablet_manager.cc:1397] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260925 16:41:49.066082  8655 tablet_bootstrap.cc:654] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.067534  8652 raft_consensus.cc:348] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.068406  8652 raft_consensus.cc:374] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.068746  8652 raft_consensus.cc:729] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.069535  8652 consensus_queue.cc:260] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.072315  8652 ts_tablet_manager.cc:1428] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260925 16:41:49.073246  8652 tablet_bootstrap.cc:492] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.076366  8653 tablet_bootstrap.cc:654] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.077364  8655 tablet_bootstrap.cc:492] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.077878  8655 ts_tablet_manager.cc:1397] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.009s
I20260925 16:41:49.079828  8652 tablet_bootstrap.cc:654] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.080585  8655 raft_consensus.cc:348] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.081388  8655 raft_consensus.cc:374] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.081720  8655 raft_consensus.cc:729] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.082506  8655 consensus_queue.cc:260] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.084878  8655 ts_tablet_manager.cc:1428] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:41:49.085767  8655 tablet_bootstrap.cc:492] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.091470  8655 tablet_bootstrap.cc:654] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.094851  8653 tablet_bootstrap.cc:492] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.095557  8653 ts_tablet_manager.cc:1397] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.038s	user 0.020s	sys 0.004s
I20260925 16:41:49.099157  8653 raft_consensus.cc:348] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.100371  8653 raft_consensus.cc:374] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.100841  8653 raft_consensus.cc:729] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.101949  8653 consensus_queue.cc:260] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.103895  8655 tablet_bootstrap.cc:492] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.104533  8655 ts_tablet_manager.cc:1397] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.009s
I20260925 16:41:49.105499  8653 ts_tablet_manager.cc:1428] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260925 16:41:49.105975  8652 tablet_bootstrap.cc:492] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.106443  8653 tablet_bootstrap.cc:492] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.106442  8652 ts_tablet_manager.cc:1397] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.033s	user 0.009s	sys 0.023s
I20260925 16:41:49.107103  8655 raft_consensus.cc:348] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.107862  8655 raft_consensus.cc:374] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.108158  8655 raft_consensus.cc:729] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.108888  8655 consensus_queue.cc:260] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.109643  8652 raft_consensus.cc:348] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.110358  8652 raft_consensus.cc:374] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.110677  8652 raft_consensus.cc:729] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
W20260925 16:41:49.111735  8564 tablet.cc:2369] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 16:41:49.111366  8652 consensus_queue.cc:260] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.113619  8652 ts_tablet_manager.cc:1428] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:41:49.114410  8655 ts_tablet_manager.cc:1428] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260925 16:41:49.114503  8652 tablet_bootstrap.cc:492] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.115274  8655 tablet_bootstrap.cc:492] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.115744  8653 tablet_bootstrap.cc:654] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.120848  8652 tablet_bootstrap.cc:654] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.121026  8655 tablet_bootstrap.cc:654] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.130290  8653 tablet_bootstrap.cc:492] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.130810  8653 ts_tablet_manager.cc:1397] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.004s
I20260925 16:41:49.133658  8655 tablet_bootstrap.cc:492] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.133337  8653 raft_consensus.cc:348] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.134301  8655 ts_tablet_manager.cc:1397] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260925 16:41:49.134328  8653 raft_consensus.cc:374] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.134951  8653 raft_consensus.cc:729] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.135672  8653 consensus_queue.cc:260] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.137820  8653 ts_tablet_manager.cc:1428] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.003s
I20260925 16:41:49.138868  8653 tablet_bootstrap.cc:492] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.137844  8655 raft_consensus.cc:348] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.139735  8655 raft_consensus.cc:374] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.140018  8655 raft_consensus.cc:729] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.140630  8652 tablet_bootstrap.cc:492] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.141124  8652 ts_tablet_manager.cc:1397] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.027s	user 0.012s	sys 0.012s
I20260925 16:41:49.140800  8655 consensus_queue.cc:260] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.142623  8660 raft_consensus.cc:482] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.143055  8660 raft_consensus.cc:504] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.143895  8652 raft_consensus.cc:348] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.144665  8652 raft_consensus.cc:374] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.144949  8653 tablet_bootstrap.cc:654] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.145037  8655 ts_tablet_manager.cc:1428] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260925 16:41:49.144984  8652 raft_consensus.cc:729] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.145385  8660 leader_election.cc:288] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.146164  8655 tablet_bootstrap.cc:492] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.147104  8652 consensus_queue.cc:260] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.149576  8652 ts_tablet_manager.cc:1428] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260925 16:41:49.150506  8652 tablet_bootstrap.cc:492] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.151566  8657 raft_consensus.cc:482] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.152107  8655 tablet_bootstrap.cc:654] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.152173  8657 raft_consensus.cc:504] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.157209  8652 tablet_bootstrap.cc:654] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.160956  8657 leader_election.cc:288] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.170413  8652 tablet_bootstrap.cc:492] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.171064  8652 ts_tablet_manager.cc:1397] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.004s
I20260925 16:41:49.174500  8652 raft_consensus.cc:348] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.175645  8652 raft_consensus.cc:374] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.176092  8652 raft_consensus.cc:729] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.177310  8661 raft_consensus.cc:482] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.177172  8652 consensus_queue.cc:260] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.177913  8661 raft_consensus.cc:504] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.180593  8652 ts_tablet_manager.cc:1428] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.003s
I20260925 16:41:49.181808  8652 tablet_bootstrap.cc:492] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.187132  8661 leader_election.cc:288] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.190043  8652 tablet_bootstrap.cc:654] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.203218  8652 tablet_bootstrap.cc:492] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.203939  8652 ts_tablet_manager.cc:1397] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.004s
I20260925 16:41:49.210183  8652 raft_consensus.cc:348] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.211357  8652 raft_consensus.cc:374] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.211813  8652 raft_consensus.cc:729] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.212847  8652 consensus_queue.cc:260] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.216185  8652 ts_tablet_manager.cc:1428] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260925 16:41:49.217706  8652 tablet_bootstrap.cc:492] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.225662  8652 tablet_bootstrap.cc:654] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.239730  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
W20260925 16:41:49.241613  8578 leader_election.cc:341] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.260227  8661 raft_consensus.cc:482] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.260694  8661 raft_consensus.cc:504] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.262256  8661 leader_election.cc:288] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.262729  8660 raft_consensus.cc:482] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.263151  8660 raft_consensus.cc:504] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.264995  8660 leader_election.cc:288] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.268024  8653 tablet_bootstrap.cc:492] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.268688  8653 ts_tablet_manager.cc:1397] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.130s	user 0.047s	sys 0.059s
I20260925 16:41:49.272269  8653 raft_consensus.cc:348] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.273197  8653 raft_consensus.cc:374] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.273536  8653 raft_consensus.cc:729] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.274371  8653 consensus_queue.cc:260] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.277506  8653 ts_tablet_manager.cc:1428] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:41:49.278671  8653 tablet_bootstrap.cc:492] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.287115  8653 tablet_bootstrap.cc:654] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
W20260925 16:41:49.287462  8409 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:41:49.303344  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.304068  8463 raft_consensus.cc:2454] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 0.
I20260925 16:41:49.305290  8578 leader_election.cc:302] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.306015  8652 tablet_bootstrap.cc:492] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.306038  8660 raft_consensus.cc:2781] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.306478  8660 raft_consensus.cc:482] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.306594  8652 ts_tablet_manager.cc:1397] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.089s	user 0.011s	sys 0.009s
I20260925 16:41:49.306798  8660 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.309476  8652 raft_consensus.cc:348] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.310292  8652 raft_consensus.cc:374] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.310628  8652 raft_consensus.cc:729] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.311499  8652 consensus_queue.cc:260] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.313550  8660 raft_consensus.cc:504] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.315737  8655 tablet_bootstrap.cc:492] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.316287  8655 ts_tablet_manager.cc:1397] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.170s	user 0.079s	sys 0.086s
I20260925 16:41:49.319159  8655 raft_consensus.cc:348] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.319934  8655 raft_consensus.cc:374] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.320361  8655 raft_consensus.cc:729] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.320526  8537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.321122  8655 consensus_queue.cc:260] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.322563  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.323500  8655 ts_tablet_manager.cc:1428] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:41:49.324466  8655 tablet_bootstrap.cc:492] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
W20260925 16:41:49.327931  8577 leader_election.cc:341] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.330468  8655 tablet_bootstrap.cc:654] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
W20260925 16:41:49.344642  8577 leader_election.cc:341] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.345100  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.345240  8577 leader_election.cc:302] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de; no voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104
I20260925 16:41:49.345884  8463 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.341306  8660 leader_election.cc:288] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.347483  8660 raft_consensus.cc:2726] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.350571  8657 raft_consensus.cc:482] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.351011  8657 raft_consensus.cc:504] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.351864  8653 tablet_bootstrap.cc:492] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.352309  8653 ts_tablet_manager.cc:1397] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.074s	user 0.020s	sys 0.018s
I20260925 16:41:49.352852  8657 leader_election.cc:288] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.354615  8463 raft_consensus.cc:2454] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 1.
I20260925 16:41:49.354827  8653 raft_consensus.cc:348] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.355561  8653 raft_consensus.cc:374] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.355609  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.355932  8653 raft_consensus.cc:729] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.356679  8653 consensus_queue.cc:260] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.357159  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.357978  8612 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.360877  8661 raft_consensus.cc:482] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.361925  8653 ts_tablet_manager.cc:1428] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260925 16:41:49.361564  8661 raft_consensus.cc:504] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
W20260925 16:41:49.362228  8577 leader_election.cc:341] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.362833  8653 tablet_bootstrap.cc:492] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.365574  8661 leader_election.cc:288] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.368860  8653 tablet_bootstrap.cc:654] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.372004  8652 ts_tablet_manager.cc:1428] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.065s	user 0.022s	sys 0.017s
I20260925 16:41:49.372936  8652 tablet_bootstrap.cc:492] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.373611  8685 raft_consensus.cc:482] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.373483  8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.374044  8685 raft_consensus.cc:504] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.377009  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.377620  8538 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 0.
I20260925 16:41:49.378551  8652 tablet_bootstrap.cc:654] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.378752  8577 leader_election.cc:302] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:49.380352  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.381664  8578 leader_election.cc:302] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.382941  8683 raft_consensus.cc:2781] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.383399  8502 leader_election.cc:302] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:49.384491  8661 raft_consensus.cc:2781] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.384990  8661 raft_consensus.cc:482] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.385414  8661 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.387005  8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
W20260925 16:41:49.387266  8503 leader_election.cc:341] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.384742  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.387620  8462 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.388016  8461 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.388777  8503 leader_election.cc:302] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.391918  8660 raft_consensus.cc:2781] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.395061  8652 tablet_bootstrap.cc:492] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.395022  8537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.395576  8652 ts_tablet_manager.cc:1397] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.023s	user 0.004s	sys 0.011s
I20260925 16:41:49.383404  8683 raft_consensus.cc:482] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.396023  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.396257  8683 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.395720  8537 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 0.
I20260925 16:41:49.398348  8652 raft_consensus.cc:348] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
W20260925 16:41:49.398939  8428 leader_election.cc:341] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.399771  8428 leader_election.cc:302] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.401451  8685 leader_election.cc:288] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.399044  8652 raft_consensus.cc:374] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.402580  8652 raft_consensus.cc:729] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.403882  8657 raft_consensus.cc:2781] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.404223  8657 raft_consensus.cc:482] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.404150  8652 consensus_queue.cc:260] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.404596  8657 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.405046  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.405848  8463 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 0.
I20260925 16:41:49.406245  8652 ts_tablet_manager.cc:1428] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260925 16:41:49.407063  8652 tablet_bootstrap.cc:492] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
W20260925 16:41:49.407285  8502 leader_election.cc:341] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.410534  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.412827  8660 raft_consensus.cc:686] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:49.413465  8657 raft_consensus.cc:504] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.414083  8660 consensus_queue.cc:237] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.415453  8657 leader_election.cc:288] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.422082  8609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.422230  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
W20260925 16:41:49.424335  8428 leader_election.cc:341] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.425642  8655 tablet_bootstrap.cc:492] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.427929  8611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.428118  8537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.403570  8661 raft_consensus.cc:504] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.430037  8652 tablet_bootstrap.cc:654] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.433705  8661 leader_election.cc:288] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.434269  8661 raft_consensus.cc:2781] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.434592  8661 raft_consensus.cc:482] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.434904  8661 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.431922  8537 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.435745  8683 raft_consensus.cc:504] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.437039  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.437589  8610 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.439487  8612 raft_consensus.cc:2379] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35c23059c70d46b09a2e26c3589aa4ab in current term 1: Already voted for candidate 1768714aa483470592b88b8f4d4b95de in this term.
W20260925 16:41:49.439513  8428 leader_election.cc:341] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:41:49.438649  8503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 49956.9us
I20260925 16:41:49.441512  8503 leader_election.cc:302] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de
I20260925 16:41:49.442252  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.443661  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
W20260925 16:41:49.445442  8428 leader_election.cc:341] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.445870  8428 leader_election.cc:302] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.446565  8657 raft_consensus.cc:2726] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.447117  8610 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 1.
I20260925 16:41:49.448149  8502 leader_election.cc:302] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:49.439082  8655 ts_tablet_manager.cc:1397] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.115s	user 0.035s	sys 0.049s
I20260925 16:41:49.440418  8683 leader_election.cc:288] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.448536  8361 catalog_manager.cc:5495] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 0 to 1, leader changed from <none> to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 1 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:49.453979  8653 tablet_bootstrap.cc:492] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.454414  8653 ts_tablet_manager.cc:1397] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.013s
I20260925 16:41:49.449597  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
W20260925 16:41:49.452019  8503 leader_election.cc:341] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.455740  8463 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.457733  8653 raft_consensus.cc:348] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.458423  8653 raft_consensus.cc:374] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.458700  8653 raft_consensus.cc:729] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.459342  8653 consensus_queue.cc:260] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.462003  8691 raft_consensus.cc:2781] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.462195  8537 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 1.
I20260925 16:41:49.463486  8428 leader_election.cc:302] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de
I20260925 16:41:49.463590  8688 raft_consensus.cc:2741] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260925 16:41:49.464212  8653 ts_tablet_manager.cc:1428] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260925 16:41:49.464567  8657 raft_consensus.cc:2781] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.465157  8653 tablet_bootstrap.cc:492] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.465337  8655 raft_consensus.cc:348] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.468775  8655 raft_consensus.cc:374] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.468994  8683 raft_consensus.cc:482] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.469311  8463 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 1.
I20260925 16:41:49.469223  8655 raft_consensus.cc:729] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.469488  8683 raft_consensus.cc:504] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.470449  8578 leader_election.cc:302] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.470569  8655 consensus_queue.cc:260] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.472190  8683 leader_election.cc:288] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.472460  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebd8f07f558b4fcc8c6c1af896753cae" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.472537  8537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebd8f07f558b4fcc8c6c1af896753cae" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.473052  8461 raft_consensus.cc:2454] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 0.
I20260925 16:41:49.471551  8660 raft_consensus.cc:2781] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.474035  8660 raft_consensus.cc:686] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:49.474911  8661 raft_consensus.cc:504] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.474833  8660 consensus_queue.cc:237] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
W20260925 16:41:49.475473  8577 leader_election.cc:341] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.477492  8578 leader_election.cc:302] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.478914  8685 raft_consensus.cc:2781] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.479326  8685 raft_consensus.cc:482] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.479804  8685 raft_consensus.cc:3037] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.489679  8657 raft_consensus.cc:686] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:49.490200  8688 raft_consensus.cc:482] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:41:49.491209  8392 debug-util.cc:398] Leaking SignalData structure 0x7b080004dbc0 after lost signal to thread 7806
I20260925 16:41:49.491494  8657 consensus_queue.cc:237] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.490646  8688 raft_consensus.cc:504] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.498797  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080e93645b724ef6a5c06f691d2a20e7" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.499480  8610 raft_consensus.cc:2454] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.500521  8502 leader_election.cc:302] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:49.502979  8696 raft_consensus.cc:2781] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.503430  8696 raft_consensus.cc:482] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.503790  8688 leader_election.cc:288] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.505149  8538 raft_consensus.cc:2379] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1768714aa483470592b88b8f4d4b95de in current term 1: Already voted for candidate 35c23059c70d46b09a2e26c3589aa4ab in this term.
I20260925 16:41:49.488701  8685 raft_consensus.cc:504] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.512494  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.513607  8463 raft_consensus.cc:2379] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35c23059c70d46b09a2e26c3589aa4ab in current term 1: Already voted for candidate 1768714aa483470592b88b8f4d4b95de in this term.
I20260925 16:41:49.512605  8685 leader_election.cc:288] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.503824  8696 raft_consensus.cc:3037] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.507956  8691 raft_consensus.cc:686] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:49.520761  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080e93645b724ef6a5c06f691d2a20e7" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.520977  8688 raft_consensus.cc:482] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.521610  8688 raft_consensus.cc:504] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.523399  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.525349  8502 leader_election.cc:302] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab; no voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104
I20260925 16:41:49.530156  8691 consensus_queue.cc:237] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.533285  8653 tablet_bootstrap.cc:654] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.535202  8688 leader_election.cc:288] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249), aa2cc69f88224272b81308853b221104 (127.7.158.193:39923)
I20260925 16:41:49.534430  8693 raft_consensus.cc:482] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.518827  8661 leader_election.cc:288] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.539402  8688 raft_consensus.cc:2726] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.542068  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebd8f07f558b4fcc8c6c1af896753cae" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.543968  8655 ts_tablet_manager.cc:1428] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.094s	user 0.035s	sys 0.024s
W20260925 16:41:49.537293  8503 leader_election.cc:341] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.544919  8655 tablet_bootstrap.cc:492] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
W20260925 16:41:49.546923  8577 leader_election.cc:341] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.545889  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebd8f07f558b4fcc8c6c1af896753cae" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.548017  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.548522  8463 raft_consensus.cc:3037] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.548660  8610 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.551134  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.538031  8693 raft_consensus.cc:504] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.552528  8655 tablet_bootstrap.cc:654] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.553861  8693 leader_election.cc:288] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.554800  8461 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.555142  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.555765  8538 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 0.
I20260925 16:41:49.556449  8503 leader_election.cc:302] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.557260  8661 raft_consensus.cc:2781] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.557296  8428 leader_election.cc:302] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.557677  8661 raft_consensus.cc:482] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.557997  8661 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.558185  8693 raft_consensus.cc:2781] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.558600  8693 raft_consensus.cc:482] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.558985  8693 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.562172  8652 tablet_bootstrap.cc:492] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.564076  8652 ts_tablet_manager.cc:1397] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.157s	user 0.023s	sys 0.031s
I20260925 16:41:49.564224  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.565860  8610 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 0.
I20260925 16:41:49.570631  8661 raft_consensus.cc:504] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.553798  8696 raft_consensus.cc:504] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.559535  8688 raft_consensus.cc:482] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.580282  8652 raft_consensus.cc:348] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.581625  8652 raft_consensus.cc:374] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.582106  8652 raft_consensus.cc:729] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.566376  8463 raft_consensus.cc:2454] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 1.
I20260925 16:41:49.583530  8652 consensus_queue.cc:260] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.586455  8652 ts_tablet_manager.cc:1428] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.001s
I20260925 16:41:49.587486  8652 tablet_bootstrap.cc:492] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: Bootstrap starting.
I20260925 16:41:49.589113  8661 leader_election.cc:288] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Requested vote from peers 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249), aa2cc69f88224272b81308853b221104 (127.7.158.193:39923)
I20260925 16:41:49.581421  8688 raft_consensus.cc:504] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.591594  8578 leader_election.cc:302] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.593494  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.594353  8696 leader_election.cc:288] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.594877  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.595911  8685 raft_consensus.cc:2781] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.597409  8685 raft_consensus.cc:686] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:49.598564  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080e93645b724ef6a5c06f691d2a20e7" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.595407  8610 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:41:49.600718  8503 leader_election.cc:341] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.600669  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080e93645b724ef6a5c06f691d2a20e7" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.601517  8612 raft_consensus.cc:3037] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.598557  8685 consensus_queue.cc:237] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.610991  8652 tablet_bootstrap.cc:654] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.612331  8610 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 1.
I20260925 16:41:49.613629  8502 leader_election.cc:302] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:49.614280  8611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.614580  8696 raft_consensus.cc:2781] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.614945  8611 raft_consensus.cc:2454] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 0.
I20260925 16:41:49.615048  8696 raft_consensus.cc:686] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:49.615803  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.615863  8696 consensus_queue.cc:237] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
W20260925 16:41:49.617204  8503 leader_election.cc:341] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.618402  8502 leader_election.cc:302] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: aa2cc69f88224272b81308853b221104
I20260925 16:41:49.619472  8661 raft_consensus.cc:2781] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.619827  8661 raft_consensus.cc:482] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.620150  8661 raft_consensus.cc:3037] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.588658  8359 catalog_manager.cc:5495] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:49.614607  8688 leader_election.cc:288] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.623855  8657 raft_consensus.cc:482] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.627265  8657 raft_consensus.cc:504] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.624922  8653 tablet_bootstrap.cc:492] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.628821  8653 ts_tablet_manager.cc:1397] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.164s	user 0.019s	sys 0.011s
I20260925 16:41:49.629479  8657 leader_election.cc:288] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.630064  8693 raft_consensus.cc:504] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:49.631152  8463 raft_consensus.cc:2379] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 35c23059c70d46b09a2e26c3589aa4ab in current term 1: Already voted for candidate aa2cc69f88224272b81308853b221104 in this term.
I20260925 16:41:49.631539  8653 raft_consensus.cc:348] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.631979  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.632207  8653 raft_consensus.cc:374] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.632489  8653 raft_consensus.cc:729] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.633049  8653 consensus_queue.cc:260] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.633744  8693 leader_election.cc:288] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Requested vote from peers 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.635197  8653 ts_tablet_manager.cc:1428] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.002s
I20260925 16:41:49.637336  8653 tablet_bootstrap.cc:492] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.641209  8655 tablet_bootstrap.cc:492] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.641650  8655 ts_tablet_manager.cc:1397] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.097s	user 0.018s	sys 0.023s
I20260925 16:41:49.641597  8685 raft_consensus.cc:482] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.642072  8685 raft_consensus.cc:504] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
W20260925 16:41:49.643934  8428 leader_election.cc:341] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.644533  8655 raft_consensus.cc:348] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.645234  8655 raft_consensus.cc:374] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.645504  8655 raft_consensus.cc:729] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.645519  8611 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.646018  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.646365  8611 raft_consensus.cc:2379] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate aa2cc69f88224272b81308853b221104 in current term 1: Already voted for candidate 35c23059c70d46b09a2e26c3589aa4ab in this term.
I20260925 16:41:49.648044  8428 leader_election.cc:302] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.649533  8693 raft_consensus.cc:2726] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.646346  8655 consensus_queue.cc:260] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.655941  8655 ts_tablet_manager.cc:1428] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260925 16:41:49.656843  8655 tablet_bootstrap.cc:492] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.663103  8612 raft_consensus.cc:2454] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 1.
I20260925 16:41:49.640362  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.664175  8610 raft_consensus.cc:2454] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 0.
I20260925 16:41:49.662940  8361 catalog_manager.cc:5495] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 0 to 1, leader changed from <none> to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 1 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:49.665254  8428 leader_election.cc:302] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.666393  8693 raft_consensus.cc:2781] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.666766  8693 raft_consensus.cc:482] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.667120  8693 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.665926  8361 catalog_manager.cc:5495] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 0 to 1, leader changed from <none> to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 1 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:49.652117  8360 catalog_manager.cc:5495] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 1 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:49.673287  8685 leader_election.cc:288] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.674234  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.675801  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.676575  8538 raft_consensus.cc:2379] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1768714aa483470592b88b8f4d4b95de in current term 1: Already voted for candidate aa2cc69f88224272b81308853b221104 in this term.
I20260925 16:41:49.677842  8502 leader_election.cc:302] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: aa2cc69f88224272b81308853b221104
I20260925 16:41:49.678962  8696 raft_consensus.cc:2781] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.679400  8696 raft_consensus.cc:686] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:49.679551  8577 leader_election.cc:302] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de; no voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104
I20260925 16:41:49.680222  8696 consensus_queue.cc:237] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.681502  8655 tablet_bootstrap.cc:654] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.676435  8661 raft_consensus.cc:504] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.691489  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.692071  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.692701  8612 raft_consensus.cc:3037] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.693022  8652 tablet_bootstrap.cc:492] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: No bootstrap required, opened a new log
I20260925 16:41:49.693476  8652 ts_tablet_manager.cc:1397] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: Time spent bootstrapping tablet: real 0.106s	user 0.027s	sys 0.028s
W20260925 16:41:49.692703  8503 leader_election.cc:341] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.685509  8693 raft_consensus.cc:504] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.695964  8652 raft_consensus.cc:348] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.696497  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.696700  8652 raft_consensus.cc:374] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.697335  8652 raft_consensus.cc:729] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Initialized, Role: FOLLOWER
W20260925 16:41:49.697971  8428 leader_election.cc:341] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:41:49.698099  8652 consensus_queue.cc:260] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.699195  8612 raft_consensus.cc:2454] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 1.
I20260925 16:41:49.685709  8685 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.700042  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:49.700573  8610 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.703778  8693 leader_election.cc:288] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.704988  8652 ts_tablet_manager.cc:1428] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260925 16:41:49.705865  8685 raft_consensus.cc:2726] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.706423  8661 leader_election.cc:288] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.707176  8653 tablet_bootstrap.cc:654] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.707259  8610 raft_consensus.cc:2454] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 1.
I20260925 16:41:49.708649  8428 leader_election.cc:302] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.710086  8502 leader_election.cc:302] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: aa2cc69f88224272b81308853b221104
I20260925 16:41:49.711160  8661 raft_consensus.cc:2781] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.712201  8661 raft_consensus.cc:686] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:49.713037  8661 consensus_queue.cc:237] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.710075  8693 raft_consensus.cc:2781] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.716764  8693 raft_consensus.cc:686] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:49.718360  8693 consensus_queue.cc:237] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.719805  8685 raft_consensus.cc:482] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.724346  8685 raft_consensus.cc:504] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.718720  8360 catalog_manager.cc:5495] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 1 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:49.717339  8655 tablet_bootstrap.cc:492] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.726114  8655 ts_tablet_manager.cc:1397] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.000s
I20260925 16:41:49.728900  8653 tablet_bootstrap.cc:492] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.728767  8655 raft_consensus.cc:348] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.729408  8653 ts_tablet_manager.cc:1397] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.092s	user 0.017s	sys 0.009s
I20260925 16:41:49.729498  8655 raft_consensus.cc:374] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.729779  8655 raft_consensus.cc:729] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.730954  8360 catalog_manager.cc:5495] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 1 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:49.731688  8653 raft_consensus.cc:348] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.732347  8653 raft_consensus.cc:374] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.732599  8653 raft_consensus.cc:729] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.733052  8655 consensus_queue.cc:260] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.733234  8653 consensus_queue.cc:260] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.735347  8653 ts_tablet_manager.cc:1428] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:41:49.736152  8653 tablet_bootstrap.cc:492] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: Bootstrap starting.
I20260925 16:41:49.736117  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.736775  8463 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 0.
I20260925 16:41:49.737823  8578 leader_election.cc:302] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.738672  8660 raft_consensus.cc:2781] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:41:49.739027  8660 raft_consensus.cc:482] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:41:49.739362  8660 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.741631  8653 tablet_bootstrap.cc:654] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.748337  8655 ts_tablet_manager.cc:1428] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260925 16:41:49.749405  8655 tablet_bootstrap.cc:492] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.752364  8653 tablet_bootstrap.cc:492] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: No bootstrap required, opened a new log
I20260925 16:41:49.752758  8653 ts_tablet_manager.cc:1397] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260925 16:41:49.752234  8685 leader_election.cc:288] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.746515  8660 raft_consensus.cc:504] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.763731  8653 raft_consensus.cc:348] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.764381  8653 raft_consensus.cc:374] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.764626  8653 raft_consensus.cc:729] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.765014  8660 leader_election.cc:288] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:49.765372  8653 consensus_queue.cc:260] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.766422  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:49.766956  8463 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.759279  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.767261  8653 ts_tablet_manager.cc:1428] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260925 16:41:49.767575  8538 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 0.
I20260925 16:41:49.766837  8537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:49.768527  8537 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.772192  8463 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 1.
I20260925 16:41:49.773160  8578 leader_election.cc:302] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:49.774583  8660 raft_consensus.cc:2781] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:41:49.775029  8660 raft_consensus.cc:686] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:49.775266  8537 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 1.
I20260925 16:41:49.775611  8660 consensus_queue.cc:237] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.778225  8361 catalog_manager.cc:5495] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 0 to 1, leader changed from <none> to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 1 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:49.757465  8655 tablet_bootstrap.cc:654] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.778373  8360 catalog_manager.cc:5495] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 0 to 1, leader changed from <none> to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:49.787806  8359 catalog_manager.cc:5495] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 0 to 1, leader changed from <none> to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 1 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:49.801996  8655 tablet_bootstrap.cc:492] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.802464  8655 ts_tablet_manager.cc:1397] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.053s	user 0.014s	sys 0.005s
I20260925 16:41:49.804930  8655 raft_consensus.cc:348] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.805751  8655 raft_consensus.cc:374] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.806013  8655 raft_consensus.cc:729] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.806618  8655 consensus_queue.cc:260] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.808732  8655 ts_tablet_manager.cc:1428] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260925 16:41:49.809576  8655 tablet_bootstrap.cc:492] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab: Bootstrap starting.
I20260925 16:41:49.815284  8655 tablet_bootstrap.cc:654] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab: Neither blocks nor log segments found. Creating new log.
I20260925 16:41:49.820070  8655 tablet_bootstrap.cc:492] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab: No bootstrap required, opened a new log
I20260925 16:41:49.820469  8655 ts_tablet_manager.cc:1397] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab: Time spent bootstrapping tablet: real 0.011s	user 0.010s	sys 0.000s
I20260925 16:41:49.822741  8655 raft_consensus.cc:348] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.823403  8655 raft_consensus.cc:374] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:41:49.823657  8655 raft_consensus.cc:729] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Initialized, Role: FOLLOWER
I20260925 16:41:49.824275  8655 consensus_queue.cc:260] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.826431  8655 ts_tablet_manager.cc:1428] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:41:49.830629  8661 raft_consensus.cc:482] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.831059  8661 raft_consensus.cc:504] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.832926  8661 leader_election.cc:288] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.833607  8463 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebd8f07f558b4fcc8c6c1af896753cae" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:49.834378  8463 raft_consensus.cc:2379] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35c23059c70d46b09a2e26c3589aa4ab in current term 1: Already voted for candidate 1768714aa483470592b88b8f4d4b95de in this term.
I20260925 16:41:49.834280  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebd8f07f558b4fcc8c6c1af896753cae" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.835654  8502 leader_election.cc:302] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab; no voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104
I20260925 16:41:49.836319  8661 raft_consensus.cc:3037] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.841324  8661 raft_consensus.cc:2726] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.863144  8537 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.871340  8660 consensus_queue.cc:1035] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:49.875849  8660 consensus_queue.cc:1035] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:49.897110  8538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:38486
I20260925 16:41:49.897854  8538 raft_consensus.cc:595] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:41:49.921368  8685 consensus_queue.cc:1035] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:49.928238  8685 consensus_queue.cc:1035] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:49.929831  8693 raft_consensus.cc:482] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:49.930413  8693 raft_consensus.cc:504] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:49.932771  8693 leader_election.cc:288] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:49.934980  8536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080e93645b724ef6a5c06f691d2a20e7" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:49.935743  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "080e93645b724ef6a5c06f691d2a20e7" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:49.936695  8610 raft_consensus.cc:2379] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa2cc69f88224272b81308853b221104 in current term 1: Already voted for candidate 35c23059c70d46b09a2e26c3589aa4ab in this term.
I20260925 16:41:49.937817  8428 leader_election.cc:302] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.939180  8657 raft_consensus.cc:3037] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:49.948302  8610 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:34262
I20260925 16:41:49.949077  8610 raft_consensus.cc:595] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:41:49.956524  8610 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a3d80556614546209830bdea088a94f0"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:34262
I20260925 16:41:49.957309  8610 raft_consensus.cc:595] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:41:49.964462  8536 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:38486
I20260925 16:41:49.965209  8536 raft_consensus.cc:595] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:41:49.975478  8693 consensus_queue.cc:1035] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:49.977578  8610 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
mode: GRACEFUL
new_leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:34262
I20260925 16:41:49.978328  8610 raft_consensus.cc:595] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Received request to transfer leadership to TS 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:49.981448  8657 raft_consensus.cc:2726] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:49.999265  8685 consensus_queue.cc:1035] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:50.018085  8693 consensus_queue.cc:1035] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.033260  8683 consensus_queue.cc:1035] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.036226  8657 raft_consensus.cc:482] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:50.036724  8657 raft_consensus.cc:504] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.045739  8661 raft_consensus.cc:482] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:50.046402  8661 raft_consensus.cc:504] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.051096  8657 leader_election.cc:288] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.048206  8461 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:50.053193  8536 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:50.053578  8696 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.054399  8661 leader_election.cc:288] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.055948  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:50.056705  8612 raft_consensus.cc:2379] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa2cc69f88224272b81308853b221104 in current term 1: Already voted for candidate 35c23059c70d46b09a2e26c3589aa4ab in this term.
I20260925 16:41:50.056493  8462 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "aa2cc69f88224272b81308853b221104" is_pre_election: true
I20260925 16:41:50.060254  8428 leader_election.cc:302] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:50.066139  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:50.066915  8612 raft_consensus.cc:2379] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 35c23059c70d46b09a2e26c3589aa4ab in current term 1: Already voted for candidate aa2cc69f88224272b81308853b221104 in this term.
I20260925 16:41:50.069047  8502 leader_election.cc:302] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab; no voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104
I20260925 16:41:50.070128  8661 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:50.071959  8657 raft_consensus.cc:2726] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:50.080173  8696 consensus_queue.cc:1035] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.083359  8460 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:50210
I20260925 16:41:50.083997  8460 raft_consensus.cc:595] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Received request to transfer leadership to TS 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:50.093745  8696 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.107287  8696 consensus_queue.cc:1035] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.116255  8661 raft_consensus.cc:2726] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:50.118031  8683 raft_consensus.cc:979] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:41:50.118556  8683 raft_consensus.cc:1067] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:41:50.128261  8463 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a3d80556614546209830bdea088a94f0"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53522
I20260925 16:41:50.128814  8463 raft_consensus.cc:482] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:50.129170  8463 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.137845  8657 raft_consensus.cc:482] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:41:50.138341  8657 raft_consensus.cc:504] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.140226  8657 leader_election.cc:288] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.142524  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1768714aa483470592b88b8f4d4b95de" is_pre_election: true
I20260925 16:41:50.143527  8612 raft_consensus.cc:2379] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate aa2cc69f88224272b81308853b221104 in current term 1: Already voted for candidate 35c23059c70d46b09a2e26c3589aa4ab in this term.
I20260925 16:41:50.152796  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab" is_pre_election: true
I20260925 16:41:50.154376  8428 leader_election.cc:302] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: aa2cc69f88224272b81308853b221104; no voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:41:50.155179  8657 raft_consensus.cc:3037] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:41:50.161737  8688 consensus_queue.cc:1035] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.162269  8657 raft_consensus.cc:2726] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:41:50.167514  8689 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.174866  8657 consensus_queue.cc:1035] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.143118  8463 raft_consensus.cc:504] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.180157  8537 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:50.181511  8537 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.183800  8689 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:41:50.186177  8688 consensus_queue.cc:1035] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.198429  8463 leader_election.cc:288] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.198823  8688 consensus_queue.cc:1035] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260925 16:41:50.208801  8537 raft_consensus.cc:2454] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.235255  8428 leader_election.cc:302] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:50.236307  8728 raft_consensus.cc:2781] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:50.236836  8728 raft_consensus.cc:686] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:50.238565  8696 raft_consensus.cc:979] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:41:50.237885  8728 consensus_queue.cc:237] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.239029  8696 raft_consensus.cc:1067] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:41:50.312913  8660 raft_consensus.cc:979] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: : Instructing follower 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:41:50.313707  8689 raft_consensus.cc:1067] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Signalling peer 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:41:50.315340  8535 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:32822
I20260925 16:41:50.315932  8535 raft_consensus.cc:482] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:50.316308  8535 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.324141  8535 raft_consensus.cc:504] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.327876  8361 catalog_manager.cc:5495] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 1 to 2, leader changed from 1768714aa483470592b88b8f4d4b95de (127.7.158.195) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:50.329501  8609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:50.334589  8609 raft_consensus.cc:3032] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:50.335018  8609 raft_consensus.cc:729] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:50.335927  8609 consensus_queue.cc:260] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.337270  8609 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.340085  8535 leader_election.cc:288] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 2 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.341817  8610 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:50.342355  8610 raft_consensus.cc:3032] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:50.342641  8610 raft_consensus.cc:729] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:50.343322  8610 consensus_queue.cc:260] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.345799  8610 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.346100  8661 raft_consensus.cc:979] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
W20260925 16:41:50.347832  8660 consensus_queue.cc:1159] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "aa2cc69f88224272b81308853b221104" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20260925 16:41:50.349025  8696 consensus_queue.cc:1035] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.353410  8657 consensus_queue.cc:1035] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:41:50.360539  8661 raft_consensus.cc:1067] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
W20260925 16:41:50.368257  8503 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:39923, user_credentials={real_user=slave}} blocked reactor thread for 110619us
I20260925 16:41:50.372053  8610 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 2.
I20260925 16:41:50.373914  8502 leader_election.cc:302] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:50.379396  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53536
I20260925 16:41:50.383965  8462 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53536
I20260925 16:41:50.385032  8461 raft_consensus.cc:482] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:50.385398  8462 raft_consensus.cc:482] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:50.385547  8461 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.385851  8462 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.386598  8458 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:50.387950  8458 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.380113  8746 raft_consensus.cc:2781] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:50.395447  8458 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 2.
I20260925 16:41:50.402098  8746 raft_consensus.cc:686] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:50.403203  8746 consensus_queue.cc:237] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.413254  8462 raft_consensus.cc:504] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:50.416193  8609 raft_consensus.cc:2454] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.425197  8462 leader_election.cc:288] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Requested vote from peers 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:50.428045  8535 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:50.428594  8535 raft_consensus.cc:3032] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:50.428891  8535 raft_consensus.cc:729] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:50.429958  8729 raft_consensus.cc:979] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: : Instructing follower 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:41:50.429597  8535 consensus_queue.cc:260] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:50.430346  8729 raft_consensus.cc:1067] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Signalling peer 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:41:50.430845  8535 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.433033  8538 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:32826
I20260925 16:41:50.433277  8609 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:50.433550  8538 raft_consensus.cc:482] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:50.433943  8609 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.433969  8538 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.437826  8535 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.438848  8428 leader_election.cc:302] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:50.439716  8731 raft_consensus.cc:2781] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:50.440169  8731 raft_consensus.cc:686] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:50.440333  8538 raft_consensus.cc:504] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.423141  8461 raft_consensus.cc:504] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.440969  8731 consensus_queue.cc:237] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:41:50.442075  8538 leader_election.cc:288] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 2 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.442781  8461 leader_election.cc:288] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.444299  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:50.444876  8538 raft_consensus.cc:3032] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:50.445214  8538 raft_consensus.cc:729] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:50.445592  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:50.445729  8607 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:50.446210  8461 raft_consensus.cc:3032] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:50.446666  8461 raft_consensus.cc:729] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:50.446161  8538 consensus_queue.cc:260] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.447757  8538 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.447391  8461 consensus_queue.cc:260] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.446265  8607 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.448697  8461 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.454093  8538 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.455180  8428 leader_election.cc:302] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:50.457021  8731 raft_consensus.cc:2781] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:50.457688  8731 raft_consensus.cc:686] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:50.458498  8731 consensus_queue.cc:237] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.464226  8607 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.465912  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:50.466491  8612 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.466593  8359 catalog_manager.cc:5495] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 1 to 2, leader changed from 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:50.468530  8461 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 2.
I20260925 16:41:50.465927  8609 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.470808  8503 leader_election.cc:302] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:50.471547  8746 raft_consensus.cc:2781] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:50.472265  8746 raft_consensus.cc:686] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:41:50.473161  8746 consensus_queue.cc:237] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.479611  8612 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 2.
I20260925 16:41:50.481172  8361 catalog_manager.cc:5495] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 1 to 2, leader changed from 1768714aa483470592b88b8f4d4b95de (127.7.158.195) to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 2 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:50.487042  8359 catalog_manager.cc:5495] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 1 to 2, leader changed from 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:50.496788  8360 catalog_manager.cc:5495] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 1 to 2, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 2 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:50.510876  8685 raft_consensus.cc:979] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:41:50.511327  8683 raft_consensus.cc:1067] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:41:50.512710  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53522
I20260925 16:41:50.513160  8461 raft_consensus.cc:482] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:50.513448  8461 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.517877  8461 raft_consensus.cc:504] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.519328  8461 leader_election.cc:288] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:41:50.520128  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:50.520689  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:41:50.520773  8538 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.521195  8612 raft_consensus.cc:3032] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:50.521476  8612 raft_consensus.cc:729] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:50.522084  8612 consensus_queue.cc:260] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.522931  8612 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:50.526849  8612 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.527645  8538 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:41:50.527827  8428 leader_election.cc:302] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:41:50.528584  8731 raft_consensus.cc:2781] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:50.529042  8731 raft_consensus.cc:686] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:50.529844  8731 consensus_queue.cc:237] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:50.536643  8360 catalog_manager.cc:5495] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 1 to 2, leader changed from 1768714aa483470592b88b8f4d4b95de (127.7.158.195) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:41:50.695511  8538 raft_consensus.cc:1261] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.696694  8731 consensus_queue.cc:1035] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.705683  8612 raft_consensus.cc:1261] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.707508  8731 consensus_queue.cc:1035] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.784793  8612 raft_consensus.cc:1261] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.786235  8746 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.793335  8461 raft_consensus.cc:1261] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.794713  8745 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.896615  8538 raft_consensus.cc:1261] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.898002  8731 consensus_queue.cc:1035] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.910845  8607 raft_consensus.cc:1261] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.912492  8728 consensus_queue.cc:1035] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.913049  8612 raft_consensus.cc:1261] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.914553  8728 consensus_queue.cc:1035] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.920403  8607 raft_consensus.cc:1261] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.921567  8745 consensus_queue.cc:1035] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.927631  8461 raft_consensus.cc:1261] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.932219  8696 consensus_queue.cc:1035] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:50.936836  8538 raft_consensus.cc:1261] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:50.941502  8731 consensus_queue.cc:1035] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:51.020619  8612 raft_consensus.cc:1261] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:51.022069  8731 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:51.030875  8538 raft_consensus.cc:1261] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:51.033239  8728 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:53.125663  7803 auto_leader_rebalancer-test.cc:339] The leader distribution is 
I20260925 16:41:53.126302  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:53.152792  8461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:50212
I20260925 16:41:53.153342  8461 raft_consensus.cc:595] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Received request to transfer leadership to TS 1768714aa483470592b88b8f4d4b95de
I20260925 16:41:53.156072  8461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:50212
I20260925 16:41:53.156598  8461 raft_consensus.cc:595] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Received request to transfer leadership to TS 1768714aa483470592b88b8f4d4b95de
I20260925 16:41:53.157614  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:41:53.158046  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:53.536008  8657 raft_consensus.cc:979] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: : Instructing follower 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:41:53.537530  8757 raft_consensus.cc:1067] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Signalling peer 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:41:53.539139  8607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:55014
I20260925 16:41:53.539883  8607 raft_consensus.cc:482] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:53.540230  8607 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:53.544611  8607 raft_consensus.cc:504] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:53.546099  8607 leader_election.cc:288] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 2 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:53.547092  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:53.546921  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:53.547552  8538 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:53.547644  8461 raft_consensus.cc:3032] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:41:53.548118  8461 raft_consensus.cc:729] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:53.548835  8461 consensus_queue.cc:260] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:53.549786  8461 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:41:53.551994  8538 raft_consensus.cc:2454] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 2.
I20260925 16:41:53.552898  8577 leader_election.cc:302] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:53.553527  8683 raft_consensus.cc:2781] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:41:53.554515  8461 raft_consensus.cc:2454] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 2.
I20260925 16:41:53.554733  8683 raft_consensus.cc:686] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:53.555907  8683 consensus_queue.cc:237] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:53.562814  8361 catalog_manager.cc:5495] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 1 to 2, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 2 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:53.632143  8758 raft_consensus.cc:979] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: : Instructing follower 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:41:53.632579  8758 raft_consensus.cc:1067] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Signalling peer 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:41:53.633945  8607 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:55014
I20260925 16:41:53.634426  8607 raft_consensus.cc:482] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:41:53.634696  8607 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:53.638814  8607 raft_consensus.cc:504] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:53.640214  8607 leader_election.cc:288] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 3 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:41:53.641037  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:41:53.641355  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:41:53.641806  8461 raft_consensus.cc:3032] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:41:53.641841  8538 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:53.642190  8461 raft_consensus.cc:729] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:41:53.642890  8461 consensus_queue.cc:260] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:53.643860  8461 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:41:53.646471  8538 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 3.
I20260925 16:41:53.647490  8577 leader_election.cc:302] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:41:53.648313  8683 raft_consensus.cc:2781] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:41:53.648339  8461 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 3.
I20260925 16:41:53.648870  8683 raft_consensus.cc:686] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:41:53.649706  8683 consensus_queue.cc:237] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:41:53.658628  8361 catalog_manager.cc:5495] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 2 to 3, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 3 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:41:53.942387  8538 raft_consensus.cc:1261] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:53.943398  8683 consensus_queue.cc:1035] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:53.952000  8461 raft_consensus.cc:1261] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:41:53.953488  8759 consensus_queue.cc:1035] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:41:54.158826  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:54.164415  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:54.164826  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:54.217056  8538 raft_consensus.cc:1261] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:54.218189  8759 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:54.226143  8461 raft_consensus.cc:1261] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:41:54.227406  8683 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:41:55.165616  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:55.170914  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:55.171311  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:56.172438  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:56.178717  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:56.179102  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:57.179929  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:57.185204  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:57.185860  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:58.186645  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:58.191460  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:58.191839  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:41:59.192602  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:41:59.198025  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:41:59.198480  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:00.199365  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:00.204842  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:00.205178  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:01.205868  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:01.211747  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:01.212075  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:02.212733  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:02.218863  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:02.219362  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:03.250070  7803 auto_leader_rebalancer-test.cc:358] The leader distribution is 
I20260925 16:42:03.257432  8612 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:34262
I20260925 16:42:03.258124  8612 raft_consensus.cc:595] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:42:03.267441  8612 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:34262
I20260925 16:42:03.267904  8612 raft_consensus.cc:595] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:42:03.272356  8538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:38486
I20260925 16:42:03.272861  8538 raft_consensus.cc:595] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:42:03.277797  8538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:38486
I20260925 16:42:03.278196  8538 raft_consensus.cc:595] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:42:03.282168  8538 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
mode: GRACEFUL
new_leader_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:38486
I20260925 16:42:03.282575  8538 raft_consensus.cc:595] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Received request to transfer leadership to TS aa2cc69f88224272b81308853b221104
I20260925 16:42:03.328372  8783 raft_consensus.cc:979] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.329016  8782 raft_consensus.cc:1067] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.330405  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53522
I20260925 16:42:03.330762  8461 raft_consensus.cc:482] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:03.331007  8461 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.335796  8461 raft_consensus.cc:504] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.337294  8461 leader_election.cc:288] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 3 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:03.338204  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:03.338063  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fb34bad4cee4832805bb62a4ff53dd1" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:03.338795  8612 raft_consensus.cc:3032] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:03.338838  8538 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.339147  8612 raft_consensus.cc:729] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:42:03.339864  8612 consensus_queue.cc:260] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.340781  8612 raft_consensus.cc:3037] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.343133  8538 raft_consensus.cc:2454] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 3.
I20260925 16:42:03.344142  8428 leader_election.cc:302] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:42:03.344834  8776 raft_consensus.cc:2781] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:03.345295  8612 raft_consensus.cc:2454] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 3.
I20260925 16:42:03.345822  8776 raft_consensus.cc:686] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:03.346684  8776 consensus_queue.cc:237] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.352877  8361 catalog_manager.cc:5495] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 2 to 3, leader changed from 1768714aa483470592b88b8f4d4b95de (127.7.158.195) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:03.361431  8789 raft_consensus.cc:979] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.362018  8777 raft_consensus.cc:1067] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.363529  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53536
I20260925 16:42:03.364017  8461 raft_consensus.cc:482] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:03.364308  8461 raft_consensus.cc:3037] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:03.369706  8461 raft_consensus.cc:504] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.371019  8461 leader_election.cc:288] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:03.371803  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:03.371876  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a68afe3dc3e14f7297388fc4ab5710fe" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:03.372501  8538 raft_consensus.cc:3032] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:03.372570  8612 raft_consensus.cc:3037] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:03.372764  8538 raft_consensus.cc:729] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:42:03.373368  8538 consensus_queue.cc:260] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.374204  8538 raft_consensus.cc:3037] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:03.376886  8612 raft_consensus.cc:2454] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:42:03.377729  8428 leader_election.cc:302] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:42:03.378438  8776 raft_consensus.cc:2781] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:03.378479  8538 raft_consensus.cc:2454] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 2.
I20260925 16:42:03.378934  8776 raft_consensus.cc:686] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:03.379760  8776 consensus_queue.cc:237] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.385922  8361 catalog_manager.cc:5495] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 1 to 2, leader changed from 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:03.412894  8789 raft_consensus.cc:979] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.413324  8777 raft_consensus.cc:1067] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.414578  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53536
I20260925 16:42:03.414992  8461 raft_consensus.cc:482] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:03.415248  8461 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.419072  8461 raft_consensus.cc:504] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.420305  8461 leader_election.cc:288] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 3 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:03.421038  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:03.421258  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "63e128a1932f4ff893465dae9787f44a" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:03.421471  8538 raft_consensus.cc:3032] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:03.421716  8612 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.421767  8538 raft_consensus.cc:729] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:42:03.422439  8538 consensus_queue.cc:260] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.423271  8538 raft_consensus.cc:3037] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.425794  8612 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 3.
I20260925 16:42:03.426523  8428 leader_election.cc:302] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:42:03.427129  8776 raft_consensus.cc:2781] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:03.427518  8776 raft_consensus.cc:686] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:03.427574  8538 raft_consensus.cc:2454] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 3.
I20260925 16:42:03.428522  8776 consensus_queue.cc:237] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.435034  8361 catalog_manager.cc:5495] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 2 to 3, leader changed from 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:03.685863  8783 raft_consensus.cc:979] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.686309  8782 raft_consensus.cc:1067] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.687849  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53522
I20260925 16:42:03.688251  8461 raft_consensus.cc:482] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:03.688463  8461 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:03.692422  8461 raft_consensus.cc:504] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.693826  8461 leader_election.cc:288] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 4 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:03.694664  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:03.694775  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "78176a1c4b6742029eb85d03fa7a50ad" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:03.695182  8538 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:03.695245  8612 raft_consensus.cc:3032] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:42:03.695588  8612 raft_consensus.cc:729] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:42:03.696204  8612 consensus_queue.cc:260] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.697273  8612 raft_consensus.cc:3037] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:03.699527  8538 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 4.
I20260925 16:42:03.700441  8428 leader_election.cc:302] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 35c23059c70d46b09a2e26c3589aa4ab, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:42:03.701156  8776 raft_consensus.cc:2781] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:42:03.701581  8776 raft_consensus.cc:686] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 4 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:03.702095  8612 raft_consensus.cc:2454] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 4.
I20260925 16:42:03.702325  8776 consensus_queue.cc:237] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.709671  8361 catalog_manager.cc:5495] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 3 to 4, leader changed from 1768714aa483470592b88b8f4d4b95de (127.7.158.195) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:03.731637  8789 raft_consensus.cc:979] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: : Instructing follower aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.732142  8777 raft_consensus.cc:1067] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Signalling peer aa2cc69f88224272b81308853b221104 to start an election
I20260925 16:42:03.733448  8461 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f"
dest_uuid: "aa2cc69f88224272b81308853b221104"
 from {username='slave'} at 127.0.0.1:53536
I20260925 16:42:03.733958  8461 raft_consensus.cc:482] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:03.734258  8461 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.738054  8461 raft_consensus.cc:504] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.739521  8461 leader_election.cc:288] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 3 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:03.740236  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:03.740391  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "aa2cc69f88224272b81308853b221104" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:03.740828  8538 raft_consensus.cc:3032] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:03.740921  8612 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.741153  8538 raft_consensus.cc:729] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:42:03.741895  8538 consensus_queue.cc:260] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.742810  8538 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:03.746142  8612 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 3.
I20260925 16:42:03.746968  8428 leader_election.cc:302] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, aa2cc69f88224272b81308853b221104; no voters: 
I20260925 16:42:03.747295  8538 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate aa2cc69f88224272b81308853b221104 in term 3.
I20260925 16:42:03.747612  8776 raft_consensus.cc:2781] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:03.748148  8776 raft_consensus.cc:686] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Becoming Leader. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:03.748955  8776 consensus_queue.cc:237] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:03.755851  8361 catalog_manager.cc:5495] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 reported cstate change: term changed from 2 to 3, leader changed from 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194) to aa2cc69f88224272b81308853b221104 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "aa2cc69f88224272b81308853b221104" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:03.832263  8612 raft_consensus.cc:1261] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:03.833792  8776 consensus_queue.cc:1035] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:03.844642  8538 raft_consensus.cc:1261] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:03.847324  8776 consensus_queue.cc:1035] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:03.873414  8612 raft_consensus.cc:1261] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:03.874459  8776 consensus_queue.cc:1035] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:03.884125  8538 raft_consensus.cc:1261] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:03.886870  8797 consensus_queue.cc:1035] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:03.960712  8612 raft_consensus.cc:1261] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:03.961692  8538 raft_consensus.cc:1261] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:03.962069  8802 consensus_queue.cc:1035] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:03.962785  8797 consensus_queue.cc:1035] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:04.287611  8538 raft_consensus.cc:1261] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:42:04.288828  8797 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:04.297878  8612 raft_consensus.cc:1261] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:42:04.299741  8802 consensus_queue.cc:1035] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:04.333709  8612 raft_consensus.cc:1261] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:04.335054  8802 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:04.347122  8538 raft_consensus.cc:1261] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Refusing update from remote peer aa2cc69f88224272b81308853b221104: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:04.348508  8776 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:06.316771  7803 auto_leader_rebalancer-test.cc:373] The leader distribution is 
I20260925 16:42:06.317480  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:06.324146  8461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:50212
I20260925 16:42:06.324905  8461 raft_consensus.cc:595] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Received request to transfer leadership to TS 1768714aa483470592b88b8f4d4b95de
I20260925 16:42:06.327342  8461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:50212
I20260925 16:42:06.327747  8461 raft_consensus.cc:595] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Received request to transfer leadership to TS 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:42:06.329707  8461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a3d80556614546209830bdea088a94f0"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:50212
I20260925 16:42:06.330034  8461 raft_consensus.cc:595] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Received request to transfer leadership to TS 35c23059c70d46b09a2e26c3589aa4ab
I20260925 16:42:06.331882  8461 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19"
dest_uuid: "aa2cc69f88224272b81308853b221104"
mode: GRACEFUL
new_leader_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:50212
I20260925 16:42:06.332206  8461 raft_consensus.cc:595] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Received request to transfer leadership to TS 1768714aa483470592b88b8f4d4b95de
I20260925 16:42:06.333112  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260925 16:42:06.333603  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:06.385646  8802 raft_consensus.cc:979] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: : Instructing follower 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:42:06.386188  8811 raft_consensus.cc:1067] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Signalling peer 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:42:06.387621  8538 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:32826
I20260925 16:42:06.388108  8538 raft_consensus.cc:482] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:06.388412  8538 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:06.393674  8538 raft_consensus.cc:504] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.395545  8538 leader_election.cc:288] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 4 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:06.396345  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:42:06.396713  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9e49655387224b6fa47a374a4e8f425f" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:06.397063  8461 raft_consensus.cc:3032] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:42:06.397215  8612 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:06.397418  8461 raft_consensus.cc:729] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:06.398241  8461 consensus_queue.cc:260] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.399144  8461 raft_consensus.cc:3037] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:06.402257  8612 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 4.
I20260925 16:42:06.403332  8502 leader_election.cc:302] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:42:06.404040  8461 raft_consensus.cc:2454] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 4.
I20260925 16:42:06.404323  8777 raft_consensus.cc:2781] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:42:06.405534  8777 raft_consensus.cc:686] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 4 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:42:06.406800  8777 consensus_queue.cc:237] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.413571  8361 catalog_manager.cc:5495] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 3 to 4, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 4 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:06.651988  8802 raft_consensus.cc:979] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: : Instructing follower 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:42:06.652413  8811 raft_consensus.cc:1067] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Signalling peer 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:42:06.653867  8612 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:55014
I20260925 16:42:06.654304  8612 raft_consensus.cc:482] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:06.654547  8612 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.658872  8612 raft_consensus.cc:504] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.660612  8612 leader_election.cc:288] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 3 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477)
I20260925 16:42:06.661365  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:42:06.661585  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d46f9745813a4ce4bf0aa8c579ce6b19" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:06.661989  8461 raft_consensus.cc:3032] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:06.662092  8538 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.662281  8461 raft_consensus.cc:729] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:06.662961  8461 consensus_queue.cc:260] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.663936  8461 raft_consensus.cc:3037] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.667085  8538 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 3.
I20260925 16:42:06.667161  8802 raft_consensus.cc:979] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: : Instructing follower 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:42:06.667768  8811 raft_consensus.cc:1067] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Signalling peer 1768714aa483470592b88b8f4d4b95de to start an election
I20260925 16:42:06.668437  8577 leader_election.cc:302] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:42:06.669070  8612 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af"
dest_uuid: "1768714aa483470592b88b8f4d4b95de"
 from {username='slave'} at 127.0.0.1:55014
I20260925 16:42:06.669293  8806 raft_consensus.cc:2781] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:06.669567  8612 raft_consensus.cc:482] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:06.669776  8461 raft_consensus.cc:2454] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 3.
I20260925 16:42:06.669912  8612 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.670526  8806 raft_consensus.cc:686] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:42:06.671511  8806 consensus_queue.cc:237] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.675964  8612 raft_consensus.cc:504] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:42:06.677529  8612 leader_election.cc:288] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 3 election: Requested vote from peers 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477), aa2cc69f88224272b81308853b221104 (127.7.158.193:39923)
I20260925 16:42:06.678097  8538 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
I20260925 16:42:06.678385  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1c6ab8102cb34b178f2316fde12cb4af" candidate_uuid: "1768714aa483470592b88b8f4d4b95de" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:42:06.678599  8538 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.678869  8461 raft_consensus.cc:3032] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:06.679136  8461 raft_consensus.cc:729] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:06.679070  8361 catalog_manager.cc:5495] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 2 to 3, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 3 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:06.679972  8461 consensus_queue.cc:260] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:42:06.680994  8461 raft_consensus.cc:3037] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.684849  8538 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 3.
I20260925 16:42:06.685885  8577 leader_election.cc:302] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:42:06.686617  8806 raft_consensus.cc:2781] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:06.687012  8461 raft_consensus.cc:2454] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1768714aa483470592b88b8f4d4b95de in term 3.
I20260925 16:42:06.687096  8806 raft_consensus.cc:686] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Becoming Leader. State: Replica: 1768714aa483470592b88b8f4d4b95de, State: Running, Role: LEADER
I20260925 16:42:06.688060  8806 consensus_queue.cc:237] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } }
I20260925 16:42:06.694365  8361 catalog_manager.cc:5495] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de reported cstate change: term changed from 2 to 3, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 1768714aa483470592b88b8f4d4b95de (127.7.158.195). New cstate: current_term: 3 leader_uuid: "1768714aa483470592b88b8f4d4b95de" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:06.886766  8802 raft_consensus.cc:979] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: : Instructing follower 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:42:06.887181  8811 raft_consensus.cc:1067] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Signalling peer 35c23059c70d46b09a2e26c3589aa4ab to start an election
I20260925 16:42:06.888394  8538 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a3d80556614546209830bdea088a94f0"
dest_uuid: "35c23059c70d46b09a2e26c3589aa4ab"
 from {username='slave'} at 127.0.0.1:32826
I20260925 16:42:06.888757  8538 raft_consensus.cc:482] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:06.888957  8538 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.892925  8538 raft_consensus.cc:504] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.894172  8538 leader_election.cc:288] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 3 election: Requested vote from peers aa2cc69f88224272b81308853b221104 (127.7.158.193:39923), 1768714aa483470592b88b8f4d4b95de (127.7.158.195:39249)
I20260925 16:42:06.894915  8461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "aa2cc69f88224272b81308853b221104"
I20260925 16:42:06.895035  8612 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3d80556614546209830bdea088a94f0" candidate_uuid: "35c23059c70d46b09a2e26c3589aa4ab" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1768714aa483470592b88b8f4d4b95de"
I20260925 16:42:06.895433  8461 raft_consensus.cc:3032] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:06.895495  8612 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.895687  8461 raft_consensus.cc:729] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: aa2cc69f88224272b81308853b221104, State: Running, Role: LEADER
I20260925 16:42:06.896355  8461 consensus_queue.cc:260] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.897189  8461 raft_consensus.cc:3037] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:06.899624  8612 raft_consensus.cc:2454] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 3.
I20260925 16:42:06.900478  8502 leader_election.cc:302] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1768714aa483470592b88b8f4d4b95de, 35c23059c70d46b09a2e26c3589aa4ab; no voters: 
I20260925 16:42:06.901154  8777 raft_consensus.cc:2781] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:06.901365  8461 raft_consensus.cc:2454] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 35c23059c70d46b09a2e26c3589aa4ab in term 3.
I20260925 16:42:06.901530  8777 raft_consensus.cc:686] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 LEADER]: Becoming Leader. State: Replica: 35c23059c70d46b09a2e26c3589aa4ab, State: Running, Role: LEADER
I20260925 16:42:06.902364  8777 consensus_queue.cc:237] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } }
I20260925 16:42:06.909679  8361 catalog_manager.cc:5495] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab reported cstate change: term changed from 2 to 3, leader changed from aa2cc69f88224272b81308853b221104 (127.7.158.193) to 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194). New cstate: current_term: 3 leader_uuid: "35c23059c70d46b09a2e26c3589aa4ab" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:06.964389  8612 raft_consensus.cc:1261] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:42:06.965479  8777 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:06.975876  8461 raft_consensus.cc:1261] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:42:06.977349  8813 consensus_queue.cc:1035] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:07.248317  8461 raft_consensus.cc:1261] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:07.249504  8823 consensus_queue.cc:1035] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:07.257441  8538 raft_consensus.cc:1261] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:07.258852  8806 consensus_queue.cc:1035] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:07.284608  8461 raft_consensus.cc:1261] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:07.285983  8830 consensus_queue.cc:1035] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:07.296280  8538 raft_consensus.cc:1261] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Refusing update from remote peer 1768714aa483470592b88b8f4d4b95de: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:07.297709  8830 consensus_queue.cc:1035] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [LEADER]: Connected to new peer: Peer: permanent_uuid: "35c23059c70d46b09a2e26c3589aa4ab" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45477 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:07.334262  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:07.340595  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:07.340934  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:07.347627  8461 raft_consensus.cc:1261] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:07.348667  8813 consensus_queue.cc:1035] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "aa2cc69f88224272b81308853b221104" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39923 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:07.357846  8612 raft_consensus.cc:1261] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Refusing update from remote peer 35c23059c70d46b09a2e26c3589aa4ab: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:07.359984  8777 consensus_queue.cc:1035] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [LEADER]: Connected to new peer: Peer: permanent_uuid: "1768714aa483470592b88b8f4d4b95de" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 39249 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:08.341593  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:08.346715  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:08.347029  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:09.347733  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:09.353111  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:09.353484  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:10.354216  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:10.359323  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:10.359735  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:11.360463  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:11.366345  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:11.366761  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:12.367494  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:12.373472  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:12.373899  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:13.374722  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:13.380985  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:13.381425  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:14.382277  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:14.388229  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:14.388707  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:15.389863  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:15.397953  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:42:15.398511  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:16.427470  7803 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260925 16:42:16.428262  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
W20260925 16:42:16.430203  8578 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 3 similar messages]
W20260925 16:42:16.436048  8578 consensus_peers.cc:487] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de -> Peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Couldn't send request to peer aa2cc69f88224272b81308853b221104. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:16.465547  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:42:16.466362  7803 tablet_replica.cc:330] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.467370  7803 raft_consensus.cc:2229] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.468564  7803 raft_consensus.cc:2258] T a68afe3dc3e14f7297388fc4ab5710fe P aa2cc69f88224272b81308853b221104 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.470481  7803 tablet_replica.cc:330] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.470960  7803 raft_consensus.cc:2229] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.471433  7803 raft_consensus.cc:2258] T 080e93645b724ef6a5c06f691d2a20e7 P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.473407  7803 tablet_replica.cc:330] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.473899  7803 raft_consensus.cc:2229] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.474697  7803 raft_consensus.cc:2258] T 3fb34bad4cee4832805bb62a4ff53dd1 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.476651  7803 tablet_replica.cc:330] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.477188  7803 raft_consensus.cc:2229] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.477705  7803 raft_consensus.cc:2258] T ebd8f07f558b4fcc8c6c1af896753cae P aa2cc69f88224272b81308853b221104 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.479405  7803 tablet_replica.cc:330] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.479962  7803 raft_consensus.cc:2229] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.480399  7803 raft_consensus.cc:2258] T 1c6ab8102cb34b178f2316fde12cb4af P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.481958  7803 tablet_replica.cc:330] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.482451  7803 raft_consensus.cc:2229] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 4 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.483237  7803 raft_consensus.cc:2258] T 78176a1c4b6742029eb85d03fa7a50ad P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.485036  7803 tablet_replica.cc:330] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.485641  7803 raft_consensus.cc:2229] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.486099  7803 raft_consensus.cc:2258] T d46f9745813a4ce4bf0aa8c579ce6b19 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.487828  7803 tablet_replica.cc:330] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.488269  7803 raft_consensus.cc:2229] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.488627  7803 raft_consensus.cc:2258] T 9e49655387224b6fa47a374a4e8f425f P aa2cc69f88224272b81308853b221104 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.490162  7803 tablet_replica.cc:330] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.490552  7803 raft_consensus.cc:2229] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.490906  7803 raft_consensus.cc:2258] T a3d80556614546209830bdea088a94f0 P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.492547  7803 tablet_replica.cc:330] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104: stopping tablet replica
I20260925 16:42:16.492903  7803 raft_consensus.cc:2229] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.493608  7803 raft_consensus.cc:2258] T 63e128a1932f4ff893465dae9787f44a P aa2cc69f88224272b81308853b221104 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:42:16.520710  8503 consensus_peers.cc:487] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab -> Peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Couldn't send request to peer aa2cc69f88224272b81308853b221104. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:16.523289  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
I20260925 16:42:16.542342  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:42:16.551124  8503 consensus_peers.cc:487] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab -> Peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Couldn't send request to peer aa2cc69f88224272b81308853b221104. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:16.571874  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:42:16.572674  7803 tablet_replica.cc:330] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.573426  7803 raft_consensus.cc:2229] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.574594  7803 raft_consensus.cc:2258] T 080e93645b724ef6a5c06f691d2a20e7 P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.577234  7803 tablet_replica.cc:330] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.578126  7803 raft_consensus.cc:2229] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.578619  7803 raft_consensus.cc:2258] T a68afe3dc3e14f7297388fc4ab5710fe P 35c23059c70d46b09a2e26c3589aa4ab [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.580435  7803 tablet_replica.cc:330] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.580958  7803 raft_consensus.cc:2229] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.582266  7803 raft_consensus.cc:2258] T a3d80556614546209830bdea088a94f0 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.584481  7803 tablet_replica.cc:330] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.585122  7803 raft_consensus.cc:2229] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 4 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.585924  7803 raft_consensus.cc:2258] T 9e49655387224b6fa47a374a4e8f425f P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.587666  7803 tablet_replica.cc:330] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.588199  7803 raft_consensus.cc:2229] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.588553  7803 raft_consensus.cc:2258] T 63e128a1932f4ff893465dae9787f44a P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.590341  7803 tablet_replica.cc:330] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.590835  7803 raft_consensus.cc:2229] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.591202  7803 raft_consensus.cc:2258] T d46f9745813a4ce4bf0aa8c579ce6b19 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.592836  7803 tablet_replica.cc:330] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.593272  7803 raft_consensus.cc:2229] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.593894  7803 raft_consensus.cc:2258] T 78176a1c4b6742029eb85d03fa7a50ad P 35c23059c70d46b09a2e26c3589aa4ab [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.596223  7803 tablet_replica.cc:330] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.596997  7803 raft_consensus.cc:2229] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.597679  7803 raft_consensus.cc:2258] T ebd8f07f558b4fcc8c6c1af896753cae P 35c23059c70d46b09a2e26c3589aa4ab [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.600410  7803 tablet_replica.cc:330] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.601020  7803 raft_consensus.cc:2229] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.601547  7803 raft_consensus.cc:2258] T 3fb34bad4cee4832805bb62a4ff53dd1 P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:42:16.602365  8578 consensus_peers.cc:487] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de -> Peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Couldn't send request to peer aa2cc69f88224272b81308853b221104. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:16.603547  7803 tablet_replica.cc:330] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab: stopping tablet replica
I20260925 16:42:16.604044  7803 raft_consensus.cc:2229] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.604427  7803 raft_consensus.cc:2258] T 1c6ab8102cb34b178f2316fde12cb4af P 35c23059c70d46b09a2e26c3589aa4ab [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:42:16.618263  8577 consensus_peers.cc:487] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de -> Peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Couldn't send request to peer 35c23059c70d46b09a2e26c3589aa4ab. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:16.634266  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
W20260925 16:42:16.648391  8577 consensus_peers.cc:487] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de -> Peer 35c23059c70d46b09a2e26c3589aa4ab (127.7.158.194:45477): Couldn't send request to peer 35c23059c70d46b09a2e26c3589aa4ab. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45477: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:42:16.656872  8578 consensus_peers.cc:487] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de -> Peer aa2cc69f88224272b81308853b221104 (127.7.158.193:39923): Couldn't send request to peer aa2cc69f88224272b81308853b221104. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39923: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:16.660410  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
I20260925 16:42:16.690578  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:42:16.691277  7803 tablet_replica.cc:330] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.692122  7803 raft_consensus.cc:2229] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.692543  7803 raft_consensus.cc:2258] T a68afe3dc3e14f7297388fc4ab5710fe P 1768714aa483470592b88b8f4d4b95de [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.694283  7803 tablet_replica.cc:330] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.694708  7803 raft_consensus.cc:2229] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.695405  7803 raft_consensus.cc:2258] T 1c6ab8102cb34b178f2316fde12cb4af P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.697054  7803 tablet_replica.cc:330] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.697486  7803 raft_consensus.cc:2229] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.698139  7803 raft_consensus.cc:2258] T ebd8f07f558b4fcc8c6c1af896753cae P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.699913  7803 tablet_replica.cc:330] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.700349  7803 raft_consensus.cc:2229] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.700721  7803 raft_consensus.cc:2258] T 3fb34bad4cee4832805bb62a4ff53dd1 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.702242  7803 tablet_replica.cc:330] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.702705  7803 raft_consensus.cc:2229] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.703128  7803 raft_consensus.cc:2258] T 9e49655387224b6fa47a374a4e8f425f P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.704741  7803 tablet_replica.cc:330] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.705147  7803 raft_consensus.cc:2229] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.705478  7803 raft_consensus.cc:2258] T 63e128a1932f4ff893465dae9787f44a P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.706864  7803 tablet_replica.cc:330] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.707267  7803 raft_consensus.cc:2229] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.707602  7803 raft_consensus.cc:2258] T 78176a1c4b6742029eb85d03fa7a50ad P 1768714aa483470592b88b8f4d4b95de [term 4 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.709234  7803 tablet_replica.cc:330] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.709658  7803 raft_consensus.cc:2229] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.710596  7803 raft_consensus.cc:2258] T d46f9745813a4ce4bf0aa8c579ce6b19 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.712363  7803 tablet_replica.cc:330] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.712767  7803 raft_consensus.cc:2229] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.713162  7803 raft_consensus.cc:2258] T a3d80556614546209830bdea088a94f0 P 1768714aa483470592b88b8f4d4b95de [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.714880  7803 tablet_replica.cc:330] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de: stopping tablet replica
I20260925 16:42:16.715260  7803 raft_consensus.cc:2229] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:16.715565  7803 raft_consensus.cc:2258] T 080e93645b724ef6a5c06f691d2a20e7 P 1768714aa483470592b88b8f4d4b95de [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.743260  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:42:16.762064  7803 master.cc:537] Master@127.7.158.254:34215 shutting down...
I20260925 16:42:16.785988  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:42:16.786597  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:16.786906  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P e6c54614a66b491fb8424d51ded64631: stopping tablet replica
I20260925 16:42:16.821017  7803 master.cc:552] Master@127.7.158.254:34215 shutdown complete.
1768714aa483470592b88b8f4d4b95de  1
35c23059c70d46b09a2e26c3589aa4ab  4
aa2cc69f88224272b81308853b221104  5
1768714aa483470592b88b8f4d4b95de  3
35c23059c70d46b09a2e26c3589aa4ab  4
aa2cc69f88224272b81308853b221104  3
1768714aa483470592b88b8f4d4b95de  1
35c23059c70d46b09a2e26c3589aa4ab  1
aa2cc69f88224272b81308853b221104  8
1768714aa483470592b88b8f4d4b95de  3
35c23059c70d46b09a2e26c3589aa4ab  3
aa2cc69f88224272b81308853b221104  4
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28720 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260925 16:42:16.866425  7803 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.158.254:39187
I20260925 16:42:16.867542  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:42:16.874864  8849 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:16.874866  8848 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:16.876132  8851 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:16.877413  7803 server_base.cc:1034] running on GCE node
I20260925 16:42:16.878322  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:42:16.878494  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:42:16.878609  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354536878601 us; error 0 us; skew 500 ppm
I20260925 16:42:16.879029  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:42:16.886294  7803 webserver.cc:460] Webserver started at http://127.7.158.254:46229/ using document root <none> and password file <none>
I20260925 16:42:16.886758  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:42:16.886911  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:42:16.887138  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:42:16.888541  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/master-0-root/instance:
uuid: "ba21ddca249c4cf39e72526cc8696c60"
format_stamp: "Formatted at 2026-09-25 16:42:16 on dist-test-slave-fknp"
I20260925 16:42:16.892867  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260925 16:42:16.896077  8856 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:16.896765  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260925 16:42:16.897032  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/master-0-root
uuid: "ba21ddca249c4cf39e72526cc8696c60"
format_stamp: "Formatted at 2026-09-25 16:42:16 on dist-test-slave-fknp"
I20260925 16:42:16.897310  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:42:16.910022  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:42:16.911206  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:42:16.952256  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.254:39187
I20260925 16:42:16.952358  8907 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.254:39187 every 8 connection(s)
I20260925 16:42:16.956224  8908 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:16.966636  8908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Bootstrap starting.
I20260925 16:42:16.971211  8908 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:16.975519  8908 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: No bootstrap required, opened a new log
I20260925 16:42:16.977638  8908 raft_consensus.cc:348] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba21ddca249c4cf39e72526cc8696c60" member_type: VOTER }
I20260925 16:42:16.978104  8908 raft_consensus.cc:374] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:16.978291  8908 raft_consensus.cc:729] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ba21ddca249c4cf39e72526cc8696c60, State: Initialized, Role: FOLLOWER
I20260925 16:42:16.978804  8908 consensus_queue.cc:260] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba21ddca249c4cf39e72526cc8696c60" member_type: VOTER }
I20260925 16:42:16.979403  8908 raft_consensus.cc:388] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 16:42:16.979658  8908 raft_consensus.cc:482] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 16:42:16.979949  8908 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:16.983852  8908 raft_consensus.cc:504] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba21ddca249c4cf39e72526cc8696c60" member_type: VOTER }
I20260925 16:42:16.984292  8908 leader_election.cc:302] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ba21ddca249c4cf39e72526cc8696c60; no voters: 
I20260925 16:42:16.985383  8908 leader_election.cc:288] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260925 16:42:16.985723  8911 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:16.987044  8911 raft_consensus.cc:686] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 LEADER]: Becoming Leader. State: Replica: ba21ddca249c4cf39e72526cc8696c60, State: Running, Role: LEADER
I20260925 16:42:16.987625  8911 consensus_queue.cc:237] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba21ddca249c4cf39e72526cc8696c60" member_type: VOTER }
I20260925 16:42:16.988255  8908 sys_catalog.cc:564] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 16:42:16.992699  8912 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ba21ddca249c4cf39e72526cc8696c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba21ddca249c4cf39e72526cc8696c60" member_type: VOTER } }
I20260925 16:42:16.993335  8912 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [sys.catalog]: This master's current role is: LEADER
I20260925 16:42:16.993463  8913 sys_catalog.cc:455] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ba21ddca249c4cf39e72526cc8696c60. Latest consensus state: current_term: 1 leader_uuid: "ba21ddca249c4cf39e72526cc8696c60" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ba21ddca249c4cf39e72526cc8696c60" member_type: VOTER } }
I20260925 16:42:16.994273  8913 sys_catalog.cc:458] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [sys.catalog]: This master's current role is: LEADER
I20260925 16:42:16.998088  8919 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 16:42:17.006640  8919 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 16:42:17.007587  7803 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260925 16:42:17.016417  8919 catalog_manager.cc:1347] Generated new cluster ID: 41beee24990d4486838ab9c0a33d295d
I20260925 16:42:17.016716  8919 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 16:42:17.053054  8919 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 16:42:17.054598  8919 catalog_manager.cc:1504] Loading token signing keys...
I20260925 16:42:17.067217  8919 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Generated new TSK 0
I20260925 16:42:17.068079  8919 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 16:42:17.074667  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:42:17.081418  8929 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:17.083153  8930 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:17.084662  7803 server_base.cc:1034] running on GCE node
W20260925 16:42:17.084630  8932 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:17.085803  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:42:17.085986  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:42:17.086102  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354537086092 us; error 0 us; skew 500 ppm
I20260925 16:42:17.086565  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:42:17.089452  7803 webserver.cc:460] Webserver started at http://127.7.158.193:36451/ using document root <none> and password file <none>
I20260925 16:42:17.089879  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:42:17.090045  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:42:17.090238  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:42:17.091357  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/instance:
uuid: "225d3432101a4758bb9a6b0efeae09c5"
format_stamp: "Formatted at 2026-09-25 16:42:17 on dist-test-slave-fknp"
I20260925 16:42:17.095832  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260925 16:42:17.099157  8937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.100071  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260925 16:42:17.100358  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "225d3432101a4758bb9a6b0efeae09c5"
format_stamp: "Formatted at 2026-09-25 16:42:17 on dist-test-slave-fknp"
I20260925 16:42:17.100636  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:42:17.120558  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:42:17.121934  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:42:17.123505  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:42:17.125743  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:42:17.125913  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.126176  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:42:17.126384  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.167060  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:40071
I20260925 16:42:17.167179  8999 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:40071 every 8 connection(s)
I20260925 16:42:17.171909  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:42:17.180109  9004 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:17.181210  9005 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:17.183399  9008 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:17.183660  7803 server_base.cc:1034] running on GCE node
I20260925 16:42:17.184751  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:42:17.184922  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:42:17.185122  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354537185092 us; error 0 us; skew 500 ppm
I20260925 16:42:17.185840  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:42:17.188412  9000 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39187
I20260925 16:42:17.188896  9000 heartbeater.cc:464] Registering TS with master...
I20260925 16:42:17.189159  7803 webserver.cc:460] Webserver started at http://127.7.158.194:32817/ using document root <none> and password file <none>
I20260925 16:42:17.189770  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:42:17.189731  9000 heartbeater.cc:511] Master 127.7.158.254:39187 requested a full tablet report, sending...
I20260925 16:42:17.190210  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:42:17.190547  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:42:17.192016  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/instance:
uuid: "8dc3391062084f45a6ba62d28d340722"
format_stamp: "Formatted at 2026-09-25 16:42:17 on dist-test-slave-fknp"
I20260925 16:42:17.192137  8873 ts_manager.cc:194] Registered new tserver with Master: 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:17.194056  8873 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38634
I20260925 16:42:17.196892  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260925 16:42:17.200881  9012 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.201656  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260925 16:42:17.202109  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root
uuid: "8dc3391062084f45a6ba62d28d340722"
format_stamp: "Formatted at 2026-09-25 16:42:17 on dist-test-slave-fknp"
I20260925 16:42:17.202538  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:42:17.225363  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:42:17.226619  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:42:17.228667  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:42:17.231354  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:42:17.231534  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.231756  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:42:17.231909  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260925 16:42:17.272737  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.194:45245
I20260925 16:42:17.272941  9074 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.194:45245 every 8 connection(s)
I20260925 16:42:17.278679  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:42:17.286087  9078 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:17.287163  9079 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:17.289541  7803 server_base.cc:1034] running on GCE node
W20260925 16:42:17.290755  9082 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:17.291857  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:42:17.292104  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:42:17.292330  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354537292312 us; error 0 us; skew 500 ppm
I20260925 16:42:17.293002  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:42:17.293242  9075 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39187
I20260925 16:42:17.293658  9075 heartbeater.cc:464] Registering TS with master...
I20260925 16:42:17.294633  9075 heartbeater.cc:511] Master 127.7.158.254:39187 requested a full tablet report, sending...
I20260925 16:42:17.296015  7803 webserver.cc:460] Webserver started at http://127.7.158.195:36651/ using document root <none> and password file <none>
I20260925 16:42:17.296635  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:42:17.296829  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:42:17.297125  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:42:17.297179  8873 ts_manager.cc:194] Registered new tserver with Master: 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:17.298704  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/instance:
uuid: "40a71744ceba4efe949720cb0f274853"
format_stamp: "Formatted at 2026-09-25 16:42:17 on dist-test-slave-fknp"
I20260925 16:42:17.299242  8873 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38640
I20260925 16:42:17.305701  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.003s	sys 0.006s
I20260925 16:42:17.309760  9086 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.310842  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.000s
I20260925 16:42:17.311185  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root
uuid: "40a71744ceba4efe949720cb0f274853"
format_stamp: "Formatted at 2026-09-25 16:42:17 on dist-test-slave-fknp"
I20260925 16:42:17.311480  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:42:17.329850  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:42:17.330984  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:42:17.332535  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:42:17.335127  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:42:17.335410  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:17.335750  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:42:17.335964  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260925 16:42:17.377787  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.195:32851
I20260925 16:42:17.377979  9148 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.195:32851 every 8 connection(s)
I20260925 16:42:17.393862  9149 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39187
I20260925 16:42:17.394361  9149 heartbeater.cc:464] Registering TS with master...
I20260925 16:42:17.395025  9149 heartbeater.cc:511] Master 127.7.158.254:39187 requested a full tablet report, sending...
I20260925 16:42:17.396852  8873 ts_manager.cc:194] Registered new tserver with Master: 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:17.397965  7803 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.01697464s
I20260925 16:42:17.398528  8873 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38646
I20260925 16:42:17.400588  7803 test_util.cc:268] Using random seed: 1715030266
I20260925 16:42:17.425145  8873 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38654:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:42:17.431571  8873 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:42:17.641301  9113 tablet_service.cc:1467] Processing CreateTablet for tablet eb346a4d887940099443a0219edadef0 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260925 16:42:17.642776  9113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb346a4d887940099443a0219edadef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.642901  9109 tablet_service.cc:1467] Processing CreateTablet for tablet e7e6790e980f40f8aeb12986a2ac7ed6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260925 16:42:17.644266  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e6790e980f40f8aeb12986a2ac7ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.648687  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 9bced284cac6492d92b23e3fcf0b9c80 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260925 16:42:17.649706  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bced284cac6492d92b23e3fcf0b9c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.652889  9111 tablet_service.cc:1467] Processing CreateTablet for tablet 4b41a723075b4ed5b21758d5b37cd917 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260925 16:42:17.654202  9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b41a723075b4ed5b21758d5b37cd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.653983  9114 tablet_service.cc:1467] Processing CreateTablet for tablet 82c043c282244d42a0ae912a76bcbe36 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260925 16:42:17.654757  8965 tablet_service.cc:1467] Processing CreateTablet for tablet 82c043c282244d42a0ae912a76bcbe36 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260925 16:42:17.655231  9114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c043c282244d42a0ae912a76bcbe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.652896  9112 tablet_service.cc:1467] Processing CreateTablet for tablet 7035ef77210644d1a724b7ba26706f52 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260925 16:42:17.655314  8964 tablet_service.cc:1467] Processing CreateTablet for tablet eb346a4d887940099443a0219edadef0 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260925 16:42:17.656038  8965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c043c282244d42a0ae912a76bcbe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.656383  9112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7035ef77210644d1a724b7ba26706f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.656643  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb346a4d887940099443a0219edadef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.662561  8963 tablet_service.cc:1467] Processing CreateTablet for tablet 7035ef77210644d1a724b7ba26706f52 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260925 16:42:17.663893  8963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7035ef77210644d1a724b7ba26706f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.664870  9107 tablet_service.cc:1467] Processing CreateTablet for tablet 42b301336d224f89acb2543ae4e24a12 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260925 16:42:17.666118  9107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b301336d224f89acb2543ae4e24a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.668838  9106 tablet_service.cc:1467] Processing CreateTablet for tablet cfb224095e1141f88e8a13ce96fb8fbb (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260925 16:42:17.670096  9106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb224095e1141f88e8a13ce96fb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.672843  9105 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3ede733d07420cb13e85c1792f036e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260925 16:42:17.674080  9105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ede733d07420cb13e85c1792f036e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.676427  9108 tablet_service.cc:1467] Processing CreateTablet for tablet a47f8b3d2d0140999fc2b3d8be7d6166 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260925 16:42:17.677807  9108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f8b3d2d0140999fc2b3d8be7d6166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.689168  9164 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:17.696094  9164 tablet_bootstrap.cc:654] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:17.699537  9165 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:17.701799  9114 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee8e183d4e44c21804c9d95ed71dd2e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260925 16:42:17.703267  9114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee8e183d4e44c21804c9d95ed71dd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.706559  9165 tablet_bootstrap.cc:654] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:17.711440  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 401361a5d37b4eefa49285e758f2f67b (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260925 16:42:17.712751  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 401361a5d37b4eefa49285e758f2f67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.716650  8963 tablet_service.cc:1467] Processing CreateTablet for tablet 4b41a723075b4ed5b21758d5b37cd917 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260925 16:42:17.718115  8963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b41a723075b4ed5b21758d5b37cd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.720796  8962 tablet_service.cc:1467] Processing CreateTablet for tablet 9bced284cac6492d92b23e3fcf0b9c80 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260925 16:42:17.721076  9111 tablet_service.cc:1467] Processing CreateTablet for tablet 92fef1a775d54176ae0a3f7d209be2bf (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260925 16:42:17.722133  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bced284cac6492d92b23e3fcf0b9c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.721865  9114 tablet_service.cc:1467] Processing CreateTablet for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260925 16:42:17.722285  9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92fef1a775d54176ae0a3f7d209be2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.723546  9114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.724891  8961 tablet_service.cc:1467] Processing CreateTablet for tablet e7e6790e980f40f8aeb12986a2ac7ed6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260925 16:42:17.726364  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e6790e980f40f8aeb12986a2ac7ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.728786  8960 tablet_service.cc:1467] Processing CreateTablet for tablet a47f8b3d2d0140999fc2b3d8be7d6166 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260925 16:42:17.729969  8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f8b3d2d0140999fc2b3d8be7d6166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.730401  9109 tablet_service.cc:1467] Processing CreateTablet for tablet 436e4feae1ee4bf7932369f80db76c34 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260925 16:42:17.731552  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436e4feae1ee4bf7932369f80db76c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.732793  8959 tablet_service.cc:1467] Processing CreateTablet for tablet 42b301336d224f89acb2543ae4e24a12 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260925 16:42:17.733986  8959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b301336d224f89acb2543ae4e24a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.736799  8958 tablet_service.cc:1467] Processing CreateTablet for tablet cfb224095e1141f88e8a13ce96fb8fbb (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260925 16:42:17.738255  8958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb224095e1141f88e8a13ce96fb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.740981  8956 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee8e183d4e44c21804c9d95ed71dd2e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260925 16:42:17.742308  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee8e183d4e44c21804c9d95ed71dd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.748824  9039 tablet_service.cc:1467] Processing CreateTablet for tablet eb346a4d887940099443a0219edadef0 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260925 16:42:17.750175  9039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb346a4d887940099443a0219edadef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.752816  9038 tablet_service.cc:1467] Processing CreateTablet for tablet 7035ef77210644d1a724b7ba26706f52 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260925 16:42:17.754307  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7035ef77210644d1a724b7ba26706f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.757045  9037 tablet_service.cc:1467] Processing CreateTablet for tablet 4b41a723075b4ed5b21758d5b37cd917 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260925 16:42:17.758219  8964 tablet_service.cc:1467] Processing CreateTablet for tablet 401361a5d37b4eefa49285e758f2f67b (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260925 16:42:17.759976  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 401361a5d37b4eefa49285e758f2f67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.759860  9036 tablet_service.cc:1467] Processing CreateTablet for tablet 9bced284cac6492d92b23e3fcf0b9c80 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260925 16:42:17.762243  8957 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3ede733d07420cb13e85c1792f036e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260925 16:42:17.764061  9105 tablet_service.cc:1467] Processing CreateTablet for tablet a2fce9318b914cda8815dd44730712b6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260925 16:42:17.764811  9035 tablet_service.cc:1467] Processing CreateTablet for tablet e7e6790e980f40f8aeb12986a2ac7ed6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260925 16:42:17.765969  9105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2fce9318b914cda8815dd44730712b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.767932  9034 tablet_service.cc:1467] Processing CreateTablet for tablet a47f8b3d2d0140999fc2b3d8be7d6166 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260925 16:42:17.770045  9033 tablet_service.cc:1467] Processing CreateTablet for tablet 42b301336d224f89acb2543ae4e24a12 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260925 16:42:17.770433  9040 tablet_service.cc:1467] Processing CreateTablet for tablet 82c043c282244d42a0ae912a76bcbe36 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260925 16:42:17.763537  8957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ede733d07420cb13e85c1792f036e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.772148  9032 tablet_service.cc:1467] Processing CreateTablet for tablet cfb224095e1141f88e8a13ce96fb8fbb (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260925 16:42:17.774223  9031 tablet_service.cc:1467] Processing CreateTablet for tablet 7d3ede733d07420cb13e85c1792f036e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260925 16:42:17.773805  9106 tablet_service.cc:1467] Processing CreateTablet for tablet ee9de086f49c4026931c128637888218 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260925 16:42:17.774533  8965 tablet_service.cc:1467] Processing CreateTablet for tablet 92fef1a775d54176ae0a3f7d209be2bf (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260925 16:42:17.779364  8965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92fef1a775d54176ae0a3f7d209be2bf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.780035  9109 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260925 16:42:17.775753  9106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee9de086f49c4026931c128637888218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.781931  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.784720  9108 tablet_service.cc:1467] Processing CreateTablet for tablet 5db686f01e4748d0b9ce8fe3b96a5895 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260925 16:42:17.786183  9108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db686f01e4748d0b9ce8fe3b96a5895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.787499  8964 tablet_service.cc:1467] Processing CreateTablet for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260925 16:42:17.788695  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.793803  9035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e7e6790e980f40f8aeb12986a2ac7ed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.794435  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bced284cac6492d92b23e3fcf0b9c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.795008  9037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4b41a723075b4ed5b21758d5b37cd917. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.795630  9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb224095e1141f88e8a13ce96fb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.796249  9033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 42b301336d224f89acb2543ae4e24a12. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.798237  9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ede733d07420cb13e85c1792f036e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.798866  9040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c043c282244d42a0ae912a76bcbe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.799448  9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f8b3d2d0140999fc2b3d8be7d6166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.817703  9165 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:17.818374  9165 ts_tablet_manager.cc:1397] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.119s	user 0.002s	sys 0.009s
I20260925 16:42:17.821269  9165 raft_consensus.cc:348] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:17.822458  9165 raft_consensus.cc:374] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:17.822849  9165 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:17.823865  9165 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:17.823210  8964 tablet_service.cc:1467] Processing CreateTablet for tablet 436e4feae1ee4bf7932369f80db76c34 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260925 16:42:17.827059  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436e4feae1ee4bf7932369f80db76c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.824664  8960 tablet_service.cc:1467] Processing CreateTablet for tablet a2fce9318b914cda8815dd44730712b6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260925 16:42:17.840642  8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2fce9318b914cda8815dd44730712b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.858376  9165 ts_tablet_manager.cc:1428] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.040s	user 0.008s	sys 0.005s
I20260925 16:42:17.858819  9149 heartbeater.cc:503] Master 127.7.158.254:39187 was elected leader, sending a full tablet report...
I20260925 16:42:17.860759  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 3c0923848b9b426eade76023fdecc31c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260925 16:42:17.862280  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0923848b9b426eade76023fdecc31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.862736  8962 tablet_service.cc:1467] Processing CreateTablet for tablet eeecf611404e405fa30831f973aec8f1 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260925 16:42:17.864220  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecf611404e405fa30831f973aec8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.864840  8959 tablet_service.cc:1467] Processing CreateTablet for tablet ee9de086f49c4026931c128637888218 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260925 16:42:17.866241  8959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee9de086f49c4026931c128637888218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.874617  8965 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260925 16:42:17.876099  9165 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:17.890152  9165 tablet_bootstrap.cc:654] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:17.906023  8963 tablet_service.cc:1467] Processing CreateTablet for tablet 5db686f01e4748d0b9ce8fe3b96a5895 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260925 16:42:17.910718  9114 tablet_service.cc:1467] Processing CreateTablet for tablet 549559d524ae4003aa83f35d26b7f4b9 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260925 16:42:17.911981  9114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 549559d524ae4003aa83f35d26b7f4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.909003  8963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db686f01e4748d0b9ce8fe3b96a5895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.920651  9111 tablet_service.cc:1467] Processing CreateTablet for tablet c71d03191b9f4a22a2ae4170c54fd018 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260925 16:42:17.936667  8965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.917290  9107 tablet_service.cc:1467] Processing CreateTablet for tablet eeecf611404e405fa30831f973aec8f1 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260925 16:42:17.946607  9035 tablet_service.cc:1467] Processing CreateTablet for tablet 8ee8e183d4e44c21804c9d95ed71dd2e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260925 16:42:17.947461  9113 tablet_service.cc:1467] Processing CreateTablet for tablet 12359c2bff0b46de91daa934c219103c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260925 16:42:17.944535  9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c71d03191b9f4a22a2ae4170c54fd018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.948037  9112 tablet_service.cc:1467] Processing CreateTablet for tablet f750a9cc810645b19ac831fe20c1010e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260925 16:42:17.956071  9109 tablet_service.cc:1467] Processing CreateTablet for tablet cd5f4e4896584eaca2d16610e2afbda8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260925 16:42:17.957290  9033 tablet_service.cc:1467] Processing CreateTablet for tablet a2fce9318b914cda8815dd44730712b6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260925 16:42:17.958602  9033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2fce9318b914cda8815dd44730712b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.960656  9113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12359c2bff0b46de91daa934c219103c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.963848  9112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750a9cc810645b19ac831fe20c1010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.964915  9110 tablet_service.cc:1467] Processing CreateTablet for tablet d89e555296ed40ef8f9abed67a87bde9 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260925 16:42:17.966395  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89e555296ed40ef8f9abed67a87bde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.966485  9164 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:17.966943  9164 ts_tablet_manager.cc:1397] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.278s	user 0.025s	sys 0.015s
I20260925 16:42:17.971819  8956 tablet_service.cc:1467] Processing CreateTablet for tablet 3c0923848b9b426eade76023fdecc31c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260925 16:42:17.973026  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0923848b9b426eade76023fdecc31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.972229  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f4e4896584eaca2d16610e2afbda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.976310  9169 tablet_bootstrap.cc:492] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:17.984128  9107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecf611404e405fa30831f973aec8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.991113  8960 tablet_service.cc:1467] Processing CreateTablet for tablet cd5f4e4896584eaca2d16610e2afbda8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260925 16:42:17.992394  8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f4e4896584eaca2d16610e2afbda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:17.993300  8964 tablet_service.cc:1467] Processing CreateTablet for tablet 549559d524ae4003aa83f35d26b7f4b9 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260925 16:42:17.994439  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 549559d524ae4003aa83f35d26b7f4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.001376  9164 raft_consensus.cc:348] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.001406  8956 tablet_service.cc:1467] Processing CreateTablet for tablet c71d03191b9f4a22a2ae4170c54fd018 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260925 16:42:18.002202  9164 raft_consensus.cc:374] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.003507  9164 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.004570  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c71d03191b9f4a22a2ae4170c54fd018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.005105  9034 tablet_service.cc:1467] Processing CreateTablet for tablet 92fef1a775d54176ae0a3f7d209be2bf (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260925 16:42:18.006294  9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92fef1a775d54176ae0a3f7d209be2bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:18.008630  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:18.012391  9035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8ee8e183d4e44c21804c9d95ed71dd2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.011955  9164 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.022370  9038 tablet_service.cc:1467] Processing CreateTablet for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260925 16:42:18.023586  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.035097  9169 tablet_bootstrap.cc:654] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.035387  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 72e548ac0b7b407dbc32d2018beb932d (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260925 16:42:18.036829  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e548ac0b7b407dbc32d2018beb932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.049041  9108 tablet_service.cc:1467] Processing CreateTablet for tablet 918e188b611843cb98bcddc996c7fc3a (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260925 16:42:18.050287  8962 tablet_service.cc:1467] Processing CreateTablet for tablet 12359c2bff0b46de91daa934c219103c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260925 16:42:18.061133  8961 tablet_service.cc:1467] Processing CreateTablet for tablet f750a9cc810645b19ac831fe20c1010e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260925 16:42:18.063788  8958 tablet_service.cc:1467] Processing CreateTablet for tablet d89e555296ed40ef8f9abed67a87bde9 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260925 16:42:18.050680  9108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918e188b611843cb98bcddc996c7fc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.080129  9031 tablet_service.cc:1467] Processing CreateTablet for tablet ee9de086f49c4026931c128637888218 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260925 16:42:18.081059  9032 tablet_service.cc:1467] Processing CreateTablet for tablet 401361a5d37b4eefa49285e758f2f67b (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260925 16:42:18.081629  9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ee9de086f49c4026931c128637888218. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.082355  9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 401361a5d37b4eefa49285e758f2f67b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.084833  9168 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.084875  8957 tablet_service.cc:1467] Processing CreateTablet for tablet 505ce6aba0e14faabdb5e6135e200af6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260925 16:42:18.085552  9168 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:18.085676  8959 tablet_service.cc:1467] Processing CreateTablet for tablet 918e188b611843cb98bcddc996c7fc3a (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260925 16:42:18.086234  9035 tablet_service.cc:1467] Processing CreateTablet for tablet eeecf611404e405fa30831f973aec8f1 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260925 16:42:18.087387  9035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecf611404e405fa30831f973aec8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.051563  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12359c2bff0b46de91daa934c219103c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.093231  9168 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:18.094563  9106 tablet_service.cc:1467] Processing CreateTablet for tablet 505ce6aba0e14faabdb5e6135e200af6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260925 16:42:18.095834  9106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 505ce6aba0e14faabdb5e6135e200af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.096377  8958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89e555296ed40ef8f9abed67a87bde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.095458  9040 tablet_service.cc:1467] Processing CreateTablet for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260925 16:42:18.098498  8959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918e188b611843cb98bcddc996c7fc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.115144  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750a9cc810645b19ac831fe20c1010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.124595  8957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 505ce6aba0e14faabdb5e6135e200af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.125591  9036 tablet_service.cc:1467] Processing CreateTablet for tablet cd5f4e4896584eaca2d16610e2afbda8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260925 16:42:18.129745  9000 heartbeater.cc:503] Master 127.7.158.254:39187 was elected leader, sending a full tablet report...
I20260925 16:42:18.133603  8962 tablet_service.cc:1467] Processing CreateTablet for tablet 72e548ac0b7b407dbc32d2018beb932d (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260925 16:42:18.134793  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e548ac0b7b407dbc32d2018beb932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.134720  9039 tablet_service.cc:1467] Processing CreateTablet for tablet 3c0923848b9b426eade76023fdecc31c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260925 16:42:18.137943  9038 tablet_service.cc:1467] Processing CreateTablet for tablet 12359c2bff0b46de91daa934c219103c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260925 16:42:18.141157  8956 tablet_service.cc:1467] Processing CreateTablet for tablet c6030f186a664452b127609fadec766b (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260925 16:42:18.142314  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6030f186a664452b127609fadec766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.027609  9037 tablet_service.cc:1467] Processing CreateTablet for tablet 436e4feae1ee4bf7932369f80db76c34 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260925 16:42:18.148896  9040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.166018  9106 tablet_service.cc:1467] Processing CreateTablet for tablet a54776b5e30341f1b8e3b9acd31b9027 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260925 16:42:18.152267  9165 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:18.191756  9169 tablet_bootstrap.cc:492] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:18.192253  9169 ts_tablet_manager.cc:1397] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.216s	user 0.004s	sys 0.026s
I20260925 16:42:18.194860  9169 raft_consensus.cc:348] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.195878  9165 ts_tablet_manager.cc:1397] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.320s	user 0.024s	sys 0.007s
I20260925 16:42:18.198472  9165 raft_consensus.cc:348] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.199146  9165 raft_consensus.cc:374] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.199580  8963 tablet_service.cc:1467] Processing CreateTablet for tablet adae4a9dd16346529fe4ff004abc3603 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260925 16:42:18.200773  8963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae4a9dd16346529fe4ff004abc3603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.208570  9111 tablet_service.cc:1467] Processing CreateTablet for tablet adae4a9dd16346529fe4ff004abc3603 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260925 16:42:18.156852  9033 tablet_service.cc:1467] Processing CreateTablet for tablet 5db686f01e4748d0b9ce8fe3b96a5895 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260925 16:42:18.157752  9105 tablet_service.cc:1467] Processing CreateTablet for tablet c6030f186a664452b127609fadec766b (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260925 16:42:18.215909  8960 tablet_service.cc:1467] Processing CreateTablet for tablet 3503b0ca8a04458ea73d2c6d127f2463 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260925 16:42:18.217097  8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3503b0ca8a04458ea73d2c6d127f2463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.199445  9165 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.195582  9169 raft_consensus.cc:374] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.230949  9039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0923848b9b426eade76023fdecc31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.241385  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f4e4896584eaca2d16610e2afbda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.231887  8964 tablet_service.cc:1467] Processing CreateTablet for tablet a54776b5e30341f1b8e3b9acd31b9027 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260925 16:42:18.228420  9165 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.236277  9164 ts_tablet_manager.cc:1428] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.269s	user 0.016s	sys 0.019s
I20260925 16:42:18.238624  8961 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcfed5db9a046b18c3437b749370a81 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260925 16:42:18.245682  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12359c2bff0b46de91daa934c219103c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.246471  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54776b5e30341f1b8e3b9acd31b9027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.257370  9033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db686f01e4748d0b9ce8fe3b96a5895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.258877  8959 tablet_service.cc:1467] Processing CreateTablet for tablet 516644be414e4a399c722f9df11d3ff5 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260925 16:42:18.260557  9109 tablet_service.cc:1467] Processing CreateTablet for tablet 3503b0ca8a04458ea73d2c6d127f2463 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260925 16:42:18.240097  9169 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.261524  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcfed5db9a046b18c3437b749370a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.268080  9169 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.242118  9106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54776b5e30341f1b8e3b9acd31b9027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.272107  9112 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcfed5db9a046b18c3437b749370a81 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260925 16:42:18.272732  9107 tablet_service.cc:1467] Processing CreateTablet for tablet 516644be414e4a399c722f9df11d3ff5 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260925 16:42:18.273501  9113 tablet_service.cc:1467] Processing CreateTablet for tablet 66c62931d7564a9698d331185552eed5 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260925 16:42:18.273720  9037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436e4feae1ee4bf7932369f80db76c34. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.280073  9108 tablet_service.cc:1467] Processing CreateTablet for tablet 4d5ba69a70184d858b847e046b24564c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260925 16:42:18.286334  9114 tablet_service.cc:1467] Processing CreateTablet for tablet dff93d0dcc5944b0b73fca3da91c5b2c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260925 16:42:18.289703  9032 tablet_service.cc:1467] Processing CreateTablet for tablet 549559d524ae4003aa83f35d26b7f4b9 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260925 16:42:18.291018  9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 549559d524ae4003aa83f35d26b7f4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.292882  8965 tablet_service.cc:1467] Processing CreateTablet for tablet 66c62931d7564a9698d331185552eed5 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260925 16:42:18.294289  9164 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:18.293977  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:18.295688  9089 leader_election.cc:341] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.303427  9075 heartbeater.cc:503] Master 127.7.158.254:39187 was elected leader, sending a full tablet report...
I20260925 16:42:18.308713  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 50e0cc681d6a47be89a47aef9f5e14f4 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260925 16:42:18.310832  9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae4a9dd16346529fe4ff004abc3603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.312217  8959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516644be414e4a399c722f9df11d3ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.312819  9165 ts_tablet_manager.cc:1428] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.117s	user 0.008s	sys 0.000s
I20260925 16:42:18.313283  8957 tablet_service.cc:1467] Processing CreateTablet for tablet 4d5ba69a70184d858b847e046b24564c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260925 16:42:18.313766  9165 tablet_bootstrap.cc:492] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:18.314487  8957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d5ba69a70184d858b847e046b24564c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.316902  9034 tablet_service.cc:1467] Processing CreateTablet for tablet c71d03191b9f4a22a2ae4170c54fd018 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260925 16:42:18.317035  8956 tablet_service.cc:1467] Processing CreateTablet for tablet dff93d0dcc5944b0b73fca3da91c5b2c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260925 16:42:18.318246  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff93d0dcc5944b0b73fca3da91c5b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.333876  9164 tablet_bootstrap.cc:654] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.334661  8962 tablet_service.cc:1467] Processing CreateTablet for tablet 50e0cc681d6a47be89a47aef9f5e14f4 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260925 16:42:18.337733  9112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcfed5db9a046b18c3437b749370a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.339440  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e0cc681d6a47be89a47aef9f5e14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.344146  9108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d5ba69a70184d858b847e046b24564c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.338436  9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c71d03191b9f4a22a2ae4170c54fd018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.356068  8965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c62931d7564a9698d331185552eed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.349669  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e0cc681d6a47be89a47aef9f5e14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.366499  9113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c62931d7564a9698d331185552eed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.368343  9107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516644be414e4a399c722f9df11d3ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.369072  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3503b0ca8a04458ea73d2c6d127f2463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.372269  9114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff93d0dcc5944b0b73fca3da91c5b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.359187  8958 tablet_service.cc:1467] Processing CreateTablet for tablet a3daaf3df10a402a9f2af4eae42e46da (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260925 16:42:18.377518  9105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6030f186a664452b127609fadec766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.378175  8958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3daaf3df10a402a9f2af4eae42e46da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.378623  9039 tablet_service.cc:1467] Processing CreateTablet for tablet f750a9cc810645b19ac831fe20c1010e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260925 16:42:18.386885  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:18.388345  9089 leader_election.cc:341] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.388788  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:18.389986  9168 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:18.392233  9039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750a9cc810645b19ac831fe20c1010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.393983  9171 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.394410  9171 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.396777  9171 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:18.402334  8859 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43875.6us
I20260925 16:42:18.415217  9031 tablet_service.cc:1467] Processing CreateTablet for tablet 918e188b611843cb98bcddc996c7fc3a (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260925 16:42:18.416505  9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918e188b611843cb98bcddc996c7fc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.435477  8962 tablet_service.cc:1467] Processing CreateTablet for tablet c756d218cfc0470183a9fe1cc08a22ab (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260925 16:42:18.403189  8960 tablet_service.cc:1467] Processing CreateTablet for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260925 16:42:18.445436  9036 tablet_service.cc:1467] Processing CreateTablet for tablet 72e548ac0b7b407dbc32d2018beb932d (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260925 16:42:18.446758  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e548ac0b7b407dbc32d2018beb932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.437165  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c756d218cfc0470183a9fe1cc08a22ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.450490  9033 tablet_service.cc:1467] Processing CreateTablet for tablet a54776b5e30341f1b8e3b9acd31b9027 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260925 16:42:18.456182  8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:18.475531  8859 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50383.2us
I20260925 16:42:18.479635  8956 tablet_service.cc:1467] Processing CreateTablet for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260925 16:42:18.481288  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.487557  9169 ts_tablet_manager.cc:1428] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.295s	user 0.015s	sys 0.020s
I20260925 16:42:18.488029  9033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54776b5e30341f1b8e3b9acd31b9027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.488585  9169 tablet_bootstrap.cc:492] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:18.407405  9038 tablet_service.cc:1467] Processing CreateTablet for tablet d89e555296ed40ef8f9abed67a87bde9 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260925 16:42:18.490783  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89e555296ed40ef8f9abed67a87bde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.495255  9165 tablet_bootstrap.cc:654] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.501506  8961 tablet_service.cc:1467] Processing CreateTablet for tablet d3ff365de6e84921a6af19e793363f70 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260925 16:42:18.503034  8963 tablet_service.cc:1467] Processing CreateTablet for tablet 9a92341cf5104c9eba99c812ba97c735 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260925 16:42:18.504793  8963 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a92341cf5104c9eba99c812ba97c735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.508072  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ff365de6e84921a6af19e793363f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.479635  9040 tablet_service.cc:1467] Processing CreateTablet for tablet c6030f186a664452b127609fadec766b (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260925 16:42:18.517550  9040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6030f186a664452b127609fadec766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.520936  8957 tablet_service.cc:1467] Processing CreateTablet for tablet 6e5cd4cb635e42ce8ee7624b47b5750a (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260925 16:42:18.522572  8957 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5cd4cb635e42ce8ee7624b47b5750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.543797  9035 tablet_service.cc:1467] Processing CreateTablet for tablet 505ce6aba0e14faabdb5e6135e200af6 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260925 16:42:18.545010  9035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 505ce6aba0e14faabdb5e6135e200af6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.548455  8959 tablet_service.cc:1467] Processing CreateTablet for tablet ef3a95f58f62434d84bf19310c928a92 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260925 16:42:18.563839  9169 tablet_bootstrap.cc:654] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.539655  9106 tablet_service.cc:1467] Processing CreateTablet for tablet a3daaf3df10a402a9f2af4eae42e46da (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260925 16:42:18.570241  9106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3daaf3df10a402a9f2af4eae42e46da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.571537  9037 tablet_service.cc:1467] Processing CreateTablet for tablet adae4a9dd16346529fe4ff004abc3603 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260925 16:42:18.573036  9037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae4a9dd16346529fe4ff004abc3603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.585476  9164 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:18.586439  9164 ts_tablet_manager.cc:1397] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.292s	user 0.013s	sys 0.008s
I20260925 16:42:18.592082  8964 tablet_service.cc:1467] Processing CreateTablet for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260925 16:42:18.599869  9165 tablet_bootstrap.cc:492] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:18.600353  9165 ts_tablet_manager.cc:1397] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.287s	user 0.011s	sys 0.008s
I20260925 16:42:18.603380  8959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef3a95f58f62434d84bf19310c928a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.610582  9175 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.611127  9031 tablet_service.cc:1467] Processing CreateTablet for tablet 3503b0ca8a04458ea73d2c6d127f2463 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260925 16:42:18.611047  9175 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.617156  9164 raft_consensus.cc:348] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.617915  9164 raft_consensus.cc:374] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.618196  9164 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.618834  9164 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.621217  9165 raft_consensus.cc:348] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.622001  9165 raft_consensus.cc:374] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.622292  9165 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.618531  9175 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:18.623914  8965 tablet_service.cc:1467] Processing CreateTablet for tablet f15ade9737ac41438bda476a00b4ad97 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260925 16:42:18.623690  9165 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.627389  9165 ts_tablet_manager.cc:1428] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260925 16:42:18.623203  8964 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.632967  9032 tablet_service.cc:1467] Processing CreateTablet for tablet 4d5ba69a70184d858b847e046b24564c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260925 16:42:18.634174  9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d5ba69a70184d858b847e046b24564c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.635991  9169 tablet_bootstrap.cc:492] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:18.636409  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:18.638070  8940 leader_election.cc:341] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.636422  9169 ts_tablet_manager.cc:1397] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.148s	user 0.008s	sys 0.004s
I20260925 16:42:18.641484  9169 raft_consensus.cc:348] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.642254  9169 raft_consensus.cc:374] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.642560  9169 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.644009  9169 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.618829  9109 tablet_service.cc:1467] Processing CreateTablet for tablet d3ff365de6e84921a6af19e793363f70 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260925 16:42:18.648738  9036 tablet_service.cc:1467] Processing CreateTablet for tablet 66c62931d7564a9698d331185552eed5 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260925 16:42:18.649926  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c62931d7564a9698d331185552eed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.651757  9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3503b0ca8a04458ea73d2c6d127f2463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.651998  8965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f15ade9737ac41438bda476a00b4ad97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.653244  9164 ts_tablet_manager.cc:1428] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.066s	user 0.008s	sys 0.000s
I20260925 16:42:18.611028  9039 tablet_service.cc:1467] Processing CreateTablet for tablet 4bcfed5db9a046b18c3437b749370a81 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260925 16:42:18.656797  9039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcfed5db9a046b18c3437b749370a81. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.662587  9164 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:18.666301  9038 tablet_service.cc:1467] Processing CreateTablet for tablet dff93d0dcc5944b0b73fca3da91c5b2c (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260925 16:42:18.616084  9034 tablet_service.cc:1467] Processing CreateTablet for tablet 516644be414e4a399c722f9df11d3ff5 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260925 16:42:18.668387  9164 tablet_bootstrap.cc:654] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.669019  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:18.670652  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ff365de6e84921a6af19e793363f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.670754  8961 tablet_service.cc:1467] Processing CreateTablet for tablet e4c4320bf19c419d939def3dc1e1c3d8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260925 16:42:18.673709  9165 tablet_bootstrap.cc:492] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:18.674479  9033 tablet_service.cc:1467] Processing CreateTablet for tablet 50e0cc681d6a47be89a47aef9f5e14f4 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260925 16:42:18.682173  8962 tablet_service.cc:1467] Processing CreateTablet for tablet cdef8e15863049f59c35fc47250d99ee (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260925 16:42:18.683884  9112 tablet_service.cc:1467] Processing CreateTablet for tablet 6e5cd4cb635e42ce8ee7624b47b5750a (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260925 16:42:18.694155  9168 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.694589  9168 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.696389  9168 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:18.698083  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:18.686903  9107 tablet_service.cc:1467] Processing CreateTablet for tablet ef3a95f58f62434d84bf19310c928a92 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260925 16:42:18.667626  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff93d0dcc5944b0b73fca3da91c5b2c. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:18.699795  9089 leader_election.cc:341] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.700542  9112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5cd4cb635e42ce8ee7624b47b5750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.702600  9033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e0cc681d6a47be89a47aef9f5e14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.706195  9036 tablet_service.cc:1467] Processing CreateTablet for tablet a3daaf3df10a402a9f2af4eae42e46da (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260925 16:42:18.707367  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3daaf3df10a402a9f2af4eae42e46da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.692093  9111 tablet_service.cc:1467] Processing CreateTablet for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
W20260925 16:42:18.699517  8939 leader_election.cc:341] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.615190  9114 tablet_service.cc:1467] Processing CreateTablet for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260925 16:42:18.707834  8939 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:18.711133  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c4320bf19c419d939def3dc1e1c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.711308  9171 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:18.720031  9108 tablet_service.cc:1467] Processing CreateTablet for tablet 9a92341cf5104c9eba99c812ba97c735 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260925 16:42:18.723181  9165 tablet_bootstrap.cc:654] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.729297  9039 tablet_service.cc:1467] Processing CreateTablet for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260925 16:42:18.615331  9110 tablet_service.cc:1467] Processing CreateTablet for tablet c756d218cfc0470183a9fe1cc08a22ab (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260925 16:42:18.731331  9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516644be414e4a399c722f9df11d3ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.737088  9169 ts_tablet_manager.cc:1428] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.098s	user 0.006s	sys 0.000s
I20260925 16:42:18.741707  9169 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:18.739333  9038 tablet_service.cc:1467] Processing CreateTablet for tablet c756d218cfc0470183a9fe1cc08a22ab (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260925 16:42:18.749490  8962 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdef8e15863049f59c35fc47250d99ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.752509  8958 tablet_service.cc:1467] Processing CreateTablet for tablet 088ac48c62d34a40b53987746a70b871 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260925 16:42:18.748054  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:18.778487  9168 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.779158  9168 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.781608  9168 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:18.782722  9107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef3a95f58f62434d84bf19310c928a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.783171  8959 tablet_service.cc:1467] Processing CreateTablet for tablet 07fa6fea161b4a24904740819d2f89fa (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260925 16:42:18.784337  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c756d218cfc0470183a9fe1cc08a22ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.788390  9108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a92341cf5104c9eba99c812ba97c735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.795502  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:18.796975  9089 leader_election.cc:341] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.803934  8956 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1eb29a67e8482385d79fa193c4edd3 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260925 16:42:18.804461  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:18.803934  9113 tablet_service.cc:1467] Processing CreateTablet for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260925 16:42:18.805852  9113 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:18.806311  9089 leader_election.cc:341] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.806715  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:18.798403  9039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:18.807917  9089 leader_election.cc:341] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.816568  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:18.809391  9168 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:18.817891  9168 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:18.815027  8960 tablet_service.cc:1467] Processing CreateTablet for tablet 49c7db4b3fda45159275230bc247b929 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260925 16:42:18.813248  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:18.819926  9015 leader_election.cc:341] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.817133  8958 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 088ac48c62d34a40b53987746a70b871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.824664  9171 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.817782  9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.824728  9035 tablet_service.cc:1467] Processing CreateTablet for tablet d3ff365de6e84921a6af19e793363f70 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260925 16:42:18.825192  9171 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.825979  9035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3ff365de6e84921a6af19e793363f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.827358  9171 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:18.827993  9114 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.828428  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:18.829064  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:18.830008  8939 leader_election.cc:341] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:18.830567  8940 leader_election.cc:341] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.830961  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:18.832057  9171 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:18.834187  9031 tablet_service.cc:1467] Processing CreateTablet for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260925 16:42:18.837359  9164 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:18.839989  9164 ts_tablet_manager.cc:1397] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.178s	user 0.029s	sys 0.025s
I20260925 16:42:18.841502  9110 tablet_service.cc:1467] Processing CreateTablet for tablet cdef8e15863049f59c35fc47250d99ee (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260925 16:42:18.842682  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdef8e15863049f59c35fc47250d99ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.842594  9164 raft_consensus.cc:348] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:18.843364  9164 raft_consensus.cc:374] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.843631  9164 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.845268  9164 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:18.837189  9106 tablet_service.cc:1467] Processing CreateTablet for tablet e4c4320bf19c419d939def3dc1e1c3d8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260925 16:42:18.848562  9106 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c4320bf19c419d939def3dc1e1c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.849689  9040 tablet_service.cc:1467] Processing CreateTablet for tablet 9a92341cf5104c9eba99c812ba97c735 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260925 16:42:18.850857  8956 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1eb29a67e8482385d79fa193c4edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.837569  9165 tablet_bootstrap.cc:492] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:18.837383  8961 tablet_service.cc:1467] Processing CreateTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260925 16:42:18.852420  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c694676902c54ad8bfe8e7fd5a725e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.853497  9037 tablet_service.cc:1467] Processing CreateTablet for tablet 6e5cd4cb635e42ce8ee7624b47b5750a (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260925 16:42:18.854722  8959 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07fa6fea161b4a24904740819d2f89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.855998  9165 ts_tablet_manager.cc:1397] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.182s	user 0.019s	sys 0.016s
I20260925 16:42:18.856168  8960 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c7db4b3fda45159275230bc247b929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.858541  9165 raft_consensus.cc:348] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.859236  9165 raft_consensus.cc:374] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.863827  9169 tablet_bootstrap.cc:654] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.838491  9109 tablet_service.cc:1467] Processing CreateTablet for tablet f15ade9737ac41438bda476a00b4ad97 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260925 16:42:18.872797  9034 tablet_service.cc:1467] Processing CreateTablet for tablet ef3a95f58f62434d84bf19310c928a92 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260925 16:42:18.874116  9164 ts_tablet_manager.cc:1428] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.034s	user 0.007s	sys 0.001s
I20260925 16:42:18.877626  9164 tablet_bootstrap.cc:492] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:18.850883  9040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a92341cf5104c9eba99c812ba97c735. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.880209  9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.881897  9112 tablet_service.cc:1467] Processing CreateTablet for tablet 088ac48c62d34a40b53987746a70b871 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260925 16:42:18.883160  9112 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 088ac48c62d34a40b53987746a70b871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.859509  9165 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:18.897092  9165 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.897315  8965 tablet_service.cc:1467] Processing CreateTablet for tablet a5837876dc21490e819ef69131e93921 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260925 16:42:18.898630  8965 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5837876dc21490e819ef69131e93921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.899398  9165 ts_tablet_manager.cc:1428] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260925 16:42:18.893898  9032 tablet_service.cc:1467] Processing CreateTablet for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260925 16:42:18.904311  9109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f15ade9737ac41438bda476a00b4ad97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.904475  9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.916049  9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ef3a95f58f62434d84bf19310c928a92. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.920871  9105 tablet_service.cc:1467] Processing CreateTablet for tablet 07fa6fea161b4a24904740819d2f89fa (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260925 16:42:18.922276  9105 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07fa6fea161b4a24904740819d2f89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.922775  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1eb29a67e8482385d79fa193c4edd3 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260925 16:42:18.923923  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1eb29a67e8482385d79fa193c4edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.929414  8961 tablet_service.cc:1467] Processing CreateTablet for tablet 3c796634a27a4d74b87d6a0081b10018 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260925 16:42:18.930706  8961 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c796634a27a4d74b87d6a0081b10018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.930595  9168 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.931159  9168 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.933223  9168 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:18.945494  9165 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:18.945317  9033 tablet_service.cc:1467] Processing CreateTablet for tablet f15ade9737ac41438bda476a00b4ad97 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260925 16:42:18.947007  9033 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f15ade9737ac41438bda476a00b4ad97. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.957056  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:18.958542  9014 leader_election.cc:341] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.958962  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:18.960016  9175 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:18.968612  9171 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:18.969084  9171 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:18.971138  9171 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:18.972213  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:18.972700  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:18.973356  9124 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
W20260925 16:42:18.973521  8940 leader_election.cc:341] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:18.974561  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:18.973992  9111 tablet_service.cc:1467] Processing CreateTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260925 16:42:18.976248  9107 tablet_service.cc:1467] Processing CreateTablet for tablet 49c7db4b3fda45159275230bc247b929 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260925 16:42:18.978003  9111 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c694676902c54ad8bfe8e7fd5a725e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.979866  9171 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:18.979775  9108 tablet_service.cc:1467] Processing CreateTablet for tablet a5837876dc21490e819ef69131e93921 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260925 16:42:18.980302  9171 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:18.986697  9171 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:18.981676  9107 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c7db4b3fda45159275230bc247b929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.966740  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c756d218cfc0470183a9fe1cc08a22ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:18.983242  9164 tablet_bootstrap.cc:654] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:18.984216  9169 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:18.996052  9169 ts_tablet_manager.cc:1397] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.255s	user 0.022s	sys 0.009s
I20260925 16:42:18.998782  9169 raft_consensus.cc:348] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:18.998453  9171 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:18.999377  9108 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5837876dc21490e819ef69131e93921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.006479  9165 tablet_bootstrap.cc:654] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.008481  9169 raft_consensus.cc:374] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:18.985472  9110 tablet_service.cc:1467] Processing CreateTablet for tablet 3c796634a27a4d74b87d6a0081b10018 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260925 16:42:19.008838  9169 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
W20260925 16:42:19.011137  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:19.015837  9169 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.017088  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.017123  9034 tablet_service.cc:1467] Processing CreateTablet for tablet 07fa6fea161b4a24904740819d2f89fa (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260925 16:42:19.017771  9124 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:19.010397  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 202490us
I20260925 16:42:19.018733  9169 ts_tablet_manager.cc:1428] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260925 16:42:19.013425  9040 tablet_service.cc:1467] Processing CreateTablet for tablet 088ac48c62d34a40b53987746a70b871 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260925 16:42:19.020467  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.020810  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:19.021692  9089 leader_election.cc:341] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.021816  9036 tablet_service.cc:1467] Processing CreateTablet for tablet e4c4320bf19c419d939def3dc1e1c3d8 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260925 16:42:19.022315  9169 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.023470  9110 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c796634a27a4d74b87d6a0081b10018. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:19.027971  9089 leader_election.cc:341] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.028554  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.029462  9187 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:19.030582  9124 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:19.031749  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:18.994699  9039 tablet_service.cc:1467] Processing CreateTablet for tablet cdef8e15863049f59c35fc47250d99ee (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260925 16:42:18.995499  9037 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5cd4cb635e42ce8ee7624b47b5750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.038457  9171 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.038992  9171 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.039403  9171 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:19.040298  9171 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:19.051750  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:19.053165  8940 leader_election.cc:341] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.054461  9040 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 088ac48c62d34a40b53987746a70b871. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.055102  9035 tablet_service.cc:1467] Processing CreateTablet for tablet 7d1eb29a67e8482385d79fa193c4edd3 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260925 16:42:19.055969  9039 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdef8e15863049f59c35fc47250d99ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.057183  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c4320bf19c419d939def3dc1e1c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.068545  9035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1eb29a67e8482385d79fa193c4edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.080089  9034 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07fa6fea161b4a24904740819d2f89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.088943  9031 tablet_service.cc:1467] Processing CreateTablet for tablet 49c7db4b3fda45159275230bc247b929 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260925 16:42:19.090339  9031 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49c7db4b3fda45159275230bc247b929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.094419  8873 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.106102  9175 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.107399  9038 tablet_service.cc:1467] Processing CreateTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260925 16:42:19.107395  9175 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.109526  9175 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.111730  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.112831  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.113500  9164 tablet_bootstrap.cc:492] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.113942  9164 ts_tablet_manager.cc:1397] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.236s	user 0.016s	sys 0.000s
W20260925 16:42:19.114066  9014 leader_election.cc:341] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:19.115039  9015 leader_election.cc:341] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.115429  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:19.116493  9175 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:19.116659  9164 raft_consensus.cc:348] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.117470  9164 raft_consensus.cc:374] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.117774  9164 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.118616  9164 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.121232  9164 ts_tablet_manager.cc:1428] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260925 16:42:19.122504  9164 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.117759  9038 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c694676902c54ad8bfe8e7fd5a725e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.119378  9169 tablet_bootstrap.cc:654] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
W20260925 16:42:19.140831  9150 tablet.cc:2369] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 16:42:19.168129  9165 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.168781  9165 ts_tablet_manager.cc:1397] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.224s	user 0.014s	sys 0.013s
I20260925 16:42:19.172861  9165 raft_consensus.cc:348] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.173964  9165 raft_consensus.cc:374] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.174633  9165 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.172896  9164 tablet_bootstrap.cc:654] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.184124  9165 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.179153  9032 tablet_service.cc:1467] Processing CreateTablet for tablet a5837876dc21490e819ef69131e93921 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260925 16:42:19.192045  9032 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5837876dc21490e819ef69131e93921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.199204  9036 tablet_service.cc:1467] Processing CreateTablet for tablet 3c796634a27a4d74b87d6a0081b10018 (DEFAULT_TABLE table=test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260925 16:42:19.200562  9036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c796634a27a4d74b87d6a0081b10018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:19.216958  9165 ts_tablet_manager.cc:1428] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.048s	user 0.007s	sys 0.001s
I20260925 16:42:19.217935  9165 tablet_bootstrap.cc:492] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.222025  9169 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.222470  9169 ts_tablet_manager.cc:1397] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.200s	user 0.021s	sys 0.039s
I20260925 16:42:19.224916  9164 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.225374  9164 ts_tablet_manager.cc:1397] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.003s
I20260925 16:42:19.225324  9169 raft_consensus.cc:348] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.225874  9169 raft_consensus.cc:374] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.226056  9169 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.226460  9169 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.228539  9164 raft_consensus.cc:348] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.229786  9164 raft_consensus.cc:374] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.230111  9164 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.230846  9164 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.233410  9165 tablet_bootstrap.cc:654] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.234566  9164 ts_tablet_manager.cc:1428] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260925 16:42:19.235514  9164 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.236560  9169 ts_tablet_manager.cc:1428] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.004s
I20260925 16:42:19.237577  9169 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.243479  9164 tablet_bootstrap.cc:654] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.246403  9169 tablet_bootstrap.cc:654] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.249887  9165 tablet_bootstrap.cc:492] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.250514  9165 ts_tablet_manager.cc:1397] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.033s	user 0.007s	sys 0.003s
I20260925 16:42:19.254593  9165 raft_consensus.cc:348] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.255576  9165 raft_consensus.cc:374] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.255960  9165 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.256285  9164 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.256824  9164 ts_tablet_manager.cc:1397] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.011s
I20260925 16:42:19.256789  9165 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.260144  9165 ts_tablet_manager.cc:1428] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.004s
I20260925 16:42:19.263672  9164 raft_consensus.cc:348] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.264510  9164 raft_consensus.cc:374] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.264837  9164 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.265623  9164 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.267802  9169 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.268153  9164 ts_tablet_manager.cc:1428] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260925 16:42:19.268276  9169 ts_tablet_manager.cc:1397] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.015s
I20260925 16:42:19.272146  9169 raft_consensus.cc:348] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.272943  9169 raft_consensus.cc:374] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.273247  9169 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.272626  9164 tablet_bootstrap.cc:492] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.276057  9165 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.279992  9169 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.282759  9165 tablet_bootstrap.cc:654] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.282981  9169 ts_tablet_manager.cc:1428] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260925 16:42:19.283744  9164 tablet_bootstrap.cc:654] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.292474  9175 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.293221  9169 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.293012  9175 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.295032  9175 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.297355  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.298117  8974 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.299091  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:19.300783  9014 leader_election.cc:341] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.301400  9169 tablet_bootstrap.cc:654] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.303238  9015 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:19.307336  9165 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.308008  9175 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.308467  9175 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.309029  9175 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.313957  9164 tablet_bootstrap.cc:492] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.314603  9164 ts_tablet_manager.cc:1397] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.007s
I20260925 16:42:19.308470  9165 ts_tablet_manager.cc:1397] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.033s	user 0.008s	sys 0.011s
I20260925 16:42:19.318037  9164 raft_consensus.cc:348] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.318979  9164 raft_consensus.cc:374] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.319314  9164 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.320289  9164 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.327486  9175 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.329759  9164 ts_tablet_manager.cc:1428] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260925 16:42:19.330991  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.332036  9171 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.332579  9171 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.335007  9171 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.337311  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.339056  9164 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.340255  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:19.341900  8940 leader_election.cc:341] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:19.342885  8939 leader_election.cc:341] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.343413  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.344798  8974 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.346001  9164 tablet_bootstrap.cc:654] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.347970  9171 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:19.357412  9164 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.358032  9164 ts_tablet_manager.cc:1397] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.019s	user 0.014s	sys 0.004s
I20260925 16:42:19.359131  8974 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.360828  9164 raft_consensus.cc:348] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.361760  9164 raft_consensus.cc:374] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.362069  9164 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.323223  9165 raft_consensus.cc:348] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.362795  9165 raft_consensus.cc:374] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.363219  9165 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.362900  9164 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.365906  9165 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.369776  9206 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.371327  9015 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.373801  9164 ts_tablet_manager.cc:1428] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260925 16:42:19.379494  9164 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.382140  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:42:19.383556  9014 leader_election.cc:341] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.374429  9206 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.388926  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:19.390707  9014 leader_election.cc:341] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.373908  9165 ts_tablet_manager.cc:1428] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260925 16:42:19.391731  9164 tablet_bootstrap.cc:654] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.392521  9165 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.384867  9175 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.397786  9175 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.398335  9175 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:19.399430  9175 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.401981  9206 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.402837  9164 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.403075  9169 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.406481  9164 ts_tablet_manager.cc:1397] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.000s
I20260925 16:42:19.407291  9169 ts_tablet_manager.cc:1397] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.114s	user 0.012s	sys 0.081s
I20260925 16:42:19.409255  9164 raft_consensus.cc:348] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.410065  9164 raft_consensus.cc:374] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.405825  9165 tablet_bootstrap.cc:654] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.410408  9164 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.410233  9169 raft_consensus.cc:348] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.411433  9169 raft_consensus.cc:374] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.411837  9169 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.412828  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.413264  9169 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:19.414451  9015 leader_election.cc:341] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.415036  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:19.416042  9207 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:19.416185  9169 ts_tablet_manager.cc:1428] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.006s
I20260925 16:42:19.416428  9164 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.417402  9169 tablet_bootstrap.cc:492] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.422755  9164 ts_tablet_manager.cc:1428] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260925 16:42:19.423749  9164 tablet_bootstrap.cc:492] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.426299  9165 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.426787  9165 ts_tablet_manager.cc:1397] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.001s
I20260925 16:42:19.428172  8873 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.429764  9165 raft_consensus.cc:348] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.430546  9165 raft_consensus.cc:374] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.430804  9165 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.431448  9165 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.433519  9165 ts_tablet_manager.cc:1428] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:42:19.439018  9175 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.439474  9175 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.441828  9175 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.443224  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.443882  9124 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.443934  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.444613  8974 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.444998  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.445842  9175 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.446213  9175 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.446961  9175 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.449098  9164 tablet_bootstrap.cc:654] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.452019  9165 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.455466  9207 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.455899  9207 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.457821  9207 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.458638  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.459245  8974 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.454452  9175 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.460395  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.451995  9169 tablet_bootstrap.cc:654] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.459168  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.461741  9124 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.461932  9165 tablet_bootstrap.cc:654] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.461115  9207 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.463413  9207 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.463841  9207 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.466130  9164 tablet_bootstrap.cc:492] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.466593  9164 ts_tablet_manager.cc:1397] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.007s
I20260925 16:42:19.469134  9164 raft_consensus.cc:348] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.469830  9164 raft_consensus.cc:374] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.470094  9164 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.470836  9164 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.479826  9207 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.481319  9164 ts_tablet_manager.cc:1428] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260925 16:42:19.482601  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.485140  8974 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.487463  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.488030  8975 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.489084  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.489831  9123 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:19.491853  8940 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:19.483777  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.492479  9124 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.495020  9169 tablet_bootstrap.cc:492] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.498056  9207 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.498445  9169 ts_tablet_manager.cc:1397] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.081s	user 0.011s	sys 0.003s
I20260925 16:42:19.484386  9175 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.500161  9123 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.497917  8975 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.501899  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.502329  8974 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.503660  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.505023  9175 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.503961  9169 raft_consensus.cc:348] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.507058  9169 raft_consensus.cc:374] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.507390  9169 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.505739  9206 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.505618  9175 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:19.508355  9206 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:19.508510  9169 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.508745  9175 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.509166  9206 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.512429  9164 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.515241  9187 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.515652  9187 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.516919  9165 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.517844  9165 ts_tablet_manager.cc:1397] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.066s	user 0.023s	sys 0.029s
I20260925 16:42:19.519881  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.520704  9050 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:19.517871  9187 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.522491  9124 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.522157  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.522156  9165 raft_consensus.cc:348] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.523653  9187 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.524808  9165 raft_consensus.cc:374] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.524683  9171 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.519604  9164 tablet_bootstrap.cc:654] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.526104  9171 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.528400  9171 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.524762  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.529599  9165 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
W20260925 16:42:19.529763  9089 leader_election.cc:341] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.530282  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.530400  9165 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.531119  9124 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:19.529367  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.524709  9187 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.533465  9187 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.539952  8939 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:19.541067  9171 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.541514  9171 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:42:19.541543  8940 leader_election.cc:341] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.542193  9171 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.544204  8871 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.553762  9190 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:19.548698  9187 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.563416  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.568022  9187 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.568409  9165 ts_tablet_manager.cc:1428] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.050s	user 0.022s	sys 0.018s
W20260925 16:42:19.565495  9089 leader_election.cc:341] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.569403  9165 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.571142  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.571733  9169 ts_tablet_manager.cc:1428] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.073s	user 0.023s	sys 0.034s
I20260925 16:42:19.571738  9050 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.572979  9169 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.575358  9171 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.577687  9171 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.578389  9165 tablet_bootstrap.cc:654] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.578233  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.579718  9169 tablet_bootstrap.cc:654] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.579800  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.580379  9123 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:19.581826  8940 leader_election.cc:341] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.581684  8873 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.586932  9165 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.586906  9050 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:19.587395  9165 ts_tablet_manager.cc:1397] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.003s
I20260925 16:42:19.588114  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:19.588352  9123 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:19.589298  9187 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.590005  9187 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:19.589866  9165 raft_consensus.cc:348] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.590783  9165 raft_consensus.cc:374] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.591115  9165 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.591874  8939 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.590973  9187 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.592006  9165 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.593447  9171 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.593881  9171 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:19.594506  9165 ts_tablet_manager.cc:1428] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:42:19.594646  9171 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.595546  9165 tablet_bootstrap.cc:492] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.602630  9164 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.603072  9164 ts_tablet_manager.cc:1397] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.091s	user 0.009s	sys 0.004s
I20260925 16:42:19.606271  9164 raft_consensus.cc:348] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.606937  9164 raft_consensus.cc:374] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.607211  9164 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.607741  9164 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.608459  9165 tablet_bootstrap.cc:654] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.610682  8873 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.615126  9164 ts_tablet_manager.cc:1428] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260925 16:42:19.615981  9164 tablet_bootstrap.cc:492] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.613075  9165 tablet_bootstrap.cc:492] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.619923  9165 ts_tablet_manager.cc:1397] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.002s
I20260925 16:42:19.621129  9164 tablet_bootstrap.cc:654] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.622097  9165 raft_consensus.cc:348] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.622771  9165 raft_consensus.cc:374] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.623000  9165 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.623600  9165 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.625383  9169 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.625820  9169 ts_tablet_manager.cc:1397] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.004s
I20260925 16:42:19.625962  9165 ts_tablet_manager.cc:1428] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:42:19.628002  9165 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.628832  9169 raft_consensus.cc:348] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.629463  9169 raft_consensus.cc:374] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.629714  9169 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.630287  9169 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.635085  9169 ts_tablet_manager.cc:1428] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260925 16:42:19.635919  9169 tablet_bootstrap.cc:492] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.634298  9218 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.641548  9165 tablet_bootstrap.cc:654] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.637642  9171 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.645300  9171 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.647892  9171 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.637422  9218 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.653148  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.653682  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.654287  9050 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:19.654809  9218 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.655350  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:42:19.655884  8939 leader_election.cc:341] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.656124  9171 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.656220  9218 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.656543  9171 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.656888  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.656915  9171 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.660521  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:19.660434  8873 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:19.661800  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:19.663640  9187 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.660626  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.664383  9187 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.664716  9187 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:19.665643  9089 leader_election.cc:341] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.656792  9218 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.671504  9218 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.679066  9171 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.681507  9171 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.682159  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.682768  9049 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.683724  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.684484  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.685009  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:42:19.685707  9089 leader_election.cc:341] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.686287  9187 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:19.686869  8939 leader_election.cc:341] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.685067  8974 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:19.688127  9169 tablet_bootstrap.cc:654] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.689461  9171 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.691007  9049 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:19.691748  9171 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.692104  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:19.693325  9228 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.693441  9187 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.688818  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.693918  9228 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:19.695519  9164 tablet_bootstrap.cc:492] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.695205  9228 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.696419  9164 ts_tablet_manager.cc:1397] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.081s	user 0.016s	sys 0.006s
I20260925 16:42:19.698061  9171 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.698288  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.703527  9187 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.703421  9124 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:19.701701  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.698745  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.703449  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.705508  8974 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:19.705799  9089 leader_election.cc:341] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.705734  9164 raft_consensus.cc:348] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:19.706202  8940 leader_election.cc:341] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.706599  9164 raft_consensus.cc:374] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.706941  9164 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.707634  9164 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.708539  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.709303  9171 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.709630  9171 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.709743  9164 ts_tablet_manager.cc:1428] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.013s	user 0.003s	sys 0.003s
I20260925 16:42:19.709933  9165 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.709973  9171 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.710451  9165 ts_tablet_manager.cc:1397] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.000s
I20260925 16:42:19.710582  9164 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.712726  9165 raft_consensus.cc:348] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.713152  9165 raft_consensus.cc:374] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.713385  9165 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.714282  9165 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.716254  9165 ts_tablet_manager.cc:1428] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260925 16:42:19.717120  9165 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.717480  9218 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.707018  9187 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.718039  9187 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.717918  9218 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.718355  9171 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.719805  9218 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.721300  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.722328  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.722502  9124 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.722618  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.722909  9050 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:19.723789  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:19.723953  8940 leader_election.cc:341] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.721804  9171 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.725445  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:19.724771  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.726645  9218 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 16:42:19.726804  9089 leader_election.cc:341] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.726990  9218 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.727308  9218 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.727862  9169 tablet_bootstrap.cc:492] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.727659  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.728345  9169 ts_tablet_manager.cc:1397] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.093s	user 0.014s	sys 0.000s
I20260925 16:42:19.728811  9217 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.732113  9187 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.736574  9187 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.737278  9214 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.737670  9214 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.729399  9124 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:19.738292  9218 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.739342  9214 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.739486  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.740463  9165 tablet_bootstrap.cc:654] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.743307  9171 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.743880  9164 tablet_bootstrap.cc:654] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.744009  9169 raft_consensus.cc:348] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.744552  9169 raft_consensus.cc:374] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.744755  9169 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.745258  9169 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.747395  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.747490  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.748940  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.752786  8975 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.753237  9169 ts_tablet_manager.cc:1428] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.001s
I20260925 16:42:19.747816  9171 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:19.753940  8974 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.754315  9171 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.754881  9015 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:42:19.754051  9089 leader_election.cc:341] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.756826  9214 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.756925  9169 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:19.757340  9214 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.757584  9218 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:19.757717  9214 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.756175  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.758522  9124 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.762241  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.746114  9217 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:19.765144  9175 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.767369  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.768280  9050 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.770435  9175 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.775985  9175 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.776928  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:19.777696  8974 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.776928  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.778453  9124 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:19.778718  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.779565  9175 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.780004  9175 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.780376  9175 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.780560  9050 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:19.785744  9175 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.788242  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.788841  8974 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.788415  8873 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.794572  8975 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
W20260925 16:42:19.795827  9089 leader_election.cc:341] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.796746  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:19.797099  9228 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.797572  9228 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.798439  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.799094  9175 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.798494  8974 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.799649  9218 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.800261  9187 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.800132  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.801082  9124 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.802196  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.803506  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.803309  9217 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:19.805150  8939 leader_election.cc:341] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.800133  9218 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:19.806491  9218 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.799492  9228 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.818171  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:19.820135  8940 leader_election.cc:341] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.820685  8940 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:19.811332  9175 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.823271  9187 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:19.811131  9124 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.822407  9228 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:19.811165  9214 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.830818  9165 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.831560  9165 ts_tablet_manager.cc:1397] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.007s
I20260925 16:42:19.832876  9169 tablet_bootstrap.cc:654] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.834684  9214 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.835343  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:19.835806  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:19.836333  9165 raft_consensus.cc:348] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.836863  9123 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.837360  9165 raft_consensus.cc:374] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.836706  8871 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.837723  9165 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.839027  9165 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.824276  9175 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:19.840828  9175 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.841497  9165 ts_tablet_manager.cc:1428] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260925 16:42:19.842430  9165 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.835913  8974 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.846036  9164 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.846411  9187 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.852998  9164 ts_tablet_manager.cc:1397] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.143s	user 0.020s	sys 0.025s
I20260925 16:42:19.855572  9123 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.858552  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:19.859440  9175 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.860714  9175 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:19.861553  9175 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.862962  8974 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:19.865810  9164 raft_consensus.cc:348] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.866350  9164 raft_consensus.cc:374] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.866581  9164 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.867131  9165 tablet_bootstrap.cc:654] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.867151  9164 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.869124  8871 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.872469  9164 ts_tablet_manager.cc:1428] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.003s
I20260925 16:42:19.873414  9228 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:19.873816  9228 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.875576  9228 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.876122  9164 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.877331  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:19.878058  8872 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:42:19.880607  8939 leader_election.cc:341] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.879415  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:19.881418  9050 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:19.882710  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:19.883687  9228 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:19.884073  9228 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:19.884408  9228 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.889094  9164 tablet_bootstrap.cc:654] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:19.899487  9214 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:19.900007  9228 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.908860  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:19.909502  9050 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.923154  9123 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:19.925143  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:42:19.926671  8939 leader_election.cc:341] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:19.927013  9228 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:19.931911  8872 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:19.950085  9050 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:19.957086  8871 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:19.968688  9214 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:19.961982  9165 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:19.970162  8871 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:19.971777  9165 ts_tablet_manager.cc:1397] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.129s	user 0.023s	sys 0.004s
I20260925 16:42:19.971915  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:19.973328  9228 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:19.973946  9228 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:19.974614  9165 raft_consensus.cc:348] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.975216  9165 raft_consensus.cc:374] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.975458  9165 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.965463  9164 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:19.976369  9164 ts_tablet_manager.cc:1397] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.103s	user 0.012s	sys 0.002s
I20260925 16:42:19.976070  9165 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.978231  9165 ts_tablet_manager.cc:1428] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:42:19.968171  9169 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:19.979209  9165 tablet_bootstrap.cc:492] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:19.978907  9169 ts_tablet_manager.cc:1397] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.222s	user 0.022s	sys 0.047s
I20260925 16:42:19.979055  9164 raft_consensus.cc:348] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.980209  9164 raft_consensus.cc:374] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.980561  9164 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.981376  9164 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.983629  9164 ts_tablet_manager.cc:1428] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:42:19.985245  9207 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:19.974942  9228 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:19.983770  9169 raft_consensus.cc:348] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:19.986187  9206 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:19.986456  9169 raft_consensus.cc:374] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:19.987411  9169 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:19.987126  9164 tablet_bootstrap.cc:492] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:19.988897  9169 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:20.010933  9169 ts_tablet_manager.cc:1428] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260925 16:42:20.012342  9169 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.029768  9164 tablet_bootstrap.cc:654] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
W20260925 16:42:20.030704  9089 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.030814  9207 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260925 16:42:20.034487  8940 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.035096  9207 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.035969  9207 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } }
I20260925 16:42:20.037465  9217 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:20.042972  9207 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:20.045198  9165 tablet_bootstrap.cc:654] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.052081  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:20.046389  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:20.061748  9169 tablet_bootstrap.cc:654] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.063658  8873 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:20.074070  9014 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:20.074888  9207 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:20.079089  9207 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260925 16:42:20.080107  9217 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.085600  9217 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.092495  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:20.093707  8974 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:20.101092  9164 tablet_bootstrap.cc:492] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:20.101568  9164 ts_tablet_manager.cc:1397] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.115s	user 0.013s	sys 0.008s
I20260925 16:42:20.108960  9165 tablet_bootstrap.cc:492] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.109385  9165 ts_tablet_manager.cc:1397] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.130s	user 0.017s	sys 0.001s
I20260925 16:42:20.110992  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:20.109193  9164 raft_consensus.cc:348] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.112608  9164 raft_consensus.cc:374] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.112857  9164 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.113317  9164 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.117193  9236 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:20.117986  9236 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:20.118297  9236 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.122208  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:20.123998  9089 leader_election.cc:341] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.116400  9217 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:20.133636  9171 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.143888  9164 ts_tablet_manager.cc:1428] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.000s
I20260925 16:42:20.144762  9164 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:20.161777  9165 raft_consensus.cc:348] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.162523  9165 raft_consensus.cc:374] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.162776  9165 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.167423  9164 tablet_bootstrap.cc:654] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
W20260925 16:42:20.168836  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:20.169458  9165 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.155366  9236 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.181259  9169 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:20.181360  9236 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:20.182483  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:20.182986  9165 ts_tablet_manager.cc:1428] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.073s	user 0.004s	sys 0.002s
I20260925 16:42:20.183049  8974 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.184193  9165 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.182708  9169 ts_tablet_manager.cc:1397] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.171s	user 0.062s	sys 0.026s
I20260925 16:42:20.186731  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:20.188567  9089 leader_election.cc:341] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.195333  9236 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.196676  8974 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:20.200978  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.201751  9169 raft_consensus.cc:348] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.202523  9169 raft_consensus.cc:374] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.204967  9164 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:20.205394  9164 ts_tablet_manager.cc:1397] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.061s	user 0.008s	sys 0.014s
I20260925 16:42:20.203004  9169 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.206161  9169 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.207258  9236 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:20.209208  9169 ts_tablet_manager.cc:1428] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.024s	user 0.001s	sys 0.005s
I20260925 16:42:20.209863  9169 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.208952  9236 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:20.212571  9236 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.218511  9164 raft_consensus.cc:348] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.219676  9164 raft_consensus.cc:374] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.219949  9164 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.220537  9164 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.225560  9164 ts_tablet_manager.cc:1428] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.008s
I20260925 16:42:20.229239  9165 tablet_bootstrap.cc:654] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.229305  9169 tablet_bootstrap.cc:654] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.230201  9164 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
W20260925 16:42:20.242079  8940 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.245844  9190 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.250892  9190 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.252835  9190 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:20.253943  9089 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.257023  9171 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.257370  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:20.263538  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:20.265265  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.266696  9171 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:20.270241  9233 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.276326  8873 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:20.278877  9207 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:20.280196  9207 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:20.304453  9165 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.304908  9165 ts_tablet_manager.cc:1397] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.121s	user 0.020s	sys 0.032s
W20260925 16:42:20.304932  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.291671  9190 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260925 16:42:20.313782  9165 raft_consensus.cc:348] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.314309  9165 raft_consensus.cc:374] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.314512  9165 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.314970  9165 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.328387  9164 tablet_bootstrap.cc:654] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.330116  9165 ts_tablet_manager.cc:1428] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260925 16:42:20.331892  9124 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.336105  9190 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.336546  9190 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.344260  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:20.346351  8939 leader_election.cc:341] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.346361  9190 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:20.362442  9207 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:20.363047  9165 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
W20260925 16:42:20.368535  9089 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.370051  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:20.371281  9050 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:20.373674  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:20.374959  9190 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:20.375938  9190 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:20.376353  9190 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.378679  9236 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.392794  9050 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.380023  9171 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260925 16:42:20.396731  9236 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.397317  9236 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.402547  9236 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:20.412667  9169 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:20.413152  9169 ts_tablet_manager.cc:1397] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.203s	user 0.015s	sys 0.025s
I20260925 16:42:20.416935  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:20.418267  9218 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.418708  9218 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.420781  9218 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:20.428951  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:20.440027  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:20.448782  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.451309  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:20.453101  9048 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:20.455799  9124 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.455590  9207 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:20.458719  9169 raft_consensus.cc:348] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.459636  9169 raft_consensus.cc:374] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.459997  9169 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.461699  9169 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.439936  9190 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.470112  9169 ts_tablet_manager.cc:1428] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.057s	user 0.006s	sys 0.001s
I20260925 16:42:20.471791  9218 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:20.474462  9274 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260925 16:42:20.504349  9169 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.511391  9165 tablet_bootstrap.cc:654] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.513980  9164 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:20.514381  9164 ts_tablet_manager.cc:1397] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.284s	user 0.037s	sys 0.038s
I20260925 16:42:20.505357  9089 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:42:20.520540  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44054.7us
I20260925 16:42:20.522524  8975 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.525727  9190 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:20.533469  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:42:20.547531  8939 leader_election.cc:341] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.549026  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:20.549715  9218 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:20.551036  9169 tablet_bootstrap.cc:654] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.549733  9049 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.575431  9164 raft_consensus.cc:348] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.578966  9164 raft_consensus.cc:374] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.579973  9164 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.580760  9164 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.593339  9190 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.604013  9164 ts_tablet_manager.cc:1428] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.089s	user 0.008s	sys 0.001s
I20260925 16:42:20.606273  9164 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:20.605350  9049 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:20.615171  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:20.616648  9190 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:20.617077  9190 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:20.617833  9190 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.628129  9169 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:20.628801  9169 ts_tablet_manager.cc:1397] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.125s	user 0.015s	sys 0.006s
I20260925 16:42:20.638084  9169 raft_consensus.cc:348] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.638793  9169 raft_consensus.cc:374] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.639073  9169 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.639667  9169 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.642278  9165 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.642661  9165 ts_tablet_manager.cc:1397] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.280s	user 0.032s	sys 0.062s
I20260925 16:42:20.644428  9164 tablet_bootstrap.cc:654] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.644987  9165 raft_consensus.cc:348] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.645769  9165 raft_consensus.cc:374] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.646332  9165 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.647207  9165 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.648937  9207 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.649477  9165 ts_tablet_manager.cc:1428] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:42:20.649513  9207 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.650620  9165 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.654539  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:20.656605  9207 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:20.657445  9165 tablet_bootstrap.cc:654] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.657591  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:20.659665  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:20.660182  9169 ts_tablet_manager.cc:1428] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.031s	user 0.004s	sys 0.002s
I20260925 16:42:20.661111  9207 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:42:20.675846  9089 consensus_peers.cc:487] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:20.691382  9169 tablet_bootstrap.cc:492] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.694077  9190 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.694792  9190 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.699154  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:20.700146  9190 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:20.700986  8940 leader_election.cc:341] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.701095  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:20.702042  9123 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:20.703428  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.705330  9190 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:20.705832  9190 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:20.706349  9190 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.717974  9190 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.721964  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:20.724581  8940 leader_election.cc:341] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.726958  9049 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.728444  9169 tablet_bootstrap.cc:654] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.733477  8869 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:20.738075  9190 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:20.738708  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:20.739827  9123 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.743786  9218 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.744439  9218 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.749321  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:20.746937  9218 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:20.749321  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:20.750849  9089 leader_election.cc:341] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:20.753434  9089 leader_election.cc:341] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.753813  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.754812  9218 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:20.757359  9164 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:20.757972  9164 ts_tablet_manager.cc:1397] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.152s	user 0.053s	sys 0.058s
I20260925 16:42:20.765632  9123 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:20.767130  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.768289  9274 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:20.768733  9274 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:20.768769  9164 raft_consensus.cc:348] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.769520  9164 raft_consensus.cc:374] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.769585  9165 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.769833  9164 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.770040  9165 ts_tablet_manager.cc:1397] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.120s	user 0.063s	sys 0.044s
I20260925 16:42:20.770051  9274 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.770502  9164 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.772595  9164 ts_tablet_manager.cc:1428] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.003s
I20260925 16:42:20.772491  9165 raft_consensus.cc:348] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.773155  9165 raft_consensus.cc:374] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.773387  9164 tablet_bootstrap.cc:492] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:20.773417  9165 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.774112  9165 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.776109  9165 ts_tablet_manager.cc:1428] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:42:20.776939  9165 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.780019  9164 tablet_bootstrap.cc:654] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.782743  9165 tablet_bootstrap.cc:654] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.787328  9169 tablet_bootstrap.cc:492] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:20.787941  9169 ts_tablet_manager.cc:1397] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.000s
I20260925 16:42:20.788625  9187 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:20.790984  9169 raft_consensus.cc:348] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.792055  9169 raft_consensus.cc:374] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.792440  9169 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.793391  9169 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.795974  9169 ts_tablet_manager.cc:1428] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:42:20.796536  8973 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.799866  9169 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.816725  9169 tablet_bootstrap.cc:654] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.821014  9165 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.821540  9165 ts_tablet_manager.cc:1397] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.045s	user 0.008s	sys 0.007s
I20260925 16:42:20.823897  9165 raft_consensus.cc:348] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.824610  9165 raft_consensus.cc:374] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.824905  9165 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.825554  9165 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.827613  9165 ts_tablet_manager.cc:1428] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.004s
I20260925 16:42:20.829892  9165 tablet_bootstrap.cc:492] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.831916  9169 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:20.832508  9169 ts_tablet_manager.cc:1397] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.002s
I20260925 16:42:20.832823  9050 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:20.835598  9169 raft_consensus.cc:348] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.836580  9169 raft_consensus.cc:374] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.836908  9169 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.840488  9165 tablet_bootstrap.cc:654] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.844617  9169 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.863495  9169 ts_tablet_manager.cc:1428] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260925 16:42:20.871237  9165 tablet_bootstrap.cc:492] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.872498  9165 ts_tablet_manager.cc:1397] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.044s	user 0.008s	sys 0.012s
I20260925 16:42:20.873364  9169 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.876158  9165 raft_consensus.cc:348] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.877031  9165 raft_consensus.cc:374] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.877374  9165 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.878607  9165 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.883473  9165 ts_tablet_manager.cc:1428] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260925 16:42:20.887202  9165 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.913836  9165 tablet_bootstrap.cc:654] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.921074  8870 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:20.926441  9164 tablet_bootstrap.cc:492] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:20.926893  9164 ts_tablet_manager.cc:1397] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.154s	user 0.060s	sys 0.066s
I20260925 16:42:20.929128  9164 raft_consensus.cc:348] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.929862  9164 raft_consensus.cc:374] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.930112  9164 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.930783  9164 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.933655  9164 ts_tablet_manager.cc:1428] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:42:20.934106  9169 tablet_bootstrap.cc:654] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.934610  9164 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:20.938333  9165 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.938717  9165 ts_tablet_manager.cc:1397] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.004s
I20260925 16:42:20.941186  9165 raft_consensus.cc:348] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.941855  9165 raft_consensus.cc:374] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.942127  9165 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.943392  9165 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.946651  9165 ts_tablet_manager.cc:1428] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:42:20.947952  9165 tablet_bootstrap.cc:492] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.947504  9164 tablet_bootstrap.cc:654] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.954818  9169 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:20.955282  9169 ts_tablet_manager.cc:1397] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.082s	user 0.007s	sys 0.006s
I20260925 16:42:20.957068  9165 tablet_bootstrap.cc:654] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.958249  9233 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:20.958761  9233 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.960999  9233 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:20.964744  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:20.965468  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:20.969650  9089 leader_election.cc:341] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:20.970533  9089 leader_election.cc:341] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:20.971037  9089 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:20.972469  9233 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:20.973639  9169 raft_consensus.cc:348] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.974574  9169 raft_consensus.cc:374] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.974905  9169 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.975795  9169 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.977988  9164 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:20.978472  9164 ts_tablet_manager.cc:1397] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.044s	user 0.015s	sys 0.020s
I20260925 16:42:20.982605  9169 ts_tablet_manager.cc:1428] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.004s
I20260925 16:42:20.982764  9165 tablet_bootstrap.cc:492] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:20.982470  9164 raft_consensus.cc:348] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.983191  9165 ts_tablet_manager.cc:1397] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.035s	user 0.020s	sys 0.008s
I20260925 16:42:20.983335  9164 raft_consensus.cc:374] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.983493  9169 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:20.983773  9164 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.984640  9164 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.985944  9165 raft_consensus.cc:348] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.986541  9165 raft_consensus.cc:374] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:20.986778  9165 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:20.987448  9165 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:20.989442  9165 ts_tablet_manager.cc:1428] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:42:20.989676  9169 tablet_bootstrap.cc:654] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:20.990233  9165 tablet_bootstrap.cc:492] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:20.990181  9164 ts_tablet_manager.cc:1428] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.005s
I20260925 16:42:20.991169  9164 tablet_bootstrap.cc:492] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:20.997027  9165 tablet_bootstrap.cc:654] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.006237  9050 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.033556  9165 tablet_bootstrap.cc:492] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.034034  9165 ts_tablet_manager.cc:1397] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.044s	user 0.017s	sys 0.003s
I20260925 16:42:21.036378  9165 raft_consensus.cc:348] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.037026  9165 raft_consensus.cc:374] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.037320  9165 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.037925  9169 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.038396  9169 ts_tablet_manager.cc:1397] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.055s	user 0.012s	sys 0.004s
I20260925 16:42:21.038185  9165 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.039012  9164 tablet_bootstrap.cc:654] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.040505  9165 ts_tablet_manager.cc:1428] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260925 16:42:21.042181  9165 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:21.050523  9165 tablet_bootstrap.cc:654] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.052816  9169 raft_consensus.cc:348] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.053551  9169 raft_consensus.cc:374] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.054023  9169 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.056174  9164 tablet_bootstrap.cc:492] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.056591  9164 ts_tablet_manager.cc:1397] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.005s
I20260925 16:42:21.057925  9169 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.059494  9164 raft_consensus.cc:348] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.060185  9164 raft_consensus.cc:374] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.060452  9164 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.061097  9164 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.064292  9164 ts_tablet_manager.cc:1428] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260925 16:42:21.064842  9190 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.065616  9190 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.069307  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.070096  9190 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.070286  9233 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.070442  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.070782  9233 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.071300  9164 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
W20260925 16:42:21.072310  8939 leader_election.cc:341] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:21.073195  8940 leader_election.cc:341] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.073601  8940 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.074227  9190 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.075685  9233 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.077294  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.078989  9165 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.080616  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.081749  9165 ts_tablet_manager.cc:1397] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.040s	user 0.017s	sys 0.011s
W20260925 16:42:21.081826  9089 leader_election.cc:341] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.083182  9169 ts_tablet_manager.cc:1428] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.003s
I20260925 16:42:21.083997  9164 tablet_bootstrap.cc:654] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.084474  9169 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.084156  9165 raft_consensus.cc:348] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.084858  9165 raft_consensus.cc:374] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.085106  9165 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.085687  9165 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.087874  9165 ts_tablet_manager.cc:1428] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:42:21.091216  9165 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:21.093480  9169 tablet_bootstrap.cc:654] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
W20260925 16:42:21.087381  9089 leader_election.cc:341] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.094559  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.095636  9233 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.096882  9165 tablet_bootstrap.cc:654] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.108362  9123 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.109305  9233 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.109925  9233 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.112572  9233 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.114764  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.117245  9274 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.121001  9165 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.121433  9165 ts_tablet_manager.cc:1397] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.000s
I20260925 16:42:21.123167  9274 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:21.123939  9171 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.124464  9171 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.125022  9207 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.125634  9207 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.127187  9171 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.129056  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.129732  9124 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:21.130996  9207 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.131559  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:21.145277  9190 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.132329  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.145761  9190 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.148042  9190 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.134548  9169 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
W20260925 16:42:21.148718  9015 leader_election.cc:341] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.149192  9169 ts_tablet_manager.cc:1397] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.065s	user 0.005s	sys 0.005s
I20260925 16:42:21.151729  9169 raft_consensus.cc:348] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.152400  9169 raft_consensus.cc:374] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.152669  9169 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.135814  9165 raft_consensus.cc:348] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.136684  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.153409  9165 raft_consensus.cc:374] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.153255  9169 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.153733  9124 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.155220  9169 ts_tablet_manager.cc:1428] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.001s
I20260925 16:42:21.155431  9014 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:21.156055  9169 tablet_bootstrap.cc:492] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.156438  9214 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.156775  9214 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.157073  9214 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.163465  9169 tablet_bootstrap.cc:654] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.153755  9165 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.164520  9165 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.166604  9165 ts_tablet_manager.cc:1428] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.045s	user 0.004s	sys 0.000s
I20260925 16:42:21.167475  9165 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
W20260925 16:42:21.139279  9089 leader_election.cc:341] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.140027  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.167659  9214 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.133589  9175 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.168893  9175 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.176973  9164 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.177469  9164 ts_tablet_manager.cc:1397] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.106s	user 0.031s	sys 0.026s
I20260925 16:42:21.179821  9164 raft_consensus.cc:348] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.180771  9164 raft_consensus.cc:374] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.180850  9175 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.180135  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.181088  9164 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.140936  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.181977  9164 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.183804  9169 tablet_bootstrap.cc:492] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.184985  9164 ts_tablet_manager.cc:1428] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:42:21.185143  9169 ts_tablet_manager.cc:1397] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.029s	user 0.012s	sys 0.007s
I20260925 16:42:21.186297  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:21.188340  8940 leader_election.cc:341] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.188340  9169 raft_consensus.cc:348] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.189462  9169 raft_consensus.cc:374] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.189781  9169 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.190331  9190 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.190490  9169 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.192814  9169 ts_tablet_manager.cc:1428] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:42:21.193248  9171 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.193756  9169 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.197081  9164 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:21.200169  9175 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.201493  9169 tablet_bootstrap.cc:654] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
W20260925 16:42:21.201524  9089 leader_election.cc:341] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.203476  9089 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.201597  9175 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.207407  9164 tablet_bootstrap.cc:654] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.217742  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:21.218561  9050 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.208619  9175 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.209189  9233 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.220323  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.221107  9122 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.222980  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:21.223436  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.223934  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.225137  8974 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.232621  8974 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.234673  9049 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.236678  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.237756  9207 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.239141  9207 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:21.240613  9207 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.212575  9048 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.213894  9190 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.211511  9165 tablet_bootstrap.cc:654] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.216104  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.242228  9164 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.252055  9123 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.252192  9164 ts_tablet_manager.cc:1397] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.055s	user 0.009s	sys 0.003s
I20260925 16:42:21.252986  9190 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:21.254644  9164 raft_consensus.cc:348] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.255280  9164 raft_consensus.cc:374] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.255523  9164 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.256132  9164 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.258244  9164 ts_tablet_manager.cc:1428] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260925 16:42:21.259193  9164 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:21.262427  9123 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:21.264810  9164 tablet_bootstrap.cc:654] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.268862  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:21.210044  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.272181  9190 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.272847  9190 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:21.273888  9190 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.276427  9122 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.276355  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:21.279074  9214 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.281786  9050 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:21.301517  9165 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.302464  9165 ts_tablet_manager.cc:1397] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.135s	user 0.006s	sys 0.010s
I20260925 16:42:21.314383  9164 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.314831  9164 ts_tablet_manager.cc:1397] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.056s	user 0.014s	sys 0.003s
I20260925 16:42:21.305301  9165 raft_consensus.cc:348] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.316205  9165 raft_consensus.cc:374] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.316489  9165 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.317102  9165 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.322047  9165 ts_tablet_manager.cc:1428] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.000s
I20260925 16:42:21.323064  9165 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:21.328541  9169 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.328930  9169 ts_tablet_manager.cc:1397] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.135s	user 0.043s	sys 0.052s
I20260925 16:42:21.330521  9214 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.333264  9169 raft_consensus.cc:348] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.333772  9169 raft_consensus.cc:374] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.334016  9169 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.336557  9169 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.337751  9214 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.338245  9214 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.339298  9169 ts_tablet_manager.cc:1428] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.003s
I20260925 16:42:21.340255  9169 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.341107  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:21.342244  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:21.342995  9214 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.345073  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.346236  9121 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.347494  9014 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.348495  9169 tablet_bootstrap.cc:654] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.351043  9165 tablet_bootstrap.cc:654] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.355666  9171 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.356138  9171 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.350004  9214 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.356971  9214 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.357304  9214 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.360764  9164 raft_consensus.cc:348] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.361770  9164 raft_consensus.cc:374] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.361987  9164 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.362562  9164 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:21.359534  9015 leader_election.cc:341] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.368623  9164 ts_tablet_manager.cc:1428] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.054s	user 0.002s	sys 0.006s
I20260925 16:42:21.367923  9171 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.370007  9164 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:21.370179  9175 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.370486  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.371119  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:21.378089  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:21.383666  8939 leader_election.cc:341] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.384527  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:21.386181  9190 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.386559  9190 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.386876  9190 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.386584  9214 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.389454  9214 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.390336  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.390901  9121 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.394114  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.394541  9190 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.396592  8974 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.401306  8869 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:21.407510  9121 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.409500  9190 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.409842  9014 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.410560  9169 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.411021  9169 ts_tablet_manager.cc:1397] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.071s	user 0.019s	sys 0.012s
I20260925 16:42:21.413910  9169 raft_consensus.cc:348] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.414611  9169 raft_consensus.cc:374] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.414873  9169 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.415032  9318 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.415649  9169 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.416646  9318 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:21.416808  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:21.417399  9049 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.417928  9169 ts_tablet_manager.cc:1428] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260925 16:42:21.417709  9318 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.418777  9169 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.419348  9218 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.420138  9264 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.419972  9218 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.420559  9264 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.423595  9264 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.426467  9169 tablet_bootstrap.cc:654] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.426398  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.429461  9218 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:21.429215  9089 leader_election.cc:341] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.431607  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.433547  9190 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.433698  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.439800  9165 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.435010  8872 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:21.437486  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.440661  9165 ts_tablet_manager.cc:1397] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.118s	user 0.018s	sys 0.028s
I20260925 16:42:21.442003  9190 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:21.444658  8939 leader_election.cc:341] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.444842  9190 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.445860  8975 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:21.446094  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.446769  9124 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
W20260925 16:42:21.448474  8939 leader_election.cc:341] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.449085  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:21.450070  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.450505  9165 raft_consensus.cc:348] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.469882  9165 raft_consensus.cc:374] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.470242  9165 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.452455  8974 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.470904  9164 tablet_bootstrap.cc:654] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.471057  9165 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.472103  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.452857  9190 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.473356  9190 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.473719  9190 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.469590  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
W20260925 16:42:21.476022  8940 leader_election.cc:341] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.477398  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:21.456768  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.478416  9264 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.478704  9165 ts_tablet_manager.cc:1428] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.015s
I20260925 16:42:21.478853  9264 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:21.479671  9165 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:21.479658  9264 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.481036  9236 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.481377  9236 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.481675  9236 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.481868  9169 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.482280  9169 ts_tablet_manager.cc:1397] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.064s	user 0.013s	sys 0.004s
W20260925 16:42:21.491775  8940 leader_election.cc:341] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.493528  8872 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:21.487272  9169 raft_consensus.cc:348] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.496021  9169 raft_consensus.cc:374] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.496335  9169 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.497853  8940 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.494930  9190 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.499120  9274 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.501569  9190 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.502805  9169 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.508426  9169 ts_tablet_manager.cc:1428] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260925 16:42:21.509344  9169 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.510202  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.516093  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:21.507264  9236 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.522754  9124 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:21.523602  9236 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.525619  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:21.525990  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.526757  8975 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:42:21.527086  9089 leader_election.cc:341] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.528337  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:42:21.529233  8940 leader_election.cc:341] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.529646  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.530652  9190 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.531164  9236 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.542140  9165 tablet_bootstrap.cc:654] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.543627  9164 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.544250  9164 ts_tablet_manager.cc:1397] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.175s	user 0.011s	sys 0.026s
I20260925 16:42:21.545512  9169 tablet_bootstrap.cc:654] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.547751  9164 raft_consensus.cc:348] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.549022  8869 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:21.548436  9214 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.552062  9164 raft_consensus.cc:374] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.552404  9164 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.552287  9214 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.553154  9164 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.555262  9164 ts_tablet_manager.cc:1428] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260925 16:42:21.556154  9164 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:21.557073  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.557917  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.561149  9164 tablet_bootstrap.cc:654] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.551663  9165 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.551730  9218 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.563405  9165 ts_tablet_manager.cc:1397] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.084s	user 0.004s	sys 0.009s
I20260925 16:42:21.563642  9218 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.563994  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.565907  9218 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.565778  9318 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.566708  9318 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.566453  9165 raft_consensus.cc:348] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.567312  9165 raft_consensus.cc:374] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.567276  9318 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.567685  9165 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.568434  9165 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.569746  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.570101  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.570375  8974 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.570680  9165 ts_tablet_manager.cc:1428] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:42:21.571688  9165 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
W20260925 16:42:21.572427  9089 leader_election.cc:341] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.573803  9214 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.573652  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:21.578769  9089 leader_election.cc:341] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.579183  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.580607  9218 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.582118  9165 tablet_bootstrap.cc:654] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.600919  9318 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.602958  9164 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.604449  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.604744  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.605055  8975 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.605268  9121 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.606011  9169 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.606403  9169 ts_tablet_manager.cc:1397] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.097s	user 0.025s	sys 0.017s
I20260925 16:42:21.608785  9169 raft_consensus.cc:348] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.609416  9169 raft_consensus.cc:374] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.609663  9169 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.610232  9169 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.611492  8975 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.613055  9015 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.613608  9169 ts_tablet_manager.cc:1428] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260925 16:42:21.613845  9214 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.614269  9214 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:21.615025  9214 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.616317  9121 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.620316  9165 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.620755  9165 ts_tablet_manager.cc:1397] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.049s	user 0.009s	sys 0.007s
I20260925 16:42:21.620967  9164 ts_tablet_manager.cc:1397] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.065s	user 0.014s	sys 0.013s
I20260925 16:42:21.621996  9169 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.623001  9165 raft_consensus.cc:348] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.623677  9165 raft_consensus.cc:374] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.623767  9318 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.624051  9165 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.624692  9165 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.626991  9165 ts_tablet_manager.cc:1428] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260925 16:42:21.628427  9169 tablet_bootstrap.cc:654] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.628450  9165 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:21.632004  9233 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.632453  9233 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.634317  9233 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.634790  8872 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:21.636147  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:21.638247  9089 leader_election.cc:341] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.638303  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.639178  8975 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:21.641510  9164 raft_consensus.cc:348] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.645093  9164 raft_consensus.cc:374] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.645360  9164 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.650377  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.652199  9233 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.652621  9233 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.652998  9233 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.664685  9233 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.670697  9164 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.672067  9233 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.672852  9164 ts_tablet_manager.cc:1428] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.052s	user 0.009s	sys 0.002s
I20260925 16:42:21.673420  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:21.674544  9169 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.675012  9169 ts_tablet_manager.cc:1397] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.009s
I20260925 16:42:21.675897  9164 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
W20260925 16:42:21.674566  9089 leader_election.cc:341] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:21.677443  9169 raft_consensus.cc:348] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.678102  9169 raft_consensus.cc:374] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.678368  9169 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.678948  9169 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.674984  9165 tablet_bootstrap.cc:654] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.680896  9169 ts_tablet_manager.cc:1428] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:42:21.681995  9169 tablet_bootstrap.cc:492] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.687137  9169 tablet_bootstrap.cc:654] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.689173  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.689777  8974 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.707512  9164 tablet_bootstrap.cc:654] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.730813  9048 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.736860  9318 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:21.750892  9264 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:21.768362  9233 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.769501  9233 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.770018  8974 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:21.778488  9164 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.778896  9164 ts_tablet_manager.cc:1397] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.103s	user 0.021s	sys 0.027s
I20260925 16:42:21.781574  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.782336  9236 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.782157  9164 raft_consensus.cc:348] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.782841  9164 raft_consensus.cc:374] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.783352  9164 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.778299  9233 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:21.784024  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:21.782794  9236 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:21.783978  9164 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.789541  9164 ts_tablet_manager.cc:1428] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260925 16:42:21.790149  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.788836  9049 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:21.792511  9236 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.793733  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:21.794536  9233 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.795274  9164 tablet_bootstrap.cc:492] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:21.812304  9318 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.827741  9318 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.830408  9169 tablet_bootstrap.cc:492] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.830855  9169 ts_tablet_manager.cc:1397] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.149s	user 0.037s	sys 0.052s
I20260925 16:42:21.830933  9318 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.834520  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.835176  9121 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.835383  9165 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:21.836066  9165 ts_tablet_manager.cc:1397] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.208s	user 0.022s	sys 0.050s
I20260925 16:42:21.836299  9014 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.837157  9318 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.837527  9318 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.837894  9318 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.843973  9165 raft_consensus.cc:348] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.845449  9165 raft_consensus.cc:374] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.845880  9165 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.846335  9318 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.844494  9169 raft_consensus.cc:348] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.847627  9169 raft_consensus.cc:374] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.848230  9169 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.849445  9233 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:21.850314  9169 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.847246  9165 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.853289  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.853924  8973 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.855270  9165 ts_tablet_manager.cc:1428] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260925 16:42:21.858112  9165 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:21.860004  9190 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.857915  8872 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:21.852769  9164 tablet_bootstrap.cc:654] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.866228  9318 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.868990  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.870021  9121 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.871584  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.872121  9175 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.853303  9169 ts_tablet_manager.cc:1428] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260925 16:42:21.873430  9169 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.876798  9121 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.877856  9014 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.878582  9175 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:21.878892  9169 tablet_bootstrap.cc:654] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.879047  9175 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:21.872160  8973 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.879890  9175 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.899976  8871 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:21.908704  9169 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.909040  9169 ts_tablet_manager.cc:1397] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.006s
I20260925 16:42:21.910673  9169 raft_consensus.cc:348] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.911096  9169 raft_consensus.cc:374] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:21.911248  9169 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:21.911736  9169 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.914749  9169 ts_tablet_manager.cc:1428] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.001s
I20260925 16:42:21.915493  9169 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:21.919229  8973 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:21.922189  9169 tablet_bootstrap.cc:654] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.931983  9175 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.932762  9165 tablet_bootstrap.cc:654] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:21.945185  9214 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:21.945714  9214 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.947072  9207 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.947576  9214 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.951977  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:21.952590  9123 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.955907  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:21.957465  9207 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:21.957854  9207 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:21.958176  9207 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.958958  9264 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.960913  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:21.961508  8975 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:21.968415  9264 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:21.973568  9207 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:21.979950  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:21.980036  9169 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:21.984141  9169 ts_tablet_manager.cc:1397] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.069s	user 0.009s	sys 0.014s
I20260925 16:42:21.982924  9164 tablet_bootstrap.cc:492] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:21.985255  9164 ts_tablet_manager.cc:1397] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.190s	user 0.036s	sys 0.060s
I20260925 16:42:21.988024  8973 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:21.990093  9207 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:21.994460  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:21.995047  9122 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.005471  9122 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:22.007403  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.008165  9214 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.008667  9214 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:22.009436  9214 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.005970  8973 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:22.012189  9169 raft_consensus.cc:348] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.014241  9169 raft_consensus.cc:374] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.011286  9164 raft_consensus.cc:348] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.015067  9164 raft_consensus.cc:374] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.015347  9164 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.014483  9169 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.016296  9169 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.016898  9165 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.017428  9165 ts_tablet_manager.cc:1397] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.159s	user 0.016s	sys 0.005s
I20260925 16:42:22.018252  9169 ts_tablet_manager.cc:1428] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.034s	user 0.004s	sys 0.000s
I20260925 16:42:22.019059  9169 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.020481  9165 raft_consensus.cc:348] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.021469  9165 raft_consensus.cc:374] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.021867  9165 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.022471  9164 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.022706  9165 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.026386  9164 ts_tablet_manager.cc:1428] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260925 16:42:22.027415  9164 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.029273  9165 ts_tablet_manager.cc:1428] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260925 16:42:22.030167  9165 tablet_bootstrap.cc:492] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.035310  9214 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.036188  8869 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:22.042534  9169 tablet_bootstrap.cc:654] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.042649  9165 tablet_bootstrap.cc:654] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.034430  9164 tablet_bootstrap.cc:654] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.056222  9233 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.056725  9233 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.059578  9233 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.061396  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.062196  8974 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:22.066092  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:22.070989  9089 leader_election.cc:341] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.071635  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.075943  9236 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.076311  9236 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.076619  9236 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.082263  9169 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.082456  9318 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.082736  9169 ts_tablet_manager.cc:1397] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.064s	user 0.015s	sys 0.006s
I20260925 16:42:22.082932  9318 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.084839  9318 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.085127  9169 raft_consensus.cc:348] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.085312  9318 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.085813  9169 raft_consensus.cc:374] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.086102  9169 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.085942  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.086632  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:22.086716  9169 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.090004  9169 ts_tablet_manager.cc:1428] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:42:22.090785  9169 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.091934  9164 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:22.097047  9164 ts_tablet_manager.cc:1397] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.070s	user 0.016s	sys 0.012s
I20260925 16:42:22.096647  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.097056  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.097787  9318 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.098214  9318 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.098526  9318 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:22.099112  9015 leader_election.cc:341] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.103022  9164 raft_consensus.cc:348] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.105648  9164 raft_consensus.cc:374] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.106104  9164 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.106761  9164 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.105381  9169 tablet_bootstrap.cc:654] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.111294  9164 ts_tablet_manager.cc:1428] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260925 16:42:22.112246  9164 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.112198  9318 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.114640  9318 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.115546  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:42:22.119354  9015 leader_election.cc:341] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.120772  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:22.121493  9122 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.123279  9165 tablet_bootstrap.cc:492] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.123745  9165 ts_tablet_manager.cc:1397] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.094s	user 0.008s	sys 0.004s
I20260925 16:42:22.124289  9164 tablet_bootstrap.cc:654] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.125598  9169 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.126235  9169 ts_tablet_manager.cc:1397] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.036s	user 0.010s	sys 0.001s
I20260925 16:42:22.127116  9165 raft_consensus.cc:348] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.127954  9165 raft_consensus.cc:374] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.128273  9165 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.128847  9165 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.131153  9165 ts_tablet_manager.cc:1428] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:42:22.133657  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:22.119342  9236 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.134768  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:22.136507  9214 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.138209  9214 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:22.138345  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:22.138967  9048 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.139065  9214 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.145695  9169 raft_consensus.cc:348] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.146020  9048 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:22.155148  9169 raft_consensus.cc:374] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.155571  9169 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.155856  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.156417  9169 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.157600  9233 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.158102  9233 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:22.159258  9169 ts_tablet_manager.cc:1428] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.002s
I20260925 16:42:22.135828  9236 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.152038  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:22.158859  9233 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.162495  9169 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.163636  8973 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.165122  9164 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:22.165985  9164 ts_tablet_manager.cc:1397] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.054s	user 0.009s	sys 0.001s
I20260925 16:42:22.166778  8870 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:22.137518  9165 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.168265  9164 raft_consensus.cc:348] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.169011  9164 raft_consensus.cc:374] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.169262  9164 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.169509  9169 tablet_bootstrap.cc:654] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.170217  9164 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.176491  8973 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:22.191303  9164 ts_tablet_manager.cc:1428] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.001s
I20260925 16:42:22.192839  9164 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.197618  9165 tablet_bootstrap.cc:654] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.199743  9233 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.204780  9169 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.204150  8870 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:22.205394  9169 ts_tablet_manager.cc:1397] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.000s
I20260925 16:42:22.207417  9048 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.209880  9164 tablet_bootstrap.cc:654] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.214210  9169 raft_consensus.cc:348] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.214833  9169 raft_consensus.cc:374] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.215059  9169 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.215461  9233 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.215602  9169 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.220645  9169 ts_tablet_manager.cc:1428] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260925 16:42:22.222313  9169 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.227833  9169 tablet_bootstrap.cc:654] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.229784  9165 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.230206  9165 ts_tablet_manager.cc:1397] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.093s	user 0.009s	sys 0.003s
I20260925 16:42:22.232429  9165 raft_consensus.cc:348] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.233088  9165 raft_consensus.cc:374] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.233345  9165 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.233961  9165 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.235903  9165 ts_tablet_manager.cc:1428] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260925 16:42:22.237540  9164 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:22.238464  9164 ts_tablet_manager.cc:1397] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.046s	user 0.006s	sys 0.003s
I20260925 16:42:22.241302  9164 raft_consensus.cc:348] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.241933  9164 raft_consensus.cc:374] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.242166  9164 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.242676  9164 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.244942  9164 ts_tablet_manager.cc:1428] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260925 16:42:22.245623  9164 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.238456  9165 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.253829  9165 tablet_bootstrap.cc:654] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.260164  9164 tablet_bootstrap.cc:654] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.261709  9169 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.262107  9169 ts_tablet_manager.cc:1397] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.040s	user 0.006s	sys 0.002s
I20260925 16:42:22.264228  9169 raft_consensus.cc:348] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.264884  9169 raft_consensus.cc:374] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.265127  9169 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.265703  9169 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.270809  9169 ts_tablet_manager.cc:1428] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:42:22.271700  9169 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.273275  9165 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.273692  9165 ts_tablet_manager.cc:1397] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.035s	user 0.005s	sys 0.004s
I20260925 16:42:22.276646  9169 tablet_bootstrap.cc:654] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.276849  9165 raft_consensus.cc:348] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.277711  9165 raft_consensus.cc:374] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.278003  9165 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.278848  9165 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.281533  9165 ts_tablet_manager.cc:1428] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:42:22.282033  9169 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.282459  9169 ts_tablet_manager.cc:1397] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.011s	user 0.008s	sys 0.000s
I20260925 16:42:22.283164  9165 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.284852  9169 raft_consensus.cc:348] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.285470  9169 raft_consensus.cc:374] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.285714  9169 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.286255  9169 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.288340  9169 ts_tablet_manager.cc:1428] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260925 16:42:22.288872  9165 tablet_bootstrap.cc:654] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.289119  9169 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.296553  9169 tablet_bootstrap.cc:654] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.296936  9165 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.297371  9165 ts_tablet_manager.cc:1397] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.014s	user 0.010s	sys 0.000s
I20260925 16:42:22.300100  9165 raft_consensus.cc:348] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.301396  9165 raft_consensus.cc:374] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.301781  9165 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.302982  9165 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.273722  9164 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:22.304039  9164 ts_tablet_manager.cc:1397] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.001s
I20260925 16:42:22.304925  9165 ts_tablet_manager.cc:1428] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:42:22.305599  9169 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.305953  9169 ts_tablet_manager.cc:1397] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.003s
I20260925 16:42:22.306463  9164 raft_consensus.cc:348] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.307416  9164 raft_consensus.cc:374] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.307734  9164 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.308079  9165 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.308543  9164 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.312700  9169 raft_consensus.cc:348] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.313159  9214 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.313465  9169 raft_consensus.cc:374] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.313755  9169 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.313593  9214 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.314360  9169 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.317366  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.318169  9122 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:22.317368  9165 tablet_bootstrap.cc:654] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.319090  9169 ts_tablet_manager.cc:1428] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.013s	user 0.004s	sys 0.001s
I20260925 16:42:22.320407  9169 tablet_bootstrap.cc:492] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.319012  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.327050  8974 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:22.327667  9169 tablet_bootstrap.cc:654] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.315492  9214 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.329135  9175 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.330581  9175 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.328707  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:22.335547  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.336174  9122 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:22.336863  9207 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.337652  9164 ts_tablet_manager.cc:1428] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260925 16:42:22.338987  9164 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.340444  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.341043  8974 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:22.341670  9014 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.345378  9165 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.346726  9190 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.353312  9165 ts_tablet_manager.cc:1397] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.045s	user 0.003s	sys 0.018s
I20260925 16:42:22.353479  9190 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.354782  9214 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.355172  9214 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.347677  9236 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.360006  9236 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.361984  9236 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.356029  9190 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.362785  9214 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.362913  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.356745  9318 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:22.363850  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.359151  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.364440  9122 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:22.365612  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:22.365777  9048 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:22.366418  9190 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 16:42:22.366583  8940 leader_election.cc:341] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.366875  9190 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.367921  9190 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.370342  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.371335  9236 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.333055  9175 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.371721  9236 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.372102  9236 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.362986  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:22.373632  9089 leader_election.cc:341] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.358783  9207 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.380493  9274 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.380970  9274 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.382794  9274 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.384457  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.356096  9165 raft_consensus.cc:348] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.346889  9164 tablet_bootstrap.cc:654] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.386274  9165 raft_consensus.cc:374] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.386576  9165 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
W20260925 16:42:22.385875  8940 leader_election.cc:341] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.389002  9165 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.391139  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.385847  9207 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:42:22.393473  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:22.391793  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:22.383687  9236 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.397596  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:42:22.399351  9089 leader_election.cc:341] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.400753  9236 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.404644  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.393921  9207 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.406190  9274 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.406611  9274 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.394858  9165 ts_tablet_manager.cc:1428] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.001s
I20260925 16:42:22.406941  9274 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.408912  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:22.409698  9048 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.401950  9214 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.412076  9214 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.416899  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:22.417546  9124 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.416277  9274 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.431890  9190 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.408174  9165 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.437994  9124 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:22.430908  9207 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.451200  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:22.451519  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:22.451829  9014 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:42:22.452864  8940 leader_election.cc:341] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:22.453500  8940 leader_election.cc:341] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.454305  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.453689  9214 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.458621  9214 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:22.459781  9214 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.466511  9264 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.468011  9264 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.469529  9264 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.470335  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.474164  9048 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
W20260925 16:42:22.466959  9014 leader_election.cc:341] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.475548  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:22.476706  9236 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.477138  9236 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:22.477954  9236 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.483080  9169 tablet_bootstrap.cc:492] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.483636  9169 ts_tablet_manager.cc:1397] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.163s	user 0.022s	sys 0.054s
I20260925 16:42:22.484814  9274 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.496141  9218 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.496783  9218 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.497219  9169 raft_consensus.cc:348] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.498019  9169 raft_consensus.cc:374] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.499006  9169 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.499871  9169 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.488987  9190 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.507732  9169 ts_tablet_manager.cc:1428] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260925 16:42:22.509158  9169 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.511508  9318 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.504015  9233 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.513535  9165 tablet_bootstrap.cc:654] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.522009  9218 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.515393  9233 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.525985  9233 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.512126  9318 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.537765  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.539183  9049 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:22.539851  9214 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.540902  9318 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.542588  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.540410  9214 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.543664  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.544096  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:22.544785  8974 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.544907  9233 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.545460  9233 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.545862  9233 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.526553  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:22.549053  9089 leader_election.cc:341] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.553409  9264 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.554091  9264 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.557945  9218 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.558964  9218 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.567766  9214 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.573904  9236 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.574854  9164 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:22.574591  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.574535  9236 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.575260  9164 ts_tablet_manager.cc:1397] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.236s	user 0.051s	sys 0.046s
I20260925 16:42:22.576174  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.576857  9236 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.577672  9164 raft_consensus.cc:348] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.578538  9164 raft_consensus.cc:374] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.578796  9164 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
W20260925 16:42:22.579397  9014 leader_election.cc:341] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.580685  9218 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.581139  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:22.584319  9089 leader_election.cc:341] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.584967  8974 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:22.585044  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:22.588317  9089 leader_election.cc:341] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.595788  9169 tablet_bootstrap.cc:654] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.596125  9233 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.597803  9122 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:22.599844  9233 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.601084  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:22.602272  9048 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.604647  9165 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.605154  9165 ts_tablet_manager.cc:1397] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.197s	user 0.003s	sys 0.012s
I20260925 16:42:22.608008  9165 raft_consensus.cc:348] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.608794  9165 raft_consensus.cc:374] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.609100  9165 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.609789  9165 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.611717  8871 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:22.613015  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.614081  9165 ts_tablet_manager.cc:1428] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260925 16:42:22.615010  9165 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.616266  9318 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 16:42:22.621094  9015 leader_election.cc:341] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.621562  9015 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:22.623574  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.623934  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:22.624014  9386 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.624557  9124 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.624701  9207 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.625880  9207 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.628180  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.628921  9121 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:42:22.629664  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:22.630200  9123 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.630656  9165 tablet_bootstrap.cc:654] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.633430  9264 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:22.637962  8940 leader_election.cc:341] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.638846  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.655354  9164 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.644797  8869 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:22.668129  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.670233  9164 ts_tablet_manager.cc:1428] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.095s	user 0.007s	sys 0.007s
I20260925 16:42:22.671665  9164 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.691048  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.687863  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.694865  8973 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:22.708281  9169 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.709020  9169 ts_tablet_manager.cc:1397] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.200s	user 0.037s	sys 0.062s
I20260925 16:42:22.710934  9175 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.713964  9164 tablet_bootstrap.cc:654] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.715451  9169 raft_consensus.cc:348] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.716467  9169 raft_consensus.cc:374] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.716743  9169 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
W20260925 16:42:22.725715  9089 leader_election.cc:341] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.726585  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.727479  9218 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:42:22.728814  9089 leader_election.cc:341] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.729416  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.729269  9169 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:22.715399  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92041.7us
W20260925 16:42:22.731953  9089 leader_election.cc:341] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.736271  9214 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:22.733335  9218 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.738590  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.739352  9386 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.739766  9386 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.740119  9386 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.728737  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:22.726579  9123 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:22.746244  9169 ts_tablet_manager.cc:1428] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.001s
I20260925 16:42:22.747372  9169 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:22.747905  9218 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:22.732108  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:42:22.764024  8939 leader_election.cc:341] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.764851  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.761927  9048 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:22.767514  9264 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.777746  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.778595  9165 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:22.785370  9165 ts_tablet_manager.cc:1397] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.171s	user 0.012s	sys 0.011s
I20260925 16:42:22.787602  9386 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.794329  9165 raft_consensus.cc:348] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.795163  9165 raft_consensus.cc:374] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.795476  9165 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.796497  9165 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.793365  9218 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.802815  9165 ts_tablet_manager.cc:1428] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260925 16:42:22.803606  9165 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:22.806648  9386 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.798275  8939 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.808946  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:22.809995  9050 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.810822  9264 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.812013  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.813083  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:22.813220  9190 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.813753  9190 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:22.809406  9169 tablet_bootstrap.cc:654] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.819623  9381 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.819799  9190 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.823949  9050 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:22.824481  9164 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:22.824898  9164 ts_tablet_manager.cc:1397] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.153s	user 0.002s	sys 0.021s
I20260925 16:42:22.825021  9381 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:22.825276  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:22.828015  9233 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:22.828490  9233 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:22.829313  9233 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.831434  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.831773  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.829108  9381 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.833055  9264 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.834365  9164 raft_consensus.cc:348] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.835026  9164 raft_consensus.cc:374] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:22.835284  9164 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:22.836313  9164 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.837404  9218 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:22.838636  9218 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:22.855937  9015 leader_election.cc:341] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:22.860386  9089 leader_election.cc:341] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.861697  9164 ts_tablet_manager.cc:1428] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.037s	user 0.004s	sys 0.003s
I20260925 16:42:22.867403  9386 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.864151  9015 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:22.868208  9386 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:22.868880  9015 leader_election.cc:341] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.869331  9015 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:22.870680  9386 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:22.871995  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:22.872678  8969 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.874295  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:22.875844  9089 leader_election.cc:341] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:22.876464  9175 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.875893  9318 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:22.893409  9164 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:22.902150  9165 tablet_bootstrap.cc:654] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.914680  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:22.915457  9050 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:22.917748  9175 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:22.919854  9214 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:22.920388  9214 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:22.920789  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:22.922328  9214 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:22.923194  9386 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:22.923559  9386 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:22.923929  9386 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:22.924753  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:22.925981  9122 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:22.931681  8870 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:22.915967  8871 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:22.933485  8870 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:42:22.940140  9089 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:22.934700  8871 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:22.970211  9164 tablet_bootstrap.cc:654] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:22.971207  9169 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:22.971817  9169 ts_tablet_manager.cc:1397] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.225s	user 0.012s	sys 0.010s
I20260925 16:42:22.977777  9386 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.001227  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:22.998123  9386 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.007031  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:23.007722  8969 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
W20260925 16:42:23.009789  9089 leader_election.cc:341] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.011333  9165 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.011830  9165 ts_tablet_manager.cc:1397] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.208s	user 0.006s	sys 0.014s
I20260925 16:42:23.015182  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:23.015839  9048 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.010281  9405 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.025s
I20260925 16:42:23.026427  9169 raft_consensus.cc:348] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.027253  9169 raft_consensus.cc:374] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.027542  9169 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.028337  9169 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.030303  9164 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.030894  9164 ts_tablet_manager.cc:1397] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.138s	user 0.011s	sys 0.007s
I20260925 16:42:23.032114  9169 ts_tablet_manager.cc:1428] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.000s
I20260925 16:42:23.033015  9169 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:23.036065  9048 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:23.040131  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:23.040998  9386 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.043000  9396 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:23.041525  9386 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.043577  9218 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:23.043767  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:23.044839  9396 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:23.044946  9386 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.045651  9396 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.046546  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.048004  9390 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.048431  9165 raft_consensus.cc:348] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:23.049060  9089 leader_election.cc:341] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.049103  9165 raft_consensus.cc:374] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.049494  9165 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.050554  9165 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.046546  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:23.055330  9089 leader_election.cc:341] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.055720  9089 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.055964  9164 raft_consensus.cc:348] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.056588  9164 raft_consensus.cc:374] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.056828  9164 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.057282  9164 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.057739  9165 ts_tablet_manager.cc:1428] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.046s	user 0.005s	sys 0.002s
I20260925 16:42:23.058843  9165 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.063062  9218 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.051600  9175 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260925 16:42:23.093041  9169 tablet_bootstrap.cc:654] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.094767  9390 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.096395  9164 ts_tablet_manager.cc:1428] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.000s
I20260925 16:42:23.097333  9164 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.104449  9165 tablet_bootstrap.cc:654] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.138154  9164 tablet_bootstrap.cc:654] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.140868  9169 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:23.141351  9169 ts_tablet_manager.cc:1397] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.108s	user 0.015s	sys 0.001s
I20260925 16:42:23.146476  9165 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.146961  9165 ts_tablet_manager.cc:1397] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.088s	user 0.007s	sys 0.005s
I20260925 16:42:23.149187  9165 raft_consensus.cc:348] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.149881  9165 raft_consensus.cc:374] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.150123  9165 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.150650  9165 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.154613  9165 ts_tablet_manager.cc:1428] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:42:23.155404  9165 tablet_bootstrap.cc:492] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.160770  9169 raft_consensus.cc:348] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.161458  9169 raft_consensus.cc:374] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.161696  9169 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.162261  9169 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.164487  8869 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:23.164527  9165 tablet_bootstrap.cc:654] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.174263  9190 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.174705  9190 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.176564  9190 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.179497  9169 ts_tablet_manager.cc:1428] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.038s	user 0.006s	sys 0.000s
I20260925 16:42:23.179729  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.182437  9048 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.184082  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:23.185012  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.181821  9164 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.185664  9122 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.185876  9190 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:42:23.186223  9190 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:23.186544  9190 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:23.185938  9164 ts_tablet_manager.cc:1397] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.089s	user 0.031s	sys 0.023s
I20260925 16:42:23.189807  9169 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:23.203305  9164 raft_consensus.cc:348] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.204252  9164 raft_consensus.cc:374] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.204576  9164 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.204466  9190 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.205735  9165 tablet_bootstrap.cc:492] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.205416  9164 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.206178  9165 ts_tablet_manager.cc:1397] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.051s	user 0.028s	sys 0.010s
I20260925 16:42:23.207538  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:23.208226  9122 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:23.210392  9390 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.210332  9165 raft_consensus.cc:348] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.211025  9165 raft_consensus.cc:374] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.210872  9390 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.211319  9165 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.207522  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:23.212170  9048 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:23.212039  9165 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.214903  9165 ts_tablet_manager.cc:1428] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260925 16:42:23.215767  9165 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.217582  9390 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.218611  9264 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.219022  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.219780  9124 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:23.219106  9264 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.220482  9274 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.220949  9274 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.223059  9274 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.223299  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.224074  9049 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:23.224593  9048 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:23.225510  9264 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.225886  9190 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.225761  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.227239  9164 ts_tablet_manager.cc:1428] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
I20260925 16:42:23.227751  9169 tablet_bootstrap.cc:654] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.215724  9122 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:23.228792  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:23.229923  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.230480  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:23.231331  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:23.228317  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.232194  9264 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:23.232331  9274 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:23.232750  9274 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:23.233107  9274 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.233265  9264 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:23.234120  9264 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.225790  9165 tablet_bootstrap.cc:654] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.229090  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.242655  9274 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.228152  9164 tablet_bootstrap.cc:492] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.248147  9274 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:23.249846  8940 leader_election.cc:341] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.253134  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.254971  9381 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.254773  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:23.255833  9123 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.256922  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:23.231353  9015 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:23.259689  9405 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:23.260267  8940 leader_election.cc:341] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.264124  9381 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.266973  9164 tablet_bootstrap.cc:654] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.270449  9405 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.274688  9218 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:23.280783  9164 tablet_bootstrap.cc:492] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.281266  9164 ts_tablet_manager.cc:1397] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.053s	user 0.011s	sys 0.007s
I20260925 16:42:23.282156  9165 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.282624  9165 ts_tablet_manager.cc:1397] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.067s	user 0.018s	sys 0.019s
I20260925 16:42:23.284093  9164 raft_consensus.cc:348] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.285182  9164 raft_consensus.cc:374] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.285485  9164 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.284847  9165 raft_consensus.cc:348] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.287087  9165 raft_consensus.cc:374] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.287387  9165 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.288098  9164 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.289194  9165 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.290702  9165 ts_tablet_manager.cc:1428] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.000s
I20260925 16:42:23.290879  9164 ts_tablet_manager.cc:1428] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260925 16:42:23.291772  9164 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.291805  9165 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.291878  9123 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.305658  9396 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.308147  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.308017  9396 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.309221  9190 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:23.309679  9190 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:23.309932  9396 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.310489  9190 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.312994  9164 tablet_bootstrap.cc:654] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.316053  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.316865  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:23.321185  9089 leader_election.cc:341] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.319799  9050 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:23.331789  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:23.335081  9395 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:23.335456  9395 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:23.335879  9395 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.335755  9218 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:23.335426  9169 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:23.337656  9169 ts_tablet_manager.cc:1397] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.012s
I20260925 16:42:23.342555  9169 raft_consensus.cc:348] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.344911  9169 raft_consensus.cc:374] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.345189  9169 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.349608  9169 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.352211  9169 ts_tablet_manager.cc:1428] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.014s	user 0.004s	sys 0.002s
I20260925 16:42:23.352473  9165 tablet_bootstrap.cc:654] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.353073  9169 tablet_bootstrap.cc:492] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:23.352567  8872 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 2, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:23.361537  9385 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:42:23.379091  9385 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:23.383615  9395 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.394958  9395 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.398100  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:42:23.400076  9089 leader_election.cc:341] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.403015  9169 tablet_bootstrap.cc:654] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.405376  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:23.406061  9048 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.410394  9164 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.412261  9164 ts_tablet_manager.cc:1397] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.121s	user 0.019s	sys 0.007s
I20260925 16:42:23.421047  9164 raft_consensus.cc:348] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.421828  9164 raft_consensus.cc:374] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.422086  9164 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.426607  9236 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:23.431308  9264 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:23.413038  8869 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:42:23.448973  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:23.452021  9164 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.454437  9164 ts_tablet_manager.cc:1428] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.042s	user 0.004s	sys 0.000s
I20260925 16:42:23.455698  9164 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.460893  9164 tablet_bootstrap.cc:654] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.485786  9264 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.486831  9264 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.490262  9385 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.490963  9385 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.500228  9385 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.497426  9264 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.501410  9395 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.509063  9395 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.510633  9396 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:23.511216  9386 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:23.514132  9218 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.516284  9218 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.517611  9390 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.514400  9048 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:23.519487  9390 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.520764  9395 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.521260  9390 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.521355  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:23.522855  9089 leader_election.cc:341] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.524293  9164 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.524796  9164 ts_tablet_manager.cc:1397] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.069s	user 0.026s	sys 0.024s
I20260925 16:42:23.525601  9218 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.526964  9165 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.527400  9165 ts_tablet_manager.cc:1397] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.236s	user 0.008s	sys 0.010s
I20260925 16:42:23.528165  9164 raft_consensus.cc:348] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.528987  9164 raft_consensus.cc:374] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.527978  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.529379  9164 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.529302  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.530023  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.530086  9164 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.530714  8972 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:23.531044  9218 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.531462  9218 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.532265  9164 ts_tablet_manager.cc:1428] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
W20260925 16:42:23.532511  9014 leader_election.cc:341] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.533105  9164 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.533367  9218 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:23.534091  9089 leader_election.cc:341] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.534775  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.515894  9264 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260925 16:42:23.534793  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:23.530620  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.533406  9165 raft_consensus.cc:348] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.537938  9165 raft_consensus.cc:374] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.538288  9165 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.538915  9165 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.539914  9264 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.540475  9264 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.541384  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.541994  9124 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:23.542762  9264 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.546563  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.537086  9390 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:23.549719  9390 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:23.550119  9390 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.553555  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.554299  9050 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:23.554791  8939 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:23.555827  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.556391  9264 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:23.556422  9047 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:23.562052  9169 tablet_bootstrap.cc:492] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:23.562937  9169 ts_tablet_manager.cc:1397] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.210s	user 0.056s	sys 0.042s
I20260925 16:42:23.572491  9164 tablet_bootstrap.cc:654] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
W20260925 16:42:23.573613  9089 leader_election.cc:341] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.574348  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:23.574376  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.576618  9218 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:23.577116  9218 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:23.577934  9218 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.556931  9264 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:23.579947  9264 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.582422  9169 raft_consensus.cc:348] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.583607  9169 raft_consensus.cc:374] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.583899  9169 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.585729  9165 ts_tablet_manager.cc:1428] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.058s	user 0.008s	sys 0.000s
I20260925 16:42:23.573575  9390 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.590077  9165 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.589512  9169 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.592473  9169 ts_tablet_manager.cc:1428] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260925 16:42:23.593616  9169 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:23.592432  8940 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.595187  9385 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.627794  9164 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.628440  9164 ts_tablet_manager.cc:1397] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.095s	user 0.026s	sys 0.005s
I20260925 16:42:23.632059  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.633594  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.634322  9390 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.635444  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:23.635458  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:23.636276  8972 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:23.637681  9014 leader_election.cc:341] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.639536  9169 tablet_bootstrap.cc:654] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.644711  9165 tablet_bootstrap.cc:654] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.648751  8869 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:23.651878  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.661465  8940 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.644910  9385 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.663200  9381 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:42:23.665931  9089 leader_election.cc:341] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.666658  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.669592  9218 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:42:23.670915  9089 leader_election.cc:341] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.671484  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.672423  9386 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.673168  8972 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
W20260925 16:42:23.673445  9089 leader_election.cc:341] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.676071  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:23.677206  9405 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:23.677692  9405 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:23.675117  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.674366  9164 raft_consensus.cc:348] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.678953  9405 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.679656  9386 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.670938  9264 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.680891  9164 raft_consensus.cc:374] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.682358  9164 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.683357  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:23.684504  9047 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.696033  9047 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.696691  9165 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.697160  9165 ts_tablet_manager.cc:1397] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.110s	user 0.013s	sys 0.006s
I20260925 16:42:23.699536  9165 raft_consensus.cc:348] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.700250  9165 raft_consensus.cc:374] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.700505  9165 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.684681  9164 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.701924  9218 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:42:23.703763  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:23.704888  9124 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.705757  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:23.707415  9381 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:23.708122  9381 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:23.708945  9381 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.704046  9264 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.713307  9124 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.714565  8869 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:23.715862  9164 ts_tablet_manager.cc:1428] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.087s	user 0.008s	sys 0.000s
I20260925 16:42:23.716728  9164 tablet_bootstrap.cc:492] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.716269  9165 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.723219  9165 ts_tablet_manager.cc:1428] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.001s
I20260925 16:42:23.724500  9165 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.733729  9165 tablet_bootstrap.cc:654] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.733647  9385 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:23.735456  9218 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.736506  9218 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.739125  9218 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:23.743347  8940 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:23.748034  9385 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.748488  9385 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.751768  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.752400  9047 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:23.752486  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.753062  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:23.753336  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:23.754101  9190 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:23.754303  9385 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.754563  9190 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:23.755141  9190 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.772291  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.773150  8970 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:42:23.774248  9190 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.775288  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:23.779126  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:23.779736  9047 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.779982  9169 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:23.780589  9169 ts_tablet_manager.cc:1397] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.187s	user 0.046s	sys 0.028s
I20260925 16:42:23.783954  9169 raft_consensus.cc:348] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.786527  9169 raft_consensus.cc:374] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.786778  9169 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.790983  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.792297  9169 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.795023  9190 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.792115  9049 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260925 16:42:23.796892  9218 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.798678  9164 tablet_bootstrap.cc:654] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.800431  9386 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.800866  9386 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.802026  9169 ts_tablet_manager.cc:1428] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260925 16:42:23.803661  9386 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:23.805167  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:23.805696  9124 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.801199  9190 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:42:23.806869  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.817884  9047 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.825523  9169 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:23.827817  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:23.828689  9089 leader_election.cc:341] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:23.829667  9089 leader_election.cc:341] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:23.830029  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:23.830855  9386 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.831607  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:23.822618  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:23.833225  9381 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:23.836654  8872 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:23.841225  9381 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:23.842103  9381 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.842677  9218 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.846854  9122 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260925 16:42:23.848820  9274 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:23.856776  9164 tablet_bootstrap.cc:492] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.857196  9164 ts_tablet_manager.cc:1397] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.141s	user 0.015s	sys 0.011s
I20260925 16:42:23.860702  9164 raft_consensus.cc:348] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.862474  9164 raft_consensus.cc:374] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.862703  9164 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.863332  9165 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.863260  9164 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.863940  9165 ts_tablet_manager.cc:1397] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.140s	user 0.024s	sys 0.023s
I20260925 16:42:23.881454  9405 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:23.882165  9165 raft_consensus.cc:348] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.881897  9405 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.882594  9164 ts_tablet_manager.cc:1428] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.025s	user 0.008s	sys 0.000s
I20260925 16:42:23.882946  9165 raft_consensus.cc:374] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.883275  9165 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.883805  9164 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.880818  8872 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:23.884871  9165 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.887619  9165 ts_tablet_manager.cc:1428] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260925 16:42:23.888949  9405 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:23.889997  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:23.890777  9169 tablet_bootstrap.cc:654] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.892868  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:23.894352  9165 tablet_bootstrap.cc:492] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.895186  9014 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:23.900081  9405 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:23.913295  9165 tablet_bootstrap.cc:654] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.932897  8974 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:23.933060  9169 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:23.933310  9164 tablet_bootstrap.cc:654] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.933573  9169 ts_tablet_manager.cc:1397] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.108s	user 0.011s	sys 0.011s
I20260925 16:42:23.936321  9169 raft_consensus.cc:348] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.937562  9169 raft_consensus.cc:374] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.938185  9169 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.939195  9169 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.944516  9164 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.944972  9164 ts_tablet_manager.cc:1397] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260925 16:42:23.948514  9165 tablet_bootstrap.cc:492] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.948210  9164 raft_consensus.cc:348] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.948861  9164 raft_consensus.cc:374] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.948943  9165 ts_tablet_manager.cc:1397] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.055s	user 0.008s	sys 0.002s
I20260925 16:42:23.949133  9164 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.949748  9164 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.952685  9165 raft_consensus.cc:348] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.953405  9165 raft_consensus.cc:374] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.953706  9165 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.955044  9164 ts_tablet_manager.cc:1428] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260925 16:42:23.955503  9169 ts_tablet_manager.cc:1428] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.001s
I20260925 16:42:23.955583  9165 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.957651  9165 ts_tablet_manager.cc:1428] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260925 16:42:23.958500  9164 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.960382  9165 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:23.964201  9164 tablet_bootstrap.cc:654] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.970242  9165 tablet_bootstrap.cc:654] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.974392  9164 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:23.975004  9164 ts_tablet_manager.cc:1397] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.008s
I20260925 16:42:23.977138  9169 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:23.977945  9164 raft_consensus.cc:348] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.978648  9164 raft_consensus.cc:374] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.978899  9164 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.979440  9164 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.982615  9164 ts_tablet_manager.cc:1428] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:42:23.983587  9164 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:23.987645  9165 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:23.988133  9165 ts_tablet_manager.cc:1397] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.002s
I20260925 16:42:23.989305  9169 tablet_bootstrap.cc:654] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.989777  9164 tablet_bootstrap.cc:654] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:23.990885  9165 raft_consensus.cc:348] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.991576  9165 raft_consensus.cc:374] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:23.991858  9165 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:23.992635  9165 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:23.995245  9165 ts_tablet_manager.cc:1428] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260925 16:42:23.996412  9165 tablet_bootstrap.cc:492] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:24.004130  9165 tablet_bootstrap.cc:654] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.004673  9164 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:24.005281  9164 ts_tablet_manager.cc:1397] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.008s
I20260925 16:42:24.012288  9381 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.012768  9381 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.014664  9381 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.008189  9164 raft_consensus.cc:348] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.015750  9164 raft_consensus.cc:374] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.016005  9164 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.016589  9164 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.020092  9169 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:24.020748  9169 ts_tablet_manager.cc:1397] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.001s
I20260925 16:42:24.016167  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.025372  9164 ts_tablet_manager.cc:1428] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260925 16:42:24.026320  9164 tablet_bootstrap.cc:492] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:24.026336  9169 raft_consensus.cc:348] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.027261  9169 raft_consensus.cc:374] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.027494  9169 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.028082  9169 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.029881  9169 ts_tablet_manager.cc:1428] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260925 16:42:24.031805  9169 tablet_bootstrap.cc:492] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:24.031854  9164 tablet_bootstrap.cc:654] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.035633  9165 tablet_bootstrap.cc:492] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:24.037029  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.038401  9047 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:24.037600  9169 tablet_bootstrap.cc:654] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.042111  9165 ts_tablet_manager.cc:1397] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.046s	user 0.007s	sys 0.013s
I20260925 16:42:24.043022  9164 tablet_bootstrap.cc:492] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:24.043457  9164 ts_tablet_manager.cc:1397] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.003s
I20260925 16:42:24.044965  9165 raft_consensus.cc:348] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.045673  9165 raft_consensus.cc:374] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.045921  9165 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.046371  9169 tablet_bootstrap.cc:492] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:24.046839  9169 ts_tablet_manager.cc:1397] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260925 16:42:24.046499  9165 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.047601  8940 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:24.048552  9165 ts_tablet_manager.cc:1428] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:42:24.049367  9165 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:24.049548  9169 raft_consensus.cc:348] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.050040  9446 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.050226  9169 raft_consensus.cc:374] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.050532  9169 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.051173  9169 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.053620  9169 ts_tablet_manager.cc:1428] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260925 16:42:24.054426  9169 tablet_bootstrap.cc:492] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:24.054431  9164 raft_consensus.cc:348] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.055523  9164 raft_consensus.cc:374] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.055845  9164 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.056540  9164 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.058706  9164 ts_tablet_manager.cc:1428] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260925 16:42:24.059103  9274 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.059597  9274 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.060603  9164 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:24.061393  9405 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.061599  9274 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.061875  9405 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.063225  9165 tablet_bootstrap.cc:654] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.064641  9207 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.065094  9207 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.066979  9207 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.067200  9164 tablet_bootstrap.cc:654] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.067907  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.068550  9124 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.069864  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.070083  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.071662  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:42:24.072350  8940 leader_election.cc:341] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:24.072672  9015 leader_election.cc:341] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.073158  9274 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.073537  9274 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.073627  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.073864  9274 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.074219  9124 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:24.075287  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:24.068564  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.076846  9207 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.077172  9207 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.077495  9207 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.078460  9164 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
W20260925 16:42:24.078452  9015 leader_election.cc:341] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.079150  9164 ts_tablet_manager.cc:1397] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.005s
I20260925 16:42:24.080118  9446 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:24.080061  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.080647  9405 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.081117  9274 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.081504  9164 raft_consensus.cc:348] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:24.088539  9014 leader_election.cc:341] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.088385  9164 raft_consensus.cc:374] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.088989  9014 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:24.089146  9164 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.089226  9274 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.090234  9405 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:24.090701  9169 tablet_bootstrap.cc:654] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.091006  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:24.091784  9120 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.091001  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:24.093653  8940 leader_election.cc:341] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.094504  9165 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:24.094980  9165 ts_tablet_manager.cc:1397] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.046s	user 0.011s	sys 0.007s
I20260925 16:42:24.089906  9164 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.097815  9165 raft_consensus.cc:348] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.098315  9386 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.099103  9165 raft_consensus.cc:374] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.099510  9165 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.099184  9386 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.100250  9165 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.101586  9386 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:24.103152  9165 ts_tablet_manager.cc:1428] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:42:24.104197  9165 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:24.104008  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:42:24.106463  9089 leader_election.cc:341] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.106616  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.107303  9386 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.107900  9386 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.108861  9164 ts_tablet_manager.cc:1428] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.029s	user 0.001s	sys 0.005s
I20260925 16:42:24.109721  9386 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:24.111532  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.112619  9165 tablet_bootstrap.cc:654] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.114678  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.115272  9274 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:24.118818  9207 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:24.120514  9089 leader_election.cc:341] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.120816  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:42:24.121717  9089 leader_election.cc:341] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:24.124768  9089 leader_election.cc:341] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.125141  9089 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:24.125764  9395 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:24.127815  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:42:24.130026  9015 leader_election.cc:341] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.131068  9165 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:24.131557  9165 ts_tablet_manager.cc:1397] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.005s
I20260925 16:42:24.132589  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:24.133137  9124 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.135329  9169 tablet_bootstrap.cc:492] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:24.135815  9169 ts_tablet_manager.cc:1397] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.082s	user 0.011s	sys 0.001s
I20260925 16:42:24.138482  9169 raft_consensus.cc:348] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.139524  9169 raft_consensus.cc:374] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.139837  9169 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.139431  9124 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:24.140120  9381 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.140568  9169 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.140591  9381 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.142140  9169 ts_tablet_manager.cc:1428] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:42:24.141062  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:24.143136  9169 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:24.144132  9381 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.144440  9214 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:24.144942  9214 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:24.145694  9214 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.150363  9169 tablet_bootstrap.cc:654] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.121374  9386 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:24.151651  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.152601  9047 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.153931  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:24.155230  9190 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.155529  9190 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.155814  9190 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.139122  9207 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.157807  9207 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.158226  9207 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.161746  9190 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.163090  9190 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.166919  9207 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.170459  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.172058  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:24.171352  9122 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.168442  9395 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:24.174199  9218 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.174780  9218 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.175050  9165 raft_consensus.cc:348] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.175751  9165 raft_consensus.cc:374] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.176035  9165 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.176663  9165 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.177258  9218 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:24.178848  9165 ts_tablet_manager.cc:1428] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.047s	user 0.002s	sys 0.001s
I20260925 16:42:24.179979  9165 tablet_bootstrap.cc:492] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:24.179782  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.180919  9122 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:24.183521  9169 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:24.182008  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.184000  9169 ts_tablet_manager.cc:1397] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.014s
I20260925 16:42:24.184070  8974 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:24.183362  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:24.185246  9207 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.185653  9207 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.186218  9207 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.186583  9165 tablet_bootstrap.cc:654] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.186619  9169 raft_consensus.cc:348] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.187564  9169 raft_consensus.cc:374] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.187979  9169 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.189054  9169 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.192003  9164 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:24.193701  9207 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.196789  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:24.197322  8974 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.198729  9381 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.199509  9164 tablet_bootstrap.cc:654] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.199162  9381 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.201447  9169 ts_tablet_manager.cc:1428] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
W20260925 16:42:24.201509  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74377us
I20260925 16:42:24.201454  9381 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.203918  8974 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:24.204516  9169 tablet_bootstrap.cc:492] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:24.205557  9120 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:24.205660  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.206431  9122 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.207748  9015 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:24.208595  9214 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:24.209034  9214 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:24.209807  9214 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.212133  9169 tablet_bootstrap.cc:654] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.225535  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:24.241747  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:24.242516  9190 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.242844  9190 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.243104  9190 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.243757  9165 tablet_bootstrap.cc:492] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:24.244181  9165 ts_tablet_manager.cc:1397] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.065s	user 0.022s	sys 0.020s
I20260925 16:42:24.247954  9395 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:24.240614  9446 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:24.244391  9274 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260925 16:42:24.256191  9446 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:24.246697  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.257081  9446 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.259522  8972 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:24.257688  9207 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.262226  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:24.262830  9120 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.264940  9190 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.267473  9190 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.270643  9165 raft_consensus.cc:348] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.272143  9165 raft_consensus.cc:374] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.272541  9165 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.273236  9165 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.275053  9214 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:24.275839  9165 ts_tablet_manager.cc:1428] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.031s	user 0.008s	sys 0.000s
I20260925 16:42:24.279521  9165 tablet_bootstrap.cc:492] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:24.286190  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:24.286825  9123 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:24.289474  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46411.5us
I20260925 16:42:24.293548  9120 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:24.298043  9164 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:24.298506  9164 ts_tablet_manager.cc:1397] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.019s
I20260925 16:42:24.298555  9190 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.298985  9190 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.302551  9190 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.303215  9164 raft_consensus.cc:348] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.303943  9164 raft_consensus.cc:374] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.304180  9164 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.304754  9164 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.306803  9164 ts_tablet_manager.cc:1428] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.008s	user 0.001s	sys 0.002s
I20260925 16:42:24.307540  9164 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:24.316701  9169 tablet_bootstrap.cc:492] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:24.317309  9169 ts_tablet_manager.cc:1397] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.019s
I20260925 16:42:24.317173  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.319733  9049 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:24.324839  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:24.326083  8939 leader_election.cc:341] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.331884  9190 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.331962  9123 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:24.332329  9190 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.335093  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:24.336133  9274 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:24.336552  9274 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:24.337354  9190 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.330806  8872 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:24.359974  8872 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:24.358999  9274 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.404249  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.439932  9169 raft_consensus.cc:348] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.441567  9169 raft_consensus.cc:374] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.441939  9169 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.443267  9169 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.471457  9264 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.457414  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:24.487346  9169 ts_tablet_manager.cc:1428] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.170s	user 0.009s	sys 0.000s
I20260925 16:42:24.488417  9169 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:24.502686  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.503456  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.508427  9164 tablet_bootstrap.cc:654] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.475184  9264 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.493340  9044 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.526333  9165 tablet_bootstrap.cc:654] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.568346  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:24.590037  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:24.591949  9483 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.592381  9483 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.586885  9476 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.595847  9169 tablet_bootstrap.cc:654] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.591285  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.604710  8869 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:24.594012  9483 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.604159  9264 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.630663  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.630949  9048 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.631331  9042 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.609999  9043 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:24.603398  9476 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.641302  9274 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260925 16:42:24.657778  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.659221  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.661948  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:42:24.668401  8940 leader_election.cc:341] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:24.669516  8940 leader_election.cc:341] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:24.671608  8939 leader_election.cc:341] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.672667  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:42:24.673310  9479 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.203s	user 0.005s	sys 0.000s
I20260925 16:42:24.682644  9491 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.683102  9491 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.683442  9491 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.693611  9165 tablet_bootstrap.cc:492] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:24.694224  9165 ts_tablet_manager.cc:1397] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.418s	user 0.021s	sys 0.020s
I20260925 16:42:24.678608  9385 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:24.686502  9207 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.701787  9164 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:24.702437  9164 ts_tablet_manager.cc:1397] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.395s	user 0.009s	sys 0.010s
I20260925 16:42:24.707275  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.707616  9165 raft_consensus.cc:348] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.697799  9385 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:24.708626  9165 raft_consensus.cc:374] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.710204  9169 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:24.717810  9165 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.718308  9169 ts_tablet_manager.cc:1397] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.230s	user 0.018s	sys 0.007s
W20260925 16:42:24.709390  9089 leader_election.cc:341] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.720752  9165 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.719791  9385 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:24.704492  9207 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.705040  9469 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260925 16:42:24.738449  9165 ts_tablet_manager.cc:1428] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.044s	user 0.008s	sys 0.003s
I20260925 16:42:24.741335  9044 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:24.741436  9164 raft_consensus.cc:348] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.742344  9164 raft_consensus.cc:374] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.742602  9164 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.743111  9165 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:24.744640  9164 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.732318  9476 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:24.722297  9381 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260925 16:42:24.758041  9164 ts_tablet_manager.cc:1428] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.002s
I20260925 16:42:24.761482  9491 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.762344  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:24.741508  9483 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.768823  9169 raft_consensus.cc:348] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.769464  9169 raft_consensus.cc:374] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:24.769820  9169 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:24.770455  9169 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.763511  9491 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:24.773203  8940 leader_election.cc:341] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.746982  9405 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.021s
I20260925 16:42:24.775573  8940 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:24.801553  9164 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:24.781168  9446 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:24.795827  9491 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:24.839382  9164 tablet_bootstrap.cc:654] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.782317  9494 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.041s
I20260925 16:42:24.799747  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:42:24.862114  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 84488.7us
I20260925 16:42:24.864722  8869 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:24.867466  9169 ts_tablet_manager.cc:1428] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.149s	user 0.008s	sys 0.007s
I20260925 16:42:24.868690  9169 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
W20260925 16:42:24.879328  9089 leader_election.cc:341] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:24.880264  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:24.869639  9274 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:42:24.882467  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110548us
W20260925 16:42:24.892122  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:24.880296  8972 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:24.864264  9491 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.884907  9218 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:24.879650  9207 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.886616  9274 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.918949  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:24.963747  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:24.971910  9124 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:24.920146  9483 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:24.985069  9165 tablet_bootstrap.cc:654] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:24.985262  9169 tablet_bootstrap.cc:654] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:25.008168  9498 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.008867  9498 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:24.976944  8970 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:25.029878  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:25.030668  9122 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.030781  9014 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:25.031629  9207 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:25.031996  9207 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:25.032368  9207 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.032706  9491 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:25.036259  9505 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:42:25.040849  9164 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:25.041309  9164 ts_tablet_manager.cc:1397] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.240s	user 0.017s	sys 0.017s
I20260925 16:42:25.055222  9274 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:25.046207  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:25.057461  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:25.058831  9385 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.059331  9164 raft_consensus.cc:348] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.060117  9498 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:25.060137  9164 raft_consensus.cc:374] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 16:42:25.062544  9089 leader_election.cc:341] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:25.065519  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:25.066577  9043 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:25.062065  9164 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:25.079778  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:25.080868  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:25.081956  9119 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:25.072570  9164 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.083997  9491 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:42:25.061515  9385 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:25.085963  9164 ts_tablet_manager.cc:1428] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.044s	user 0.006s	sys 0.001s
I20260925 16:42:25.086568  9395 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.099627  9164 tablet_bootstrap.cc:492] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:25.102166  9207 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.083408  9122 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
W20260925 16:42:25.112841  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:25.108675  9207 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:25.115468  9089 leader_election.cc:341] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:25.116123  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:25.127820  9486 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:25.137135  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:25.143280  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:25.145154  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:25.145813  8972 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.104681  9395 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.147642  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:25.148499  9124 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:25.152715  8939 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:25.154266  9385 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:25.154789  9385 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:25.155676  9385 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:25.164094  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 355331us
I20260925 16:42:25.164767  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:25.178681  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:25.163564  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:25.184314  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:25.199144  9165 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:25.201242  9507 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.194155  9122 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.200212  9165 ts_tablet_manager.cc:1397] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.461s	user 0.021s	sys 0.013s
W20260925 16:42:25.209532  8939 leader_election.cc:341] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:25.211987  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:25.212769  9042 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.214036  9165 raft_consensus.cc:348] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.214977  9165 raft_consensus.cc:374] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:25.215301  9165 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:25.216120  9165 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.216146  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:25.225042  9503 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:25.225538  9503 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:25.234443  9165 ts_tablet_manager.cc:1428] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.029s	user 0.007s	sys 0.000s
I20260925 16:42:25.235606  9165 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:25.220634  8972 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:25.256819  9169 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:25.257308  9169 ts_tablet_manager.cc:1397] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.389s	user 0.041s	sys 0.019s
I20260925 16:42:25.250535  9046 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:42:25.263166  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:25.250109  9483 raft_consensus.cc:2741] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260925 16:42:25.273702  9214 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:25.279093  9503 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.286780  9214 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:25.274914  9395 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:25.290753  9516 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
W20260925 16:42:25.291203  9517 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260925 16:42:25.279997  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:25.319181  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:25.317570  9385 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260925 16:42:25.373543  9165 tablet_bootstrap.cc:654] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:25.376296  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:25.380891  9169 raft_consensus.cc:348] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.381608  9169 raft_consensus.cc:374] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:25.381880  9169 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:25.382961  9169 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:25.397352  9089 leader_election.cc:341] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:25.402113  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 124947us
I20260925 16:42:25.377353  9044 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.396128  9042 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
W20260925 16:42:25.427102  8940 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:25.428179  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:25.439575  9169 ts_tablet_manager.cc:1428] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.182s	user 0.012s	sys 0.000s
I20260925 16:42:25.415472  9507 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:25.380276  9214 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:25.441315  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 165647us
W20260925 16:42:25.449858  9089 leader_election.cc:341] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:25.450387  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:25.458714  9485 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:25.467038  9164 tablet_bootstrap.cc:654] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:25.458783  9526 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:25.472508  9510 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.477032  9510 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.473542  9526 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:25.487959  9526 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.483022  9122 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:25.479884  9510 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:25.501971  9169 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
W20260925 16:42:25.568416  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 98046.3us
W20260925 16:42:25.704660  9532 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260925 16:42:25.704346  9264 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260925 16:42:25.730547  9165 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:25.731673  9165 ts_tablet_manager.cc:1397] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.496s	user 0.010s	sys 0.017s
I20260925 16:42:25.763000  9169 tablet_bootstrap.cc:654] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:25.777395  9214 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.778476  9214 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.780314  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:25.790314  9214 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:25.790904  9165 raft_consensus.cc:348] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.791994  9165 raft_consensus.cc:374] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:25.800477  9165 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:25.802013  9165 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.803434  9164 tablet_bootstrap.cc:492] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:25.804162  9164 ts_tablet_manager.cc:1397] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.705s	user 0.025s	sys 0.018s
I20260925 16:42:25.804311  9165 ts_tablet_manager.cc:1428] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.065s	user 0.008s	sys 0.001s
I20260925 16:42:25.807550  9264 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260925 16:42:25.808784  8940 leader_election.cc:341] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:25.806428  9044 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:25.816438  9165 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:25.830027  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:25.828035  9508 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.831025  9117 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:25.831104  9508 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.834919  9508 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:25.845765  9395 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.846369  9395 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.848237  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:25.848980  9121 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:25.853781  9395 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:25.860127  9483 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:25.879341  8872 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:25.888087  9169 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:25.889145  9169 ts_tablet_manager.cc:1397] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.387s	user 0.018s	sys 0.016s
I20260925 16:42:25.897078  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:25.909328  9165 tablet_bootstrap.cc:654] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:25.910284  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:25.911235  9498 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:25.911616  9498 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:25.912113  9498 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.913241  9169 raft_consensus.cc:348] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.914606  9169 raft_consensus.cc:374] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:25.914880  9169 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:25.915551  9169 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.891325  9164 raft_consensus.cc:348] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.920053  9164 raft_consensus.cc:374] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:25.920435  9164 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:25.926290  9164 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.932832  9169 ts_tablet_manager.cc:1428] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.042s	user 0.006s	sys 0.004s
I20260925 16:42:25.938633  9498 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.942369  9164 ts_tablet_manager.cc:1428] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.138s	user 0.011s	sys 0.001s
I20260925 16:42:25.945109  9164 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:25.946983  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:25.951354  9522 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:25.951824  9522 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:25.954555  9529 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:42:25.953840  9522 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:25.984447  9537 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:25.985394  9537 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:25.994990  9165 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:25.995558  9537 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:25.996382  9169 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:26.000478  9165 ts_tablet_manager.cc:1397] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.180s	user 0.006s	sys 0.010s
I20260925 16:42:26.016698  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:26.032070  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.041008  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:26.043424  9015 leader_election.cc:341] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.041464  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.045127  9048 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.045663  9165 raft_consensus.cc:348] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.046856  9165 raft_consensus.cc:374] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.047215  9165 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.045778  9041 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:42:26.047672  9089 leader_election.cc:341] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.032545  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:26.036779  9498 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.057196  9165 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.039476  9506 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
W20260925 16:42:26.062649  9089 leader_election.cc:341] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.067423  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:42:26.065176  9541 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.084s	user 0.000s	sys 0.001s
I20260925 16:42:26.071445  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.072814  9042 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:42:26.074090  9164 tablet_bootstrap.cc:654] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.074312  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:26.076346  9506 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:26.080024  9119 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.086216  9506 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260925 16:42:26.104681  9386 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:26.063351  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:26.105376  9115 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:26.110065  9015 leader_election.cc:341] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.127175  9530 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.128007  9530 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.061468  9498 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.068s
I20260925 16:42:26.139739  9214 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:26.145488  9165 ts_tablet_manager.cc:1428] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.145s	user 0.009s	sys 0.000s
W20260925 16:42:26.151873  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89250.4us
I20260925 16:42:26.159350  9530 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.160665  9089 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:42:26.162636  9089 leader_election.cc:341] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.163081  9169 tablet_bootstrap.cc:654] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.163024  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.164281  9165 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:26.168601  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.194722  9485 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.195263  9485 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:26.199019  8940 leader_election.cc:341] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.209432  9386 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:26.183157  9522 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.255017  9485 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:26.258852  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:26.259114  9503 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:26.259672  9122 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:26.268970  9522 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.298503  9115 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:26.299312  9395 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:26.356130  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:26.366624  9089 leader_election.cc:341] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.368076  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.378633  9165 tablet_bootstrap.cc:654] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.380154  9274 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:26.380571  9274 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:26.380901  9274 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:26.382710  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:42:26.390084  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:26.395275  9214 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:26.396353  9214 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:26.400545  9169 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:26.426039  9169 ts_tablet_manager.cc:1397] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.459s	user 0.010s	sys 0.027s
I20260925 16:42:26.411669  9164 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:26.426929  9164 ts_tablet_manager.cc:1397] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.482s	user 0.018s	sys 0.026s
I20260925 16:42:26.414714  9274 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.422041  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.439561  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:26.440184  9124 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.441722  9214 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.458519  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:26.466557  8940 leader_election.cc:341] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:26.471282  9089 leader_election.cc:341] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.473572  9089 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.479310  9169 raft_consensus.cc:348] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.480002  9169 raft_consensus.cc:374] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.480244  9169 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.480799  9169 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.515098  9169 ts_tablet_manager.cc:1428] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.089s	user 0.003s	sys 0.003s
I20260925 16:42:26.482064  9395 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:26.518579  9169 tablet_bootstrap.cc:492] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:26.524762  9164 raft_consensus.cc:348] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.525714  9164 raft_consensus.cc:374] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.526046  9164 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.527144  9502 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.527850  9537 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.528128  9164 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.528456  9537 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:26.530349  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81888.3us
I20260925 16:42:26.530544  9537 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:26.530755  9164 ts_tablet_manager.cc:1428] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.104s	user 0.004s	sys 0.005s
I20260925 16:42:26.527623  9502 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.532634  9502 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.532918  9274 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.536417  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:26.536279  9164 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
W20260925 16:42:26.538010  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53368.5us
W20260925 16:42:26.540011  9014 leader_election.cc:341] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.540148  9124 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:26.543408  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.544102  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:26.553885  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:26.553953  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:26.554772  8975 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
W20260925 16:42:26.555490  8940 leader_election.cc:341] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:26.559661  9089 leader_election.cc:341] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.558619  9015 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:26.561767  9214 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:26.562160  9214 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:26.563220  9214 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.555869  9529 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:26.568840  9169 tablet_bootstrap.cc:654] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.569695  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:26.570386  9121 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.581845  9121 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:26.584848  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.585707  9526 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:26.587626  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.587433  8870 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:26.588104  9526 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:26.589927  9526 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.589788  8870 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:26.592264  9214 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:26.597453  9089 leader_election.cc:341] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.597867  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.601581  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:42:26.603063  9014 leader_election.cc:341] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.603084  9537 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:26.604947  9214 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.567555  9529 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:26.607578  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:26.608747  8975 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.608610  9529 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.610481  9165 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:26.613626  9165 ts_tablet_manager.cc:1397] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.450s	user 0.034s	sys 0.035s
I20260925 16:42:26.616477  9165 raft_consensus.cc:348] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.639139  9165 raft_consensus.cc:374] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.639492  9165 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.640278  9165 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.648967  8975 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:26.651103  9015 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:42:26.656112  9165 ts_tablet_manager.cc:1428] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.000s
I20260925 16:42:26.657121  9165 tablet_bootstrap.cc:492] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:26.654124  9502 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:26.659137  8872 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:26.660398  9502 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:26.663532  9502 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.661442  8872 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:42:26.687122  9164 tablet_bootstrap.cc:654] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.691419  9165 tablet_bootstrap.cc:654] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.704938  9169 tablet_bootstrap.cc:492] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:26.705539  9169 ts_tablet_manager.cc:1397] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.187s	user 0.015s	sys 0.008s
I20260925 16:42:26.708369  9169 raft_consensus.cc:348] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.709239  9169 raft_consensus.cc:374] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.709586  9169 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.720031  9169 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.723558  9164 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:26.724277  9164 ts_tablet_manager.cc:1397] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.189s	user 0.017s	sys 0.008s
I20260925 16:42:26.725622  9169 ts_tablet_manager.cc:1428] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.000s
I20260925 16:42:26.726578  9169 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:26.728009  9164 raft_consensus.cc:348] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.729043  9164 raft_consensus.cc:374] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.729358  9164 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.730099  9164 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.732265  9164 ts_tablet_manager.cc:1428] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:42:26.731593  8870 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:26.733340  9164 tablet_bootstrap.cc:492] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:26.733927  9165 tablet_bootstrap.cc:492] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:26.734338  9165 ts_tablet_manager.cc:1397] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.077s	user 0.008s	sys 0.006s
I20260925 16:42:26.736609  9165 raft_consensus.cc:348] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.737224  9165 raft_consensus.cc:374] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.737453  9165 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.738098  9165 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.740671  9164 tablet_bootstrap.cc:654] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.750499  9165 ts_tablet_manager.cc:1428] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260925 16:42:26.751535  9165 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:26.752357  9164 tablet_bootstrap.cc:492] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:26.753196  9164 ts_tablet_manager.cc:1397] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.003s
I20260925 16:42:26.734834  8870 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:26.756275  9164 raft_consensus.cc:348] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.756956  9164 raft_consensus.cc:374] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.757253  9164 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.752632  9169 tablet_bootstrap.cc:654] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.758997  9165 tablet_bootstrap.cc:654] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.761188  9164 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.764326  9164 ts_tablet_manager.cc:1428] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260925 16:42:26.765312  9164 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:26.771528  9164 tablet_bootstrap.cc:654] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.795727  8869 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:26.807277  9165 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:26.808014  9165 ts_tablet_manager.cc:1397] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.057s	user 0.022s	sys 0.016s
I20260925 16:42:26.811355  9169 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:26.811951  9169 ts_tablet_manager.cc:1397] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.086s	user 0.022s	sys 0.012s
I20260925 16:42:26.826594  9169 raft_consensus.cc:348] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.827378  9169 raft_consensus.cc:374] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.827657  9169 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.830056  9165 raft_consensus.cc:348] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.830807  9165 raft_consensus.cc:374] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.831077  9165 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.831274  9164 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:26.831780  9164 ts_tablet_manager.cc:1397] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.067s	user 0.014s	sys 0.014s
I20260925 16:42:26.831748  9165 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.833572  9169 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.834609  9165 ts_tablet_manager.cc:1428] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260925 16:42:26.837378  9165 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Bootstrap starting.
I20260925 16:42:26.841835  9502 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.842195  9169 ts_tablet_manager.cc:1428] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260925 16:42:26.842330  9502 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.843163  9169 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:26.843142  9472 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.843308  9165 tablet_bootstrap.cc:654] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.843843  9472 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.845825  9472 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:26.849172  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:26.849551  9169 tablet_bootstrap.cc:654] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.850618  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:26.853097  9015 leader_election.cc:341] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.855014  9165 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: No bootstrap required, opened a new log
I20260925 16:42:26.855491  9165 ts_tablet_manager.cc:1397] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.004s
I20260925 16:42:26.855424  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.855650  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:26.856388  9123 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:26.857883  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:42:26.857260  9089 leader_election.cc:341] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.858820  9561 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:26.859304  9561 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:26.858767  9165 raft_consensus.cc:348] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.859668  9561 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.859805  9165 raft_consensus.cc:374] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.860131  9165 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.860909  9165 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.863108  9165 ts_tablet_manager.cc:1428] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:42:26.863263  9502 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:26.866870  9089 leader_election.cc:341] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.867343  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:26.867084  9561 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.869087  9561 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.839915  9164 raft_consensus.cc:348] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.870007  9164 raft_consensus.cc:374] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.870152  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:26.870314  9164 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.870781  9123 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.871045  9164 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.873348  9164 ts_tablet_manager.cc:1428] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.041s	user 0.006s	sys 0.000s
I20260925 16:42:26.874377  9164 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:26.874840  9472 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:26.881281  9164 tablet_bootstrap.cc:654] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.884577  9529 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:26.895965  9529 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.898089  9169 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:26.898532  9169 ts_tablet_manager.cc:1397] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.011s
I20260925 16:42:26.899833  9529 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.900333  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:26.900887  9124 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:26.901767  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:26.903927  9169 raft_consensus.cc:348] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.904603  9169 raft_consensus.cc:374] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.904860  9169 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.905405  9169 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.906522  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:26.907755  9169 ts_tablet_manager.cc:1428] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260925 16:42:26.908329  9493 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:26.908707  9493 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:26.909018  9493 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.884781  9123 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:26.885151  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:26.916124  9493 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:26.917246  9015 leader_election.cc:341] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.919437  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:26.920382  9169 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:26.927850  9493 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:26.928089  9561 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:26.930577  9561 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:26.931734  9561 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.934826  8974 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:26.939242  8940 leader_election.cc:341] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:26.919489  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:26.944063  9169 tablet_bootstrap.cc:654] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:26.944605  9123 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:26.949302  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:26.967015  9169 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:26.967499  9169 ts_tablet_manager.cc:1397] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.047s	user 0.002s	sys 0.013s
I20260925 16:42:26.969810  9169 raft_consensus.cc:348] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.970486  9169 raft_consensus.cc:374] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:26.970739  9169 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:26.971316  9169 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:26.991283  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:27.001922  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:27.003623  9522 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:27.004631  9522 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:27.005620  9522 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.011788  9472 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.012550  9472 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.015874  9472 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:27.017939  8940 leader_election.cc:341] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.024430  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:27.025179  8968 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 1: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:42:27.025880  9169 ts_tablet_manager.cc:1428] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.058s	user 0.012s	sys 0.001s
I20260925 16:42:27.026809  9169 tablet_bootstrap.cc:492] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:27.028995  9529 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:27.032922  9169 tablet_bootstrap.cc:654] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:27.035434  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:27.038655  9169 tablet_bootstrap.cc:492] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:27.039260  9169 ts_tablet_manager.cc:1397] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.013s	user 0.008s	sys 0.001s
I20260925 16:42:27.041857  9502 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.042315  9502 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.043316  9169 raft_consensus.cc:348] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.044539  9169 raft_consensus.cc:374] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:27.044759  9502 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.044994  9169 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:27.045863  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.046577  9121 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:27.047646  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:27.048518  9502 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:27.048853  9502 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:27.049165  9502 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.050468  9169 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.053952  9169 ts_tablet_manager.cc:1428] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260925 16:42:27.054898  9169 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:27.058563  9164 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:27.059124  9164 ts_tablet_manager.cc:1397] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.185s	user 0.064s	sys 0.067s
I20260925 16:42:27.067477  9214 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.061476  9169 tablet_bootstrap.cc:654] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:27.067931  9214 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.068892  9164 raft_consensus.cc:348] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.069538  9164 raft_consensus.cc:374] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:27.069846  9164 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:27.070475  9164 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.071192  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.072130  9121 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 0.
I20260925 16:42:27.073132  9214 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.074113  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:27.076119  9561 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:27.076566  9561 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:27.079764  9561 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.064821  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:27.080799  9502 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.083190  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:27.090464  9386 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.078198  9169 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:27.091125  9169 ts_tablet_manager.cc:1397] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260925 16:42:27.079118  9164 ts_tablet_manager.cc:1428] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260925 16:42:27.088863  9214 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:27.093868  9164 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
W20260925 16:42:27.084931  9015 leader_election.cc:341] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.094789  9169 raft_consensus.cc:348] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.095499  9169 raft_consensus.cc:374] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:27.099390  9502 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.103853  9169 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:27.104961  9169 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.106341  9164 tablet_bootstrap.cc:654] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:27.099313  9386 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:27.100369  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:27.108130  9115 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.103399  9561 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.109423  9169 ts_tablet_manager.cc:1428] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260925 16:42:27.110472  9169 tablet_bootstrap.cc:492] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:27.106294  8869 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:27.114128  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:27.115005  9124 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.101265  8872 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:27.117916  9164 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:27.118481  9164 ts_tablet_manager.cc:1397] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.003s
I20260925 16:42:27.120898  9164 raft_consensus.cc:348] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.121536  9164 raft_consensus.cc:374] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:27.121766  9164 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:27.122511  9214 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.122332  9164 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.122956  9214 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.124063  9498 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:27.125486  9164 ts_tablet_manager.cc:1428] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260925 16:42:27.126466  9164 tablet_bootstrap.cc:492] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:27.128993  9214 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.132113  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.133198  9118 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:42:27.139379  8940 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:27.144141  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:27.145203  9048 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.150688  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:27.153293  9164 tablet_bootstrap.cc:654] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:27.153815  9214 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:27.154376  9214 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:27.155072  9214 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.163614  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:27.163216  9493 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260925 16:42:27.159596  9561 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.168006  9498 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.171442  9115 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:42:27.196154  9521 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.213788  9521 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.216212  9521 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.199218  9498 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.218715  9498 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.206941  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:27.222059  9169 tablet_bootstrap.cc:654] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:27.212356  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:27.242122  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:27.236310  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:27.243156  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.243520  9045 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:27.243865  9124 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:27.246825  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:27.247447  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.248123  9122 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:27.226200  9498 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:27.254364  9498 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:27.255203  9498 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.258256  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:42:27.259127  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72621.2us
W20260925 16:42:27.262295  9015 leader_election.cc:341] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:27.267060  9015 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:27.260458  9506 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:27.282217  9015 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:42:27.314334  9015 leader_election.cc:341] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:42:27.315464  9015 leader_election.cc:341] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.283156  9506 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:27.329130  9506 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.343258  9590 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:27.355949  8971 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.366462  8869 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:27.361752  9395 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.372351  9395 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.413746  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:42:27.421008  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60034us
I20260925 16:42:27.435755  9164 tablet_bootstrap.cc:492] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:27.436550  9164 ts_tablet_manager.cc:1397] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.310s	user 0.045s	sys 0.026s
I20260925 16:42:27.458508  9395 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:27.482741  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60815us
W20260925 16:42:27.487253  9587 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.160s	user 0.003s	sys 0.001s
W20260925 16:42:27.501139  9596 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260925 16:42:27.502540  9593 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.503038  9593 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.500932  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:27.512761  9214 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260925 16:42:27.519402  9089 leader_election.cc:341] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.522100  9169 tablet_bootstrap.cc:492] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:27.522912  9169 ts_tablet_manager.cc:1397] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.413s	user 0.007s	sys 0.037s
I20260925 16:42:27.492682  9506 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.536239  9593 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.544570  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:27.568786  9169 raft_consensus.cc:348] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.569752  9169 raft_consensus.cc:374] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:27.570091  9169 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:27.573702  9169 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.577097  9506 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:42:27.584985  8921 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260925 16:42:27.587595  8940 leader_election.cc:341] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.588764  9169 ts_tablet_manager.cc:1428] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.065s	user 0.002s	sys 0.007s
I20260925 16:42:27.592907  9164 raft_consensus.cc:348] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.593673  9164 raft_consensus.cc:374] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:27.593963  9164 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:27.595221  9164 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.592272  9593 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260925 16:42:27.589354  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:27.620791  9164 ts_tablet_manager.cc:1428] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.184s	user 0.008s	sys 0.000s
I20260925 16:42:27.619514  9118 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.599665  9590 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260925 16:42:27.659497  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67906.8us
I20260925 16:42:27.665788  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:27.648140  9611 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.669776  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:27.670404  9050 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.672389  9611 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.674058  9589 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.677605  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:27.678648  8974 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 0.
I20260925 16:42:27.681887  9611 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.683136  9592 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.683574  9592 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.685496  9592 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.688715  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:27.708032  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.708736  9121 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 0.
I20260925 16:42:27.709906  9169 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:27.719172  9537 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:27.729177  9537 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:27.729580  9537 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.745833  9164 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
I20260925 16:42:27.745857  9614 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260925 16:42:27.748769  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.749647  9589 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:27.741647  9050 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:27.780005  9502 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:27.788132  9502 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.790644  9502 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.795320  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:27.801988  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 136313us
I20260925 16:42:27.812683  9498 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:27.840552  8939 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:27.841559  9612 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:42:27.841956  9612 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:42:27.842326  9612 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:27.843737  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73674.2us
W20260925 16:42:27.847548  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:27.824604  9118 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:27.855278  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:27.851792  8966 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.831441  9537 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.877960  8940 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:27.869956  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:27.893440  9123 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 1: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:42:27.872649  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:27.900646  9614 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 16:42:27.881390  9617 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260925 16:42:27.906155  9169 tablet_bootstrap.cc:654] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:27.901206  9537 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:27.910728  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:27.917908  8939 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:27.895195  9604 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:27.932399  9621 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:27.939646  9047 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:27.943594  8940 leader_election.cc:341] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.946189  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:27.952795  9604 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:27.930750  8972 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:27.953779  9612 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.972288  9612 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:27.974887  9604 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:27.978132  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:27.984159  8872 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 0 to 1, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:27.986775  9590 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:27.991429  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:27.994329  9089 leader_election.cc:341] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:27.994524  8940 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:42:28.001197  8940 leader_election.cc:341] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:42:28.003726  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:28.029765  9624 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:28.022950  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:28.031389  9121 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:42:28.150554  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70725.5us
W20260925 16:42:28.174073  9631 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260925 16:42:28.183583  9164 tablet_bootstrap.cc:654] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:28.172137  9493 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:28.211472  9589 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:28.190840  9493 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.209980  8972 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:42:28.241492  9610 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:28.242894  9493 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:28.243800  9526 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:28.243461  9121 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:42:28.263274  8939 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:28.264853  9521 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:28.265512  9521 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:28.267895  9521 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.269977  9169 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:28.270692  9169 ts_tablet_manager.cc:1397] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.561s	user 0.024s	sys 0.026s
I20260925 16:42:28.273387  9169 raft_consensus.cc:348] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.274132  9169 raft_consensus.cc:374] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:28.274225  9164 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:28.274444  9169 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:28.274799  9164 ts_tablet_manager.cc:1397] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.529s	user 0.021s	sys 0.011s
I20260925 16:42:28.276444  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:28.277168  9615 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:42:28.277611  9615 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:28.278703  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:28.278759  9615 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.283021  9169 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.286047  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:28.290943  9169 ts_tablet_manager.cc:1428] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.000s
I20260925 16:42:28.291998  9169 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Bootstrap starting.
I20260925 16:42:28.299862  9169 tablet_bootstrap.cc:654] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:28.300196  9164 raft_consensus.cc:348] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.307593  9164 raft_consensus.cc:374] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:28.307942  9164 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:28.308561  9164 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.389899  9169 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: No bootstrap required, opened a new log
I20260925 16:42:28.390406  9169 ts_tablet_manager.cc:1397] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent bootstrapping tablet: real 0.099s	user 0.013s	sys 0.008s
I20260925 16:42:28.392808  9169 raft_consensus.cc:348] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.393496  9169 raft_consensus.cc:374] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:28.393719  9169 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Initialized, Role: FOLLOWER
I20260925 16:42:28.394307  9169 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.396139  9169 ts_tablet_manager.cc:1428] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.001s
I20260925 16:42:28.406162  9164 ts_tablet_manager.cc:1428] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.131s	user 0.008s	sys 0.000s
I20260925 16:42:28.410624  9164 tablet_bootstrap.cc:492] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Bootstrap starting.
W20260925 16:42:28.412230  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 102226us
I20260925 16:42:28.413542  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:28.414856  9529 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:28.443161  9498 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:42:28.443753  9498 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.445796  9498 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:28.448302  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:28.449198  9124 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 1: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:42:28.449424  8872 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 0 to 1, leader changed from <none> to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:28.445950  9164 tablet_bootstrap.cc:654] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Neither blocks nor log segments found. Creating new log.
I20260925 16:42:28.460639  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:28.464010  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:28.464784  9498 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:28.467077  9164 tablet_bootstrap.cc:492] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: No bootstrap required, opened a new log
I20260925 16:42:28.467592  9164 ts_tablet_manager.cc:1397] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent bootstrapping tablet: real 0.061s	user 0.000s	sys 0.009s
I20260925 16:42:28.470419  9164 raft_consensus.cc:348] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.471977  9164 raft_consensus.cc:374] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:42:28.472293  9164 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Initialized, Role: FOLLOWER
I20260925 16:42:28.472543  9498 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:42:28.473034  9164 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:28.475584  9164 ts_tablet_manager.cc:1428] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.001s
I20260925 16:42:28.501307  8869 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:28.502579  8869 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:28.529785  9521 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:28.540868  9604 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:28.576440  8967 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:28.667562  9047 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:28.674068  9615 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:28.687379  9622 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:28.775508  9602 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:42:28.789595  9521 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:42:28.859192  8973 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:42:29.750288  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:42:29.774492  9656 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:29.775727  9658 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:42:29.776078  9655 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:42:29.779275  7803 server_base.cc:1034] running on GCE node
I20260925 16:42:29.780551  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:42:29.780809  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:42:29.781018  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354549781001 us; error 0 us; skew 500 ppm
I20260925 16:42:29.781747  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:42:29.788982  7803 webserver.cc:460] Webserver started at http://127.7.158.196:34611/ using document root <none> and password file <none>
I20260925 16:42:29.790793  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:42:29.791030  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:42:29.791456  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:42:29.793323  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-3-root/instance:
uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
format_stamp: "Formatted at 2026-09-25 16:42:29 on dist-test-slave-fknp"
I20260925 16:42:29.800107  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260925 16:42:29.805471  9663 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:29.810122  7803 fs_manager.cc:725] Time spent opening block manager: real 0.007s	user 0.001s	sys 0.004s
I20260925 16:42:29.811134  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-3-root
uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
format_stamp: "Formatted at 2026-09-25 16:42:29 on dist-test-slave-fknp"
I20260925 16:42:29.811534  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:42:29.845883  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:42:29.847922  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:42:29.849772  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:42:29.853147  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:42:29.853402  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:29.853658  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:42:29.853830  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:42:29.934273  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.196:37639
I20260925 16:42:29.934402  9726 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.196:37639 every 8 connection(s)
I20260925 16:42:29.940065  7803 auto_leader_rebalancer-test.cc:413] add a tserver: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:29.967722  9727 heartbeater.cc:347] Connected to a master server at 127.7.158.254:39187
I20260925 16:42:29.968257  9727 heartbeater.cc:464] Registering TS with master...
I20260925 16:42:29.969133  9727 heartbeater.cc:511] Master 127.7.158.254:39187 requested a full tablet report, sending...
I20260925 16:42:29.970968  8870 ts_manager.cc:194] Registered new tserver with Master: e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:42:29.972579  8870 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:50106
I20260925 16:42:30.785936  9124 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:30.793411  9045 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:30.795089  8967 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:30.797628  9622 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:30.799564  9654 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:30.815914  9622 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:30.817238  9045 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:30.825838  8967 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:30.842262  9090 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: dff93d0dcc5944b0b73fca3da91c5b2c. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:30.838973  8870 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:30.864758  8973 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:30.877023  9045 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:30.879251  9692 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:30.885947  9124 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:30.888396  9692 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:42:30.911427  8941 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a2fce9318b914cda8815dd44730712b6. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:30.912833  9616 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:30.920004  9124 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:30.976948  9727 heartbeater.cc:503] Master 127.7.158.254:39187 was elected leader, sending a full tablet report...
I20260925 16:42:30.986060  8872 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:30.992851  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 77130.5us
I20260925 16:42:31.002247  9049 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.017081  9045 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.029858  9122 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:31.030588  8973 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:31.031245  9610 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:31.031975  9498 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:31.055135  9610 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.055306  8973 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.062011  9122 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:31.071286  9016 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cdef8e15863049f59c35fc47250d99ee. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:31.077679  9045 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.078297  8869 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:31.089913  9123 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 16:42:31.090070  9016 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07fa6fea161b4a24904740819d2f89fa. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:31.091218  9498 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:31.097324  8972 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:31.098732  9610 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:31.107088  9124 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.105479  9498 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.123615  8973 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.128180  8872 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:31.328704  9764 ts_tablet_manager.cc:927] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:31.330582  9764 tablet_copy_client.cc:316] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:31.349545  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet a2fce9318b914cda8815dd44730712b6 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:31.350281  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet a2fce9318b914cda8815dd44730712b6 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-a2fce9318b914cda8815dd44730712b6
I20260925 16:42:31.359014  8985 tablet_copy_source_session.cc:205] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:31.363566  9764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a2fce9318b914cda8815dd44730712b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:31.379528  9764 tablet_copy_client.cc:791] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:31.380569  9764 tablet_copy_client.cc:655] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:31.385320  9764 tablet_copy_client.cc:531] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:31.393463  9764 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:31.415258  9767 ts_tablet_manager.cc:927] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:31.417969  9767 tablet_copy_client.cc:316] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:31.422060  9764 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:31.422942  9764 tablet_bootstrap.cc:492] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:31.423477  9764 ts_tablet_manager.cc:1397] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.030s	user 0.022s	sys 0.005s
I20260925 16:42:31.426910  9764 raft_consensus.cc:348] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.427796  9764 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:31.428421  9764 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.443045  9764 ts_tablet_manager.cc:1428] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.005s
I20260925 16:42:31.472702  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet dff93d0dcc5944b0b73fca3da91c5b2c from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:31.473263  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a2fce9318b914cda8815dd44730712b6 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:31.473730  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a2fce9318b914cda8815dd44730712b6 on tablet a2fce9318b914cda8815dd44730712b6 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:31.473346  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet dff93d0dcc5944b0b73fca3da91c5b2c from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-dff93d0dcc5944b0b73fca3da91c5b2c
I20260925 16:42:31.487951  9134 tablet_copy_source_session.cc:205] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:31.491473  9767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dff93d0dcc5944b0b73fca3da91c5b2c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:31.504011  9767 tablet_copy_client.cc:791] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:31.504570  9767 tablet_copy_client.cc:655] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:31.508630  9767 tablet_copy_client.cc:531] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:31.520256  9767 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:31.541285  9767 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:31.542168  9767 tablet_bootstrap.cc:492] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:31.543102  9767 ts_tablet_manager.cc:1397] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260925 16:42:31.545611  9767 raft_consensus.cc:348] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.546844  9767 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:31.547742  9767 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.552938  9767 ts_tablet_manager.cc:1428] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260925 16:42:31.556993  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-dff93d0dcc5944b0b73fca3da91c5b2c received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:31.557404  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-dff93d0dcc5944b0b73fca3da91c5b2c on tablet dff93d0dcc5944b0b73fca3da91c5b2c with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:31.576853  9767 ts_tablet_manager.cc:927] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:31.578421  9767 tablet_copy_client.cc:316] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:31.604375  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 07fa6fea161b4a24904740819d2f89fa from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:31.604943  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 07fa6fea161b4a24904740819d2f89fa from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-07fa6fea161b4a24904740819d2f89fa
I20260925 16:42:31.614424  9764 ts_tablet_manager.cc:927] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:31.618181  9060 tablet_copy_source_session.cc:205] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:31.621258  9764 tablet_copy_client.cc:316] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:31.622066  9767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 07fa6fea161b4a24904740819d2f89fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:31.623152  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet cdef8e15863049f59c35fc47250d99ee from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:31.623905  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet cdef8e15863049f59c35fc47250d99ee from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-cdef8e15863049f59c35fc47250d99ee
I20260925 16:42:31.631124  9060 tablet_copy_source_session.cc:205] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:31.634636  9764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cdef8e15863049f59c35fc47250d99ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:31.647868  9767 tablet_copy_client.cc:791] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:31.648402  9767 tablet_copy_client.cc:655] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:31.653944  9767 tablet_copy_client.cc:531] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:31.663241  9764 tablet_copy_client.cc:791] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:31.663599  9767 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:31.663864  9764 tablet_copy_client.cc:655] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:31.667982  9764 tablet_copy_client.cc:531] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:31.675621  9764 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:31.687273  9767 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:31.688232  9767 tablet_bootstrap.cc:492] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:31.688863  9767 ts_tablet_manager.cc:1397] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.010s
I20260925 16:42:31.691819  9767 raft_consensus.cc:348] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.692668  9767 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:31.693295  9767 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.699122  9767 ts_tablet_manager.cc:1428] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.010s	user 0.001s	sys 0.005s
I20260925 16:42:31.699862  9764 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:31.700791  9764 tablet_bootstrap.cc:492] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:31.701409  9764 ts_tablet_manager.cc:1397] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.006s
I20260925 16:42:31.701730  9060 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-07fa6fea161b4a24904740819d2f89fa received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:31.702163  9060 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-07fa6fea161b4a24904740819d2f89fa on tablet 07fa6fea161b4a24904740819d2f89fa with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:31.705051  9764 raft_consensus.cc:348] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.705969  9764 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:31.706929  9764 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:31.709813  9764 ts_tablet_manager.cc:1428] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260925 16:42:31.711483  9060 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-cdef8e15863049f59c35fc47250d99ee received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:31.711890  9060 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-cdef8e15863049f59c35fc47250d99ee on tablet cdef8e15863049f59c35fc47250d99ee with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:31.884605  9702 raft_consensus.cc:1203] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:31.930450  9702 raft_consensus.cc:1203] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:32.075138  9702 raft_consensus.cc:1203] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:32.194694  9702 raft_consensus.cc:1203] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:32.376981  9734 raft_consensus.cc:1050] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:32.379910  9734 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.389359  9702 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.389432  9045 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.390619  8967 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.390951  9772 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.392253  9734 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:32.404266  9781 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:32.408202  9781 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.411940  9049 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.421301  8967 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.426049  9702 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.435184  8872 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:32.499039  9779 raft_consensus.cc:1050] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:32.501367  9779 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.511770  9702 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.511773  9043 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.513342  9692 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.514688  9754 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.519940  9122 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.521607  9692 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.535176  9749 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.542646  9049 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.544198  9124 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.552639  9702 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.555822  8870 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:32.567113  9498 raft_consensus.cc:1050] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:32.569262  9498 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.589223  9124 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.590600  9702 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.591966  9786 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.593590  9786 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.601189  8967 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.603157  9786 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.612545  8967 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.662469  9700 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.662750  9049 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.664047  9749 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:32.665284  9498 raft_consensus.cc:1050] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:32.666682  9754 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:32.667301  9498 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.675555  9692 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.679177  9049 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.679585  9700 raft_consensus.cc:2932] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.692087  9763 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.700309  9122 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.700682  9701 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.702836  9786 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.699375  9702 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.705768  9610 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:32.750939  8967 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:32.762956  9610 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:32.763561  8967 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.765247  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a2fce9318b914cda8815dd44730712b6 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:32.768085  8870 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.777069  9121 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.798295  9786 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.816676  9123 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.822424  8872 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.824749  8973 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.840243  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet a2fce9318b914cda8815dd44730712b6 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:32.840472  9701 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.856761  9805 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:32.857797  9805 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:32.857650  8869 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.858628  9805 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:32.866312  9805 ts_tablet_manager.cc:1905] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:32.883302  9805 ts_tablet_manager.cc:1918] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:32.883802  9805 log.cc:1196] T a2fce9318b914cda8815dd44730712b6 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/a2fce9318b914cda8815dd44730712b6
I20260925 16:42:32.885491  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet a2fce9318b914cda8815dd44730712b6 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:32.895221  9049 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.895569  9045 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.902346  9123 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.903730  9786 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:32.907840  9702 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.910189  9701 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.912405  9498 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:32.910219  9121 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.914110  9498 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:32.917042  9800 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.930892  9786 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:32.930065  9121 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.934026  9702 raft_consensus.cc:2932] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.946326  9763 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.947430  9124 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.950412  8871 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.964170  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet cdef8e15863049f59c35fc47250d99ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:32.967283  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 07fa6fea161b4a24904740819d2f89fa with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:32.968775  9701 raft_consensus.cc:2932] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:32.974208  9124 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:32.980659  9702 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.982362  8972 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:32.982227  9781 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:32.985488  9734 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:32.995599  8872 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:32.992348  9734 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:33.000391  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet cdef8e15863049f59c35fc47250d99ee with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:33.029794  9701 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:33.042485  8959 tablet_service.cc:1514] Processing DeleteTablet for tablet 07fa6fea161b4a24904740819d2f89fa with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:33.048000  8973 raft_consensus.cc:2932] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:33.057001  9807 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:33.058228  9807 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:33.059003  9807 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:33.063876  9807 ts_tablet_manager.cc:1905] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:33.063859  8872 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:33.064935  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet dff93d0dcc5944b0b73fca3da91c5b2c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:33.076244  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet dff93d0dcc5944b0b73fca3da91c5b2c with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:33.081156  9810 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:33.083207  9810 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:33.083999  9810 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:33.087661  9810 ts_tablet_manager.cc:1905] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:33.101717  9810 ts_tablet_manager.cc:1918] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:33.102169  9810 log.cc:1196] T dff93d0dcc5944b0b73fca3da91c5b2c P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/dff93d0dcc5944b0b73fca3da91c5b2c
I20260925 16:42:33.104249  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet dff93d0dcc5944b0b73fca3da91c5b2c (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:33.106199  9807 ts_tablet_manager.cc:1918] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:33.106664  9807 log.cc:1196] T cdef8e15863049f59c35fc47250d99ee P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/cdef8e15863049f59c35fc47250d99ee
I20260925 16:42:33.108309  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet cdef8e15863049f59c35fc47250d99ee (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:33.108645  9807 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:33.110110  9807 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:33.110777  9807 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:33.113575  9807 ts_tablet_manager.cc:1905] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:33.128291  9807 ts_tablet_manager.cc:1918] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:33.128662  9807 log.cc:1196] T 07fa6fea161b4a24904740819d2f89fa P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/07fa6fea161b4a24904740819d2f89fa
I20260925 16:42:33.131155  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet 07fa6fea161b4a24904740819d2f89fa (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:34.777213  9823 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:42:34.777745  9823 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.791937  9823 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:34.807711  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.814451  9813 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:42:34.815219  9813 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.817330  9813 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:34.818770  9826 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:42:34.819226  9826 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.821265  9826 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:42:34.828380  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76335.8us
I20260925 16:42:34.829514  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.833443  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.837399  9826 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:42:34.837988  9826 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.840003  9826 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:34.841445  9734 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:42:34.841951  9734 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.843938  9734 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:34.846967  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.847194  9823 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:42:34.847766  9823 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.848250  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.849781  9823 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:34.851080  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.851451  9823 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:42:34.852658  9823 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.855769  9823 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:34.855866  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.859295  9823 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:42:34.859890  9823 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.862118  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:34.862157  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.867635  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:34.868232  9823 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:34.869019  9828 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:42:34.869493  9828 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:34.871625  9828 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:34.872762  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:42:34.874004  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:34.876538  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:42:34.878212  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:42:34.884590  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08001361e0 after lost signal to thread 7806
W20260925 16:42:34.885474  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800038200 after lost signal to thread 8907
W20260925 16:42:34.886442  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7fc0 after lost signal to thread 8999
W20260925 16:42:34.887293  8904 debug-util.cc:398] Leaking SignalData structure 0x7b080030af80 after lost signal to thread 9074
W20260925 16:42:34.888288  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08000928a0 after lost signal to thread 9148
W20260925 16:42:34.889457  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08002ff300 after lost signal to thread 9726
I20260925 16:42:34.894830  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:34.895864  9813 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.901535  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:34.902470  9813 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.902866  9049 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:34.910084  9014 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:34.911806  9813 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.913273  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:34.914290  9813 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.915439  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:42:34.916493  9813 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.918077  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:34.922286  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:34.923939  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:34.925884  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:42:34.931936  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:34.932943  9826 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.934057  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:34.934823  9826 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.935511  9089 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:34.936910  9826 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:42:34.937608  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:34.938565  9826 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 16:42:34.944888  9016 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7035ef77210644d1a724b7ba26706f52. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:34.947352  9122 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:34.947530  8972 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:34.949214  9813 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:34.950819  9823 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:34.959518  9813 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:34.961632  9124 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:34.970407  8967 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:34.973804  8972 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:34.980608  8870 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:34.994138  9124 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:34.994387  9049 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:34.995781  9820 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:34.996999  9832 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:42:35.002213  8941 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3503b0ca8a04458ea73d2c6d127f2463. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:35.016618  9791 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.020833  9122 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.033222  9049 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.050693  9122 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:35.078959  9090 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4bcfed5db9a046b18c3437b749370a81. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:35.084821  8972 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:35.086071  9826 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:35.088078  9049 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:35.087824  8870 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.089180  9826 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:35.097626  9829 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.106009  9045 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.117888  8972 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.135108  8872 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.139896  9049 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:35.191424  9016 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e4c4320bf19c419d939def3dc1e1c3d8. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:35.192906  9122 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:35.194897  9830 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:35.198302  8972 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:35.209393  9813 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:35.208681  9830 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.213923  9121 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.252344  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:35.239224  8972 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:35.392669  9849 ts_tablet_manager.cc:927] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:35.395809  9849 tablet_copy_client.cc:316] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:35.397265  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 3503b0ca8a04458ea73d2c6d127f2463 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:35.397783  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 3503b0ca8a04458ea73d2c6d127f2463 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-3503b0ca8a04458ea73d2c6d127f2463
I20260925 16:42:35.405017  8985 tablet_copy_source_session.cc:205] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:35.410233  9849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3503b0ca8a04458ea73d2c6d127f2463. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:35.426949  9849 tablet_copy_client.cc:791] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:35.427562  9849 tablet_copy_client.cc:655] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:35.432333  9849 tablet_copy_client.cc:531] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:35.444965  9849 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:35.469980  9849 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:35.470794  9849 tablet_bootstrap.cc:492] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:35.471444  9849 ts_tablet_manager.cc:1397] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.027s	user 0.011s	sys 0.010s
I20260925 16:42:35.474095  9849 raft_consensus.cc:348] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:35.475035  9849 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:35.475731  9849 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:35.481549  9849 ts_tablet_manager.cc:1428] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.003s
I20260925 16:42:35.485682  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3503b0ca8a04458ea73d2c6d127f2463 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:35.486099  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3503b0ca8a04458ea73d2c6d127f2463 on tablet 3503b0ca8a04458ea73d2c6d127f2463 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:35.561371  9849 ts_tablet_manager.cc:927] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:35.564443  9849 tablet_copy_client.cc:316] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:35.565979  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 7035ef77210644d1a724b7ba26706f52 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:35.566625  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 7035ef77210644d1a724b7ba26706f52 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-7035ef77210644d1a724b7ba26706f52
I20260925 16:42:35.574339  9060 tablet_copy_source_session.cc:205] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:35.577414  9849 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7035ef77210644d1a724b7ba26706f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:35.596861  9849 tablet_copy_client.cc:791] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:35.597457  9849 tablet_copy_client.cc:655] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:35.602746  9849 tablet_copy_client.cc:531] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:35.617576  9849 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:35.650804  9854 ts_tablet_manager.cc:927] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:35.664081  9854 tablet_copy_client.cc:316] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:35.670398  9849 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:35.671464  9849 tablet_bootstrap.cc:492] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:35.672170  9849 ts_tablet_manager.cc:1397] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.055s	user 0.018s	sys 0.010s
I20260925 16:42:35.673424  9857 ts_tablet_manager.cc:927] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:35.675112  9849 raft_consensus.cc:348] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:35.676117  9849 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:35.675913  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 4bcfed5db9a046b18c3437b749370a81 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:35.676929  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 4bcfed5db9a046b18c3437b749370a81 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-4bcfed5db9a046b18c3437b749370a81
I20260925 16:42:35.676846  9849 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:35.688313  9849 ts_tablet_manager.cc:1428] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.002s
I20260925 16:42:35.696699  9060 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-7035ef77210644d1a724b7ba26706f52 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:35.697184  9060 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-7035ef77210644d1a724b7ba26706f52 on tablet 7035ef77210644d1a724b7ba26706f52 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:35.710762  9134 tablet_copy_source_session.cc:205] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:35.754822  9854 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4bcfed5db9a046b18c3437b749370a81. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:35.779893  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 108177us
I20260925 16:42:35.804741  9857 tablet_copy_client.cc:316] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:35.823661  9854 tablet_copy_client.cc:791] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:35.830463  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet e4c4320bf19c419d939def3dc1e1c3d8 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:35.831260  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet e4c4320bf19c419d939def3dc1e1c3d8 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-e4c4320bf19c419d939def3dc1e1c3d8
I20260925 16:42:35.841470  9854 tablet_copy_client.cc:655] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:35.847602  9060 tablet_copy_source_session.cc:205] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:35.851136  9854 tablet_copy_client.cc:531] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:35.851380  9857 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e4c4320bf19c419d939def3dc1e1c3d8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:35.862104  9854 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:35.871438  9857 tablet_copy_client.cc:791] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:35.872121  9857 tablet_copy_client.cc:655] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:42:35.991190  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55278.6us
I20260925 16:42:35.991993  9702 raft_consensus.cc:1203] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:36.021708  9702 raft_consensus.cc:1203] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260925 16:42:36.058950  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 91488.7us
I20260925 16:42:36.117578  9857 tablet_copy_client.cc:531] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:36.142328  9854 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260925 16:42:36.143160  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65311.1us
I20260925 16:42:36.157212  9854 tablet_bootstrap.cc:492] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:36.158382  9854 ts_tablet_manager.cc:1397] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.296s	user 0.020s	sys 0.025s
I20260925 16:42:36.194173  9857 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:36.214437  9854 raft_consensus.cc:348] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:36.219019  9854 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:36.222208  9854 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:36.227986  9854 ts_tablet_manager.cc:1428] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260925 16:42:36.232890  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-4bcfed5db9a046b18c3437b749370a81 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:36.233419  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-4bcfed5db9a046b18c3437b749370a81 on tablet 4bcfed5db9a046b18c3437b749370a81 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:36.264497  9702 raft_consensus.cc:1203] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:36.325206  9857 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:36.326223  9857 tablet_bootstrap.cc:492] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:36.327380  9857 ts_tablet_manager.cc:1397] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.134s	user 0.008s	sys 0.034s
I20260925 16:42:36.330837  9857 raft_consensus.cc:348] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:36.331789  9857 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:36.332506  9857 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:36.335064  9857 ts_tablet_manager.cc:1428] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:42:36.337178  9060 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-e4c4320bf19c419d939def3dc1e1c3d8 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:36.337627  9060 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-e4c4320bf19c419d939def3dc1e1c3d8 on tablet e4c4320bf19c419d939def3dc1e1c3d8 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:36.415853  9786 raft_consensus.cc:1050] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:36.418610  9786 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:36.431492  9123 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.433197  9871 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.435581  9702 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.437249  9786 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:36.452752  8970 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.455879  9786 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.488593  9871 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.490391  9124 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.501878  9702 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.518712  8872 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.557380  8970 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.569662  9867 raft_consensus.cc:1050] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:36.577473  9867 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:36.586969  9702 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.588917  9885 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.602752  9122 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.604470  9043 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.606011  9868 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.610555  9858 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.659976  9702 raft_consensus.cc:1203] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:36.676205  9867 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.681339  9043 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.695912  9042 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:36.705962  9702 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:36.708361  9869 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:36.711979  8970 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:36.713534  9869 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:36.718387  9702 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.723773  9871 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.734233  8871 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:36.726399  9701 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.740929  9124 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.746932  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7035ef77210644d1a724b7ba26706f52 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:36.779392  8968 raft_consensus.cc:2932] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.785259  8869 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.799602  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet 7035ef77210644d1a724b7ba26706f52 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:36.827876  9873 raft_consensus.cc:1050] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:36.830426  9873 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:36.850193  8970 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:36.868355  9702 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.871594  9701 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:36.874559  9864 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:36.881556  9875 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.881582  9858 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.889341  9700 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.891633  9043 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.911544  8972 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:36.924014  9875 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:36.932464  9124 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:36.934386  9873 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:36.935305  8871 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.936988  9864 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:36.942726  9892 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:36.944260  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 3503b0ca8a04458ea73d2c6d127f2463 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:36.953024  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 3503b0ca8a04458ea73d2c6d127f2463 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:36.947118  9124 raft_consensus.cc:2932] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.968433  9894 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.973546  9049 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:36.998518  9700 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.001861  9899 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:37.004979  8870 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.006758  8974 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.016999  9899 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:37.033914  9899 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:37.046139  9892 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:37.046330  9899 ts_tablet_manager.cc:1905] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:37.048069  9892 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:37.067660  9892 ts_tablet_manager.cc:1905] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:37.072964  9122 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:37.074397  9899 ts_tablet_manager.cc:1918] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:37.077521  9899 log.cc:1196] T 3503b0ca8a04458ea73d2c6d127f2463 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/3503b0ca8a04458ea73d2c6d127f2463
I20260925 16:42:37.079416  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 3503b0ca8a04458ea73d2c6d127f2463 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:37.089802  9700 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:37.091536  9895 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:37.092728  8974 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:37.093991  9873 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:37.099640  9827 raft_consensus.cc:1050] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:37.101748  9892 ts_tablet_manager.cc:1918] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:37.102252  9892 log.cc:1196] T 7035ef77210644d1a724b7ba26706f52 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/7035ef77210644d1a724b7ba26706f52
I20260925 16:42:37.102021  9827 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:37.105607  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet 7035ef77210644d1a724b7ba26706f52 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:37.104957  9894 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.107604  9702 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.117162  8974 raft_consensus.cc:2932] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.127048  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4bcfed5db9a046b18c3437b749370a81 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:37.131234  8870 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.141609  9124 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:37.142019  8974 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:37.145134  9871 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:37.147183  9702 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:37.156234  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 4bcfed5db9a046b18c3437b749370a81 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:37.156845  9786 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:37.163993  9813 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:37.166353  9899 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:37.177151  9786 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.181617  8974 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.194267  9122 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.206012  9702 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.215664  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.218178  9899 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:37.219000  9899 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:37.224586  9899 ts_tablet_manager.cc:1905] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:37.349700  9899 ts_tablet_manager.cc:1918] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:37.350243  9899 log.cc:1196] T 4bcfed5db9a046b18c3437b749370a81 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/4bcfed5db9a046b18c3437b749370a81
I20260925 16:42:37.357563  9048 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:37.364012  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 4bcfed5db9a046b18c3437b749370a81 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:37.367923  9700 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:37.371271  9122 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:37.371556  9813 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:37.372861  9827 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:37.388218  9827 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.391511  9122 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.401654  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet e4c4320bf19c419d939def3dc1e1c3d8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:37.404533  9700 raft_consensus.cc:2932] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.412797  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:37.433491  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet e4c4320bf19c419d939def3dc1e1c3d8 with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:37.436079  9904 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:37.437250  9904 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:37.437944  9904 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:37.442157  9904 ts_tablet_manager.cc:1905] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:37.465080  9904 ts_tablet_manager.cc:1918] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:37.465516  9904 log.cc:1196] T e4c4320bf19c419d939def3dc1e1c3d8 P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/e4c4320bf19c419d939def3dc1e1c3d8
I20260925 16:42:37.469937  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet e4c4320bf19c419d939def3dc1e1c3d8 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:38.549615  9045 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:38.557583  9016 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bbd44a1efa8149a7bbcd2a06b68c6ce8. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:38.557983  9122 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.559437  9827 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.561498  8972 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.562892  9813 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.568260  9813 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.570811  9122 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.571803  8972 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.590394  8970 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:38.586813  8870 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:42:38.604636  8941 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cfb224095e1141f88e8a13ce96fb8fbb. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:38.606786  9124 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.614396  9864 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:38.634796  9045 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.637303  9905 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.649458  9864 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.654198  9124 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.702867  8972 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:38.695300  9045 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.714897  8871 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:42:38.722311  8941 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 82c043c282244d42a0ae912a76bcbe36. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:38.723901  9047 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.725493  9864 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.728195  9124 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.735550  9858 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.759483  9864 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.766131  9047 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.774654  9124 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.786691  9122 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:38.793241  8871 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:38.802824  9090 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 549559d524ae4003aa83f35d26b7f4b9. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:38.817965  8970 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.818739  9045 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:38.820518  9895 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.822134  9894 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:38.846462  9895 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.848266  8970 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.878167  8869 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:38.889842  9047 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:39.017882  9927 ts_tablet_manager.cc:927] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:39.029229  9927 tablet_copy_client.cc:316] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:39.032351  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet cfb224095e1141f88e8a13ce96fb8fbb from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:39.032939  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet cfb224095e1141f88e8a13ce96fb8fbb from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-cfb224095e1141f88e8a13ce96fb8fbb
I20260925 16:42:39.050203  8985 tablet_copy_source_session.cc:205] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:39.054386  9929 ts_tablet_manager.cc:927] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:39.056675  9929 tablet_copy_client.cc:316] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:39.058267  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:39.058858  9927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfb224095e1141f88e8a13ce96fb8fbb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:39.058863  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-bbd44a1efa8149a7bbcd2a06b68c6ce8
I20260925 16:42:39.069494  9060 tablet_copy_source_session.cc:205] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:39.075537  9929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:39.087221  9927 tablet_copy_client.cc:791] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:39.087865  9927 tablet_copy_client.cc:655] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:39.092520  9927 tablet_copy_client.cc:531] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:39.094230  9929 tablet_copy_client.cc:791] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:39.103205  9929 tablet_copy_client.cc:655] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:39.106726  9927 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:39.106772  9929 tablet_copy_client.cc:531] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:39.115546  9929 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:39.159515  9929 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:39.159682  9927 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:39.160465  9929 tablet_bootstrap.cc:492] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:39.160485  9927 tablet_bootstrap.cc:492] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:39.161348  9929 ts_tablet_manager.cc:1397] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.005s
I20260925 16:42:39.161348  9927 ts_tablet_manager.cc:1397] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.055s	user 0.017s	sys 0.014s
I20260925 16:42:39.164793  9929 raft_consensus.cc:348] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.165855  9929 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:39.165557  9927 raft_consensus.cc:348] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.166388  9927 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:39.166656  9929 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.167201  9927 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.180440  9929 ts_tablet_manager.cc:1428] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.019s	user 0.014s	sys 0.001s
I20260925 16:42:39.184607  9060 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-bbd44a1efa8149a7bbcd2a06b68c6ce8 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:39.185012  9060 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-bbd44a1efa8149a7bbcd2a06b68c6ce8 on tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:39.193615  9929 ts_tablet_manager.cc:927] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:39.211789  9929 tablet_copy_client.cc:316] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:39.214985  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 549559d524ae4003aa83f35d26b7f4b9 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:39.215580  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 549559d524ae4003aa83f35d26b7f4b9 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-549559d524ae4003aa83f35d26b7f4b9
I20260925 16:42:39.223770  9134 tablet_copy_source_session.cc:205] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:39.227311  9929 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 549559d524ae4003aa83f35d26b7f4b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:39.234141  9927 ts_tablet_manager.cc:1428] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.072s	user 0.009s	sys 0.005s
I20260925 16:42:39.244514  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-cfb224095e1141f88e8a13ce96fb8fbb received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:39.244961  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-cfb224095e1141f88e8a13ce96fb8fbb on tablet cfb224095e1141f88e8a13ce96fb8fbb with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:39.246385  9929 tablet_copy_client.cc:791] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:39.248476  9929 tablet_copy_client.cc:655] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:39.253314  9929 tablet_copy_client.cc:531] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:39.261000  9929 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:39.272176  9927 ts_tablet_manager.cc:927] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:39.294610  9929 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:39.295511  9929 tablet_bootstrap.cc:492] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:39.296227  9929 ts_tablet_manager.cc:1397] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.035s	user 0.023s	sys 0.011s
I20260925 16:42:39.299109  9929 raft_consensus.cc:348] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.300064  9929 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:39.300762  9929 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.303329  9929 ts_tablet_manager.cc:1428] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260925 16:42:39.304121  9927 tablet_copy_client.cc:316] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:39.306411  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-549559d524ae4003aa83f35d26b7f4b9 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:39.306874  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-549559d524ae4003aa83f35d26b7f4b9 on tablet 549559d524ae4003aa83f35d26b7f4b9 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:39.307993  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 82c043c282244d42a0ae912a76bcbe36 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:39.308575  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 82c043c282244d42a0ae912a76bcbe36 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-82c043c282244d42a0ae912a76bcbe36
I20260925 16:42:39.321373  8985 tablet_copy_source_session.cc:205] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:39.325807  9927 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 82c043c282244d42a0ae912a76bcbe36. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:39.342649  9927 tablet_copy_client.cc:791] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:39.343163  9927 tablet_copy_client.cc:655] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:39.346541  9927 tablet_copy_client.cc:531] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:39.359480  9927 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:39.402487  9927 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:39.403438  9927 tablet_bootstrap.cc:492] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:39.404096  9927 ts_tablet_manager.cc:1397] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.045s	user 0.018s	sys 0.006s
I20260925 16:42:39.412880  9927 raft_consensus.cc:348] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.413702  9927 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:39.414247  9927 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:39.427358  9927 ts_tablet_manager.cc:1428] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.000s
I20260925 16:42:39.429109  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-82c043c282244d42a0ae912a76bcbe36 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:39.429534  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-82c043c282244d42a0ae912a76bcbe36 on tablet 82c043c282244d42a0ae912a76bcbe36 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:39.510398  9702 raft_consensus.cc:1203] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:39.568782  9702 raft_consensus.cc:1203] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:39.603353  9702 raft_consensus.cc:1203] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:39.702414  9702 raft_consensus.cc:1203] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:39.964915  9917 raft_consensus.cc:1050] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:39.968273  9917 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:39.975184  9702 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:39.976823  9045 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:39.977414  9121 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:39.978358  9858 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:39.979158  9864 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:39.980713  9917 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:39.993257  9917 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:39.997148  9702 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:39.998450  9122 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.004906  9045 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.012521  8869 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.069723  8974 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.076747  9702 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.078109  9858 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:40.079386  9045 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.085328  9858 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260925 16:42:40.089412  9945 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.095072  9045 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.097591  9702 raft_consensus.cc:2932] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.104535  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet cfb224095e1141f88e8a13ce96fb8fbb with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:40.114473  8872 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:40.133242  9813 raft_consensus.cc:1050] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:40.135321  9813 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.138886  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet cfb224095e1141f88e8a13ce96fb8fbb with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:40.141084  9951 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:40.152288  9702 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.153664  9952 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:40.159888  8974 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.161198  9952 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:40.170235  9124 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.173996  9909 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:40.174628  9951 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:40.176255  9951 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:40.183216  9951 ts_tablet_manager.cc:1905] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:40.215555  9951 ts_tablet_manager.cc:1918] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:40.216046  9951 log.cc:1196] T cfb224095e1141f88e8a13ce96fb8fbb P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/cfb224095e1141f88e8a13ce96fb8fbb
I20260925 16:42:40.219123  9864 raft_consensus.cc:1050] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:40.219825  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet cfb224095e1141f88e8a13ce96fb8fbb (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:40.222820  9895 raft_consensus.cc:1050] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:40.221823  9864 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.215865  9909 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.228034  9895 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.232208  9045 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.233292  9122 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.230377  9702 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.235055  9864 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:40.236608  9858 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:40.238003  9917 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:40.229928  8974 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.254923  9121 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.276048  9047 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.280328  9700 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:42:40.281540  9958 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260925 16:42:40.282855  8870 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.288859  9701 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.291160  9925 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:40.301617  9045 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.302953  9701 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.302474  9047 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.306840  9925 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:40.311899  8968 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.294696  9864 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.314853  9813 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:40.317533  8970 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:40.362703  9959 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:40.376219  9698 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.400313  9953 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:40.405435  8870 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.405052  9124 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.445410  9952 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.452251  8968 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.469980  9047 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.473544  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:40.474256  9700 raft_consensus.cc:2932] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.466943  9925 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.494695  8974 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.517376  9700 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.521662  9864 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:40.523634  8871 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:42:40.529793  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45779us
I20260925 16:42:40.542431  9124 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.542373  9858 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.550149  9864 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:40.555366  9699 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.602267  9121 raft_consensus.cc:2932] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.608359  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 82c043c282244d42a0ae912a76bcbe36 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260925 16:42:40.608294  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67272us
I20260925 16:42:40.617962  9700 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.620988  8870 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:40.638034  8870 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.639407  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:40.640334  9951 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:40.641328  9951 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:40.641999  9951 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:40.649941  9951 ts_tablet_manager.cc:1905] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:40.650303  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 82c043c282244d42a0ae912a76bcbe36 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:40.663233  9976 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:40.664444  9976 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:40.665127  9976 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:40.669152  8974 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.693691  9976 ts_tablet_manager.cc:1905] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:40.696110  9951 ts_tablet_manager.cc:1918] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:40.696561  9951 log.cc:1196] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/bbd44a1efa8149a7bbcd2a06b68c6ce8
I20260925 16:42:40.709619  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet bbd44a1efa8149a7bbcd2a06b68c6ce8 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:40.715399  9976 ts_tablet_manager.cc:1918] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:40.715946  9976 log.cc:1196] T 82c043c282244d42a0ae912a76bcbe36 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/82c043c282244d42a0ae912a76bcbe36
I20260925 16:42:40.717492  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 82c043c282244d42a0ae912a76bcbe36 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:40.733497  9122 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:40.738684  9700 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.738781  9048 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:40.740275  9975 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:40.741281  9969 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:40.748993  9969 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.750480  9048 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.761283  9700 raft_consensus.cc:2932] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.779918  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 549559d524ae4003aa83f35d26b7f4b9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:40.780934  8870 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:40.795544  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet 549559d524ae4003aa83f35d26b7f4b9 with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:40.798033  9977 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:40.799306  9977 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:40.800102  9977 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:40.803519  9977 ts_tablet_manager.cc:1905] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:40.816442  9977 ts_tablet_manager.cc:1918] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:40.816814  9977 log.cc:1196] T 549559d524ae4003aa83f35d26b7f4b9 P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/549559d524ae4003aa83f35d26b7f4b9
I20260925 16:42:40.818233  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet 549559d524ae4003aa83f35d26b7f4b9 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:41.856235  8974 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:41.862277  8941 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa99d4dee31544f3b7bfe97ab9e9e3a3. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:41.863142  9123 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:41.863396  9047 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:41.864271  9858 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:41.865437  9966 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:41.875046  9123 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.873606  9981 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.880287  9047 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.890497  8870 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.893285  9048 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:41.903599  9016 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eeecf611404e405fa30831f973aec8f1. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:41.906075  9123 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:41.908290  9952 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:41.919907  8974 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:41.922654  9952 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:41.926360  9952 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.932926  9122 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.944479  8968 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:41.949676  8872 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:41.955864  9048 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 16:42:41.956614  8941 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bfcf558f0a6b4011a3cb46c3ebbe4a3e. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:41.953089  8968 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.957799  9966 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:41.968856  9122 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:41.971203  9858 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:41.984652  9981 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.988972  9048 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:41.992151  9122 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:42.005901  9048 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.017715  8870 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:42.023428  9016 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 918e188b611843cb98bcddc996c7fc3a. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:42.024917  9122 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:42.026367  9952 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:42.026814  8968 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:42.029273  9953 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:42.063813  9985 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:42.075201  8968 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:42.075945  9122 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:42.093110  8870 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:42.332669  9998 ts_tablet_manager.cc:927] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:42.335170  9998 tablet_copy_client.cc:316] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:42.336830  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:42.337277  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-aa99d4dee31544f3b7bfe97ab9e9e3a3
I20260925 16:42:42.344547  8985 tablet_copy_source_session.cc:205] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:42.347781  9998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:42.363570  9998 tablet_copy_client.cc:791] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:42.364161  9998 tablet_copy_client.cc:655] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:42.367995  9998 tablet_copy_client.cc:531] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:42.376169  9998 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:42.381016 10000 ts_tablet_manager.cc:927] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:42.399109 10000 tablet_copy_client.cc:316] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:42.400555  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:42.401078  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-bfcf558f0a6b4011a3cb46c3ebbe4a3e
I20260925 16:42:42.406450  9998 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:42.407446  9998 tablet_bootstrap.cc:492] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:42.408141  9998 ts_tablet_manager.cc:1397] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.032s	user 0.024s	sys 0.000s
I20260925 16:42:42.409897  8985 tablet_copy_source_session.cc:205] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:42.411016  9998 raft_consensus.cc:348] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.411939  9998 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:42.412612  9998 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.413551 10000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:42.426982  9998 ts_tablet_manager.cc:1428] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.009s
I20260925 16:42:42.428630  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-aa99d4dee31544f3b7bfe97ab9e9e3a3 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:42.429004  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-aa99d4dee31544f3b7bfe97ab9e9e3a3 on tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:42.432329 10000 tablet_copy_client.cc:791] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:42.432909 10000 tablet_copy_client.cc:655] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:42.445932 10000 tablet_copy_client.cc:531] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:42.458191 10000 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:42.461740  9998 ts_tablet_manager.cc:927] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:42.463289  9998 tablet_copy_client.cc:316] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:42.465530  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 918e188b611843cb98bcddc996c7fc3a from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:42.466035  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 918e188b611843cb98bcddc996c7fc3a from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-918e188b611843cb98bcddc996c7fc3a
I20260925 16:42:42.473502  9060 tablet_copy_source_session.cc:205] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:42.481724  9998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 918e188b611843cb98bcddc996c7fc3a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:42.487385 10000 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:42.488365 10000 tablet_bootstrap.cc:492] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:42.489037 10000 ts_tablet_manager.cc:1397] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.031s	user 0.018s	sys 0.003s
I20260925 16:42:42.491628 10000 raft_consensus.cc:348] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.492534 10000 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:42.493171 10000 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.497727 10000 ts_tablet_manager.cc:1428] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:42:42.499534  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-bfcf558f0a6b4011a3cb46c3ebbe4a3e received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:42.500252  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-bfcf558f0a6b4011a3cb46c3ebbe4a3e on tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:42.509223 10000 ts_tablet_manager.cc:927] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:42.511368 10000 tablet_copy_client.cc:316] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:42.512744  9060 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet eeecf611404e405fa30831f973aec8f1 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:42.513338  9060 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet eeecf611404e405fa30831f973aec8f1 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-eeecf611404e405fa30831f973aec8f1
I20260925 16:42:42.520870  9998 tablet_copy_client.cc:791] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:42.521499  9998 tablet_copy_client.cc:655] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:42.521665  9060 tablet_copy_source_session.cc:205] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:42.527274  9998 tablet_copy_client.cc:531] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:42.527613 10000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeecf611404e405fa30831f973aec8f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:42.535295  9998 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:42.542841 10000 tablet_copy_client.cc:791] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:42.543349 10000 tablet_copy_client.cc:655] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:42.547271 10000 tablet_copy_client.cc:531] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:42.555563 10000 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:42.650449  9998 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:42.651433 10000 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:42.652822  9998 tablet_bootstrap.cc:492] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:42.655251  9998 ts_tablet_manager.cc:1397] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.120s	user 0.019s	sys 0.020s
I20260925 16:42:42.658368  9998 raft_consensus.cc:348] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.659204  9998 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:42.659808  9998 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.662148  9998 ts_tablet_manager.cc:1428] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260925 16:42:42.653311 10000 tablet_bootstrap.cc:492] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:42.663342 10000 ts_tablet_manager.cc:1397] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.108s	user 0.029s	sys 0.020s
I20260925 16:42:42.665493  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-918e188b611843cb98bcddc996c7fc3a received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:42.665946  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-918e188b611843cb98bcddc996c7fc3a on tablet 918e188b611843cb98bcddc996c7fc3a with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:42.666245 10000 raft_consensus.cc:348] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.667073 10000 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:42.667659 10000 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:42.670763 10000 ts_tablet_manager.cc:1428] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260925 16:42:42.675526  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-eeecf611404e405fa30831f973aec8f1 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:42.675915  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-eeecf611404e405fa30831f973aec8f1 on tablet eeecf611404e405fa30831f973aec8f1 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:42.859661  9699 raft_consensus.cc:1203] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:42.891441  9699 raft_consensus.cc:1203] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:42.917785  9699 raft_consensus.cc:1203] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:43.132454  9700 raft_consensus.cc:1203] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:43.306543  9993 raft_consensus.cc:1050] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:43.312258  9993 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.318687 10008 raft_consensus.cc:1050] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:43.321000 10008 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.326320  9700 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.329166  9124 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.331348  9858 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:43.347029  9858 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:43.368523  9699 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.370981  9993 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:43.380998  9122 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.385280 10020 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:43.386674  9953 raft_consensus.cc:1050] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:43.390864  9953 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.395275  9045 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.394152  9993 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.399348 10018 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:43.400187  9048 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.403023  9121 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.407555 10019 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:43.413304  9699 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.434449  8870 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:43.447043 10020 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.451572  9121 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.481890  9698 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.478048  9700 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.494367  9985 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:43.501049  8968 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.515753  9121 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.522040 10027 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
I20260925 16:42:43.516970  9047 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.536784  9048 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.562003 10027 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:43.598170  9952 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.599792  9698 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.614717  8871 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.626420  8968 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.632481  9123 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.642342  8869 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.660141  8970 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.663822  8968 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.672291  9698 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.675961 10015 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.681921  9042 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.683305  9045 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.684580  9698 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.685001 10018 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.688035  9122 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.687925 10020 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.689826  9993 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.689888 10018 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.694732  9698 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.694937  8968 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.696759 10031 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.696432  9045 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.700160  9122 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.701218 10031 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.697327 10017 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.714495  9700 raft_consensus.cc:2932] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.716853 10032 raft_consensus.cc:1050] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:43.722199 10032 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.741701  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:43.742412  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:43.741014  9698 raft_consensus.cc:2932] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.750283 10028 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.760488  8968 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.762965  9699 raft_consensus.cc:2932] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.759804  8872 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:43.767802  8872 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:43.792536  9121 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.793010  8870 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.794034  9952 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:43.795599  8968 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.800386 10029 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.004s
I20260925 16:42:43.825456  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet 918e188b611843cb98bcddc996c7fc3a with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:43.830451  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:43.833632  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:43.833957  9699 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:43.835614 10029 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:43.855723  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 918e188b611843cb98bcddc996c7fc3a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:43.857859 10045 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:43.864092 10029 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.865718  9699 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.890990 10045 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:43.910423 10045 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:43.913566 10044 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:43.914667  9121 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.915903 10045 ts_tablet_manager.cc:1905] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:43.916436 10044 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:43.918829 10044 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:43.921176  8968 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.912719  8870 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.939291 10044 ts_tablet_manager.cc:1905] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:43.940101 10045 ts_tablet_manager.cc:1918] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:43.941536 10045 log.cc:1196] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/aa99d4dee31544f3b7bfe97ab9e9e3a3
I20260925 16:42:43.943893  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet aa99d4dee31544f3b7bfe97ab9e9e3a3 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:43.963476 10044 ts_tablet_manager.cc:1918] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:43.964085 10044 log.cc:1196] T 918e188b611843cb98bcddc996c7fc3a P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/918e188b611843cb98bcddc996c7fc3a
I20260925 16:42:43.965556 10044 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:43.965761  9042 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:43.966367 10044 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:43.967089 10044 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:43.968811  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet 918e188b611843cb98bcddc996c7fc3a (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:43.970489 10044 ts_tablet_manager.cc:1905] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:43.975380  9123 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.976478  9699 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:43.978125 10031 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.983567 10031 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:43.986096 10044 ts_tablet_manager.cc:1918] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:43.986654 10044 log.cc:1196] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/bfcf558f0a6b4011a3cb46c3ebbe4a3e
I20260925 16:42:43.988190  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet bfcf558f0a6b4011a3cb46c3ebbe4a3e (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:43.988011 10029 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:43.995555  9700 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:44.009137  9123 raft_consensus.cc:2932] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:44.012830  8870 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:44.024744  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet eeecf611404e405fa30831f973aec8f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:44.025307  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet eeecf611404e405fa30831f973aec8f1 with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:44.032846 10047 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:44.033814 10047 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:44.034420 10047 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:44.038329 10047 ts_tablet_manager.cc:1905] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:44.056913 10047 ts_tablet_manager.cc:1918] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:44.057322 10047 log.cc:1196] T eeecf611404e405fa30831f973aec8f1 P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/eeecf611404e405fa30831f973aec8f1
I20260925 16:42:44.058941  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet eeecf611404e405fa30831f973aec8f1 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:45.099103  9045 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:45.105793  9016 consensus_peers.cc:487] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 72e548ac0b7b407dbc32d2018beb932d. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:45.106799  9122 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.106966  8970 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.108372 10050 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:45.109388 10031 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:45.133630  9952 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.136080  9122 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.155515  8872 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:45.156972  9123 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.178874  8968 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.194166  9045 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 16:42:45.194602  9090 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 66c62931d7564a9698d331185552eed5. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:45.195459 10048 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:45.198108  8968 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.199440 10039 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:45.212018 10039 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.214731  9045 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.221391  8968 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.245915  8871 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.247550  8968 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:45.264144  8941 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6e5cd4cb635e42ce8ee7624b47b5750a. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:45.265190  9123 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.266947  9993 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:45.267196  9045 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.268615 10019 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:45.276883 10053 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.278368  9123 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.283633  9045 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.292115  9042 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.302951  8870 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.313624  8970 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.315062 10050 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:42:45.316138  9016 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5db686f01e4748d0b9ce8fe3b96a5895. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:45.316668  9123 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:45.317780 10050 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:45.326560 10031 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.329090  9124 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.338270  8970 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:45.364403  8872 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:45.663166 10071 ts_tablet_manager.cc:927] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:45.664255 10072 ts_tablet_manager.cc:927] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:45.672829 10072 tablet_copy_client.cc:316] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:45.673056 10071 tablet_copy_client.cc:316] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:45.674512  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 72e548ac0b7b407dbc32d2018beb932d from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:45.674671  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 66c62931d7564a9698d331185552eed5 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:45.675004  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 72e548ac0b7b407dbc32d2018beb932d from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-72e548ac0b7b407dbc32d2018beb932d
I20260925 16:42:45.675166  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 66c62931d7564a9698d331185552eed5 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-66c62931d7564a9698d331185552eed5
I20260925 16:42:45.683828  9134 tablet_copy_source_session.cc:205] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:45.689617  9059 tablet_copy_source_session.cc:205] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:45.692188 10071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 66c62931d7564a9698d331185552eed5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:45.699905 10072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 72e548ac0b7b407dbc32d2018beb932d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:45.721977 10071 tablet_copy_client.cc:791] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:45.722469 10072 tablet_copy_client.cc:791] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:45.722648 10071 tablet_copy_client.cc:655] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:45.723007 10072 tablet_copy_client.cc:655] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:45.727954 10071 tablet_copy_client.cc:531] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:45.728629 10072 tablet_copy_client.cc:531] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:45.736086 10071 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:45.739167 10072 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:45.768919 10072 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:45.769972 10072 tablet_bootstrap.cc:492] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:45.771901 10072 ts_tablet_manager.cc:1397] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.033s	user 0.014s	sys 0.008s
I20260925 16:42:45.774927 10071 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:45.774562 10072 raft_consensus.cc:348] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.775362 10072 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:45.775856 10071 tablet_bootstrap.cc:492] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:45.776525 10071 ts_tablet_manager.cc:1397] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.008s
I20260925 16:42:45.776072 10072 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.779309 10072 ts_tablet_manager.cc:1428] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:42:45.779357 10071 raft_consensus.cc:348] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.780344 10071 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:45.780990  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-72e548ac0b7b407dbc32d2018beb932d received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:45.781410  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-72e548ac0b7b407dbc32d2018beb932d on tablet 72e548ac0b7b407dbc32d2018beb932d with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:45.781365 10071 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.784554 10071 ts_tablet_manager.cc:1428] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:42:45.788721  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-66c62931d7564a9698d331185552eed5 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:45.789127  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-66c62931d7564a9698d331185552eed5 on tablet 66c62931d7564a9698d331185552eed5 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:45.840669 10071 ts_tablet_manager.cc:927] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:45.850386 10072 ts_tablet_manager.cc:927] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:45.851049 10071 tablet_copy_client.cc:316] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:45.852417 10072 tablet_copy_client.cc:316] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:45.852907  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 5db686f01e4748d0b9ce8fe3b96a5895 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:45.853518  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 5db686f01e4748d0b9ce8fe3b96a5895 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-5db686f01e4748d0b9ce8fe3b96a5895
I20260925 16:42:45.856009  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 6e5cd4cb635e42ce8ee7624b47b5750a from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:45.856593  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 6e5cd4cb635e42ce8ee7624b47b5750a from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-6e5cd4cb635e42ce8ee7624b47b5750a
I20260925 16:42:45.861985  9059 tablet_copy_source_session.cc:205] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:45.865291 10071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5db686f01e4748d0b9ce8fe3b96a5895. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:45.868855  8985 tablet_copy_source_session.cc:205] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:45.871392 10072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6e5cd4cb635e42ce8ee7624b47b5750a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:45.881553 10071 tablet_copy_client.cc:791] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:45.882155 10071 tablet_copy_client.cc:655] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:45.886147 10072 tablet_copy_client.cc:791] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:45.886654 10072 tablet_copy_client.cc:655] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:45.887354 10071 tablet_copy_client.cc:531] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:45.894620 10072 tablet_copy_client.cc:531] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:45.896214 10071 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:45.902958 10072 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:45.923599 10071 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:45.924533 10071 tablet_bootstrap.cc:492] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:45.925199 10071 ts_tablet_manager.cc:1397] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.011s
I20260925 16:42:45.928040 10071 raft_consensus.cc:348] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.928962 10071 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:45.929816 10071 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.932530 10071 ts_tablet_manager.cc:1428] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260925 16:42:45.934373  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-5db686f01e4748d0b9ce8fe3b96a5895 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:45.934772  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-5db686f01e4748d0b9ce8fe3b96a5895 on tablet 5db686f01e4748d0b9ce8fe3b96a5895 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:45.938391 10072 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:45.939322 10072 tablet_bootstrap.cc:492] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:45.939977 10072 ts_tablet_manager.cc:1397] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.037s	user 0.028s	sys 0.008s
I20260925 16:42:45.942425 10072 raft_consensus.cc:348] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.946846 10072 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:45.947508 10072 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:45.951524 10072 ts_tablet_manager.cc:1428] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260925 16:42:45.959669  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-6e5cd4cb635e42ce8ee7624b47b5750a received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:45.960222  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-6e5cd4cb635e42ce8ee7624b47b5750a on tablet 6e5cd4cb635e42ce8ee7624b47b5750a with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:46.263959  9699 raft_consensus.cc:1203] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:46.277809  9699 raft_consensus.cc:1203] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:46.301041  9700 raft_consensus.cc:1203] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:46.459522  9699 raft_consensus.cc:1203] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:46.679033 10031 raft_consensus.cc:1050] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:46.681854 10031 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:46.691056  9700 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.691123  9124 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.692595 10031 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:46.693610 10083 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:46.694861  8968 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.696478 10083 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:46.714636 10083 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.725466  9124 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.731738  8968 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.740037  8871 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:46.741616  9700 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.757899 10031 raft_consensus.cc:1050] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:46.766117 10031 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:46.785791 10085 raft_consensus.cc:1050] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:46.805425 10085 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:46.819896  9700 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.821434  9124 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.821386 10031 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:46.824299 10031 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:46.835745  8968 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.850317  9952 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:46.869657 10083 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.874110  9049 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.877614  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.874935  9699 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.886075 10061 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:46.889617 10061 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:46.897703  9045 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:46.901703  8970 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:46.904333  9700 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:46.906342 10084 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:46.920815  8970 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:46.927958 10061 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:46.941568  8870 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.956393 10084 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:46.964695  9952 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.973330  9700 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:46.979631  9122 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.059185  8974 raft_consensus.cc:2932] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.060950  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 5db686f01e4748d0b9ce8fe3b96a5895 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:47.061614  8870 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.104074 10109 raft_consensus.cc:1050] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:47.104171  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet 5db686f01e4748d0b9ce8fe3b96a5895 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:47.111263 10109 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:47.116693 10085 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.117769  9042 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:47.119125  9699 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.146404  8872 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.152462  9121 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:47.153864  9699 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:47.153806 10083 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:47.153548  8974 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.156693 10110 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:47.176293 10107 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.180446  9042 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:47.182901 10114 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:47.181838  9121 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.186547  9042 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.187680  9700 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:47.189925 10111 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:47.193642 10116 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:47.196866 10116 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:47.197538 10116 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:47.200135  9122 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:47.200964  8973 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.212121  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 72e548ac0b7b407dbc32d2018beb932d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:47.211294  9699 raft_consensus.cc:2932] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.214368 10116 ts_tablet_manager.cc:1905] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:47.237675 10111 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260925 16:42:47.259999  9124 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:47.265673 10086 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.249640  8870 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:47.267026  9700 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.286368  9699 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:47.288195  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet 72e548ac0b7b407dbc32d2018beb932d with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:47.291592  9047 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.293624 10115 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:47.297106  8870 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:47.308555 10115 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.312845  9701 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.319306  8968 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:47.334702  9123 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.337221 10085 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:47.342048 10121 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:47.356040  8974 raft_consensus.cc:2932] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.363821  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 66c62931d7564a9698d331185552eed5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:47.373905 10116 ts_tablet_manager.cc:1918] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:47.374467 10116 log.cc:1196] T 5db686f01e4748d0b9ce8fe3b96a5895 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/5db686f01e4748d0b9ce8fe3b96a5895
I20260925 16:42:47.374670  8968 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:47.377987  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet 5db686f01e4748d0b9ce8fe3b96a5895 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:47.378901  8870 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:47.385634  9701 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:47.387394  9121 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:47.387506 10111 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:47.390412 10111 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:47.390800 10121 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:47.393834 10121 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:47.397746 10121 ts_tablet_manager.cc:1905] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:47.399170 10114 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.409359  9121 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.410377  9701 raft_consensus.cc:2932] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:47.412631  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6e5cd4cb635e42ce8ee7624b47b5750a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:47.414799  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 66c62931d7564a9698d331185552eed5 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:47.422104  8872 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:47.434269 10121 ts_tablet_manager.cc:1918] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:47.434859 10121 log.cc:1196] T 72e548ac0b7b407dbc32d2018beb932d P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/72e548ac0b7b407dbc32d2018beb932d
I20260925 16:42:47.437788  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet 72e548ac0b7b407dbc32d2018beb932d (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:47.441299  9033 tablet_service.cc:1514] Processing DeleteTablet for tablet 6e5cd4cb635e42ce8ee7624b47b5750a with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:47.443884 10122 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:47.445065 10122 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:47.445819 10122 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:47.449949 10122 ts_tablet_manager.cc:1905] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:47.467451 10122 ts_tablet_manager.cc:1918] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:47.467844 10122 log.cc:1196] T 66c62931d7564a9698d331185552eed5 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/66c62931d7564a9698d331185552eed5
I20260925 16:42:47.469384 10122 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:47.469332  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 66c62931d7564a9698d331185552eed5 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:47.470453 10122 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:47.471040 10122 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:47.473924 10122 ts_tablet_manager.cc:1905] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:47.489579 10122 ts_tablet_manager.cc:1918] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:47.490247 10122 log.cc:1196] T 6e5cd4cb635e42ce8ee7624b47b5750a P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/6e5cd4cb635e42ce8ee7624b47b5750a
I20260925 16:42:47.491665  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 6e5cd4cb635e42ce8ee7624b47b5750a (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:48.499641  9123 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:48.505205  9042 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 16:42:48.505369  9090 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a5837876dc21490e819ef69131e93921. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:48.505587  8968 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:48.506721 10085 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.507686 10039 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.515549 10085 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.517652  8968 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.519995  9047 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.537323  8872 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.545682  9047 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:48.553253  9121 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260925 16:42:48.553380  9016 consensus_peers.cc:487] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4d3b8dd7a0c64a6b99b7fd687634b17c. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:48.554970 10110 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.555547  8968 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:48.566746 10110 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:48.573623 10107 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.578720  8968 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.578722  9121 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.597615  8870 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.607179  8968 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:48.631018  8941 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c796634a27a4d74b87d6a0081b10018. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:48.633777  9121 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:48.634842  9047 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:48.635093 10123 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.636406 10114 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.646463 10123 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.648393  9047 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.657014  9123 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.674782  8973 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:48.693691  8941 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 50e0cc681d6a47be89a47aef9f5e14f4. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:48.697484  8869 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:48.705792  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44329.8us
I20260925 16:42:48.709910  9123 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:48.711592  9042 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:48.715016 10142 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.716040 10114 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:48.738400 10142 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.742202  9047 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.747031  9123 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:48.762566  8869 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:48.898759 10147 ts_tablet_manager.cc:927] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:48.944610 10147 tablet_copy_client.cc:316] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:48.949014  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet a5837876dc21490e819ef69131e93921 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:48.949697  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet a5837876dc21490e819ef69131e93921 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-a5837876dc21490e819ef69131e93921
I20260925 16:42:48.956838 10149 ts_tablet_manager.cc:927] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:48.967193  9134 tablet_copy_source_session.cc:205] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:48.974251 10147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5837876dc21490e819ef69131e93921. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:48.974239 10149 tablet_copy_client.cc:316] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:48.977197  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:48.977836  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 4d3b8dd7a0c64a6b99b7fd687634b17c from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-4d3b8dd7a0c64a6b99b7fd687634b17c
I20260925 16:42:48.998632  9059 tablet_copy_source_session.cc:205] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:49.007014 10147 tablet_copy_client.cc:791] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:49.007789 10147 tablet_copy_client.cc:655] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:49.024708 10149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:49.058482 10149 tablet_copy_client.cc:791] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:49.059443 10149 tablet_copy_client.cc:655] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:49.153932 10153 ts_tablet_manager.cc:927] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:49.168711 10153 tablet_copy_client.cc:316] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:49.172014  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 3c796634a27a4d74b87d6a0081b10018 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:49.172590  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 3c796634a27a4d74b87d6a0081b10018 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-3c796634a27a4d74b87d6a0081b10018
I20260925 16:42:49.179232 10147 tablet_copy_client.cc:531] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:49.194129 10149 tablet_copy_client.cc:531] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:49.194348  8985 tablet_copy_source_session.cc:205] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:49.201766 10147 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:49.203254 10153 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c796634a27a4d74b87d6a0081b10018. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:49.204322 10149 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:49.224835 10153 tablet_copy_client.cc:791] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:49.225620 10153 tablet_copy_client.cc:655] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:49.231392 10153 tablet_copy_client.cc:531] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:49.250830 10149 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:49.254189 10153 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:49.255187 10147 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:49.256074 10147 tablet_bootstrap.cc:492] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:49.259332 10147 ts_tablet_manager.cc:1397] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.058s	user 0.015s	sys 0.027s
I20260925 16:42:49.262334 10147 raft_consensus.cc:348] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.263283 10147 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:49.263949 10147 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.265372 10149 tablet_bootstrap.cc:492] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:49.267582 10149 ts_tablet_manager.cc:1397] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.063s	user 0.021s	sys 0.013s
I20260925 16:42:49.274159 10147 ts_tablet_manager.cc:1428] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.014s	user 0.010s	sys 0.002s
I20260925 16:42:49.275731  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a5837876dc21490e819ef69131e93921 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:49.276144  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a5837876dc21490e819ef69131e93921 on tablet a5837876dc21490e819ef69131e93921 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:49.271839 10149 raft_consensus.cc:348] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.286965 10149 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:49.287738 10149 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.289995 10149 ts_tablet_manager.cc:1428] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.000s
I20260925 16:42:49.291457  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-4d3b8dd7a0c64a6b99b7fd687634b17c received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:49.291862  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-4d3b8dd7a0c64a6b99b7fd687634b17c on tablet 4d3b8dd7a0c64a6b99b7fd687634b17c with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:49.295217 10149 ts_tablet_manager.cc:927] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:49.304342 10153 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:49.305522 10153 tablet_bootstrap.cc:492] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:49.306185 10153 ts_tablet_manager.cc:1397] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.063s	user 0.022s	sys 0.012s
I20260925 16:42:49.309736 10153 raft_consensus.cc:348] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.313200 10153 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:49.314033 10153 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.319648 10153 ts_tablet_manager.cc:1428] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260925 16:42:49.321669  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3c796634a27a4d74b87d6a0081b10018 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:49.322237  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3c796634a27a4d74b87d6a0081b10018 on tablet 3c796634a27a4d74b87d6a0081b10018 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:49.323413 10149 tablet_copy_client.cc:316] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:49.325085  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 50e0cc681d6a47be89a47aef9f5e14f4 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:49.325599  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 50e0cc681d6a47be89a47aef9f5e14f4 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-50e0cc681d6a47be89a47aef9f5e14f4
I20260925 16:42:49.338364  8985 tablet_copy_source_session.cc:205] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:49.342739 10149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 50e0cc681d6a47be89a47aef9f5e14f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:49.362496 10149 tablet_copy_client.cc:791] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:49.363492 10149 tablet_copy_client.cc:655] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:49.368985 10149 tablet_copy_client.cc:531] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:49.372323  9700 raft_consensus.cc:1203] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:49.379367 10149 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:49.399309 10149 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:49.400298 10149 tablet_bootstrap.cc:492] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:49.400972 10149 ts_tablet_manager.cc:1397] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.022s	user 0.021s	sys 0.003s
I20260925 16:42:49.404588 10149 raft_consensus.cc:348] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.405411 10149 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:49.406023 10149 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:49.409106 10149 ts_tablet_manager.cc:1428] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:42:49.411140  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-50e0cc681d6a47be89a47aef9f5e14f4 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:49.411528  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-50e0cc681d6a47be89a47aef9f5e14f4 on tablet 50e0cc681d6a47be89a47aef9f5e14f4 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:49.485654  9700 raft_consensus.cc:1203] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:49.510094  9700 raft_consensus.cc:1203] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:49.757714  9700 raft_consensus.cc:1203] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:49.885712 10114 raft_consensus.cc:1050] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:49.888754 10114 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:49.895493  9701 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:49.896908  9124 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:49.897087 10087 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:49.898272  9042 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:49.899318 10143 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260925 16:42:49.901902 10087 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:49.910775 10110 raft_consensus.cc:1050] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:49.914238 10110 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:49.932328 10167 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:49.933893  9121 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:49.935660  8968 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:49.933722  9701 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:49.936996 10136 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:49.937996 10154 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:49.938540  9124 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:49.944298 10154 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:49.953099  9700 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:49.959908  8872 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:49.963891 10164 raft_consensus.cc:1050] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:49.969086 10164 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:49.976928 10154 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:49.994845  8968 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.009538  9048 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.025296  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:50.027947  9124 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.036586  9700 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.055447  9701 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:50.058449  9048 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:50.064589 10165 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:50.068275 10085 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:50.064059  8871 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.075217  8974 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260925 16:42:50.076018  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1fc0 after lost signal to thread 7806
W20260925 16:42:50.076988  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5a20 after lost signal to thread 8907
W20260925 16:42:50.078086  8996 debug-util.cc:398] Leaking SignalData structure 0x7b0800273e60 after lost signal to thread 8999
W20260925 16:42:50.079119  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08002f6a40 after lost signal to thread 9074
W20260925 16:42:50.086699  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08002a7f80 after lost signal to thread 9148
I20260925 16:42:50.085029 10085 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260925 16:42:50.098038  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08002e6a00 after lost signal to thread 9726
I20260925 16:42:50.123251  9048 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.126915  8972 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.141784  9124 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.146158  9700 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.150372  9048 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.151185 10085 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.155089  9700 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.156541 10167 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:50.158365 10167 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:50.159433 10136 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:50.164556 10110 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:50.170116 10114 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.182126  8970 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.188745  9124 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.201177  9700 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.202598 10155 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.205389  9701 raft_consensus.cc:2932] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.218142  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:50.221045  9048 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.232236  8871 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.199522  9042 raft_consensus.cc:2932] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.235229 10167 raft_consensus.cc:1050] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:50.241221  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 3c796634a27a4d74b87d6a0081b10018 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:50.243757 10167 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.258845  9124 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:50.260172  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet 4d3b8dd7a0c64a6b99b7fd687634b17c with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:50.265115  8872 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.267300  9698 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:50.273412 10169 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:50.265817  9700 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.288218  8871 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.296139 10169 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:50.299988  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet 3c796634a27a4d74b87d6a0081b10018 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:50.305601  9047 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:50.314281 10169 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:50.359324 10190 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:50.363977 10190 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:50.378779 10190 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:50.367472  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:50.379734  8970 raft_consensus.cc:595] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:50.382067  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:50.371254 10171 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.382670  8970 raft_consensus.cc:595] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:50.376471  9698 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.386801  8972 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:50.387370  8972 raft_consensus.cc:595] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:50.391881 10190 ts_tablet_manager.cc:1905] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:50.410743 10192 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:50.382352  9124 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.412904 10143 raft_consensus.cc:979] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.436098  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:50.451936 10167 raft_consensus.cc:1067] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.452088  9048 raft_consensus.cc:595] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:50.455983  9700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:42:50.457983  9700 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:50.440759 10190 ts_tablet_manager.cc:1918] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:50.441144  9049 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.458348  9700 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.466665  9700 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.470745  9700 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:50.474133  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:50.474702  8970 raft_consensus.cc:595] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:50.476114  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:50.477097  9120 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.481699  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:50.482344  8970 raft_consensus.cc:595] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:50.484337  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:42:50.485229  9120 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.486235 10190 log.cc:1196] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/4d3b8dd7a0c64a6b99b7fd687634b17c
I20260925 16:42:50.486497  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:50.448058  8872 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.516057  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:50.516894  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet 4d3b8dd7a0c64a6b99b7fd687634b17c (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:50.506188  9049 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.512195 10192 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:50.518923 10192 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:50.512408  9700 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.524014  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:50.513310 10136 raft_consensus.cc:979] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.524902 10136 raft_consensus.cc:1067] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.525321 10159 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:50.527738  9700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42268
I20260925 16:42:50.528307  9700 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:50.528652  9700 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.529450 10192 ts_tablet_manager.cc:1905] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:50.529675 10165 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:50.531217 10188 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:50.544504  9700 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.556859 10085 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.563427  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:50.564070  9048 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:50.564507  9048 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:50.565204  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:50.565853  8970 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.566047  9047 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.584673  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a5837876dc21490e819ef69131e93921 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:50.585949  9698 raft_consensus.cc:2932] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.565215  9048 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.619445  9048 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.591822  8871 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.590875  9124 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.600379  9700 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:50.591264  8970 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.586352  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:50.629822  8968 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:50.630297  8968 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:50.631181  8968 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.634635  8968 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.639796 10159 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:50.640906 10159 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:42:50.646598  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63236.3us
I20260925 16:42:50.648955 10114 raft_consensus.cc:979] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.653834 10114 raft_consensus.cc:1067] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.652143 10169 raft_consensus.cc:979] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:50.655043 10169 raft_consensus.cc:1067] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:50.658279  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:42:50.658847  9701 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:50.659305  9701 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.664937  8869 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.674487  9701 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.678515  9701 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:50.652830  8968 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.654445  9048 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.681248  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:50.681562  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:50.681885  9048 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.682399 10159 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:50.682823 10159 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:50.684149 10159 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.690963  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet a5837876dc21490e819ef69131e93921 with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:50.692042 10190 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:50.693358  8970 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.704149  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:42:50.704666  9121 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:50.704986  9121 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:50.711206 10192 ts_tablet_manager.cc:1918] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:50.714655  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:50.715570  8967 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:50.715915  8967 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:50.716574  8967 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.717892  8967 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.714929 10190 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:50.720293 10190 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:50.717468  9121 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:50.724197 10190 ts_tablet_manager.cc:1905] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:50.727610  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:50.727970  9124 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.728332  9045 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:50.742295  9045 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:42:50.743003 10171 raft_consensus.cc:979] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:50.742729  9121 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:50.751284 10171 raft_consensus.cc:1067] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:50.748692  9048 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.752130  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:50.753305  9701 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:50.753320 10188 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:50.755975 10188 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:50.756364  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:50.756994  8973 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:50.757103 10188 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:50.753998 10192 log.cc:1196] T 3c796634a27a4d74b87d6a0081b10018 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/3c796634a27a4d74b87d6a0081b10018
I20260925 16:42:50.754854 10169 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:50.765084  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet 3c796634a27a4d74b87d6a0081b10018 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:50.757330  8973 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:50.765746 10114 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:50.766443  8973 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:50.767925  8973 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:50.739522  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.774421 10171 raft_consensus.cc:979] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.774933 10171 raft_consensus.cc:1067] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:50.777112  9700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:42:50.777627  9700 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:50.777993  9700 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.779891  9124 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:42:50.780453  9124 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:50.780827  9124 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.780903  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:50.781826 10159 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:50.782320 10159 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:50.783187 10159 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.784633 10190 ts_tablet_manager.cc:1918] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:50.785053 10190 log.cc:1196] T a5837876dc21490e819ef69131e93921 P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/a5837876dc21490e819ef69131e93921
I20260925 16:42:50.789170 10114 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.787060  8973 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:42:50.795102  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet a5837876dc21490e819ef69131e93921 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:50.802510  9698 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.807497  9700 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.809463  9700 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:50.812572  9124 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:50.819950  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90143us
I20260925 16:42:50.822444  9124 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:50.823323  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:50.823931  8967 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:50.755175  8872 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.824239  8967 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:50.825066  8967 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.825946  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:50.826362  8967 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.826567  9048 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.818600  9121 raft_consensus.cc:2932] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:50.832945  8967 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.834758  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 50e0cc681d6a47be89a47aef9f5e14f4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:50.835687  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:50.836318  8968 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:50.836601  8968 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:50.837301  8968 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:50.838384  8968 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.844852  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:50.822129  8871 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 3, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.847007  8968 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:50.852015  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:50.852056  8870 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.855835  9045 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:50.859961  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:50.858479  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:50.861718 10159 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:50.862272 10159 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:50.863080 10159 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:50.861732 10085 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:50.865516 10085 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:50.870649  9045 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:50.872733 10085 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:50.889351 10200 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260925 16:42:50.916224  8871 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.920068  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 50e0cc681d6a47be89a47aef9f5e14f4 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:50.938707 10205 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:50.939850 10205 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:50.940479 10205 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:50.935741  8870 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.943101  8870 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:50.949958 10205 ts_tablet_manager.cc:1905] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:50.969257 10205 ts_tablet_manager.cc:1918] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:50.969676 10205 log.cc:1196] T 50e0cc681d6a47be89a47aef9f5e14f4 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/50e0cc681d6a47be89a47aef9f5e14f4
I20260925 16:42:50.971657  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 50e0cc681d6a47be89a47aef9f5e14f4 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:51.050158  9124 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.051570 10159 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:51.061316  8968 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.063102 10159 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:51.120597  8970 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.128863 10210 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:51.154539  9048 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.156674 10210 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:51.173565  8967 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:42:51.179044  9042 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.181686 10085 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:51.184286 10196 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260925 16:42:51.200042  8968 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.204419 10196 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
W20260925 16:42:51.289172  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49220.4us
I20260925 16:42:51.335301  9048 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:42:51.338066 10164 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:51.403913  8970 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:51.407073 10085 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:51.412376  9049 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:51.414924 10164 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260925 16:42:51.481930  8968 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.483127  9049 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:51.484414 10210 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:51.485807 10196 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:51.872994  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:51.956419  9120 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:51.975045  9049 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:51.976408  8967 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:51.977852 10165 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:42:51.981187  9090 consensus_peers.cc:487] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 436e4feae1ee4bf7932369f80db76c34. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:51.985097 10164 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:51.990398  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:51.991235  8970 raft_consensus.cc:595] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:51.998240  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:51.999254  8967 raft_consensus.cc:595] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:51.999075  8970 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.003551  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:52.004087  8967 raft_consensus.cc:595] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:51.996943 10165 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.007309  9042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:52.007938  9042 raft_consensus.cc:595] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:52.008402  9049 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.016369  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:52.016919  8967 raft_consensus.cc:595] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:52.026211  8968 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:52.027077  8968 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:52.035276  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:42:52.037103  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:52.041504  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:52.037314  8872 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.053216  8970 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:52.098798  8941 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d1eb29a67e8482385d79fa193c4edd3. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:52.103205  9124 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:52.106865  9049 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:52.108081 10204 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:52.113397 10114 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:52.125523 10167 raft_consensus.cc:979] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:52.125993 10114 raft_consensus.cc:979] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:52.126567 10114 raft_consensus.cc:1067] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:52.126021 10167 raft_consensus.cc:1067] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:52.132298  9120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:42:52.132802  9120 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:52.133118  9120 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.139891  9120 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.140745  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:42:52.141309  9121 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:52.141618  9121 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.141659  9120 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:52.151175  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:52.151927  9042 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.160508  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:52.161221  8968 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:52.161545  8968 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:52.162289  8968 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.163789  8968 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.171064  8968 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:52.181358 10204 raft_consensus.cc:979] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:52.188285 10114 raft_consensus.cc:1067] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:52.195638  9121 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.227092  9121 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:52.218762  9042 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:52.227336  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:52.228806  9045 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.229467  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:52.230258 10227 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:52.230734 10227 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:52.231645 10227 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.238634  9045 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:52.247898  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:52.248797 10165 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:52.249307 10165 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:42:52.250468  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70034.1us
I20260925 16:42:52.250151 10165 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.255069  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:52.255682  8970 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:52.255976  8970 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:52.256636  8970 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.264969  8970 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.252285 10167 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:42:52.284591  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 138166us
I20260925 16:42:52.288789  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:42:52.284432 10217 raft_consensus.cc:979] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:52.289301  9701 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:52.289763  9701 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.289819 10136 raft_consensus.cc:1067] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:52.290720  8970 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:52.298812  9701 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.301412  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:52.301669  9700 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42268
I20260925 16:42:52.301935  9124 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.302146  9700 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:52.302474  9700 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.307902  9701 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:52.308310 10242 raft_consensus.cc:979] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:52.308758 10242 raft_consensus.cc:1067] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:52.311589  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:52.312004  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:42:52.312547  9701 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:52.312923  9701 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.313179  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:52.313936 10210 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:52.314409 10210 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:52.309484  9700 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.315176 10210 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.319887  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:52.320736  9045 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:52.321110  9045 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:52.321835  9700 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:52.322082  9045 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.324404  9045 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.328828  9049 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.330147  9701 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:42:52.334755  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77325.1us
I20260925 16:42:52.339959  9121 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.339530  8870 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:52.344507  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:52.345137  8970 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:52.345453  8970 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:52.345878  9045 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:52.351378  9701 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:52.351584  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:52.352353  8967 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.353963  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:52.354423  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:52.354532  8968 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:52.354949  8968 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:52.354974  9124 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.355682  8968 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.356953  8968 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.354949  8970 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.362982  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:52.364596  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:52.365540 10196 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:52.363504  8968 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:52.370432 10238 raft_consensus.cc:979] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:52.371058 10238 raft_consensus.cc:1067] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:52.371321  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:52.377583  9123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:42:52.378171  9123 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:52.378528  9123 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.380868  8967 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:52.390441  8970 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.404502  8871 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:52.405467  8973 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:52.386013  9123 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.413277  9123 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:52.413632  8970 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:52.418653 10244 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:52.419184 10244 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:52.424737  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:42:52.426218  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54976.1us
I20260925 16:42:52.426796  9049 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.428021  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:52.428618  8973 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:52.428947  8973 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:52.429733  8973 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.430838  8973 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:52.435421  9042 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:52.438082  9123 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:52.440497 10242 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:52.420048 10244 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.442840 10242 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:52.445005 10196 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:52.446094 10196 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:52.416551  8870 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.453048  9049 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:52.454042  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:52.454967 10165 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:52.455544 10165 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:52.456408  8973 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:52.456477 10165 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:52.466531  8869 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:42:52.484193  8941 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 516644be414e4a399c722f9df11d3ff5. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:52.503266 10235 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.510790  9045 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.516294  8872 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:52.533952  9121 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.566334  8870 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:52.589303  9124 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:52.608901 10253 ts_tablet_manager.cc:927] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:52.629642  8870 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:52.631348  8870 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:52.648200 10253 tablet_copy_client.cc:316] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:52.649747  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 436e4feae1ee4bf7932369f80db76c34 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:52.650394  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 436e4feae1ee4bf7932369f80db76c34 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-436e4feae1ee4bf7932369f80db76c34
I20260925 16:42:52.652328  8973 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:52.654067 10165 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:52.657791  9045 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:52.659519 10165 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:52.662981  9134 tablet_copy_source_session.cc:205] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:52.674150 10253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 436e4feae1ee4bf7932369f80db76c34. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:42:52.677759  9090 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a54776b5e30341f1b8e3b9acd31b9027. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:52.690335  9045 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:52.691867  8973 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:52.699204 10164 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:52.702751  8973 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:52.706854 10165 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260925 16:42:52.712788 10253 tablet_copy_client.cc:791] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:52.713542 10253 tablet_copy_client.cc:655] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:52.724565 10253 tablet_copy_client.cc:531] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:52.747428 10165 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260925 16:42:52.764426  9042 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:52.780162 10270 ts_tablet_manager.cc:927] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:52.788524 10269 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.797138 10165 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:52.800101  8967 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.803534 10270 tablet_copy_client.cc:316] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:52.822223  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 7d1eb29a67e8482385d79fa193c4edd3 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:52.824781  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 7d1eb29a67e8482385d79fa193c4edd3 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-7d1eb29a67e8482385d79fa193c4edd3
I20260925 16:42:52.838538  9122 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:52.840123 10247 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:52.841424  8973 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:52.848971 10247 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:52.850294  8968 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:52.864526 10253 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:52.866554 10247 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:52.867103  8870 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:52.871227  8985 tablet_copy_source_session.cc:205] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:52.882687 10270 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d1eb29a67e8482385d79fa193c4edd3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:52.882094  9049 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:52.889048 10276 ts_tablet_manager.cc:927] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:52.890856  8970 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:52.893492 10244 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:52.901750  8974 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:52.903228 10269 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:52.912386  9047 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:52.914026 10244 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:52.964545  9122 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:52.970836 10244 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:53.083169 10276 tablet_copy_client.cc:316] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:53.136821  9042 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260925 16:42:53.146996 10281 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260925 16:42:53.171888 10085 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:42:53.172811  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51589.4us
I20260925 16:42:53.188364 10270 tablet_copy_client.cc:791] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:53.189369 10270 tablet_copy_client.cc:655] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:42:53.197705 10279 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.002s
W20260925 16:42:53.229290 10282 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.004s
W20260925 16:42:53.293830  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 176014us
I20260925 16:42:53.294282  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:53.327324  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 516644be414e4a399c722f9df11d3ff5 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
W20260925 16:42:53.335404  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 84084.8us
I20260925 16:42:53.339440  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 516644be414e4a399c722f9df11d3ff5 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-516644be414e4a399c722f9df11d3ff5
I20260925 16:42:53.422557  8985 tablet_copy_source_session.cc:205] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:53.426786 10253 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:53.488477 10253 tablet_bootstrap.cc:492] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:53.500267 10253 ts_tablet_manager.cc:1397] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.636s	user 0.064s	sys 0.053s
I20260925 16:42:53.504963 10253 raft_consensus.cc:348] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:53.517030 10253 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:53.518258 10253 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:53.522519 10253 ts_tablet_manager.cc:1428] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.022s	user 0.005s	sys 0.004s
I20260925 16:42:53.563467  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-436e4feae1ee4bf7932369f80db76c34 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:53.570734  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-436e4feae1ee4bf7932369f80db76c34 on tablet 436e4feae1ee4bf7932369f80db76c34 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:53.632468  9698 raft_consensus.cc:1203] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:53.637720 10253 ts_tablet_manager.cc:927] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:53.719295 10253 tablet_copy_client.cc:316] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
W20260925 16:42:53.765983  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48136.8us
W20260925 16:42:53.777561  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 388002us
I20260925 16:42:53.800796 10276 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 516644be414e4a399c722f9df11d3ff5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:53.807088  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet a54776b5e30341f1b8e3b9acd31b9027 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:53.807749  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet a54776b5e30341f1b8e3b9acd31b9027 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-a54776b5e30341f1b8e3b9acd31b9027
I20260925 16:42:53.813369  9120 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:53.814066  9120 raft_consensus.cc:595] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:53.826793  9134 tablet_copy_source_session.cc:205] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:53.831224  9120 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "66c62931d7564a9698d331185552eed5"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:53.832044  9120 raft_consensus.cc:595] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:53.834720  9045 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:53.835304  9045 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:53.850575  9120 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:53.851429  9120 raft_consensus.cc:595] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:53.860571  9045 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:53.861287  9045 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:53.865109  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:42:53.859303 10270 tablet_copy_client.cc:531] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:53.866796  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:53.867443  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:53.875651 10253 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a54776b5e30341f1b8e3b9acd31b9027. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:53.888981 10270 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:53.923333 10269 raft_consensus.cc:979] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:53.926556 10269 raft_consensus.cc:1067] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:53.934648  8970 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "66c62931d7564a9698d331185552eed5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:53.935150  8970 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:53.935477  8970 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:53.941684  8970 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:53.937274 10276 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42256 (request call id 256) took 1118 ms. Trace:
I20260925 16:42:53.944231  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:53.944818  9123 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:53.945102  9123 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:53.945884  9123 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:53.947002  9123 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:53.956161 10165 raft_consensus.cc:979] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:53.943491 10276 rpcz_store.cc:276] 0925 16:42:52.808171 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:42:52.808316 (+   145us) service_pool.cc:227] Handling call
0925 16:42:52.889425 (+ 81109us) ts_tablet_manager.cc:928] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
0925 16:42:53.798823 (+909398us) tablet_copy_client.cc:361] Tablet copy session begun
0925 16:42:53.830229 (+ 31406us) tablet_metadata.cc:641] Metadata flushed
0925 16:42:53.830440 (+   211us) tablet_copy_client.cc:490] Wrote new tablet metadata
0925 16:42:53.871778 (+ 41338us) tablet_copy_client.cc:411] Wrote new consensus metadata
0925 16:42:53.885739 (+ 13961us) tablet_replica.cc:205] Creating consensus instance
0925 16:42:53.922530 (+ 36791us) ts_tablet_manager.cc:983] Replica registered.
0925 16:42:53.926920 (+  4390us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":81757,"tablet-copy.queue_time_us":79995,"thread_start_us":209258,"threads_started":2}
I20260925 16:42:53.956700 10296 raft_consensus.cc:1067] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:53.963644  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:42:53.964359  9698 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:53.964982  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42240
I20260925 16:42:53.965505  9701 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:53.965816  9701 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:53.958602  8970 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:42:53.981279  9701 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:53.962289  9123 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:53.984377  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:53.985062  9045 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:53.985450  9701 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:53.987056  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:53.984068 10276 tablet_copy_client.cc:791] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:53.968921 10253 tablet_copy_client.cc:791] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:53.987527  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:54.003504 10253 tablet_copy_client.cc:655] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:53.992892 10276 tablet_copy_client.cc:655] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:54.003683  9123 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:54.004510  9123 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:53.990141 10285 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:54.005977 10285 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:54.006980 10285 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:54.005365  9123 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:54.009517  9123 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:53.991868  9698 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:54.022418 10276 tablet_copy_client.cc:531] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:54.026669 10253 tablet_copy_client.cc:531] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:54.028577  9045 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:54.030532  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:54.031416 10290 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:54.031960 10290 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:54.032856 10290 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:54.037230 10218 raft_consensus.cc:979] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:54.048846 10218 raft_consensus.cc:1067] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:54.054348  8869 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:54.057078  9124 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:42:54.057741  9124 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:54.058193  9124 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:54.059553  9123 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:54.045958 10276 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:54.066287 10165 raft_consensus.cc:979] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:54.069531 10165 raft_consensus.cc:1067] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:54.061798  8870 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:54.076664  8968 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:54.077234  8968 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:54.077586  8968 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:54.083681  9124 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.092238  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:54.092852  9045 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:54.093140  9045 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:54.094342  9124 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:54.094369  8968 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.097703  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:54.097504  9045 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.098330  9049 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:54.096954  8968 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:54.102381  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:54.102933  8970 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:54.104774  9045 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:54.106949  9049 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:42:54.111155  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:54.107846  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:54.112022 10285 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:42:54.112089  9124 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:42:54.115962  9124 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:54.112622 10285 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:54.117705 10285 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.117579  9124 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.119280  9124 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:54.126574  9045 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:54.127521  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:54.127576  9124 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:42:54.128957  8970 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:54.131357 10296 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:54.132011 10296 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:54.135969 10296 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.155627 10269 raft_consensus.cc:1050] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:54.146697 10270 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:54.206689 10270 tablet_bootstrap.cc:492] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:54.225128  8870 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:54.228883 10270 ts_tablet_manager.cc:1397] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.340s	user 0.024s	sys 0.002s
I20260925 16:42:54.234750 10270 raft_consensus.cc:348] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:54.229249 10269 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:54.237509 10253 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:54.257474 10276 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:54.258502 10276 tablet_bootstrap.cc:492] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:54.259214 10276 ts_tablet_manager.cc:1397] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.213s	user 0.032s	sys 0.019s
I20260925 16:42:54.235634 10270 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:54.266667 10270 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:54.268870 10257 raft_consensus.cc:979] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:54.269389 10257 raft_consensus.cc:1067] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:54.272097 10270 ts_tablet_manager.cc:1428] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260925 16:42:54.285597  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:42:54.286155  9121 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:54.286455  9121 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:54.294147  9121 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.297227  9121 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:54.298470  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:54.299324  9049 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:54.299687  9049 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:54.300757  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:54.304394  8970 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:54.303869  9049 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.309466  8970 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:54.315835  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:54.317018  9049 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:54.357712  9049 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:54.359829  9701 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260925 16:42:54.372567  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56811.2us
I20260925 16:42:54.378153  9045 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:54.355103 10165 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:54.380447 10165 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:54.384114  8968 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:54.375931 10269 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260925 16:42:54.386336 10165 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:54.405349  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-7d1eb29a67e8482385d79fa193c4edd3 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:54.369539 10276 raft_consensus.cc:348] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:54.414484 10276 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:54.415196 10276 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:54.408877  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-7d1eb29a67e8482385d79fa193c4edd3 on tablet 7d1eb29a67e8482385d79fa193c4edd3 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:54.411655  8870 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:54.403019 10297 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260925 16:42:54.454696 10276 ts_tablet_manager.cc:1428] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.195s	user 0.007s	sys 0.002s
W20260925 16:42:54.487733  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 79892.7us
I20260925 16:42:54.487124  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-516644be414e4a399c722f9df11d3ff5 received from {username='slave'} at 127.0.0.1:41948
W20260925 16:42:54.510480 10316 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260925 16:42:54.526134  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-516644be414e4a399c722f9df11d3ff5 on tablet 516644be414e4a399c722f9df11d3ff5 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:54.488793 10325 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.047s
I20260925 16:42:54.576053  9048 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:42:54.587455  8870 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:42:54.614393  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 131672us
I20260925 16:42:54.616256  9048 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:54.626721 10253 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:54.632165  9042 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:54.636749 10253 tablet_bootstrap.cc:492] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:54.640791 10253 ts_tablet_manager.cc:1397] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.403s	user 0.041s	sys 0.004s
I20260925 16:42:54.641780 10297 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:54.644402 10253 raft_consensus.cc:348] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:54.645304 10253 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:54.655474 10334 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:54.657423  9120 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260925 16:42:54.660719  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79753.5us
W20260925 16:42:54.728163  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58939.7us
I20260925 16:42:54.731001  9121 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:42:54.732208  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:54.742022  9120 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:54.705168 10242 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260925 16:42:54.646062 10253 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:54.784397  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72009.1us
I20260925 16:42:54.748790 10244 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260925 16:42:54.812553 10165 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:54.819350  9048 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:54.824090 10337 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260925 16:42:54.825953 10331 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.159s
I20260925 16:42:54.827481 10238 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:54.832448 10253 ts_tablet_manager.cc:1428] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.191s	user 0.012s	sys 0.004s
I20260925 16:42:54.838599  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a54776b5e30341f1b8e3b9acd31b9027 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:54.839231  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a54776b5e30341f1b8e3b9acd31b9027 on tablet a54776b5e30341f1b8e3b9acd31b9027 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:54.826180  9698 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:54.852847  9043 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:54.873272  9700 raft_consensus.cc:1203] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:54.927145  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:42:54.972448  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 233912us
I20260925 16:42:54.993265  9701 raft_consensus.cc:1203] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260925 16:42:55.003926  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 272537us
I20260925 16:42:55.041344  8870 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.048235  9699 raft_consensus.cc:1203] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
W20260925 16:42:55.112493  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61399.3us
I20260925 16:42:55.122716  8973 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:55.130780  8970 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:55.149807  8970 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.208863 10332 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:55.218010  9123 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.254442  9698 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:55.256357  9047 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:55.257782 10269 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:55.260802 10347 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:55.264849 10165 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:55.283900 10296 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:55.306386  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:55.306991  9047 raft_consensus.cc:595] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:55.310546 10165 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.319764  9049 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.326112  9123 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:55.326686  9123 raft_consensus.cc:595] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:55.340569  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ee9de086f49c4026931c128637888218"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:55.341534  8970 raft_consensus.cc:595] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:55.347282  9049 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:55.347854  9049 raft_consensus.cc:595] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:55.349740 10258 raft_consensus.cc:979] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:55.350688  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260925 16:42:55.352664  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:55.352873 10257 raft_consensus.cc:979] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:55.353293  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:55.353478 10257 raft_consensus.cc:1067] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:55.355433  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 436e4feae1ee4bf7932369f80db76c34 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:55.355970 10136 raft_consensus.cc:1067] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:55.372269  9123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:42:55.372939  9123 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:55.373365  9123 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.389760  9117 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:42:55.390381  9117 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:55.390745  9117 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.392992 10288 raft_consensus.cc:1050] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:55.395622 10371 raft_consensus.cc:979] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:55.396083 10371 raft_consensus.cc:1067] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:55.397590 10288 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.402216  9123 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.402711  8975 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:55.403448  8975 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:55.403837  8975 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.445848 10329 raft_consensus.cc:1050] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:55.448408 10329 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.455304  8975 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:55.458195  8975 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:55.459389  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:55.460587  9049 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.459852  9699 raft_consensus.cc:2932] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.461601  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:55.462179  9121 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:55.462463  9121 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:55.465909  9121 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:55.467533  9121 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.480525  9123 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:42:55.481789  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:42:55.482339  9698 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.485318  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:55.485904  9047 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:55.486217  9047 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:55.486877  9047 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.488742  9047 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.489334  9121 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:55.491011  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:55.493686 10332 raft_consensus.cc:1050] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:55.495857 10293 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:55.496315 10293 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:55.497195 10293 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:55.453473  9117 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.497844  8870 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.501292  9117 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:42:55.502230  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:42:55.503279  9700 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.503794  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:55.504325  9043 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:55.504580  9043 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:55.505231  9043 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.506208  9043 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.505602  9048 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.509019 10288 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:55.511957  9700 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:55.513761  9701 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.517593  9047 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:55.520362  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:55.521737  9043 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:55.555279  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:55.540913 10332 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.562516 10296 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:55.563288 10296 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:55.539836 10288 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:55.502902  9049 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
W20260925 16:42:55.547735  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 98042.3us
I20260925 16:42:55.548866  9121 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.553026  9698 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:55.565974  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet 436e4feae1ee4bf7932369f80db76c34 with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:55.560597 10337 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:55.567910 10296 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.595579  9698 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.598270  8970 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.602572 10349 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:55.607178 10347 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:55.608414 10327 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:55.610263  9043 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.613409 10370 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260925 16:42:55.608199 10337 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:55.655992  9700 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.644160 10379 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:42:55.662626 10377 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260925 16:42:55.670526 10379 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:55.671187 10379 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:55.674054  9117 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.642349 10337 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.682750 10349 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:55.687201 10331 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260925 16:42:55.712128  9048 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:55.744832 10323 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260925 16:42:55.722203 10379 ts_tablet_manager.cc:1905] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:55.755743 10347 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.773517  8871 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:55.808591  9699 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.800825 10293 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.868860  8870 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:42:55.871912 10388 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260925 16:42:55.874236  8870 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:55.872991  8872 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.891939 10349 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.893257  9700 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.891966 10332 raft_consensus.cc:979] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:55.895200 10332 raft_consensus.cc:1067] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:55.899777  9047 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ee9de086f49c4026931c128637888218"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:42:55.900285  9047 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:55.900585  9047 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.905867  9121 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.928996  9043 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.934128 10379 ts_tablet_manager.cc:1918] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:55.934577 10379 log.cc:1196] T 436e4feae1ee4bf7932369f80db76c34 P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/436e4feae1ee4bf7932369f80db76c34
I20260925 16:42:55.909898  9700 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.938145  9047 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:55.944728  9120 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:55.947546  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:55.948167  8970 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:55.948416  8970 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:55.949138  9047 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:55.949004  8970 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:55.949885  8970 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.950124  9121 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.949227  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:55.951960  9117 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:55.952477  8973 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:42:55.955839  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45804.8us
I20260925 16:42:55.956691  9699 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:55.958164 10337 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:55.964852  9117 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:42:55.965885  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:55.966614 10258 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:55.967614 10258 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:55.968580 10258 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:55.970870  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet 436e4feae1ee4bf7932369f80db76c34 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:55.975242 10347 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.977687  8970 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:42:55.981407  9701 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:55.986774  9048 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.005138  9049 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.014708  9117 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:56.016546 10238 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:55.982380  8872 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:56.022625  9045 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:56.030893  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a54776b5e30341f1b8e3b9acd31b9027 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:56.042486  8970 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.052726 10347 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:56.054782  9701 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:56.056973 10355 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:56.069931 10355 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.070281  9701 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.080251  9043 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:56.085827 10349 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260925 16:42:56.089334  8872 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:56.097829  8870 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.096483  9047 raft_consensus.cc:2932] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.098260  9043 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:56.106459  8870 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.099534  9049 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:56.100700  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 516644be414e4a399c722f9df11d3ff5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:56.114392 10347 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.007s
I20260925 16:42:56.121868  9700 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:56.124320 10371 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:56.110920  9048 raft_consensus.cc:2932] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.151657  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet a54776b5e30341f1b8e3b9acd31b9027 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 3 (current committed config index is 4)) from {username='slave'} at 127.0.0.1:49990
I20260925 16:42:56.152657 10379 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:42:56.153748 10379 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:56.154420 10379 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:56.157985 10379 ts_tablet_manager.cc:1905] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:56.115216 10355 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.044s
I20260925 16:42:56.166702  8970 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.172511  9043 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:56.175565  9701 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:56.178658 10349 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:56.179134  9121 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:56.190454 10165 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:56.197256 10355 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:56.200700 10355 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.205341  9701 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.214902  9123 raft_consensus.cc:2932] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:56.233203  9699 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:56.238981 10329 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:56.274565 10379 ts_tablet_manager.cc:1918] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:56.279614 10379 log.cc:1196] T a54776b5e30341f1b8e3b9acd31b9027 P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/a54776b5e30341f1b8e3b9acd31b9027
I20260925 16:42:56.311168  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7d1eb29a67e8482385d79fa193c4edd3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:56.319204  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet a54776b5e30341f1b8e3b9acd31b9027 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:56.392073  8870 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:56.419008  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet 516644be414e4a399c722f9df11d3ff5 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:42:56.454936 10409 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:42:56.457425 10409 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:56.459005 10409 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:56.454739  8872 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:56.474195  9121 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:56.475812 10373 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:56.479164  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d1eb29a67e8482385d79fa193c4edd3 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:56.483002 10409 ts_tablet_manager.cc:1905] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:56.496840  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:56.524986  8972 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:56.536101 10374 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:56.537276 10409 ts_tablet_manager.cc:1918] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:56.544672 10409 log.cc:1196] T 516644be414e4a399c722f9df11d3ff5 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/516644be414e4a399c722f9df11d3ff5
I20260925 16:42:56.553570 10411 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:42:56.554868 10411 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:42:56.556056 10411 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:42:56.556857  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet 516644be414e4a399c722f9df11d3ff5 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:56.583777 10411 ts_tablet_manager.cc:1905] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:42:56.622180 10411 ts_tablet_manager.cc:1918] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:42:56.622637 10411 log.cc:1196] T 7d1eb29a67e8482385d79fa193c4edd3 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/7d1eb29a67e8482385d79fa193c4edd3
I20260925 16:42:56.625185  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 7d1eb29a67e8482385d79fa193c4edd3 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:42:56.633654  9121 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:56.634483  9121 raft_consensus.cc:595] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:56.638865  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:56.639501  8970 raft_consensus.cc:595] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:56.646351  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:56.647053  9043 raft_consensus.cc:595] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:56.651921  9121 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:56.652515  9121 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:56.654994  8972 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:56.655509  8972 raft_consensus.cc:595] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:56.656984  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:42:56.658736  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:56.659852  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:56.690991 10391 raft_consensus.cc:979] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:56.691486 10391 raft_consensus.cc:1067] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:56.695817  9043 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:42:56.696995  9043 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:56.697448  9043 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:42:56.704975  9043 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:56.707284  9043 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:56.707499  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:56.708475  8972 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:42:56.708817  8972 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:56.709563  8972 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:56.710934  8972 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:42:56.707612  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:56.712404  9120 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:42:56.718467  8972 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:42:56.718912  9120 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:42:56.720050  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:56.721077 10258 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:42:56.721565 10258 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:56.722800 10258 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:56.749569  8871 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:56.866456 10329 raft_consensus.cc:979] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:56.867074 10337 raft_consensus.cc:1067] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:56.869285  8970 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:56.869899  8970 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:56.870227  8970 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:56.879295  8970 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.882875  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:56.883365  9121 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:56.883618  9121 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:56.883736  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:42:56.884379  9701 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:56.884387  9121 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.886296  9121 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:56.891927  9701 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:56.892167  8970 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:42:56.893323  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:56.893913  9121 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:56.894129 10391 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:56.894627 10391 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:56.895450 10391 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.908214  8871 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:56.928396 10329 raft_consensus.cc:979] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:56.929059 10297 raft_consensus.cc:1067] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:56.931912  8972 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:56.932426  8972 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:56.932775  8972 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:56.940286  8972 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:56.943794  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:56.944314  9045 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:56.948436  8972 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:56.948940 10374 raft_consensus.cc:979] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:56.949378 10373 raft_consensus.cc:1067] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:56.950899  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42268
I20260925 16:42:56.951612  9701 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:56.952009  9701 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:56.952636  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:56.953171  9121 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:56.953438  9121 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:56.952519  9045 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:42:56.954279  9121 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:56.955520  8940 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:56.955842  9121 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:56.956537 10288 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:56.957036 10288 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:56.958029 10288 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:56.966501  9121 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:42:56.974489  8871 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:56.974490  9701 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.979429  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:56.980019  9701 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:56.981235  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:56.981837  9043 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:56.982124  9043 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:56.982900  9043 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:56.980043  8972 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:56.984268  9043 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:56.989423  8972 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:56.990504  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:56.991354 10339 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:56.991374  9043 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:56.991945 10339 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:56.992884 10339 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:57.012928  8871 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:57.102654 10391 raft_consensus.cc:979] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:57.103298 10288 raft_consensus.cc:1067] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:42:57.105439  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:42:57.106001  9701 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:57.106577  9701 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:57.113574  9701 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:57.115121  9701 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:57.116134  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:57.116354  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:57.116778  9043 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:57.116837  8972 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:57.117311  8972 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:57.118151  8972 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:57.119686  8972 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:57.128722  8972 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:57.129662  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:42:57.130477 10339 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:57.130928 10339 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:42:57.131848 10339 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:57.132388  9043 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:42:57.141541  8871 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:42:57.228535  8972 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:42:57.230082 10374 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:57.262161  9120 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:42:57.266796 10258 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:57.359395  9045 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:57.361078 10391 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:57.363131  9121 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:57.391394 10288 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:57.394107  9121 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:42:57.398554  9701 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:57.399878 10288 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:57.410228 10391 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:57.424975  8972 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:57.426178 10339 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:57.486958  9043 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:57.496153 10334 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:57.558558  8970 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:57.561784 10339 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:57.569131  9043 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:42:57.571257 10416 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:57.687016  8972 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:57.700783  8941 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a47f8b3d2d0140999fc2b3d8be7d6166. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:57.702841  9043 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260925 16:42:57.703826  9120 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260925 16:42:57.704514 10355 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:57.705650 10424 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:42:57.714571 10424 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.718649  9120 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.719897  9045 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.742724  8869 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 4, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:57.737129  9049 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:57.777115  9016 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cd5f4e4896584eaca2d16610e2afbda8. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:57.778527  9121 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:57.780318 10373 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:57.790261  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:57.806030  8970 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:57.807763 10374 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:57.833525 10373 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.847563  8972 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.854324  9120 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:57.865371  9121 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:57.866204  9121 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:57.869204  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:57.869812  9043 raft_consensus.cc:595] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:57.874431  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:57.874974  8970 raft_consensus.cc:595] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:57.878854  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
W20260925 16:42:57.879062  9090 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d3ede733d07420cb13e85c1792f036e. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:57.879370  8970 raft_consensus.cc:595] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:57.880455  9043 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:57.881759  8975 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:42:57.883394 10329 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:42:57.885424 10329 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:57.886082  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260925 16:42:57.888612  9120 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.902153 10329 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.906096  8972 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.906759  8870 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.903262  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:57.908609  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:57.925012  9043 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.948453  8872 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:57.958483  9123 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:42:57.989718  9090 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9bced284cac6492d92b23e3fcf0b9c80. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:42:57.990340  9043 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:42:57.991672 10329 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:57.992466  8972 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:42:57.995878 10329 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:58.003870 10337 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:58.008652  8972 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:58.016144  9043 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:58.039685  8872 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:42:58.055780 10329 raft_consensus.cc:979] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:58.057734 10297 raft_consensus.cc:1067] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:58.059368  8972 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:58.059916  8972 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:58.060225  8972 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.069586  8972 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.071990  8972 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:58.072492  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:58.073127  9123 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:58.073441  9123 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:58.073323  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:58.074268  9043 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.074244  9123 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.075484  9123 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.080263  9043 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:58.081363  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:58.082134 10391 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:58.082223  9123 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:58.082598 10391 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:58.083884 10391 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.115833  8872 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:58.220206 10373 raft_consensus.cc:979] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:58.220722 10258 raft_consensus.cc:1067] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:58.223394  9123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:42:58.223959  9123 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:58.224311  9123 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.236421  9123 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.238145  9123 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:58.239530  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:58.239610  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:58.240082  8975 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.241591  9043 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:58.242017  9043 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:58.242923  9043 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.244479  9043 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.251616 10288 raft_consensus.cc:979] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:58.252226 10288 raft_consensus.cc:1067] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:58.254040  9048 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:42:58.254495  9048 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:58.254820  9048 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.256578  9043 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:58.259114  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:58.259945 10337 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:58.260419 10337 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:58.261274 10337 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.262712  9048 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.264668  9048 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:58.266063  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:58.266701  9123 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.268481  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:58.269462  8972 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:58.269762  8972 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:58.270596  8972 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.272660  8972 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.294148  8872 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:58.315451  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:42:58.316893 10449 ts_tablet_manager.cc:927] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:42:58.317301  8972 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:42:58.319227 10391 raft_consensus.cc:979] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:58.319736 10391 raft_consensus.cc:1067] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:58.319912  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:58.320996 10373 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:58.322510 10373 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:58.325811 10449 tablet_copy_client.cc:316] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:42:58.331161 10373 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.338805  8975 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:58.340240  9123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:42:58.340740  9123 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:58.341042  9123 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.342078  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet a47f8b3d2d0140999fc2b3d8be7d6166 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:42:58.342705  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet a47f8b3d2d0140999fc2b3d8be7d6166 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-a47f8b3d2d0140999fc2b3d8be7d6166
I20260925 16:42:58.343032 10451 ts_tablet_manager.cc:927] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:58.355466  8872 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:58.362151  8985 tablet_copy_source_session.cc:205] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:58.374050 10449 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a47f8b3d2d0140999fc2b3d8be7d6166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:58.375994  9123 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.378315  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:58.378827  8972 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:58.379108  8972 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:58.379796  8972 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.380880  8972 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.393195  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:58.393754  9043 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:58.400241  9043 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:58.400794  8972 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:42:58.401198  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:58.401503  9123 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:58.402577 10337 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:58.403162 10337 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:58.404485 10337 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:58.405376 10451 tablet_copy_client.cc:316] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:58.407857  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 7d3ede733d07420cb13e85c1792f036e from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:58.408612  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 7d3ede733d07420cb13e85c1792f036e from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-7d3ede733d07420cb13e85c1792f036e
I20260925 16:42:58.417953 10449 tablet_copy_client.cc:791] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:58.418607 10449 tablet_copy_client.cc:655] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:58.420885 10455 ts_tablet_manager.cc:927] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:58.437769 10455 tablet_copy_client.cc:316] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:42:58.439436  9134 tablet_copy_source_session.cc:205] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:58.454943  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet cd5f4e4896584eaca2d16610e2afbda8 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:42:58.455538  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet cd5f4e4896584eaca2d16610e2afbda8 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-cd5f4e4896584eaca2d16610e2afbda8
I20260925 16:42:58.443079  8872 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:58.459769 10451 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7d3ede733d07420cb13e85c1792f036e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:58.463533 10449 tablet_copy_client.cc:531] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:58.476498 10449 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:58.504946  9043 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:58.509646 10424 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:58.524642  9059 tablet_copy_source_session.cc:205] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:58.528766 10455 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd5f4e4896584eaca2d16610e2afbda8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:58.550012 10459 ts_tablet_manager.cc:927] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:58.553552 10459 tablet_copy_client.cc:316] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:42:58.558296  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 9bced284cac6492d92b23e3fcf0b9c80 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:42:58.558883  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 9bced284cac6492d92b23e3fcf0b9c80 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-9bced284cac6492d92b23e3fcf0b9c80
I20260925 16:42:58.559250 10455 tablet_copy_client.cc:791] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:58.560498 10455 tablet_copy_client.cc:655] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:58.563843 10455 tablet_copy_client.cc:531] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:58.568640  9123 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:58.570178 10424 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:58.555681 10449 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:58.578223 10449 tablet_bootstrap.cc:492] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:58.579444 10449 ts_tablet_manager.cc:1397] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.103s	user 0.017s	sys 0.038s
I20260925 16:42:58.576730  9134 tablet_copy_source_session.cc:205] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:42:58.582938 10449 raft_consensus.cc:348] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:58.585376 10449 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:58.586066 10449 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:58.595311 10449 ts_tablet_manager.cc:1428] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260925 16:42:58.597174  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a47f8b3d2d0140999fc2b3d8be7d6166 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:42:58.597570  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a47f8b3d2d0140999fc2b3d8be7d6166 on tablet a47f8b3d2d0140999fc2b3d8be7d6166 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:58.615240 10451 tablet_copy_client.cc:791] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:58.620404 10451 tablet_copy_client.cc:655] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:58.656644 10455 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:58.688346  9699 raft_consensus.cc:1203] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260925 16:42:58.690563 10451 tablet_copy_client.cc:531] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:58.691428 10459 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9bced284cac6492d92b23e3fcf0b9c80. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:42:58.705986 10451 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:42:58.720167  8975 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:58.724031 10459 tablet_copy_client.cc:791] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:42:58.725453  8972 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:58.726800 10329 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:58.737902 10459 tablet_copy_client.cc:655] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:42:58.760321 10374 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260925 16:42:58.768617  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 115211us
I20260925 16:42:58.774886 10455 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:58.775815 10455 tablet_bootstrap.cc:492] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:58.776499 10455 ts_tablet_manager.cc:1397] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.120s	user 0.034s	sys 0.035s
I20260925 16:42:58.779641  9043 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:58.783565 10337 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260925 16:42:58.779343 10455 raft_consensus.cc:348] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:58.786784 10455 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:58.787518 10455 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:58.789991 10455 ts_tablet_manager.cc:1428] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260925 16:42:58.818684  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-cd5f4e4896584eaca2d16610e2afbda8 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:42:58.819181  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-cd5f4e4896584eaca2d16610e2afbda8 on tablet cd5f4e4896584eaca2d16610e2afbda8 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:58.821604  9123 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:58.824401 10373 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:42:58.839243 10459 tablet_copy_client.cc:531] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:42:58.853544 10459 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:42:58.968871  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 126696us
W20260925 16:42:58.974565  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 84222.3us
I20260925 16:42:58.978245  9700 raft_consensus.cc:1203] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:58.991581 10451 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:58.992583 10451 tablet_bootstrap.cc:492] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:58.993376 10451 ts_tablet_manager.cc:1397] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.293s	user 0.025s	sys 0.001s
I20260925 16:42:58.998567  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:42:58.985047  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 94401.4us
W20260925 16:42:59.011909  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84010.1us
I20260925 16:42:59.023654 10424 raft_consensus.cc:1050] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:59.025230 10459 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:42:59.029269  8975 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:59.026113 10459 tablet_bootstrap.cc:492] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:42:59.043299 10459 ts_tablet_manager.cc:1397] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.190s	user 0.022s	sys 0.007s
I20260925 16:42:59.026088 10424 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:59.038508 10451 raft_consensus.cc:348] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:59.093600 10451 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:59.094400 10451 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:59.096232 10451 ts_tablet_manager.cc:1428] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.102s	user 0.009s	sys 0.000s
I20260925 16:42:59.098959  9047 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260925 16:42:59.102862  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58658.4us
W20260925 16:42:59.106287  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71620.9us
I20260925 16:42:59.114521 10329 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.010s
I20260925 16:42:59.134917 10483 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.005s
I20260925 16:42:59.171083  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-7d3ede733d07420cb13e85c1792f036e received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:59.171567  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-7d3ede733d07420cb13e85c1792f036e on tablet 7d3ede733d07420cb13e85c1792f036e with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:59.174679 10459 raft_consensus.cc:348] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:59.178051 10459 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:42:59.178840 10459 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:42:59.186146  9701 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260925 16:42:59.189857 10459 ts_tablet_manager.cc:1428] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.146s	user 0.007s	sys 0.002s
I20260925 16:42:59.194808  9042 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260925 16:42:59.196499  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:42:59.197198  8975 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:42:59.200947 10391 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:59.201939  9117 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:42:59.202557  9117 raft_consensus.cc:595] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:42:59.204995 10493 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:42:59.208989  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ee9de086f49c4026931c128637888218"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:42:59.209726  9043 raft_consensus.cc:595] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:42:59.224262  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260925 16:42:59.225828  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:42:59.226433  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:42:59.226727 10493 raft_consensus.cc:979] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:59.227255 10391 raft_consensus.cc:1067] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:42:59.228811  9042 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:42:59.229481  9042 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:59.229826  9042 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:59.236127  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-9bced284cac6492d92b23e3fcf0b9c80 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:42:59.236567  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-9bced284cac6492d92b23e3fcf0b9c80 on tablet 9bced284cac6492d92b23e3fcf0b9c80 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:59.238050  9042 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:42:59.246582  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 127151us
I20260925 16:42:59.265621  9701 raft_consensus.cc:1203] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:42:59.269207  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:59.269801  8975 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:42:59.270079  8975 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:59.270781  8975 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:59.272054  8975 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:59.295336  9042 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:42:59.296269  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:42:59.302201  9123 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260925 16:42:59.302953  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:59.303546  9117 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:59.316679  9117 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:42:59.333033  8975 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:42:59.362169  9015 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:42:59.364054 10258 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:42:59.364638 10258 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:59.365703 10258 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:59.389294  8872 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 4, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194), now has a pending config: VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194), VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195), VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.400262 10488 raft_consensus.cc:979] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:59.400776 10488 raft_consensus.cc:1067] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:59.408481  8973 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:42:59.409034  8973 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:59.409404  8973 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:59.448374  8973 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:59.452919  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:59.453594  9043 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:59.459920  9043 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:59.461733  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:42:59.462471 10458 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:42:59.462934 10458 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:42:59.463156  8973 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:42:59.463797 10458 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:59.471549  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:42:59.472352  9117 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:42:59.472760  9117 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:59.474057  9117 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:59.476362  9117 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:42:59.490839  9117 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:42:59.497157  8870 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:59.521855  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:59.522519  9043 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Received request to transfer leadership
I20260925 16:42:59.535772 10484 raft_consensus.cc:979] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:59.536262 10484 raft_consensus.cc:1067] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:42:59.538683  9123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ee9de086f49c4026931c128637888218"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:42:59.539239  9123 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:42:59.539587  9123 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:59.547044  9042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:59.547627  9042 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Received request to transfer leadership
I20260925 16:42:59.547880  9123 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:42:59.548666  8859 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for a47f8b3d2d0140999fc2b3d8be7d6166 already in progress [suppressed 6 similar messages]
I20260925 16:42:59.549790  9123 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:42:59.551328  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:42:59.552014  8973 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:59.552042  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:42:59.553417  9042 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:42:59.553586 10374 raft_consensus.cc:1050] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:59.553782  9042 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:42:59.554962  9042 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:59.556128  9042 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:42:59.556237 10374 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:59.559213  8973 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:42:59.561084  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:42:59.562029 10488 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:42:59.562798 10488 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:42:59.563752 10488 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:42:59.575578  9700 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:59.578389 10484 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:59.580545  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:55034
I20260925 16:42:59.581111  9043 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Received request to transfer leadership
I20260925 16:42:59.582387  9123 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
W20260925 16:42:59.583209  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for a47f8b3d2d0140999fc2b3d8be7d6166 already in progress
W20260925 16:42:59.583595  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for a47f8b3d2d0140999fc2b3d8be7d6166 already in progress
I20260925 16:42:59.583407  9042 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:42:59.584100 10484 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:42:59.589347  8973 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:59.591993 10374 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:59.611186  8872 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 3, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:42:59.628219 10484 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.629513  9123 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.645159  9700 raft_consensus.cc:1203] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260925 16:42:59.669718  9700 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.683545  8973 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.689518  8870 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.705204 10483 raft_consensus.cc:1050] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:42:59.708196 10483 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:59.720453  9700 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:59.721053  9042 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:42:59.722291  9043 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:59.736438 10483 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:59.741595  9697 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:59.745415  8972 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:42:59.749315 10258 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:59.775902 10337 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:59.732398  8973 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:42:59.788340 10374 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:42:59.793147 10488 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:42:59.807926 10488 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.820387  8975 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.823012  9042 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.827566 10258 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.831395  9123 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:42:59.832623 10374 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:59.919510  9700 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:42:59.837006  8973 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.905534  9701 raft_consensus.cc:2932] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.948411  8972 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:42:59.932940  8871 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:42:59.960731 10374 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:59.967741  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet cd5f4e4896584eaca2d16610e2afbda8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:42:59.971797  9697 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.977648  9123 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:42:59.983444 10484 raft_consensus.cc:979] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:59.983976 10484 raft_consensus.cc:1067] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:42:59.986140  9700 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:42:59.985308 10490 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.987412 10374 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:42:59.990373  9698 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:42:59.992157  9117 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.008816 10494 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:00.014387  8872 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:00.023923  9043 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:00.025579 10494 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:00.026467  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet cd5f4e4896584eaca2d16610e2afbda8 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:43:00.043602  8973 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:50010
I20260925 16:43:00.044431  8973 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:00.044896  8973 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:00.058465  9047 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:00.065994 10488 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:00.074591  9121 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.074585 10519 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:43:00.080804  9701 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:00.084621 10495 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:43:00.070464  8973 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.092021  9042 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:00.101230  8872 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 4 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194), VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195), VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.103678 10337 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:43:00.105465 10495 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.113216  9698 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.113870  9043 raft_consensus.cc:2932] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.121817  8975 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:00.123595 10373 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:00.123835  8975 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:00.125541  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:00.126474 10519 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:00.127931 10519 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:00.131409 10519 ts_tablet_manager.cc:1905] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:00.137202 10483 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:00.137569  9047 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:00.142779  9047 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:00.143523  9047 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.144797  9047 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:00.145453  8973 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:00.160167  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:00.160915  9697 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:00.167335  9047 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:00.170843 10483 raft_consensus.cc:1050] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:00.173111 10483 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:00.183413 10490 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260925 16:43:00.185619  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:00.189627  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 7d3ede733d07420cb13e85c1792f036e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:00.215035  9698 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260925 16:43:00.221541 10337 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:00.230749 10519 ts_tablet_manager.cc:1918] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:43:00.231914 10519 log.cc:1196] T cd5f4e4896584eaca2d16610e2afbda8 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/cd5f4e4896584eaca2d16610e2afbda8
I20260925 16:43:00.234146  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet cd5f4e4896584eaca2d16610e2afbda8 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:00.238680  8975 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260925 16:43:00.241531 10337 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:00.246093  9697 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:00.251483  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:00.260246  9049 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260925 16:43:00.247010  8872 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.262497 10337 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:43:00.274385 10528 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:00.274943 10528 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:00.275915 10528 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.319000  8871 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 5 to 4, term changed from 4 to 5, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from VOTER to NON_VOTER, now has a pending config: VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194), VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195), VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:43:00.323917  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 72525.8us
I20260925 16:43:00.326789  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet 7d3ede733d07420cb13e85c1792f036e with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:43:00.330933  9049 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.360519 10531 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:43:00.387847  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 134090us
I20260925 16:43:00.389228  8871 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.390568 10537 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:43:00.391739 10537 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:00.392385 10537 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:00.402505 10537 ts_tablet_manager.cc:1905] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:00.417801  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:00.416898  9698 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.486100 10537 ts_tablet_manager.cc:1918] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:43:00.486599 10537 log.cc:1196] T 7d3ede733d07420cb13e85c1792f036e P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/7d3ede733d07420cb13e85c1792f036e
I20260925 16:43:00.494160  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet 7d3ede733d07420cb13e85c1792f036e (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:00.524696  8966 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.554253  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:00.554770  8975 raft_consensus.cc:595] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:00.557837  9120 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:00.558418  9120 raft_consensus.cc:595] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:00.568786  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:00.569342  8975 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:00.571741  9117 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:00.572540  9117 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:00.575392  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260925 16:43:00.577131  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:00.577680  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:00.584736  9123 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.601145  8975 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:00.602489  9698 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:00.603643 10483 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:00.621086 10535 raft_consensus.cc:979] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:43:00.625231 10535 raft_consensus.cc:1067] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:43:00.630188 10488 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.632243  8966 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.645421  9697 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:43:00.646039  9697 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:00.646384  9697 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:00.647883 10531 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:00.662868  9698 raft_consensus.cc:2932] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.667683 10337 raft_consensus.cc:979] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:00.668222 10483 raft_consensus.cc:1067] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:00.669967  9049 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55050
I20260925 16:43:00.670722  9049 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:00.671303  9049 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:00.678350  9049 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:00.680706  9049 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:00.670336  9697 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.682657  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:00.682912  9697 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:00.683373  9120 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:00.683738  9120 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:00.684532  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 9bced284cac6492d92b23e3fcf0b9c80 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:00.684449  9120 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:00.685585  9120 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:00.688812  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:00.689476  9123 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:00.692575  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:00.693152  8975 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:00.693431  8975 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:00.694221  8975 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.695437  9120 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:00.698168  8870 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 4 to 5, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:00.700058  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:00.700835 10373 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:00.695549  8975 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:00.701345 10373 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:00.702520 10373 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:00.713498  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet 9bced284cac6492d92b23e3fcf0b9c80 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:55034
I20260925 16:43:00.715345  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:00.715955  8970 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:00.722345  9701 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:00.723258  8970 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:00.723881  8975 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:00.725595 10535 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:00.730090 10540 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:43:00.732833  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:00.739251 10517 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:00.740191 10540 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:00.740456 10517 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:00.740970 10540 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:00.739573  9123 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:00.741398 10517 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.744802  8871 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 4 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194), VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195), VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.750504 10540 ts_tablet_manager.cc:1905] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:00.748073  8870 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:00.759716 10534 raft_consensus.cc:979] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:00.760166 10534 raft_consensus.cc:1067] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:00.762110  9049 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:43:00.762619  9049 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:00.762960  9049 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:00.768868 10540 ts_tablet_manager.cc:1918] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20260925 16:43:00.769797 10540 log.cc:1196] T 9bced284cac6492d92b23e3fcf0b9c80 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/9bced284cac6492d92b23e3fcf0b9c80
I20260925 16:43:00.771579  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet 9bced284cac6492d92b23e3fcf0b9c80 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:00.777249  9049 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:00.779737  9049 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:00.778755  8870 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:00.780965  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:00.781555  9123 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:00.781490  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:00.782344  8975 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:00.782696  8975 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:00.783519  8975 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:00.784837  8975 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:00.803574  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:00.804853  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:00.805682 10373 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:00.806166 10373 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:00.807090 10373 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:00.808349  8975 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:00.820186  8870 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:00.875240  9049 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:00.877147 10534 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:00.881179  9117 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:00.885793 10528 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.893433  9117 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:00.894954 10494 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:00.973969  8966 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:00.979395  9701 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260925 16:43:00.980019  9117 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260925 16:43:00.980756 10535 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:00.981716 10534 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:00.990860 10534 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 5 to 8, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:00.993072  9698 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 5 to 8, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:01.001603  9117 raft_consensus.cc:2932] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 5 to 8, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:01.008203  8870 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 5 to 8, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:01.023342  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a47f8b3d2d0140999fc2b3d8be7d6166 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:01.029141  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet a47f8b3d2d0140999fc2b3d8be7d6166 with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:55034
I20260925 16:43:01.030058 10540 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:43:01.031030 10540 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:01.031638 10540 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:01.036829 10540 ts_tablet_manager.cc:1905] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:01.046063 10488 raft_consensus.cc:979] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:01.046582 10488 raft_consensus.cc:1067] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:01.049943  8970 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:43:01.050583  8970 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:01.050916  8970 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:01.053252 10540 ts_tablet_manager.cc:1918] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260925 16:43:01.053730 10540 log.cc:1196] T a47f8b3d2d0140999fc2b3d8be7d6166 P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/a47f8b3d2d0140999fc2b3d8be7d6166
I20260925 16:43:01.055333  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet a47f8b3d2d0140999fc2b3d8be7d6166 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:01.059157  8970 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:01.061650  8970 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:01.061681  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:01.062391  9049 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:01.073879  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:01.074908  9117 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:01.076575  9117 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:01.085923  9117 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:01.087204  9117 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:01.087877  9049 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:01.088894  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:01.089640 10534 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:01.090150 10534 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:01.090993 10534 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:01.106784  9117 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:01.114593  8871 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:01.127462  8970 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:01.128724 10374 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:01.145081  9117 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:01.146332 10374 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:01.221460  9117 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:01.222702 10471 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:01.233664  8966 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:01.236567 10517 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:01.265729  8970 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:01.267472 10490 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:01.278074  9117 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:01.279754 10374 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:01.579031  9049 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:01.580500 10534 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:01.592036  9123 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:01.596750 10535 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:01.662585  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:01.705482  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:01.706063  9047 raft_consensus.cc:595] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:01.708493  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:01.709025  9047 raft_consensus.cc:595] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:01.711925  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:01.712412  8970 raft_consensus.cc:595] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:01.713636  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260925 16:43:01.715194  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:01.715776  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:01.761240 10374 raft_consensus.cc:979] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:01.761752 10374 raft_consensus.cc:1067] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:01.763054  8970 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:50010
I20260925 16:43:01.764550  8970 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:01.764878  8970 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:01.769804  8970 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:01.771332  8970 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:01.772259  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:01.773191  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:01.773852  9047 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:01.773713  9123 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:01.774168  9047 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:01.774878  9047 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:01.775882  9047 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:01.781714  9123 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:01.782763 10494 raft_consensus.cc:979] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:01.783442 10494 raft_consensus.cc:1067] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:01.783552  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:01.784423 10494 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:01.781883  9047 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:01.784917 10494 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:01.785430  8970 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:01.786052  9123 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:43:01.785940 10494 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:01.786648  9123 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:01.787021  9123 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
W20260925 16:43:01.792104  8941 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 92fef1a775d54176ae0a3f7d209be2bf. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:43:01.794754  9117 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:01.795603  9123 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:01.796221 10534 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:01.797569  9123 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:01.797910  9047 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:01.798871  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:01.799310  9698 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:01.799155 10494 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:01.802750  8869 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:01.807576  9698 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:01.808813  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:01.809623 10483 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:01.810045 10483 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:01.810797 10483 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:01.817341  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:01.818120  8966 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:01.818531  8966 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:01.819435  8966 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:01.821372 10535 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:01.824762  9047 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:01.830330  8966 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:01.840080  9123 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:01.856438  8966 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:01.859050  9047 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:01.873107  8871 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:01.876384  8870 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:02.035609  9016 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a3daaf3df10a402a9f2af4eae42e46da. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:43:02.042008  9123 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:02.045725 10553 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.118494  8975 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:02.147857 10374 raft_consensus.cc:979] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:02.148669 10553 raft_consensus.cc:1067] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:02.151679  9117 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:02.152302  9117 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:02.152616  9117 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:02.165232 10374 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.169023  9117 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.169934 10374 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.172855  9117 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:02.173336  9120 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.174470  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:02.174995  9701 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:02.175125  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:02.175733  9042 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:02.176007  9042 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:02.176636  9042 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.177752  9042 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:02.180891  9701 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:02.182081  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:02.183065 10567 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:02.183516 10567 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:02.184676 10567 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.196378  8871 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.198346  9042 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:02.205137  9121 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:02.207646  9120 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:02.210832 10569 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.233701  8972 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:02.235498 10574 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:02.259505  9701 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:02.262002 10567 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:02.318403  8968 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.336606  9042 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:02.338519 10569 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260925 16:43:02.353130  9090 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f750a9cc810645b19ac831fe20c1010e. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:43:02.353324  9043 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:02.355374 10574 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.362202  8972 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:02.364499 10574 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.379655 10584 ts_tablet_manager.cc:927] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:43:02.363158  8869 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:02.406793 10574 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.413878  9043 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.420639  8972 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.436287 10584 tablet_copy_client.cc:316] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:43:02.439054  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet 92fef1a775d54176ae0a3f7d209be2bf from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:43:02.439575  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet 92fef1a775d54176ae0a3f7d209be2bf from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-92fef1a775d54176ae0a3f7d209be2bf
I20260925 16:43:02.450349  8870 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:02.453780  8985 tablet_copy_source_session.cc:205] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:43:02.455556  9047 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:02.466374 10584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 92fef1a775d54176ae0a3f7d209be2bf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:43:02.483040  9016 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d89e555296ed40ef8f9abed67a87bde9. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:43:02.484777  9121 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:02.486184 10553 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.490356  8972 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260925 16:43:02.492599 10374 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:02.494462 10584 tablet_copy_client.cc:791] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:43:02.495049 10584 tablet_copy_client.cc:655] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:43:02.499027 10584 tablet_copy_client.cc:531] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:43:02.500509 10374 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.579459 10584 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:43:02.612447 10584 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:43:02.613533 10584 tablet_bootstrap.cc:492] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:43:02.614219 10584 ts_tablet_manager.cc:1397] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.035s	user 0.022s	sys 0.011s
I20260925 16:43:02.616307 10594 ts_tablet_manager.cc:927] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:02.617738 10584 raft_consensus.cc:348] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:02.618590 10584 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:43:02.619212 10584 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:02.619285  9120 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.625787 10584 ts_tablet_manager.cc:1428] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260925 16:43:02.636237  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-92fef1a775d54176ae0a3f7d209be2bf received from {username='slave'} at 127.0.0.1:41948
I20260925 16:43:02.636657  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-92fef1a775d54176ae0a3f7d209be2bf on tablet 92fef1a775d54176ae0a3f7d209be2bf with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:02.646994  8968 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:02.603890  8869 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 2, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:02.680774  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68992.2us
I20260925 16:43:02.685529  9043 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:02.691496 10483 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260925 16:43:02.702965  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67149.2us
I20260925 16:43:02.722613 10594 tablet_copy_client.cc:316] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:43:02.724244  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet a3daaf3df10a402a9f2af4eae42e46da from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:43:02.724758  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet a3daaf3df10a402a9f2af4eae42e46da from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-a3daaf3df10a402a9f2af4eae42e46da
I20260925 16:43:02.736506  9059 tablet_copy_source_session.cc:205] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:43:02.746574 10594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a3daaf3df10a402a9f2af4eae42e46da. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:43:02.752050  9697 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:02.757498 10597 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:02.768158  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:02.790331 10594 tablet_copy_client.cc:791] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:43:02.790894 10594 tablet_copy_client.cc:655] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:43:02.794833 10594 tablet_copy_client.cc:531] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:43:02.803815 10594 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:43:02.824239 10594 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:43:02.825024 10594 tablet_bootstrap.cc:492] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:43:02.826042 10594 ts_tablet_manager.cc:1397] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.022s	user 0.019s	sys 0.006s
I20260925 16:43:02.826120  9120 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:02.827345  9120 raft_consensus.cc:595] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:02.829720 10594 raft_consensus.cc:348] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:02.831099 10594 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:43:02.831480  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:02.832377  8966 raft_consensus.cc:595] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:02.831707 10594 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:02.834592  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:43:02.835750 10594 ts_tablet_manager.cc:1428] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260925 16:43:02.837808  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a3daaf3df10a402a9f2af4eae42e46da received from {username='slave'} at 127.0.0.1:43114
I20260925 16:43:02.838181  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-a3daaf3df10a402a9f2af4eae42e46da on tablet a3daaf3df10a402a9f2af4eae42e46da with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:02.838872  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:02.839677  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:02.877241 10566 raft_consensus.cc:979] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:02.877699 10566 raft_consensus.cc:1067] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:02.879273  8966 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:49998
I20260925 16:43:02.879890  8966 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:02.880564  8966 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:02.888839  8966 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.891675  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:02.891819  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:02.892242  9123 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:02.892359  9701 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:02.892587  9123 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:02.893280  9123 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.896991 10594 ts_tablet_manager.cc:927] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:02.902698  9697 raft_consensus.cc:1203] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:43:02.895113  9123 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:02.908742  9701 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:02.909508  8966 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:02.911453 10594 tablet_copy_client.cc:316] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:43:02.914992  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet f750a9cc810645b19ac831fe20c1010e from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:43:02.915196  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:02.915539  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet f750a9cc810645b19ac831fe20c1010e from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-f750a9cc810645b19ac831fe20c1010e
I20260925 16:43:02.916208 10570 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:02.916601 10570 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:02.917239 10570 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.917899  9123 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:02.923594  9134 tablet_copy_source_session.cc:205] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:43:02.930267 10594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f750a9cc810645b19ac831fe20c1010e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:43:02.932225  8870 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:02.941517 10569 raft_consensus.cc:979] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:02.941955 10569 raft_consensus.cc:1067] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:02.943555  9043 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:43:02.944108  9043 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:02.944440  9043 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:02.951026 10594 tablet_copy_client.cc:791] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:43:02.951870 10594 tablet_copy_client.cc:655] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:43:02.953742  9043 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.955371 10594 tablet_copy_client.cc:531] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:43:02.956547  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:02.956547  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:02.957243  9701 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:02.957267  8968 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:02.959444  8968 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:02.960111  8968 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.961086  8968 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:02.964982 10594 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:43:02.967808  9701 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:02.968781  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:02.969651 10553 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:02.970070 10553 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:02.971216  8968 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:02.971282 10553 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:02.957100  9043 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:02.983050  8870 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:03.005149 10594 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:43:03.005956 10594 tablet_bootstrap.cc:492] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:43:03.009996 10594 ts_tablet_manager.cc:1397] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.045s	user 0.025s	sys 0.009s
I20260925 16:43:03.010414 10584 ts_tablet_manager.cc:927] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:03.012094 10584 tablet_copy_client.cc:316] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:43:03.012729 10594 raft_consensus.cc:348] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:03.013571  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet d89e555296ed40ef8f9abed67a87bde9 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:43:03.013662 10594 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:43:03.014114  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet d89e555296ed40ef8f9abed67a87bde9 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-d89e555296ed40ef8f9abed67a87bde9
I20260925 16:43:03.014374 10594 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:03.017357 10594 ts_tablet_manager.cc:1428] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260925 16:43:03.020336  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-f750a9cc810645b19ac831fe20c1010e received from {username='slave'} at 127.0.0.1:43572
I20260925 16:43:03.020706  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-f750a9cc810645b19ac831fe20c1010e on tablet f750a9cc810645b19ac831fe20c1010e with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:03.028213  9059 tablet_copy_source_session.cc:205] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:43:03.031179 10584 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d89e555296ed40ef8f9abed67a87bde9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:43:03.045444 10584 tablet_copy_client.cc:791] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:43:03.045962 10584 tablet_copy_client.cc:655] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:43:03.049842 10584 tablet_copy_client.cc:531] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:43:03.058287 10584 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:43:03.066448  9701 raft_consensus.cc:1203] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:43:03.081665 10584 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:43:03.082545 10584 tablet_bootstrap.cc:492] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:43:03.083209 10584 ts_tablet_manager.cc:1397] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.005s
I20260925 16:43:03.085537 10584 raft_consensus.cc:348] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:03.086254 10584 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:43:03.086869 10584 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:03.089620 10584 ts_tablet_manager.cc:1428] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.003s
I20260925 16:43:03.091441  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-d89e555296ed40ef8f9abed67a87bde9 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:43:03.091825  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-d89e555296ed40ef8f9abed67a87bde9 on tablet d89e555296ed40ef8f9abed67a87bde9 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:03.298578  9697 raft_consensus.cc:1203] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:43:03.352921  9120 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:03.355072 10569 raft_consensus.cc:1050] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:03.357398 10569 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.360953 10570 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:03.369951  9697 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.371052  9123 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.371354 10569 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:03.373172 10569 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.373891  9042 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.414258 10568 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.417258  9701 raft_consensus.cc:1203] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260925 16:43:03.446637 10571 raft_consensus.cc:1050] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:03.448752  8968 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:03.449092 10571 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.462678 10568 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.466657 10553 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:03.470171  9697 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:03.470945  9120 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.478515  9043 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.480222  9697 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.481009  9124 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.481508 10553 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.483999 10553 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.486009  9697 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.495666  9698 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:03.497133 10571 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:03.501592 10570 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:03.532593  8968 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.538856 10553 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:03.565948  8872 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.568790  9123 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.563231 10622 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.577592  8966 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.596000  9700 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.627573  8966 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.627859  8872 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:03.633200  9700 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:03.634366  9043 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:03.634495 10614 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:03.635509 10568 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:03.644775 10568 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.646204  9042 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.651137  9043 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.651932  9700 raft_consensus.cc:2932] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.658619  9698 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:03.659875 10553 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:03.668666  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 92fef1a775d54176ae0a3f7d209be2bf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:03.672151  9123 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:03.674854 10553 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:03.678377 10622 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.679946  9700 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.683672  8871 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.685598  9120 raft_consensus.cc:2932] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.707891  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet a3daaf3df10a402a9f2af4eae42e46da with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:03.711686  8869 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 3 to 4, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.728579  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet 92fef1a775d54176ae0a3f7d209be2bf with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:43:03.732343  8960 tablet_service.cc:1514] Processing DeleteTablet for tablet a3daaf3df10a402a9f2af4eae42e46da with delete_type TABLET_DATA_TOMBSTONED (TS 225d3432101a4758bb9a6b0efeae09c5 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:49990
I20260925 16:43:03.736019 10633 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:43:03.740590 10633 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:03.737079 10634 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:43:03.741976 10633 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:03.743362 10634 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:03.744220 10634 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:03.745620 10633 ts_tablet_manager.cc:1905] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:03.749527 10634 ts_tablet_manager.cc:1905] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:03.762125 10633 ts_tablet_manager.cc:1918] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:43:03.762555 10633 log.cc:1196] T 92fef1a775d54176ae0a3f7d209be2bf P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/92fef1a775d54176ae0a3f7d209be2bf
I20260925 16:43:03.765715  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet 92fef1a775d54176ae0a3f7d209be2bf (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:03.768774 10634 ts_tablet_manager.cc:1918] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:43:03.769174 10634 log.cc:1196] T a3daaf3df10a402a9f2af4eae42e46da P 225d3432101a4758bb9a6b0efeae09c5: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/wals/a3daaf3df10a402a9f2af4eae42e46da
I20260925 16:43:03.770677  8859 catalog_manager.cc:4841] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): tablet a3daaf3df10a402a9f2af4eae42e46da (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:03.800470 10566 raft_consensus.cc:1050] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:03.802729 10566 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.809556  9043 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.809710  9700 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.811378 10596 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:03.813186 10596 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.822448 10596 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.823668  8971 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.830443  9043 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.831847 10636 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.833856  9700 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.846490  8872 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:03.857561  8971 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.883867 10622 raft_consensus.cc:1050] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:03.885823 10622 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.890911  9123 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.890915  9700 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.892387  8971 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260925 16:43:03.892372 10622 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:03.893324 10571 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.894223 10553 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:03.901891  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:03.908206 10553 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.910193  9123 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.913879  8971 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.936343  8871 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.929558  9700 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.970121  9043 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:03.972038  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:03.972626  8966 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:03.975109  9123 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:03.975654  9123 raft_consensus.cc:595] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:03.976989  9700 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:03.978407  8966 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:03.978464 10553 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:43:03.983850 10571 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:03.985244 10373 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.989060  9700 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.992677  8966 raft_consensus.cc:2932] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:03.995389  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:03.995930  9043 raft_consensus.cc:595] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:04.000715  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260925 16:43:04.002166  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet d89e555296ed40ef8f9abed67a87bde9 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:04.005676  8872 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 3 to 4, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 1 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:04.007491  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:04.008138  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:04.008844 10596 raft_consensus.cc:979] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:43:04.009373 10596 raft_consensus.cc:1067] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:43:04.010556 10553 raft_consensus.cc:979] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:04.011721  9701 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42240
I20260925 16:43:04.012058 10553 raft_consensus.cc:1067] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:04.012390  9701 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:04.012738  9701 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:04.016003  9120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:04.017546  9120 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:04.017923  9120 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:04.027324  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet d89e555296ed40ef8f9abed67a87bde9 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:45942
I20260925 16:43:04.028216 10633 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:43:04.029188 10633 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:04.029757 10633 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:04.032560  9120 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.032701  9701 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.035303  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:04.035517  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:04.035851  9698 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:04.036303  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:04.036809  9043 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:04.038211  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:04.038748  9042 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:04.039041  9042 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:04.039419 10633 ts_tablet_manager.cc:1905] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:04.039721  9042 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.040753  9042 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:04.042162  9698 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:04.043474  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:04.044178 10596 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:04.036087  9123 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:04.045166  9120 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:04.045430 10596 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:04.045181  9123 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:04.046825  9123 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.046401 10596 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.047926  9123 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:04.049731  9701 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:04.050000  9043 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:04.051129  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:04.053054 10471 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:04.053495 10471 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:04.052263  8871 catalog_manager.cc:5042] ChangeConfig:REMOVE_PEER RPC for tablet d89e555296ed40ef8f9abed67a87bde9 with cas_config_opid_index 3: aborting the task: latest config opid_index 4; task opid_index 3
I20260925 16:43:04.054222 10471 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.054350  9042 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:04.067457  9123 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:04.070525  8871 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 3 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:04.081856  8870 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:04.090837 10633 ts_tablet_manager.cc:1918] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:43:04.091271 10633 log.cc:1196] T d89e555296ed40ef8f9abed67a87bde9 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/d89e555296ed40ef8f9abed67a87bde9
I20260925 16:43:04.093053  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet d89e555296ed40ef8f9abed67a87bde9 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:04.174044 10614 raft_consensus.cc:979] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:04.174544 10569 raft_consensus.cc:1067] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:43:04.175782  9043 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:43:04.176205  9043 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:04.176486  9043 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:04.182673  9043 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:04.184434  9043 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:04.184717  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:04.184929  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:04.185461  8966 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:04.185474  9124 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:04.185839  8966 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:04.186591  8966 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:04.187551  8966 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:04.191514  9124 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:04.192467  8966 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:04.192576  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:04.193265 10373 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:04.193665 10373 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:04.194337 10373 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:04.203048  8871 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 3, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:04.470700  9124 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:04.477258  9701 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:04.478434  8968 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260925 16:43:04.479805 10636 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:04.480521 10566 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:04.487674 10636 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:04.489040  8968 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:04.494755  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet f750a9cc810645b19ac831fe20c1010e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:43:04.500610  9700 raft_consensus.cc:2932] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:04.504493  8871 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, VOTER 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) evicted. New cstate: current_term: 1 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:04.512661  9032 tablet_service.cc:1514] Processing DeleteTablet for tablet f750a9cc810645b19ac831fe20c1010e with delete_type TABLET_DATA_TOMBSTONED (TS 8dc3391062084f45a6ba62d28d340722 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:55034
I20260925 16:43:04.514019 10648 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:43:04.515012 10648 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:43:04.515743 10648 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:43:04.518349 10648 ts_tablet_manager.cc:1905] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:43:04.534643 10648 ts_tablet_manager.cc:1918] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260925 16:43:04.534941 10648 log.cc:1196] T f750a9cc810645b19ac831fe20c1010e P 8dc3391062084f45a6ba62d28d340722: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/wals/f750a9cc810645b19ac831fe20c1010e
I20260925 16:43:04.536142  8859 catalog_manager.cc:4841] TS 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): tablet f750a9cc810645b19ac831fe20c1010e (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:43:04.576365  9700 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:04.578408 10636 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:04.584791  8968 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:04.586392 10571 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260925 16:43:04.600591  9123 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:04.601749 10553 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:04.606777  9124 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:04.614100  9042 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:04.614463 10600 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:04.615717 10471 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:04.679309  9043 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:04.690778 10658 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260925 16:43:05.138170  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:05.176271  9123 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:05.176880  9123 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:05.182996  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:05.183655  9047 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:05.184737  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:43:05.186031  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:05.186507  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:06.879865 10672 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:06.880575 10672 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:06.882809 10672 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:06.889048 10674 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:06.889883 10674 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:06.890839 10673 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:06.891328 10673 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:06.892612 10674 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:06.893254 10673 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:06.895210 10673 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:06.895777 10673 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:06.898208 10673 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:06.898860 10673 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:06.899515 10673 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:06.901938 10673 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:06.899991 10674 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:06.902456 10678 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:06.902670 10674 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:06.904611 10678 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:06.905920 10674 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:06.904067 10673 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:06.907601 10678 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:06.908306 10673 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:06.907827 10672 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:06.935626 10672 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:06.941831 10672 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:06.911029 10673 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:06.988961  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.524s	user 0.008s	sys 0.021s
W20260925 16:43:06.989478  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.525s	user 0.009s	sys 0.021s
I20260925 16:43:07.294646 10679 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.295607 10679 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.297860 10679 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:07.298252 10679 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.298588 10679 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.340605  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:43:07.416277  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.004s	sys 0.005s
W20260925 16:43:07.416988  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.004s	sys 0.005s
I20260925 16:43:07.516731 10679 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.517717 10679 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.513384 10677 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.534571 10677 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.518575 10679 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.519918 10676 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:07.545568  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.005s	sys 0.009s
I20260925 16:43:07.548761 10682 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.550223 10682 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.553694 10682 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.554857 10683 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.561699 10676 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.613250 10683 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.616043 10676 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.566103 10675 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.616427 10683 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.617157 10675 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.618228 10682 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.619123 10682 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.569329 10677 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.620417 10677 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.620870 10675 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.571521 10679 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:07.547143  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.006s	sys 0.009s
I20260925 16:43:07.621248 10677 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.625245 10677 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.628222 10679 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.630357 10679 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.632682 10688 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.628582 10676 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.633981 10675 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.633687 10688 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.633725 10676 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.636317 10679 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:07.634654 10675 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.645555 10681 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.648656 10687 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.649717 10687 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.652771 10687 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.646608 10681 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.654781 10687 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.660286 10677 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.768357 10681 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.770017 10687 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.772482 10687 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.774988 10682 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.753643 10679 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.776165 10688 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.776677 10679 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.787905 10677 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.790572 10682 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.791268 10682 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.791895 10675 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.776185 10676 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.779660 10679 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.793282 10682 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.794582 10676 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.794530 10683 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.790584 10677 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.795449 10676 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.797847 10690 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.779953 10689 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.798642 10690 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.801847 10690 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.798801 10689 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.811672 10675 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.796906 10688 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.811124 10679 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.848011 10688 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.812389 10675 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.816598 10676 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.803848 10683 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.859445 10677 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.859823 10688 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.860237 10677 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.849785 10690 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.862480 10690 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.862985 10677 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.864547 10690 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.865106 10679 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.867204 10679 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.841435 10680 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.868434 10689 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:07.889274 10689 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.889407 10691 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.868696 10680 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.885349 10676 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.886498 10688 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.892274 10679 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.904106 10687 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.904909 10691 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.909085 10679 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.909242 10687 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.910559 10691 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.911149 10679 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.904371 10686 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.904042 10676 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.911742 10687 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.905284 10675 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:07.912465  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.448s	user 0.027s	sys 0.014s
I20260925 16:43:07.914992 10704 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.915215 10684 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.916368 10704 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.917503 10693 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.917773 10692 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.918195 10693 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.918730 10692 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.916179 10684 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.920598 10693 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.921693 10692 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.921816 10684 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.922166 10693 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.922465 10684 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.922793 10693 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.919545 10704 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.924755 10704 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.924932 10693 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.925444 10693 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.922410 10692 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.926266 10692 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.923233 10684 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.911825 10686 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.932420 10676 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.933784 10686 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.934362 10696 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.926080 10693 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.925412 10704 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:07.936739  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.473s	user 0.028s	sys 0.014s
I20260925 16:43:07.901542 10681 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.948318 10681 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.948992 10680 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.950721 10681 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.942602 10687 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.952471 10687 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.952858 10702 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.935047 10696 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.899910 10689 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.937572 10692 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.955791 10676 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.953460 10702 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.937949 10684 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.968770 10683 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.968571 10676 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.939571 10691 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.964308 10675 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:07.970387 10696 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:07.979951 10691 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.980937 10687 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.986609 10675 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.989732 10694 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.990270 10682 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.990746 10677 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:07.991259 10695 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:07.992916 10689 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.993295 10686 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.995023 10679 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.998327 10702 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.964346 10688 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:07.992920 10676 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:07.997999 10695 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:07.999022 10690 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:07.997217 10684 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.110436 10658 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.092629 10683 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.293560 10692 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.006903 10702 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.004099 10687 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.307015 10693 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.017318 10686 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.307624 10693 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.088466 10703 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.308259 10693 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.309445 10688 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.291944 10697 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.310392 10693 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.293864 10658 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.292325 10706 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.110718 10708 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.291841 10710 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.018888 10699 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.076896 10596 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.294210 10692 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.298128 10702 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.339306 10715 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.339468  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.007685 10676 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.020535 10566 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.285163 10704 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.323390  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "088ac48c62d34a40b53987746a70b871"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:08.017220 10677 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.332293  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.347488  9045 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.332078  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.333519  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.348850  9049 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.076339 10701 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.228376 10700 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.350291  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.350929  9049 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.105875 10665 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:08.017740  9723 debug-util.cc:398] Leaking SignalData structure 0x7b0800288aa0 after lost signal to thread 7806
I20260925 16:43:08.090742 10685 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.339987 10715 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.358047 10685 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.359525 10715 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.360208 10685 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.335180 10706 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.294097 10683 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.335839 10693 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.364930 10693 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.365597 10692 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.291616 10668 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.016987 10682 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.328423 10675 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.340219  9046 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.345633 10702 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.368310 10668 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.345355 10676 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.345794  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.322949 10703 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.334407  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.346375 10664 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.012079 10679 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.349520 10701 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.113960 10694 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.351166  9047 raft_consensus.cc:595] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:08.298513 10684 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.353332 10596 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.346215 10566 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.360805  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.078619 10696 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.310318 10697 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.350479 10700 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.353237 10699 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.356576 10708 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.167507 10666 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.344468 10690 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.357569 10687 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.589087  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.587320  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.615419  9045 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.589238  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.619920  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.620538  9700 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
W20260925 16:43:08.619933  9014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.195:32851 timed out after 1.695s (SENT)
I20260925 16:43:08.621825 10668 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.622097 10706 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.623347 10668 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.624348 10717 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.644018 10717 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.647219 10717 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.647882 10717 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.648593 10717 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.624737 10691 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.624890 10713 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.592587 10693 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.453331 10682 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.642998 10668 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:08.629644  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08001d80e0 after lost signal to thread 8907
I20260925 16:43:08.397505 10676 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.388468 10683 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.403198 10658 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.567807  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.631812  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.380402 10710 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.632722  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.634207  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.634865 10664 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.635933  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.636004  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.637102  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.374534  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.637606  9041 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:08.593058  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.459622  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.651902  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.628640  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.651649  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:08.663242  9723 debug-util.cc:398] Leaking SignalData structure 0x7b0800330d80 after lost signal to thread 8999
I20260925 16:43:08.667793 10710 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.667742  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.668948  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.669584  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.535416 10709 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.638815  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.660778  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.672168  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.436264 10703 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.667212  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.671525  8968 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:08.672991  9700 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:08.683053  9042 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:08.656376 10695 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.657274 10713 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.677335  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.677460  9049 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.676527  9050 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.679070  9046 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.679176  9695 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:08.679553  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.675838 10717 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.680372  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.687223  9044 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.686148  9043 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:08.695799 10664 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.689666  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.664141 10696 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.698643 10668 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.690032 10713 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:08.695417  9723 debug-util.cc:398] Leaking SignalData structure 0x7b080030d260 after lost signal to thread 9074
I20260925 16:43:08.688292  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.699472 10696 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.699910 10723 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:08.704574  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08001d2a40 after lost signal to thread 9148
I20260925 16:43:08.707163  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.708670 10683 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:08.710618 10566 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.710788 10683 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.711360 10683 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.712746  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.711529 10596 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.716295 10687 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.714089 10686 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
W20260925 16:43:08.717927  9723 debug-util.cc:398] Leaking SignalData structure 0x7b0800311120 after lost signal to thread 9726
I20260925 16:43:08.719518  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.719906  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.720115  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.722844  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.723762  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.724020  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.724849  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.725049  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.723764  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.726393  9698 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:08.727257  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.727892  9696 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:08.728011  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.730852  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.732908  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.709272 10677 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.460505 10665 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.735332  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.732558 10710 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:08.736976  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.737141 10724 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.737385 10679 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.737629  8971 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:08.739404  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.730662 10687 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:08.742022 10700 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.744738  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.746325  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.681320 10666 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.744607 10596 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.737709 10724 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.747956 10691 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:08.743664 10702 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:08.756577 10691 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.757114 10691 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.757652  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.758038  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.758278  8975 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:08.758538  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.750145  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.753149 10690 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.740854 10703 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:08.761420 10701 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.762056  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.753197  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.754202  8971 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:08.736974 10710 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.704500 10723 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.756642 10702 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.740885 10687 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.775429  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.775961 10687 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.777045  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.777367 10694 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.764072  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.778036  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.778750  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.762216  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.766356 10721 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.765062 10693 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.780027  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.780294  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.780517 10693 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.767108  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.780735  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.780961 10693 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.767884  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.768141  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.768668  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.768803 10710 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.768888  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.770000  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.770252  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.771775 10697 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.771127 10596 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.774118  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.775477 10700 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.775569 10702 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.765002  9697 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:08.782281  8967 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:08.786206  8966 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:08.760950 10703 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.797793 10596 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.798188 10700 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.800150  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.799047  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.801172  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.803093  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.780287 10721 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.807791  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.808336  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.795193 10694 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.713171 10709 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.764653 10683 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.808950  9042 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:08.808490  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.793623 10703 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.810228  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.817298  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.814862  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.817631  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.818200  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.818797  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.792728  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.796236 10684 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.810155  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.819721  9702 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:08.810591 10695 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.810629 10685 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:08.808950 10699 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.820492  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.795384 10701 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.841758 10700 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.841327 10701 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.844125 10701 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.807127 10708 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:08.831476 10687 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.846004  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.846767 10686 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.847093 10686 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.847519 10687 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.848133  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.828079 10684 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.832439  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.822878 10724 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.832580 10685 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.852766 10685 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:08.824354 10695 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.813971 10694 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.833647  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.810519 10664 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.839942  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.840701 10721 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.852094 10684 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:08.857450 10695 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.858352 10690 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.856639 10686 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.859334  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.861430  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:08.874416  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.883204 10690 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.899366 10690 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.895360  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.895586  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.874470 10684 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.861800 10694 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.915091  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:08.915959 10727 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.916311 10668 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.916600 10727 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.916911 10668 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.917795 10726 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.918200 10729 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.918354 10726 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:08.918237  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.918802 10729 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:08.859720  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48440.3us
I20260925 16:43:08.925660  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.925648 10664 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.925045  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.927789 10724 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.948307 10724 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.949378 10699 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:08.949772 10699 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.950126 10699 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:08.950377 10724 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:08.951087  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 89757.1us
I20260925 16:43:08.952948 10701 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.954023 10665 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.953938  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.954332 10701 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.955385 10668 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.956069 10691 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:08.967007  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.966189  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.960583  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:08.957958 10691 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.965827  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.980165 10724 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:08.966589  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.965133 10701 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.964745  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:08.987613  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:08.987737  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48768.8us
I20260925 16:43:08.987649  9123 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:08.989352  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.989765  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:08.990818  8974 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:08.992409 10726 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:08.963789 10721 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:08.992581  9697 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:08.996130  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:08.996429 10664 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.994328  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.973636 10683 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:08.994308  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:08.995297  9123 raft_consensus.cc:595] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:08.985713 10668 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:08.971907 10665 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:09.004381  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:09.005983  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:08.994174 10724 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.013237  9121 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:09.006255 10709 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.013728  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.014199  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.014997 10719 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.015909  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:09.015749 10719 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.027652  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.028086  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.028465  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:09.031448  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.032064  9124 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:09.032270 10709 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.032655 10709 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.033143 10709 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:08.990115 10691 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:09.062369  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:43:09.062860 10676 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.063845  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:09.064627 10691 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.064770 10676 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.065135 10691 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.065244 10676 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.065294  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:09.024369  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:09.063292  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59009.9us
I20260925 16:43:09.062197  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.069933  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.070056 10700 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:43:09.070175  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45874.6us
I20260925 16:43:09.070533 10700 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:09.070906 10700 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:09.067636  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:09.078058 10724 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.081435  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:09.090351  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.077526  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.021113 10721 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.133522  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.140758  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.141674  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.144716 10697 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.145084 10729 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.145115 10697 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.145776 10697 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.064136 10665 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.148991  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:09.144426  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 63083.1us
I20260925 16:43:09.064020 10666 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.150473  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.151558  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.152266 10721 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.152343  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.116456 10710 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.148502  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.153422  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.080045 10727 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.154894  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.154990 10710 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.155970  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:09.089462 10696 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.160117  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.132964  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.163686 10665 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.165232  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.165613 10700 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.161741 10699 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.184092  9123 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:09.172976  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.079510 10723 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.174721  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.185487  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:09.186534  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.162439 10676 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.188086  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:09.078281 10668 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.192875  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.095907 10684 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.195554  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.185750 10710 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.197691  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.198433  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.199355  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.200677  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.200855  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.167726 10696 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.201375  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.201843  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.173964  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.208163  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.190776 10683 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.209736  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.173748  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.197544 10710 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.215255  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.198053  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.207495  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.223783  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.224509  9117 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:09.240761  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.225970  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:09.225723  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.246585  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.246876  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.240072  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.248245  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:09.241127 10676 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.246876  9049 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:43:09.249624 10691 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.250110  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.253098  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.208140 10696 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.256284  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.257364  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.257786  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.222239 10710 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.263322 10668 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.264161 10699 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.212157 10683 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.195410 10702 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.211001  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.209300 10685 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.265201 10684 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.265408 10676 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:09.266216 10700 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.266891  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.257941  9121 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:09.267576  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.267956  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.344535  9042 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.269979  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.333048  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.251402 10682 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.336097  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.336397  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.338052  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.335865 10683 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.339061  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:09.339016  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63891us
I20260925 16:43:09.335547  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.214474 10719 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.340682  9049 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.222332  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:09.328549  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.347721  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.348937  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.258351 10709 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.354631  8970 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:09.355813  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.359148  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.336962 10690 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.349344 10682 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.368577  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.349043  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.372694  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.372879  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.374320  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.377903  9124 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:09.377836  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.378564  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.379822  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.356585  9115 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:09.388747  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.364980  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.371161 10675 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.371121 10682 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.369992  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:09.398496  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 128382us
I20260925 16:43:09.401789  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.392783  9090 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.403736  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.372227  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.404515  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.406985  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.391577  9697 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.404532  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:09.412173  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:09.412787  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.415105  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.413543 10668 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260925 16:43:09.416424  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.417595 10727 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.419883  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.425119 10687 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:09.425334 10668 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.425565 10687 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.425786 10668 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.425981 10687 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.426669 10668 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.427735  8969 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:09.427913 10685 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.428402 10690 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.433434 10709 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.433991 10702 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.412241  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.434607  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.406045 10729 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.049s
I20260925 16:43:09.435668  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.522432  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:09.525521 10710 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:09.520107  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59251.7us
I20260925 16:43:09.436368  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.499157  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.442620  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:09.529366  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 86815.3us
I20260925 16:43:09.527004  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.473385  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.532372  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.532838 10730 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.413367 10719 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.476720  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.463936  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.461185  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.522468  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.543283  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.418044 10691 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.436997  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.546689  8972 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.546581  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.547082 10691 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.547250  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.548383  8975 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.550107  8974 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.551084  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.554934  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:09.482061 10703 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.656s	user 0.013s	sys 0.008s
W20260925 16:43:09.432145 10694 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.504s	user 0.003s	sys 0.007s
I20260925 16:43:09.552421  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:09.484452 10695 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.589s	user 0.010s	sys 0.009s
I20260925 16:43:09.553512  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.553781 10700 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.498167 10687 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.554527  8973 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.543203  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:09.483829 10693 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.702s	user 0.041s	sys 0.040s
I20260925 16:43:09.431198 10721 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.456161 10723 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.557741  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.580982  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:09.581557  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.490900 10697 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.558398 10703 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.554803 10668 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.587286  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.558413  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.458410 10709 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.101s
I20260925 16:43:09.560027 10727 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.576792 10691 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.561342  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.563956  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.564575  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.564962  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.566224  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.566955  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.561728  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.584883 10724 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:09.569486 10686 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.674s	user 0.013s	sys 0.026s
I20260925 16:43:09.569873 10694 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.571291 10683 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.572068  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.602223 10686 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.603030  9124 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:09.603571 10694 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.603865  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.604528  9050 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.573071  9117 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:43:09.589993 10665 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.574111  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.474323  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.575330 10695 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:09.576424  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63906.9us
I20260925 16:43:09.577448  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.578128  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.578320  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.557855  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.585675  8966 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.589928  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.562965  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.612697  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.568810 10682 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.613356  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.614506  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.615018 10682 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.594709  9115 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:09.615574  9702 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.587494 10703 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.596439  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.616398  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.617101  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.617552  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.617836  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.618254 10731 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.596755  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.597285  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.621519  9119 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:09.622087 10735 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.622455  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.623335 10697 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.572276  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.622469 10735 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.624693 10735 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.624642  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.597540  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.606173  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.605584  8969 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.606864  9696 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.608671  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.630699  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.630731 10686 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.593257 10736 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.623531  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.631819  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.603521 10683 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.632649  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.632988  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.633062  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.633744  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.633973  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.637964  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.638728  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.626035 10691 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.609897  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.619141  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.619429  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.620066  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.621585 10703 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.623255  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.646348  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.600160 10687 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.605541  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.627166  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.650643  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.651206 10729 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:09.651947  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.652470 10729 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.652740 10676 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.652801 10703 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:09.653411 10703 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:09.653499 10676 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:09.653806 10703 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:09.653946 10676 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:09.654366 10676 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.655802 10702 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.656178 10702 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:09.657114 10702 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.657455  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.658473 10675 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:09.631933 10736 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.658860 10675 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:09.659457 10675 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:09.643630  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62136.8us
I20260925 16:43:09.591173 10727 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.644487  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.581871 10693 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.626322  9115 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:09.663246  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.659317 10736 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.666558  9048 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.658833  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.667548  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.663198 10683 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:09.665750  8941 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: adae4a9dd16346529fe4ff004abc3603. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:43:09.666026 10727 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:09.665048  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 91089.2us
I20260925 16:43:09.668521  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.626219 10682 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.668891 10709 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.669029 10724 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.670598 10685 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.652853 10729 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.667675 10697 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.671268 10727 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.601575 10696 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.672989  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.673697  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.672194 10687 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.674636 10729 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.676437 10700 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.672060 10694 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260925 16:43:09.680187  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.677431  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.678133  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.647321 10691 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.650542 10686 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:09.658486 10702 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.681646  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.685513  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.700238 10731 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:09.702679  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.703424 10731 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.703831 10731 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.703974 10735 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.704627 10731 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.705761 10731 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.694355 10734 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260925 16:43:09.687897 10687 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.711848 10700 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.712018  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.711592  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.712435  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.713086 10697 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.713613  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.714545  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.697081 10729 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.693152 10730 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:09.684958 10710 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.717783 10734 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:09.715464 10682 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
I20260925 16:43:09.718259 10700 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.685104 10701 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:09.720168  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.707499  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.708318  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.691368 10736 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.703894 10691 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.687928 10693 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.715372  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.717121  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.715025 10683 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:09.697173  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.680953 10665 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.677977 10675 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.721329 10690 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.723493  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.721901  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.746646  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.718999 10739 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.725292 10735 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.725219  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.727156  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.726042  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.707091 10686 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:09.752966 10686 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.731411 10694 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.733129 10719 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.755383 10695 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.756644 10694 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.740303 10690 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.757339 10736 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.732431  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.681062 10685 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.039s
I20260925 16:43:09.758139 10690 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.736011  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.739010  9122 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:09.742909 10675 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.743378 10683 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.763474 10683 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.763888 10683 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.764585  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.739462 10691 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.770076 10708 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.770614 10708 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:09.759526 10690 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.771757 10708 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.773785 10708 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.757351 10676 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.745389  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.759569 10696 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.745987  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.724939 10734 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.777459 10734 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.777956  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.778355 10734 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.748718  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.779680  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.719766 10724 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.780119  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.780794 10734 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.756594 10682 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.781059  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.758427  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:09.731599  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50870.5us
I20260925 16:43:09.762666  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.759473 10685 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.744413  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.749243 10677 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.776399 10719 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.750550  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:09.791939  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47600.3us
I20260925 16:43:09.784001  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.785238  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:09.785447  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49555.7us
I20260925 16:43:09.785550 10697 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.783272  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.793390  8941 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.794466  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.795049  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.795650  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.783253 10694 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.788466 10703 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.789362  9118 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:09.803223  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.803920 10687 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.796371 10739 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.804559 10701 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.805172 10719 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.791728 10677 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.796730 10691 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.806344 10694 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:09.806785 10694 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.806438 10677 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.808060 10677 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.783473 10724 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.802271  9124 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:09.796911  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.803254  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.783592  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.774771 10686 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.811044  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.791131 10685 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:09.812460  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.812655  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.813299  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.811360 10724 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.815479 10709 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.816313  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.797060  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.792721 10675 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:09.817188  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.820025  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.821198 10721 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.821597 10683 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.816385 10729 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.821246 10687 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.823856 10701 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.821440 10727 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.824452 10683 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.826790  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.827543  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.821593 10675 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:09.828887 10675 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.829142  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.829994  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.830096 10740 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.831969  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.834180  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.828444  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.835093  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.836207  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.836701 10701 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:09.836742  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.831368 10727 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:09.837857  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.837747 10690 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:09.837877 10727 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:09.838912 10727 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.838929 10682 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.839675  9042 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 3: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:09.840265  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.841938  8974 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.839433 10682 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.843878  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:09.844002  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:09.844195 10682 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.844995  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.840950  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:09.817601 10702 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.845737  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.846634  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.848106  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.849663  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.849942  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.850685  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.851310  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.845472 10682 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.852090 10729 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.852293  8975 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.852177  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.853150 10719 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.853365  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.853721 10684 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.853672 10727 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.854362  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.854393 10724 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.854983 10727 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:09.855583  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.856568 10691 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.859243 10691 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.793123 10743 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.085s
I20260925 16:43:09.854466 10721 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.861058  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.831514 10685 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.861773 10691 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.862473 10685 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.863842  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.864590 10733 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.869094  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.870399  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.871455  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.872488  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.873610  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.869774 10701 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:09.875981 10695 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.876161 10691 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.876605 10683 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.876802 10740 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:09.877905 10701 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.878279 10701 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.880160  9043 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.880927 10682 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:09.881260  9050 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.882026 10682 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.882366 10682 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.871829  9042 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:09.884006 10685 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.883134 10682 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.885598 10682 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:09.893092  8967 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:09.893635  8973 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:09.895962  8972 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:09.900856 10675 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.902787 10675 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:09.902863 10719 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:09.904011 10739 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.904363 10739 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.904752 10730 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:41932 (request call id 13) took 1152 ms. Trace:
I20260925 16:43:09.905200 10739 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.911125  9045 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:09.916450  8966 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.916900  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:09.918200 10739 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.918747  8975 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.916317  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.840673 10703 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.920956  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.878991 10701 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.889954  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:09.924346  8971 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:09.924422 10676 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:09.925447  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.926919  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.928207  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.869812 10733 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.925853 10702 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260925 16:43:09.936326 10702 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:09.936662 10702 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:09.937145 10686 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:09.937424 10702 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.938169  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.938560 10702 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:09.938782  9122 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:09.939666  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.905104 10730 rpcz_store.cc:276] 0925 16:43:08.752146 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:08.752285 (+   139us) service_pool.cc:227] Handling call
0925 16:43:08.772999 (+ 20714us) log.cc:842] Serialized 506 byte log entry
0925 16:43:08.945124 (+172125us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18000de040. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:43:08.956065 (+ 10941us) spinlock_profiling.cc:243] Waited 18.1 ms on lock 0x7b18000de040. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bea4320 00007f719bf0a113 00007f719bf307e2 00007f71a0e6cf39
0925 16:43:09.904646 (+948581us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":67634,"raft.queue_time_us":113624,"raft.run_cpu_time_us":2196,"raft.run_wall_time_us":37406,"spinlock_wait_cycles":51338880,"thread_start_us":37921,"threads_started":1,"wal-append.queue_time_us":112163}
I20260925 16:43:09.940564  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.941756  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.942543  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:09.940693 10695 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:09.944077  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.940511  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.945581 10694 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:09.946566 10665 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:09.932590 10734 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.950238 10700 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:09.949962 10686 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:09.950600 10700 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:09.951107 10686 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:09.951493  9700 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.951786 10701 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.951398 10700 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.951457 10686 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:09.956310  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.960680  9122 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 3: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:09.962255  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.962682  9042 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:09.966871  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:09.967960 10742 ts_tablet_manager.cc:927] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:43:09.948668 10684 raft_consensus.cc:979] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:09.976367  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:09.977488  9048 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:09.949033 10677 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:09.955354  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.968494  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:09.983805  9120 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:09.954473 10695 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:09.969070 10700 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:09.981598 10743 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:09.983601 10732 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.034s
I20260925 16:43:09.988612  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:09.995450  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:09.997255 10695 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:09.999367  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.000294 10679 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:09.992254 10677 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.001924  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.003103  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.004248 10693 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:10.004869 10731 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:10.004773 10677 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.005260 10693 raft_consensus.cc:1067] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:09.980475 10675 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260925 16:43:10.005674 10731 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.006356 10703 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:10.006693 10703 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:10.015759  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.016722 10679 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.017745  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.019109 10679 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.023624 10703 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.025198  8971 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.022923  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.026654 10679 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.028034  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.029994 10679 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 16:43:10.030942  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48812.8us
I20260925 16:43:09.980952 10708 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.010s
I20260925 16:43:10.029675  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.037933  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.039647  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.040887  8971 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.041153 10708 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:10.041538 10708 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.042351 10743 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.027614  9119 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:10.030485 10666 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:10.036751 10684 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
W20260925 16:43:10.048555  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64518.2us
I20260925 16:43:09.986474 10686 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.052927 10749 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:10.039354 10690 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.042260 10708 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.050511 10679 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260925 16:43:10.050079 10684 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.061681 10666 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:10.061987  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:10.046515  8871 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:10.049154 10723 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260925 16:43:10.057974 10751 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:10.080241 10751 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.080749 10679 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.081147 10679 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.081346 10751 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.087478  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:10.087875  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:10.060858 10749 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:10.092057  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.098351  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.099817  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.101605  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.105261  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:10.107024  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:10.069926 10739 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260925 16:43:10.113624  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:10.115835  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:10.090924 10694 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:10.113783 10679 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.119457  9121 raft_consensus.cc:2362] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3. Re-sending same reply.
I20260925 16:43:10.097308 10749 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.105703 10682 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:10.102265 10677 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.105463 10731 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 16:43:10.133004  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79792.4us
I20260925 16:43:10.090226 10742 tablet_copy_client.cc:316] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.193:40071
I20260925 16:43:10.137146  8971 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.137439 10679 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.135104  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.139261 10731 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:10.140290 10731 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.140614 10731 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.141788 10731 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.143116 10731 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.149314  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:10.130820 10684 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.154304 10684 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
W20260925 16:43:10.156050  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 98645us
I20260925 16:43:10.135838 10682 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.174011  8985 tablet_copy_service.cc:140] P 225d3432101a4758bb9a6b0efeae09c5: Received BeginTabletCopySession request for tablet adae4a9dd16346529fe4ff004abc3603 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:41948)
I20260925 16:43:10.174556 10702 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.174643  8985 tablet_copy_service.cc:161] P 225d3432101a4758bb9a6b0efeae09c5: Beginning new tablet copy session on tablet adae4a9dd16346529fe4ff004abc3603 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:41948: session id = e3a3bc92ca0a4efa913eca1800a1550d-adae4a9dd16346529fe4ff004abc3603
I20260925 16:43:10.176257  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.177273 10686 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.177333  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.178404  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.178714 10708 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:10.180019  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:10.180670 10703 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.181236 10724 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.181587 10724 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:10.182358 10724 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.183993 10724 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.193950 10750 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.199395  8967 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.200606  9120 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:10.202757  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:10.192828 10694 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:10.213249  9117 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:10.213526  8975 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.214828  8985 tablet_copy_source_session.cc:205] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:43:10.215790 10729 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:10.216761 10729 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.217042 10729 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:10.217712 10729 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.218885 10729 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.219918  8966 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.193102 10702 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.224442  9119 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:10.225558 10701 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:10.225013  8872 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:10.230813 10755 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.231163 10755 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:43:10.232913  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54563.4us
I20260925 16:43:10.233284  8966 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:10.233521  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.234543  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.235528 10755 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.243361  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.243644 10702 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.241484 10668 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.246840 10668 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:10.238840 10679 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260925 16:43:10.246865 10702 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.250280 10682 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.247532 10747 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260925 16:43:10.251304 10682 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.239135 10709 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.250888  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.254153  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.251873 10747 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:10.268255 10747 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.268967 10747 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.260965 10709 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.270648 10747 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.254683 10702 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.266862  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.283583 10702 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:10.284019  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.254776 10742 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet adae4a9dd16346529fe4ff004abc3603. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:43:10.288152 10709 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.289839  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.267411 10682 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.291265 10682 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.292980 10702 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:10.247629 10668 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.307888 10668 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.315757 10755 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:10.118119 10748 consensus_queue.cc:1159] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 6 status { last_received { term: 5 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:43:10.334174 10751 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:10.343669  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53878us
I20260925 16:43:10.348440  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.349143 10709 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.349824 10709 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.350196  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.350909 10684 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.353621 10749 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.356817  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:10.357493  9048 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 2: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:10.374315  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 296437us
I20260925 16:43:10.378501  9116 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:59688
I20260925 16:43:10.379246  9116 raft_consensus.cc:595] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:10.379665  9116 raft_consensus.cc:603] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:10.389648  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.393368  9118 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:10.394408 10684 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.396201  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.397572  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.399003 10749 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:10.402956  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 301403us
I20260925 16:43:10.403949  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.405411  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.406791 10731 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.410598 10666 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:10.411001 10666 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:10.411835 10666 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:10.413779 10682 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.414063 10666 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.414266  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.416508  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.417069 10684 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.419447 10686 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:10.419895  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.419934 10686 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.418300 10749 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.419459 10684 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:10.421211 10684 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:10.421413  9700 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.421624 10684 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.421810 10677 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.421468 10686 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.430168  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:10.430531  9700 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.417423  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.432523  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.433532  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.440923  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:10.429957 10684 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.445371 10684 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:10.448730 10731 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.449432 10747 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:10.450078 10747 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.450878 10747 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.451308  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:10.450284 10748 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.452857  8966 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.455917 10751 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:10.456311 10682 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:10.456683 10682 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:10.457515 10682 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.457639 10751 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:10.459496  9048 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.465605  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.466558  9124 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:10.467307 10751 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:10.468068  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:10.467473  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.471369 10748 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:10.472361 10764 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:10.473945 10764 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.474601  9124 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "088ac48c62d34a40b53987746a70b871"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:10.478317  9124 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:10.478766  9124 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.483157  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:10.476378 10751 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:10.489151 10764 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.499655  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:10.500291  9048 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:10.500633  9048 raft_consensus.cc:603] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:10.501525 10751 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.503144 10751 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.472496 10731 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260925 16:43:10.506798  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.507243  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:10.524233 10732 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:10.531787  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:43:10.534252  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:10.534849  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:10.534065  9124 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.542290  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:10.542906  8975 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.543059  9124 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:10.543149  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:10.544186  9048 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:10.545274  9048 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.545596  9045 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:10.545964  9048 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.549142  9048 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.550496 10742 tablet_copy_client.cc:791] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:43:10.551142 10742 tablet_copy_client.cc:655] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:43:10.559633  8975 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:10.560719  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:10.561546 10666 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:10.561934  9048 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:10.562021 10666 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:10.564416 10666 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.559358  9118 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:10.573561  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:10.575347 10747 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:10.580382 10747 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:10.582808 10747 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:10.583983 10742 tablet_copy_client.cc:531] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:43:10.572026 10764 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260925 16:43:10.589368 10686 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:10.589771 10686 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.590590 10686 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.571573 10682 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.602697  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:10.603454  8966 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 2: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:10.606186 10686 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:10.618709 10682 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:10.620123  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:10.654083  8975 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.660367  8869 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:10.676934  8871 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:10.684748  8975 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.694936 10764 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260925 16:43:10.692209  9118 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:10.767887 10742 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:43:10.778661  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:43:10.768800  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 76029.8us
I20260925 16:43:10.780085 10731 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:10.781112 10731 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:10.782021 10731 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:10.823872  8872 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 3 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:10.840962  8872 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:10.879093  9118 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.880903 10731 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:10.877115  8870 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:10.889833  8870 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:10.892282  8870 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:10.908717  9048 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.910204 10764 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:10.922086  8871 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:10.940732  9048 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:10.942242 10764 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:10.945956 10742 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:43:10.953753 10742 tablet_bootstrap.cc:492] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:43:10.954134  9700 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:10.956732 10742 ts_tablet_manager.cc:1397] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.189s	user 0.040s	sys 0.024s
I20260925 16:43:10.960474 10742 raft_consensus.cc:348] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:10.962018  8975 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:10.968328  9697 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:10.972592 10742 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:43:10.972601 10666 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:10.973542 10742 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:10.974342 10708 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:10.976377 10742 ts_tablet_manager.cc:1428] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260925 16:43:10.976413  9124 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:10.983318 10686 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:10.984760  9048 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:10.989943  9124 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:10.990911  9700 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:10.991920  8985 tablet_copy_service.cc:342] P 225d3432101a4758bb9a6b0efeae09c5: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-adae4a9dd16346529fe4ff004abc3603 received from {username='slave'} at 127.0.0.1:41948
I20260925 16:43:10.993569  8985 tablet_copy_service.cc:433] P 225d3432101a4758bb9a6b0efeae09c5: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-adae4a9dd16346529fe4ff004abc3603 on tablet adae4a9dd16346529fe4ff004abc3603 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:10.991552 10732 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:10.995324 10732 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:10.992619 10723 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:10.999925  9118 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:11.001292 10708 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:11.111042 10732 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.111552 10732 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.113511 10732 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.114382  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.114986  8975 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:11.116036  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.116763 10693 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:11.117112 10693 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.117281  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.117893  9124 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:11.117460 10693 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.124112 10693 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.126623  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.127140  8975 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.127331  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:11.127915  9124 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.133523  8975 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:11.137153  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.138243 10747 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:11.138762 10747 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:11.139714 10747 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.141057  9124 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:11.144438  8975 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:11.145164  9119 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:11.146602 10732 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:11.149299 10732 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:11.142359 10693 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.184060 10686 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.183910  8872 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:11.184568 10686 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.186348 10686 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.187645  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.188541  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.189105  8975 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:11.190649  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:11.191777 10686 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.192153 10686 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.192485 10686 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.208415 10686 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.211129  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.211647  8966 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.215023  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.216573 10686 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.218209  8966 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.219254  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:11.220443 10686 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.228834  9119 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:11.232889 10749 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:11.237250 10747 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.237907 10747 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.250911  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.249907 10747 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.251541  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:11.252364  8975 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:11.252467  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.251757 10686 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:11.253813 10764 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.254104  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.253150  8966 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:11.254310 10764 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.254771 10731 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:11.255198 10747 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:11.255581 10747 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.255959 10747 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:11.256254 10764 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.256738 10786 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:11.257189 10786 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.258450  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.259016  8966 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:11.260280  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.260895  9045 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.261965  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.262984  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.264554  9048 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.263916  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.253846 10686 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.267263 10764 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.269189 10764 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.269767 10764 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.272720 10743 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:11.273104 10743 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:11.273231  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.273505 10743 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:11.273958  9700 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:11.275190 10786 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.281442 10731 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.287843 10731 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.290349  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.290915  8966 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:11.291549  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.291843  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.296962 10749 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.297346 10749 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.291227 10731 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.297684 10749 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.302135 10747 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.308315 10743 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.310904 10743 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.311868  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:11.312649  9700 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:11.315282  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.319322  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.319438  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:11.320173  8966 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:11.321889 10747 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.326876  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:11.327986  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:11.328686 10747 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:11.329445 10747 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:11.330461 10749 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.330382 10747 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.339206 10764 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.341526  9700 raft_consensus.cc:1203] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260925 16:43:11.343247  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.343847  8966 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.344594 10743 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:11.345068 10743 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.348070  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.347769 10743 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.348733  9045 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.350211  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.350488  9048 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.350965 10743 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:11.351468  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:11.352022 10731 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.352546 10786 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:11.352602 10731 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.353191 10786 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:11.353695  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.354525  8971 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.354166 10786 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.354983 10731 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.356016  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.356199  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.356739  9700 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:11.356043  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.357923  8967 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:11.359287  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:11.360319 10693 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.360939 10693 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.351332 10743 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:11.362324 10743 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:11.363382 10682 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.364019 10764 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.364532 10748 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.363461 10749 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.364691  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.365025 10748 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.365506  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.366021  9048 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.366962 10748 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.363099 10693 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.368017  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.368366  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.368366  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.368768  8967 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:11.369127  9045 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.368968  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.369591  8971 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.369218  8969 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:11.370996  9015 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:11.370957  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.371394  9015 leader_election.cc:401] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:11.372411 10731 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.372993 10731 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:11.363862 10682 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.374004 10731 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.374927 10682 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.376754 10693 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.379505 10786 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.379980 10786 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.381832 10786 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.382279 10666 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.382730 10666 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.383961 10723 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.383544 10743 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.384243  9048 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.384419 10723 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.386291 10723 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.386394 10743 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.389113  8871 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:11.390399  8966 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.392026 10743 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.392555 10743 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.392958 10666 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.394821 10743 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.395463 10693 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:11.399928  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.400249  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.400519  9050 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:11.400791  9042 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:11.401738  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.402391  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.403163 10723 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.403471 10723 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.403808 10723 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.404194  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.405057 10686 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.405360  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.405490 10686 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.405901  9050 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:11.407310 10686 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.408865 10786 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:11.409224 10786 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.409526 10786 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.410900  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.411518  9118 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:11.411639  9042 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.413667  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.414275  8966 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:11.413697  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.415084  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.390105  8873 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 3, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:11.415213  9124 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:11.415760 10786 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.416884  8975 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:11.416836  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.417872 10731 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.418340 10731 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:11.418557 10786 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.419176 10731 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.422842  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.423625  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.424410  9042 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.425036  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.425477  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.423672  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.427027  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:11.428932  9115 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.425884  9045 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.430241  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.430811  9048 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:11.431902  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.432885 10743 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:11.444552  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.445413  9042 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.431491 10786 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:43:11.447294  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 84357.3us
I20260925 16:43:11.439035 10686 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:11.461766  9042 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:11.469605  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:11.470321  9700 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:11.472465  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.449924 10686 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.448814 10786 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.478716 10812 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.479283 10812 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.481354 10812 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.481817 10812 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:11.482172 10812 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:11.482928 10812 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.493949  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.492314 10686 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:11.492041 10786 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:11.491923 10743 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:11.500056 10815 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.495584 10810 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.513489  8873 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:11.518002  8873 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:11.503772 10815 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.514780 10810 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.523099 10723 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.532270  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.533691  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.537515  8975 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:11.533960  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.539113  8966 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:11.529816 10815 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.540349  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.540624  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:11.540925  9050 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.541345 10818 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.541673 10818 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.541996 10818 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.531462 10723 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.531073 10810 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.526810 10743 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.547847  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.548439  8969 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.547538  9050 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:11.556618  8969 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:11.556864 10812 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.556391  8869 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:11.559394 10786 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.558298 10812 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.556761  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.564311 10810 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.528034  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.565245  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:11.565510 10810 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:11.534132  9115 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:11.566931 10724 raft_consensus.cc:2741] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260925 16:43:11.567145 10786 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.566510 10810 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.569391 10682 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.569723 10818 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.525074 10814 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.573438 10814 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.570533  9697 raft_consensus.cc:2354] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:11.575541 10814 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.573773 10812 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.577695  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:11.578310  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.578843  8966 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.581434  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.582420  9016 leader_election.cc:398] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:11.582754  9016 leader_election.cc:401] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:11.587400  8966 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:11.588948  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:11.592721 10814 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.593302 10764 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.593480  9119 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:11.593978 10724 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.593708 10814 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.593755 10764 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.594527 10724 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:11.578812  9115 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:11.595414 10724 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.595672 10764 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.598379 10814 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.608237 10693 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.610177 10693 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.611510  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.612228  8969 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:11.612902 10812 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.612774  8869 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:11.613327 10812 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.614436  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.614367  8869 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 5, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:11.615585 10708 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.615213  9119 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:11.617093  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.619323 10764 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.619503  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.615582 10812 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.620151  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:11.618089 10682 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.620965  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.621527  8975 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.621256 10686 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.622543 10708 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:11.623375  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.623980  9050 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.619750 10764 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.624809 10764 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.624997 10814 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.625591 10814 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.627946 10818 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.628963 10814 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.631547 10686 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.631790  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.592375 10786 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.617141  9115 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:11.637099  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:11.639325  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.639554  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.639925  9042 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:11.640316  8975 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.641486  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.642031  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.641820 10786 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.643802  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.646257  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.646507  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:11.649932  9042 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
W20260925 16:43:11.650373  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 128629us
I20260925 16:43:11.651600  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:11.639349  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.652362  8966 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:11.655295  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:11.666596  9050 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.645036 10748 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:11.654075 10682 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.653551 10812 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.654891 10731 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:11.651386 10693 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.655992 10814 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.671103 10743 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:11.671440 10748 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.686635  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.687341  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.688298  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:11.688282 10825 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.672879  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.680284 10812 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.694422  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.695916  9043 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.689724 10825 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.689731 10685 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.696842 10685 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.697145 10685 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.697310  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.697950  9046 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.698984  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.699602  9041 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:11.692235  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.700335  9050 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.692358  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.698027 10825 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.703918  9042 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:11.693737  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.704990  9045 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:11.705570  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:11.684437 10814 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.716924  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.732466  9124 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.733793  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.686439 10748 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.736284 10814 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.743666 10814 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.686358 10682 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:11.711730  9050 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:11.708552  9697 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:11.695369 10747 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.754138  9042 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:11.754796 10805 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.755215 10805 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.755076  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:11.756208 10815 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:11.756531 10815 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.756846 10815 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:11.707517 10812 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.753960 10747 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.709968 10808 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.764122 10808 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.765024 10764 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.765998 10747 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.766845 10764 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.755548 10805 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.770622 10686 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:11.771126 10686 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.773046 10686 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.773963 10682 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.775077 10748 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.775802  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.779194  9124 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:11.693367 10743 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:11.800063 10743 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.776629  9119 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.804543  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.805380 10824 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:11.781622  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.766180 10808 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.793989 10830 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.796008  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.797324  8967 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:11.806442  9050 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.797369  8971 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:11.797556  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.798141  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:11.798782  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:11.782315  9045 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:11.809808  8974 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:11.808223  8966 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:11.810287  9045 raft_consensus.cc:595] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:11.813087  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.805728 10824 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:11.751849 10786 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.790261 10686 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.837535  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.838505  9042 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 2: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:11.811518  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.839036 10731 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:11.844501  9050 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.849555  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.850400  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:11.828508  8969 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.828624 10824 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:11.860571  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.808320 10685 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.811635 10823 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260925 16:43:11.862541  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.848054 10818 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:11.853080  9115 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.859411  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:11.861662 10814 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.827876 10805 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.874727  8975 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:11.811674 10830 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.863813 10764 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:11.869346 10743 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:11.864619 10749 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.860452 10682 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260925 16:43:11.848400 10686 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.870718 10708 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:11.870867 10817 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:11.896436 10817 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.885352  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.896816 10817 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:11.891747 10830 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.883915 10743 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.897861 10743 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:11.891865  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 332606us
I20260925 16:43:11.884418 10749 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.900238 10749 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:11.884481 10748 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.893800 10805 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.894850  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.895963  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:11.901309  9121 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:11.902843 10708 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.903251 10708 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:11.887140 10837 raft_consensus.cc:979] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:11.903991 10837 raft_consensus.cc:1067] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:11.901924  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:11.904376 10686 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.905299 10764 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:11.900827 10685 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.917695  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:11.918337  9124 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:11.907724 10764 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.908291  9697 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:11.905988 10786 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.911741  9115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:11.911900  9121 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:11.880017 10693 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.034s
I20260925 16:43:11.879098 10731 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.928678  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:11.925050  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.930639  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.931347 10837 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:11.931852 10837 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:11.932001  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:11.932714  9694 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.932667 10837 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.936247  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.867731 10818 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.948135  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:11.939594  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.930634  9115 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:11.949266 10666 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:11.951340  9115 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:11.951581 10666 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.952096  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.952179  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.952775  9696 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:11.927188 10749 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.953557 10666 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:11.953711 10749 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.954061 10749 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.955420  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:11.956153  9050 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:11.956171  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:11.972533  9118 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.926685 10686 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:11.937018  9693 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:11.928695 10786 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:11.977123  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:11.982542  8969 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:11.984499 10812 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:11.986223  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:11.978228 10686 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.987430  9116 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:11.978101 10805 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:11.986783 10812 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:11.988265 10827 raft_consensus.cc:2741] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260925 16:43:11.990900  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:11.991562  9045 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.903211 10815 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:11.999846  9045 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:11.988801 10686 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.000968  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "66c62931d7564a9698d331185552eed5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:12.001840 10817 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:12.002128  9115 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.002902  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:12.002660 10749 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.006165 10743 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.007776 10838 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260925 16:43:12.011116  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 144896us
I20260925 16:43:12.019073  9120 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
W20260925 16:43:12.019928  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63391.6us
I20260925 16:43:12.022222  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:12.023131  8869 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 7, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 7 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:11.978463 10786 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:11.983045 10708 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:12.028095  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:12.028738  9050 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:12.032280  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:12.034953  9045 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:12.036435  8873 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:12.037119  9699 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:12.019424  8969 raft_consensus.cc:595] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:12.042025  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:12.027648 10838 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:12.045622  9042 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:12.046898  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:12.018545  9696 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:12.036588  9119 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.042670 10832 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:12.060511  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:12.061194  9121 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:12.047421 10685 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:12.061111  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.066310  9117 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.050922 10838 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.064620  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.068847  9121 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.067303  9124 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:12.058770 10686 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:12.060030 10832 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:12.085481  9045 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:12.055943 10808 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260925 16:43:12.062723  9046 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
W20260925 16:43:12.079874 10835 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260925 16:43:12.049628 10682 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260925 16:43:12.085772 10832 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.073604 10685 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.103833  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:12.104425  9045 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:12.104738  9045 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:12.109457  9121 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:12.038437 10836 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260925 16:43:12.091832  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:12.119234  9045 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.131987  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:12.132866  9050 raft_consensus.cc:2354] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3.
I20260925 16:43:12.136874  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:12.137614  9042 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.140658  9089 leader_election.cc:398] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3.
I20260925 16:43:12.140949  9089 leader_election.cc:401] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:12.141898  9045 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:12.147783  9042 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:12.149075  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:12.152338 10815 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:12.153012 10815 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.155983 10708 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.160597 10824 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.163077 10824 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.135062 10818 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:12.168583 10749 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.149055  8969 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:12.181690 10685 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:12.185401 10817 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.185618  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:12.186326  9050 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 2: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:12.155833  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:12.192432  9117 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:12.199926  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.200690  9117 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:12.203078  9045 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:12.209095  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:12.100451 10723 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260925 16:43:12.149430  9115 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:12.212625  9046 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.222396  9042 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:12.192026 10743 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:12.269534  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 140651us
I20260925 16:43:12.233942 10818 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:12.233566 10686 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:12.242796  9694 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:12.242182  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.312073  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.270942 10819 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260925 16:43:12.220795 10841 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:12.321225 10724 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:12.322512 10838 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.324744  9118 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:12.325603  9119 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:12.326210  9042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:12.445737  9042 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:12.445948  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:12.330899 10815 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3.
I20260925 16:43:12.357168 10686 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.337994  9050 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:12.338501  9047 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260925 16:43:12.342276  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 215450us
I20260925 16:43:12.343348  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:12.344331  8967 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:12.343725  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:12.457501  8974 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:12.346366  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:12.458297  8973 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:12.359172  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:12.458784  8972 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:12.342535  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:12.414129  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:12.417517  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:12.464936  8968 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.419763  9046 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:12.420495  9049 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:12.421872  9041 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:12.423202 10724 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:12.426420  8871 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:12.431594 10805 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:12.438835  9693 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:12.486764  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:12.440189 10841 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.441187 10851 raft_consensus.cc:1050] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:12.496436  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260925 16:43:12.498390  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:12.499229  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:12.418133  8969 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:12.364624 10818 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:12.483031 10805 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.522984  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:12.444666 10838 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:12.466575  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 52529.1us
I20260925 16:43:12.529175  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.529721  9124 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.468374  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:12.466883  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:12.471166  8872 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:12.478067  8970 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:12.468796 10829 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:12.478763  8971 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.536552  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:12.478411 10743 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:12.488711  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:12.475647 10827 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260925 16:43:12.515726  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:12.518904 10685 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:12.548221  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.551508  9120 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.548599  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:12.487212 10833 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.051s
I20260925 16:43:12.558802  8972 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:12.533298 10723 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:12.476966 10840 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260925 16:43:12.563323  9124 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:12.549638 10824 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:12.528417 10682 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260925 16:43:12.526583 10786 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.557489  9697 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:12.552608 10829 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:12.602207  9116 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:12.567971  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:12.545475 10808 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260925 16:43:12.603387  9695 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.603128 10829 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.592329 10818 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.562806 10743 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.605939 10743 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.607998  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:12.608332 10724 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:12.578357  9694 raft_consensus.cc:2354] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
I20260925 16:43:12.608847 10786 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:12.609915 10839 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:12.610348 10839 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:12.611101 10839 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.596385 10832 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.615061  9696 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:12.565430 10723 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:12.617048 10723 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.617803 10686 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.619282 10832 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:12.571280 10841 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.598757 10851 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.574820 10685 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.620743  8973 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:12.621999  9090 leader_election.cc:398] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
I20260925 16:43:12.626284  8968 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:12.626576  9120 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 3 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260925 16:43:12.630864  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104460us
I20260925 16:43:12.641181  9090 leader_election.cc:401] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260925 16:43:12.643244 10810 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
I20260925 16:43:12.643712 10693 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:12.644375 10693 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.648674  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:12.648932  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:12.649497  9120 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:12.651244  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:12.652503 10823 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:12.652990 10823 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:12.682957  9043 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:12.683561  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:12.684508  9048 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:12.686156  9048 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:12.695959  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:12.700707  9042 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.709344  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.657465 10823 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.712978  9045 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:43:12.661872 10686 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.656780 10693 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:12.711905  9042 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:12.689209 10843 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.057s
I20260925 16:43:12.712742  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:12.717974  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:12.758406  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:12.744571  9118 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:12.771140 10866 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:12.776791 10840 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:12.781654 10840 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:12.782084  9049 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260925 16:43:12.782617 10840 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.783640  9115 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:12.785120  9045 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260925 16:43:12.787595 10829 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:12.795864  9695 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:12.798759  8971 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:12.767417 10685 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:12.752437 10786 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
I20260925 16:43:12.813246  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:12.792290 10817 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.040s
I20260925 16:43:12.819931 10838 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260925 16:43:12.850703 10838 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:12.851082 10838 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.805418 10826 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260925 16:43:12.826227 10814 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:12.814472 10813 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
I20260925 16:43:12.879827 10813 consensus_queue.cc:1225] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260925 16:43:12.882864 10723 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:12.894145  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 143448us
I20260925 16:43:12.868417 10805 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.879634 10823 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.870931 10838 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.912990  9120 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.915844 10838 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.915951 10805 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:12.916751  9702 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:12.922521 10708 raft_consensus.cc:979] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:12.924738  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:12.931371 10748 raft_consensus.cc:1067] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:12.931867 10823 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:12.932396 10830 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:12.932864 10830 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.936120  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.938452  9124 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:12.949647  9124 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:12.953016  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:12.956295  9122 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:12.956878  9122 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:12.956488 10830 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:12.957226  9122 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:12.957969  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:12.917479 10833 consensus_queue.cc:1159] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 3 status { last_received { term: 1 index: 4 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:43:12.954622  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:12.964870 10748 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:12.981336  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:12.983186  9120 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:12.983870  9122 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:12.987643  9122 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:12.989558 10867 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:12.990111 10867 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:12.990725 10748 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:13.020833  8971 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:13.022732  8968 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:13.006083  9118 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:13.029187  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:13.034946  9048 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:13.029762 10867 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:13.030726 10869 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.310s	user 0.004s	sys 0.000s
I20260925 16:43:13.031549 10748 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:13.032793 10860 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.313s	user 0.002s	sys 0.000s
I20260925 16:43:13.033262  8968 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:13.046347  8968 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:13.050329  9048 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:13.050694  8968 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:13.051419  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:13.069187 10861 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260925 16:43:13.075934  8968 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:13.076289 10812 raft_consensus.cc:979] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:13.082867  8869 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 337) took 1098 ms. Trace:
W20260925 16:43:13.046540 10859 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.325s	user 0.002s	sys 0.002s
I20260925 16:43:13.086566 10819 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:13.092490  9120 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260925 16:43:13.093602 10864 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.368s	user 0.002s	sys 0.000s
I20260925 16:43:13.093883  9115 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:13.083225  8869 rpcz_store.cc:276] 0925 16:43:11.984847 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:11.984980 (+   133us) service_pool.cc:227] Handling call
0925 16:43:13.082790 (+1097810us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:12.034768 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:12.092538 (+ 57770us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:12.097869 (+  5331us) write_op.cc:435] Acquired schema lock
0925 16:43:12.101221 (+  3352us) tablet.cc:660] Decoding operations
0925 16:43:12.180457 (+ 79236us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:12.180512 (+    55us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:12.180538 (+    26us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:43:12.180729 (+   191us) tablet.cc:699] Row locks acquired
0925 16:43:12.180746 (+    17us) write_op.cc:260] PREPARE: finished
0925 16:43:12.180875 (+   129us) write_op.cc:270] Start()
0925 16:43:12.180984 (+   109us) write_op.cc:276] Timestamp: P: 1790354592180835 usec, L: 0
0925 16:43:12.181005 (+    21us) op_driver.cc:331] REPLICATION: starting
0925 16:43:12.181602 (+   597us) log.cc:842] Serialized 541 byte log entry
0925 16:43:12.619800 (+438198us) op_driver.cc:444] REPLICATION: finished
0925 16:43:12.758052 (+138252us) write_op.cc:301] APPLY: starting
0925 16:43:12.763834 (+  5782us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:12.763959 (+   125us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:12.764101 (+   142us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:12.764314 (+   213us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:12.764474 (+   160us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 16:43:12.764521 (+    47us) write_op.cc:312] APPLY: finished
0925 16:43:12.764715 (+   194us) log.cc:842] Serialized 23 byte log entry
0925 16:43:12.764876 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:12.764943 (+    67us) write_op.cc:454] Released schema lock
0925 16:43:12.764981 (+    38us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:12.765224 (+   243us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:12.765256 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":115883,"apply.run_cpu_time_us":1802,"apply.run_wall_time_us":11544,"num_ops":1,"prepare.queue_time_us":92,"prepare.run_cpu_time_us":2964,"prepare.run_wall_time_us":154457,"replication_time_us":400628,"thread_start_us":68758,"threads_started":1}]]}
I20260925 16:43:13.100070  8873 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 215) took 1072 ms. Trace:
I20260925 16:43:13.088378 10805 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:13.102137 10829 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:13.104089  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:13.104238 10731 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:13.105120 10731 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:13.105504 10731 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:13.106716  9115 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:13.106304 10731 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:13.080315  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:13.016371  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:13.044790  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:13.119205  9049 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:13.119625  9049 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:13.133777  8971 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260925 16:43:13.107666 10731 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:13.139881  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:13.140779  9048 raft_consensus.cc:2354] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
W20260925 16:43:13.141623  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 96933.5us
I20260925 16:43:13.147722  8968 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260925 16:43:13.148164  8968 pending_rounds.cc:76] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 4
I20260925 16:43:13.120468  9049 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:13.150614  9049 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:13.107978 10805 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:13.107892 10723 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:13.100428  8873 rpcz_store.cc:276] 0925 16:43:12.027727 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:12.029003 (+  1276us) service_pool.cc:227] Handling call
0925 16:43:13.100010 (+1071007us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:12.182012 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:12.182503 (+   491us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:12.182531 (+    28us) write_op.cc:435] Acquired schema lock
0925 16:43:12.182552 (+    21us) tablet.cc:660] Decoding operations
0925 16:43:12.182859 (+   307us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:12.182905 (+    46us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:12.182930 (+    25us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:43:12.183096 (+   166us) tablet.cc:699] Row locks acquired
0925 16:43:12.183109 (+    13us) write_op.cc:260] PREPARE: finished
0925 16:43:12.183249 (+   140us) write_op.cc:270] Start()
0925 16:43:12.183349 (+   100us) write_op.cc:276] Timestamp: P: 1790354592183189 usec, L: 0
0925 16:43:12.183365 (+    16us) op_driver.cc:331] REPLICATION: starting
0925 16:43:12.259606 (+ 76241us) log.cc:842] Serialized 536 byte log entry
0925 16:43:13.076218 (+816612us) op_driver.cc:444] REPLICATION: finished
0925 16:43:13.076538 (+   320us) write_op.cc:301] APPLY: starting
0925 16:43:13.076609 (+    71us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:13.076710 (+   101us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:13.076839 (+   129us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:13.077055 (+   216us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:13.077186 (+   131us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 16:43:13.077230 (+    44us) write_op.cc:312] APPLY: finished
0925 16:43:13.077397 (+   167us) log.cc:842] Serialized 23 byte log entry
0925 16:43:13.077538 (+   141us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:13.077604 (+    66us) write_op.cc:454] Released schema lock
0925 16:43:13.077637 (+    33us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:13.077844 (+   207us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:13.077868 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":6107,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":94,"apply.run_cpu_time_us":1503,"apply.run_wall_time_us":1503,"num_ops":1,"prepare.queue_time_us":139700,"prepare.run_cpu_time_us":2468,"prepare.run_wall_time_us":121460,"replication_time_us":892751}]]}
I20260925 16:43:13.169211  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:13.178122  8974 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:13.148443  8968 pending_rounds.cc:97] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260925 16:43:13.158313  9089 leader_election.cc:398] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
I20260925 16:43:13.110828  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:13.169564  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:13.178970  9089 leader_election.cc:401] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260925 16:43:13.179189  8967 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:13.170737  8966 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:13.138307  9697 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:13.183630 10863 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:13.185937  9115 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260925 16:43:13.190725  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 52819.5us
I20260925 16:43:13.196903  8968 raft_consensus.cc:2866] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:13.143473 10839 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260925 16:43:13.144852 10686 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260925 16:43:13.210810 10821 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:13.195168 10724 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
W20260925 16:43:13.222154  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44148.2us
W20260925 16:43:13.229843  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 132628us
W20260925 16:43:13.232345 10848 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260925 16:43:13.211597 10821 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:13.321553  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 69775.3us
I20260925 16:43:13.241016  9696 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:13.255209  8971 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:13.253991 10823 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260925 16:43:13.214376 10863 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:13.325086 10813 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260925 16:43:13.418737  8967 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:13.248605 10805 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:13.445971 10858 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260925 16:43:13.414108 10831 raft_consensus.cc:1067] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:13.351936 10866 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.102s
W20260925 16:43:13.512404 10880 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260925 16:43:13.521210 10888 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260925 16:43:13.444862 10821 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:13.573742 10723 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:13.578564 10898 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:13.578384 10723 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:13.570701 10857 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:13.599170  9049 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:13.601792 10723 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:13.608706 10723 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:13.609228 10723 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:13.616190 10723 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:13.633132 10885 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.096s	user 0.001s	sys 0.001s
I20260925 16:43:13.579162 10898 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:13.631763 10832 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.017s	sys 0.010s
W20260925 16:43:13.635973  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 363180us
W20260925 16:43:13.645397 10832 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.018s	sys 0.010s
I20260925 16:43:13.613587 10857 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:13.658406 10666 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:13.701884  9043 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.029s	sys 0.072s
W20260925 16:43:13.702256  9043 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.029s	sys 0.073s
I20260925 16:43:13.658191 10863 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:13.705715  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:13.701484 10731 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.551s	user 0.004s	sys 0.007s
I20260925 16:43:13.713539  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:13.714269  9694 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260925 16:43:13.715385  9699 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:13.673540 10666 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:13.769078  9700 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:13.772488  9049 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260925 16:43:13.719612 10732 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.005s	sys 0.024s
I20260925 16:43:13.774466  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:13.775802  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:13.788520  9046 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:13.789366 10666 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:13.788546  9694 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260925 16:43:13.790498 10666 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260925 16:43:13.782007 10732 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.005s	sys 0.024s
I20260925 16:43:13.762086 10898 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:13.769109 10786 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260925 16:43:13.757112 10863 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260925 16:43:13.812012 10813 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:13.813994 10813 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260925 16:43:13.805179 10892 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.212s	user 0.002s	sys 0.000s
I20260925 16:43:13.825461 10833 raft_consensus.cc:979] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:13.798008 10817 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
W20260925 16:43:13.839679 10886 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.197s	user 0.000s	sys 0.001s
I20260925 16:43:13.852895  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:13.859635  9047 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260925 16:43:13.846923 10831 raft_consensus.cc:1067] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:13.850255 10857 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:13.886715  9115 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.000s	sys 0.021s
I20260925 16:43:13.887988  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 306) took 1197 ms. Trace:
I20260925 16:43:13.888391  9050 rpcz_store.cc:276] 0925 16:43:12.690455 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:12.690590 (+   135us) service_pool.cc:227] Handling call
0925 16:43:12.887484 (+196894us) spinlock_profiling.cc:243] Waited 885 us on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:12.887656 (+   172us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:12.891339 (+  3683us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:12.891385 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:12.891793 (+   408us) log.cc:842] Serialized 26 byte log entry
0925 16:43:13.293169 (+401376us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:13.293265 (+    96us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:13.293454 (+   189us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:13.887639 (+594185us) raft_consensus.cc:1671] finished
0925 16:43:13.887664 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:13.887892 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4849,"raft.queue_time_us":6323,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":1251,"spinlock_wait_cycles":2034432,"thread_start_us":391626,"threads_started":1,"wal-append.queue_time_us":599346}
W20260925 16:43:13.889909 10853 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.810s	user 0.014s	sys 0.021s
W20260925 16:43:13.890309 10853 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.015s	sys 0.021s
I20260925 16:43:13.898566 10812 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:13.901499 10812 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
W20260925 16:43:13.904963  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.039s	sys 0.088s
W20260925 16:43:13.905290  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.039s	sys 0.088s
W20260925 16:43:13.905535  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 583056us
W20260925 16:43:13.906572  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.030s	sys 0.098s
W20260925 16:43:13.906883  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.030s	sys 0.098s
W20260925 16:43:13.909029  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.016s	sys 0.016s
W20260925 16:43:13.909722  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.582s	user 0.016s	sys 0.016s
W20260925 16:43:13.912307  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 634877us
W20260925 16:43:13.912611  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.037s	sys 0.083s
W20260925 16:43:13.912915  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.037s	sys 0.083s
I20260925 16:43:13.914713  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 315) took 1116 ms. Trace:
I20260925 16:43:13.915164  9043 rpcz_store.cc:276] 0925 16:43:12.798861 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:12.920883 (+122022us) service_pool.cc:227] Handling call
0925 16:43:12.921241 (+   358us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:12.923086 (+  1845us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:12.923116 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:12.937818 (+ 14702us) log.cc:842] Serialized 26 byte log entry
0925 16:43:13.702840 (+765022us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:13.702886 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:13.702970 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:13.914517 (+211547us) raft_consensus.cc:1671] finished
0925 16:43:13.914535 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:13.914655 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1303,"raft.queue_time_us":9599,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":97,"thread_start_us":735461,"threads_started":1,"wal-append.queue_time_us":958709}
I20260925 16:43:13.932504  9043 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260925 16:43:13.934784 10819 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.004s	sys 0.020s
W20260925 16:43:13.935366 10819 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.004s	sys 0.020s
W20260925 16:43:13.941598  9041 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.806s	user 0.009s	sys 0.013s
W20260925 16:43:13.942276  9041 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.807s	user 0.009s	sys 0.013s
I20260925 16:43:13.977974 10867 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:13.978750 10867 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:13.981665 10867 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:13.982471  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:13.983155  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:13.983789  9045 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:13.985214  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:14.006431  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.000s	sys 0.016s
W20260925 16:43:14.006914  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.000s	sys 0.017s
W20260925 16:43:14.007622  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.004s	sys 0.014s
W20260925 16:43:14.010892  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.005s	sys 0.014s
W20260925 16:43:14.011459  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 771292us
W20260925 16:43:14.008288  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.007s	sys 0.011s
W20260925 16:43:14.024116  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.007s	sys 0.011s
W20260925 16:43:14.007865  9118 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.000s	sys 0.021s
W20260925 16:43:14.025557  9118 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.691s	user 0.000s	sys 0.022s
W20260925 16:43:14.007305  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 826113us
W20260925 16:43:14.008157 10748 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.009s	sys 0.006s
I20260925 16:43:14.037374  9045 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260925 16:43:14.008067 10815 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.004s	sys 0.012s
W20260925 16:43:14.045567 10932 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260925 16:43:14.047582 10901 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:14.027933 10849 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:13.994781 10867 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:14.023288  8873 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:14.442269  8873 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:14.115248  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 86467.7us
W20260925 16:43:14.111296  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63435.7us
I20260925 16:43:14.221213  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 442) took 1120 ms. Trace:
I20260925 16:43:14.473783 10849 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.118065 10724 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:14.481034 10724 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.482851 10724 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:14.483307 10724 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:14.452463  9702 rpcz_store.cc:276] 0925 16:43:13.100364 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.100525 (+   161us) service_pool.cc:227] Handling call
0925 16:43:14.221023 (+1120498us) spinlock_profiling.cc:243] Waited 923 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:14.221134 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2122790144}
I20260925 16:43:14.047336 10819 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:14.049412  9116 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:14.109936 10920 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:14.490665 10819 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.117790 10812 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:14.492319 10812 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.449343  8873 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:14.491612 10920 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:14.493880  8873 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:14.473170 10815 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.242s	user 0.012s	sys 0.047s
W20260925 16:43:14.440451 10748 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.114s	user 0.020s	sys 0.008s
I20260925 16:43:14.052695 10857 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:14.110095 10851 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:14.218446 10927 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260925 16:43:14.399034 10912 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.269s
W20260925 16:43:14.912165  8973 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.137s	user 0.032s	sys 0.071s
W20260925 16:43:14.979709 10929 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.344s	user 0.001s	sys 0.000s
I20260925 16:43:14.985401  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 237) took 1154 ms. Trace:
I20260925 16:43:14.801138 10920 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:14.608440 10892 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.161s	user 0.002s	sys 0.000s
I20260925 16:43:14.295090 10813 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:14.987288 10813 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.985893  9121 rpcz_store.cc:276] 0925 16:43:13.830560 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.830691 (+   131us) service_pool.cc:227] Handling call
0925 16:43:13.831077 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.831462 (+   385us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.831501 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.832018 (+   517us) log.cc:842] Serialized 26 byte log entry
0925 16:43:14.002095 (+170077us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:14.002128 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.002186 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:14.985134 (+982948us) raft_consensus.cc:1671] finished
0925 16:43:14.985160 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:14.985316 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"thread_start_us":169756,"threads_started":1,"wal-append.queue_time_us":285262}
I20260925 16:43:14.724968 10819 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:14.784426 10845 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.029s
I20260925 16:43:14.988608 10819 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:14.989091 10845 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.220s	user 0.016s	sys 0.041s
I20260925 16:43:14.989375 10813 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:14.801224  9050 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.036s	sys 0.032s
W20260925 16:43:14.990111  9050 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.079s	user 0.036s	sys 0.032s
W20260925 16:43:14.965729 10838 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.934s	user 0.017s	sys 0.028s
I20260925 16:43:14.494875 10724 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.699146  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 372) took 1523 ms. Trace:
W20260925 16:43:14.991253  8973 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.036s	sys 0.071s
I20260925 16:43:14.292737 10666 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:14.483623 10849 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:15.636521 10935 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
W20260925 16:43:15.380919  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.005s	sys 0.029s
W20260925 16:43:15.644647  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.167s	user 0.009s	sys 0.035s
I20260925 16:43:14.224108 10805 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 1.421s
I20260925 16:43:14.993408 10907 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.645351  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 563) took 1771 ms. Trace:
I20260925 16:43:15.091722 10748 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:14.628360  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 140500us
W20260925 16:43:15.219666  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.885s	user 0.003s	sys 0.021s
W20260925 16:43:15.646800  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.312s	user 0.003s	sys 0.040s
I20260925 16:43:15.646850  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:14.330319 10863 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:15.645900  9693 rpcz_store.cc:276] 0925 16:43:13.873804 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.877015 (+  3211us) service_pool.cc:227] Handling call
0925 16:43:13.877450 (+   435us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.877862 (+   412us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.877891 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.878380 (+   489us) log.cc:842] Serialized 26 byte log entry
0925 16:43:13.998792 (+120412us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:13.998846 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:13.998950 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:15.645122 (+1646172us) raft_consensus.cc:1671] finished
0925 16:43:15.645148 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:15.645281 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":72,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"thread_start_us":120039,"threads_started":1,"wal-append.queue_time_us":1174150}
I20260925 16:43:15.052436 10693 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:15.560074 10904 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:14.218963  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 318) took 1282 ms. Trace:
I20260925 16:43:14.448415 10867 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:15.648568 10693 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.649242 10867 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:15.053725 10724 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:15.580284 10903 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:15.650243 10903 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:15.650979  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 449) took 1852 ms. Trace:
I20260925 16:43:15.648911 10904 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:14.993229 10812 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:15.652045 10903 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:14.799535 10749 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.036s	sys 0.053s
I20260925 16:43:15.652982 10904 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:15.653163 10749 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.725s	user 0.040s	sys 0.103s
I20260925 16:43:15.651463  9695 rpcz_store.cc:276] 0925 16:43:13.798497 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.798876 (+   379us) service_pool.cc:227] Handling call
0925 16:43:13.799277 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.799749 (+   472us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.799801 (+    52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.800367 (+   566us) log.cc:842] Serialized 26 byte log entry
0925 16:43:13.994346 (+193979us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:13.995483 (+  1137us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.008909 (+ 13426us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:15.650792 (+1641883us) raft_consensus.cc:1671] finished
0925 16:43:15.650811 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:15.650926 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1338,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":4308,"thread_start_us":175360,"threads_started":1,"wal-append.queue_time_us":175123}
W20260925 16:43:15.055650  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 581276us
I20260925 16:43:14.986225 10920 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.213492 10829 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:15.654979 10829 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:14.991551  8974 rpcz_store.cc:276] 0925 16:43:13.176165 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.179883 (+  3718us) service_pool.cc:227] Handling call
0925 16:43:13.180121 (+   238us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.555383 (+375262us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.555422 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.600965 (+ 45543us) log.cc:842] Serialized 26 byte log entry
0925 16:43:13.997026 (+396061us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:14.034260 (+ 37234us) log.cc:842] Serialized 14 byte log entry
0925 16:43:14.078636 (+ 44376us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.678279 (+599643us) spinlock_profiling.cc:243] Waited 275 ms on lock 0x7b54003c46d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:14.678353 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:14.678416 (+    63us) raft_consensus.cc:1671] finished
0925 16:43:14.698929 (+ 20513us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:14.699067 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":156569,"prepare.queue_time_us":612369,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":11134,"raft.queue_time_us":77022,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":3088,"spinlock_wait_cycles":632613248,"thread_start_us":408767,"threads_started":2,"wal-append.queue_time_us":427551,"wal-append.run_cpu_time_us":2197,"wal-append.run_wall_time_us":1006738}
W20260925 16:43:15.656595 10708 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.924s	user 0.017s	sys 0.034s
W20260925 16:43:15.657003 10708 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.924s	user 0.017s	sys 0.034s
I20260925 16:43:15.657431 10829 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:15.658320  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.665s	user 0.001s	sys 0.001s
W20260925 16:43:15.658650  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.002s	sys 0.001s
I20260925 16:43:14.689599 10866 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.659143 10866 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.645429 10907 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:15.661324 10866 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:14.294809 10786 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:15.662009 10743 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:15.662165 10812 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:15.672087  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:15.513492  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 1918) took 1605 ms. Trace:
I20260925 16:43:15.040772 10826 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:15.246443  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.799s	user 0.009s	sys 0.013s
W20260925 16:43:15.597395 10933 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260925 16:43:15.465560 10942 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260925 16:43:15.648918  9041 rpcz_store.cc:276] 0925 16:43:12.936841 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.134570 (+197729us) service_pool.cc:227] Handling call
0925 16:43:13.134826 (+   256us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:13.134978 (+   152us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:13.942704 (+807726us) log.cc:842] Serialized 14 byte log entry
0925 16:43:14.158759 (+216055us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:14.168362 (+  9603us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:14.168413 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.218767 (+ 50354us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:14.218911 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":135979,"prepare.queue_time_us":385359,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":108290,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":62142,"thread_start_us":892829,"threads_started":2,"wal-append.queue_time_us":1428720}
I20260925 16:43:14.989251 10819 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:15.647342 10748 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:15.661993 10786 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:14.667390 10832 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.982s
I20260925 16:43:15.648062 10863 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:15.665171  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.000s	sys 0.016s
W20260925 16:43:15.665599  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.940s	user 0.014s	sys 0.015s
W20260925 16:43:15.700302  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.000s	sys 0.016s
I20260925 16:43:15.651051 10693 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:15.666302  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:15.203783 10723 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.054198 10878 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:15.091270 10930 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
W20260925 16:43:15.667143  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.000s	sys 0.008s
W20260925 16:43:15.723565  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.000s	sys 0.009s
I20260925 16:43:15.068248 10841 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:15.032155 10911 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:15.667826  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:15.668491 10829 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:15.662566 10743 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:15.750608  8970 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
W20260925 16:43:15.216193 10847 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.359s	user 0.041s	sys 0.059s
W20260925 16:43:15.751093  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 96741.5us
I20260925 16:43:15.668967  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:15.675529 10666 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.452423 10840 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:15.669890 10866 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:15.671044  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:14.990845 10838 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.959s	user 0.017s	sys 0.030s
W20260925 16:43:15.208897  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.005s	sys 0.015s
W20260925 16:43:15.790140  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.145s	user 0.008s	sys 0.021s
I20260925 16:43:15.788002  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:15.791203  9045 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:15.672925  9050 rpcz_store.cc:276] 0925 16:43:13.908375 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.908528 (+   153us) service_pool.cc:227] Handling call
0925 16:43:13.908867 (+   339us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.909970 (+  1103us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.910011 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.910522 (+   511us) log.cc:842] Serialized 26 byte log entry
0925 16:43:14.990567 (+1080045us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:14.990602 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.990660 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:15.513250 (+522590us) raft_consensus.cc:1671] finished
0925 16:43:15.513282 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:15.513431 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":461,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":96,"thread_start_us":1079642,"threads_started":1,"wal-append.queue_time_us":1340413}
I20260925 16:43:15.131821 10901 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:15.675639  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.228s	user 0.014s	sys 0.015s
I20260925 16:43:15.679733  9048 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260925 16:43:14.935842 10916 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.866s	user 0.026s	sys 0.072s
W20260925 16:43:15.803586 10916 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.840s	user 0.027s	sys 0.091s
W20260925 16:43:15.234917 10815 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.012s	sys 0.009s
W20260925 16:43:15.700448  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.975s	user 0.014s	sys 0.015s
I20260925 16:43:15.053610 10915 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:14.160003 10919 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.671983 10821 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:15.662047 10907 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:15.708498  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.006s	sys 0.013s
I20260925 16:43:15.030752 10857 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:15.654546 10920 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.735559  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 562) took 1870 ms. Trace:
W20260925 16:43:15.668649  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.008s	sys 0.000s
W20260925 16:43:15.700182 10732 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.005s	sys 0.013s
I20260925 16:43:15.756819  9047 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:15.328325 10682 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.681927 10812 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:15.760380  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111671us
I20260925 16:43:15.687923 10826 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.793224  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:15.746613  9046 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
W20260925 16:43:15.792578 10847 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.227s	user 0.048s	sys 0.060s
W20260925 16:43:15.878322  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 114523us
W20260925 16:43:15.928071 10943 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
W20260925 16:43:15.806289 10815 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.139s	user 0.023s	sys 0.012s
I20260925 16:43:15.792886 10840 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.889110 10905 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:15.756455 10911 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.792423 10958 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:15.863617 10832 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.734750 10878 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.803167 10867 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.809172 10959 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:15.807344 10693 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:15.782773 10904 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:15.722944 10723 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.750577 10841 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:15.792662 10829 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:15.782059 10953 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:15.886272  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 128115us
I20260925 16:43:16.191392  8967 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:15.808699 10805 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.954840 10786 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:15.885164  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:15.976166  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 252615us
I20260925 16:43:15.982558  9124 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
W20260925 16:43:16.040881  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.989s	user 0.011s	sys 0.017s
I20260925 16:43:15.999635  9117 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260925 16:43:16.041343  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.014s	sys 0.002s
I20260925 16:43:15.981170  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "66c62931d7564a9698d331185552eed5"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:43:15.931444  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:15.906695 10956 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:15.906212 10965 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:16.065479  9042 raft_consensus.cc:2396] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:15.982713  9123 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:16.041704  9699 rpcz_store.cc:276] 0925 16:43:13.865276 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.865397 (+   121us) service_pool.cc:227] Handling call
0925 16:43:13.866038 (+   641us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.866457 (+   419us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.866492 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.867562 (+  1070us) log.cc:842] Serialized 564 byte log entry
0925 16:43:14.355988 (+488426us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:14.356037 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.356125 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:15.735285 (+1379160us) raft_consensus.cc:1671] finished
0925 16:43:15.735313 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:15.735486 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":486498,"threads_started":1,"wal-append.queue_time_us":1366584}
I20260925 16:43:15.930239 10833 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:16.121037  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 227697us
W20260925 16:43:16.046312 10732 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.005s	user 0.005s	sys 0.022s
I20260925 16:43:15.888435 10915 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.036131 10866 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:16.053521 10960 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.106427 10907 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:15.807582 10901 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.120141 10821 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:16.189950 10926 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.305s	user 0.000s	sys 0.000s
I20260925 16:43:15.892231 10919 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.122740  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 324) took 1893 ms. Trace:
I20260925 16:43:16.114187 10948 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:16.287858 10743 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.317090  9121 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:16.309796  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:16.316984 10953 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.173338 10967 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:16.172482 10748 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.318193  9119 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:16.319125  9117 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:43:16.059864 10682 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.320441  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:16.552923  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:16.113276 10905 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.385483 10805 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:16.386907  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 195106us
I20260925 16:43:16.558449  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:16.250353 10922 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.263s	user 0.000s	sys 0.000s
W20260925 16:43:16.394707 10955 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.636s	user 0.000s	sys 0.001s
I20260925 16:43:16.133701 10863 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.394097 10968 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:16.474793  8975 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.089s	sys 0.133s
I20260925 16:43:16.316433  9124 pending_rounds.cc:76] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 1
W20260925 16:43:16.569619  8975 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.089s	sys 0.133s
I20260925 16:43:16.569720  9124 pending_rounds.cc:97] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.2
I20260925 16:43:16.527168 10977 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:16.527801 10974 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.528426 10981 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:16.574378  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.018s	sys 0.019s
I20260925 16:43:16.533548  9121 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:16.574755  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.018s	sys 0.019s
I20260925 16:43:16.386996 10866 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.476917 10907 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.551266 10951 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.554731  9117 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:16.595211  9117 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:16.122469 10832 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.174381 10693 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.250622 10829 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.192997 10904 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.318817 10833 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.113227 10958 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.570119  9124 raft_consensus.cc:2894] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Aborting config change with OpId 1.2: Aborted: Op aborted by new leader
W20260925 16:43:16.527493  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 221312us
I20260925 16:43:16.578780  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:16.570951  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:16.544737  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46227.9us
I20260925 16:43:16.580471  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1266) took 3400 ms. Trace:
W20260925 16:43:16.471282  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.013s	sys 0.052s
I20260925 16:43:16.137532 10959 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.587237  9121 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.599501 10987 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:16.600339 10908 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.934s	user 0.013s	sys 0.031s
I20260925 16:43:16.319090 10965 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.607038  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:16.606217  9124 raft_consensus.cc:2866] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:16.563331 10748 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
W20260925 16:43:16.609601  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.013s	sys 0.052s
I20260925 16:43:16.593459 10952 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:16.673373  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:16.672520  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43564 (request call id 10) took 6632 ms. Trace:
I20260925 16:43:14.544430  8873 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:16.600925 10666 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.605012 10966 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.632901  9121 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.566826 10988 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:16.607988  8973 rpcz_store.cc:276] 0925 16:43:13.175238 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.178167 (+  2929us) service_pool.cc:227] Handling call
0925 16:43:13.178495 (+   328us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.709587 (+531092us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.709625 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.726985 (+ 17360us) log.cc:842] Serialized 26 byte log entry
0925 16:43:15.652375 (+1925390us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:15.652411 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:15.652466 (+    55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:16.575630 (+923164us) raft_consensus.cc:1671] finished
0925 16:43:16.575657 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:16.575817 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43878,"raft.queue_time_us":60937,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":47333,"thread_start_us":2364274,"threads_started":2,"wal-append.queue_time_us":2007117}
I20260925 16:43:16.596448 10838 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:16.318989 10956 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.668829  8971 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:16.676275  8873 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:16.674849 10908 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.030s	user 0.013s	sys 0.031s
I20260925 16:43:16.680925 10959 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.685323  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:16.674999  9117 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.685925 10971 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:16.687863  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:16.774309 10970 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:16.775048 10961 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.665s	user 0.000s	sys 0.001s
I20260925 16:43:16.775506 10969 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:16.513430 10786 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:16.674795  9124 rpcz_store.cc:276] 0925 16:43:10.007932 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:10.009593 (+  1661us) service_pool.cc:227] Handling call
0925 16:43:10.208625 (+199032us) spinlock_profiling.cc:243] Waited 3.91 ms on lock 0x7b58000611b0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf25a7a 00007f719bf26ada 00007f719bf25c8b 00007f719bf31084 00007f719bf30743 00007f71a0e6cf39 00007f719a558704 00007f719a558692
0925 16:43:10.392556 (+183931us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b5400288820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beb840d 00007f719bea6050 00007f719bf09aba 00007f719bf25a7a 00007f719bf26ada 00007f719bf25c8b 00007f719bf31084 00007f719bf30743 00007f71a0e6cf39 00007f719a558704
0925 16:43:10.402693 (+ 10137us) log.cc:842] Serialized 506 byte log entry
0925 16:43:16.640025 (+6237332us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":758,"raft.run_cpu_time_us":321,"raft.run_wall_time_us":321,"spinlock_wait_cycles":430075520,"thread_start_us":7427,"threads_started":1,"wal-append.queue_time_us":17739,"wal-append.run_cpu_time_us":1690,"wal-append.run_wall_time_us":1005240}
I20260925 16:43:16.482297 10960 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.641692 10812 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.669799 10950 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:16.815136  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 221730us
W20260925 16:43:16.878729  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 268951us
I20260925 16:43:16.554510 10967 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:16.814671  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 504916us
W20260925 16:43:16.834246 10982 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.645s	user 0.001s	sys 0.000s
W20260925 16:43:16.812156 10939 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.574s	user 0.001s	sys 0.000s
I20260925 16:43:16.813143 10841 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.776708  9046 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:16.783841  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:16.684422 10867 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.670276  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:16.675432 10840 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.675207 10826 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.764675 10666 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:16.559449 10948 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.766170 10838 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:16.842212 10956 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.880669  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:16.886543  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:16.886952  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.009s	sys 0.035s
I20260925 16:43:16.932518  9124 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
W20260925 16:43:16.932772  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.010s	sys 0.035s
I20260925 16:43:16.763931 10748 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.890255 10919 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.890404 10905 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.783365 10723 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.704231 10857 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:16.625213 10977 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.593726 10968 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.601752 10974 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.609861 10981 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.902776 10953 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:16.903889 10829 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.848453 10911 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.853196 10908 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:16.639207 10951 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.675138 10987 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.885188 10995 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.915912 10972 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:16.917886  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:16.908437 10821 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:16.887032 10812 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:16.482065  9044 rpcz_store.cc:276] 0925 16:43:14.229117 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:14.269851 (+ 40734us) service_pool.cc:227] Handling call
0925 16:43:15.047689 (+777838us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:15.091753 (+ 44064us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:15.198491 (+106738us) log.cc:842] Serialized 14 byte log entry
0925 16:43:15.976883 (+778392us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:16.035509 (+ 58626us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:16.038305 (+  2796us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:16.054551 (+ 16246us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:16.113129 (+ 58578us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33756,"prepare.queue_time_us":85328,"prepare.run_wall_time_us":46,"raft.queue_time_us":387766,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":77410,"spinlock_wait_cycles":40604928,"thread_start_us":723610,"threads_started":2,"wal-append.queue_time_us":830917}
I20260925 16:43:16.844347 10952 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.877331 10786 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:16.949843 10857 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:16.939940  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48454us
I20260925 16:43:16.918102 10682 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.926402 10915 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.931591 10838 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:17.051826 10833 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.234833 10832 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:16.776854 10988 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:16.947973 10963 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.378s	user 0.001s	sys 0.001s
I20260925 16:43:17.049721  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 1919) took 3041 ms. Trace:
W20260925 16:43:17.408634  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.000s	sys 0.007s
W20260925 16:43:17.410624  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.007s
I20260925 16:43:17.233704 10866 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.942099 10805 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.948221 10919 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:16.950718 10901 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.947714  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:17.287561  9121 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:16.940032 10973 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:16.927249 10666 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:17.295010  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:16.891096 10950 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:17.441540  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 146623us
W20260925 16:43:17.286823  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 339975us
I20260925 16:43:16.918246 10970 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.951327 10723 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:16.943763  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57300.1us
I20260925 16:43:17.031368 10829 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.939545 10748 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:16.812446 10966 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.052611 10911 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:17.053972 10953 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:17.400310  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.001s	sys 0.001s
I20260925 16:43:17.079741  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:16.902093 10971 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.057978 10976 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:16.946852 10826 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:17.411438  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 522787us
I20260925 16:43:17.352275 10693 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.353528 10840 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:17.409621  9049 rpcz_store.cc:276] 0925 16:43:13.911648 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.911800 (+   152us) service_pool.cc:227] Handling call
0925 16:43:13.912584 (+   784us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:13.912928 (+   344us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:13.912960 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:13.913781 (+   821us) log.cc:842] Serialized 564 byte log entry
0925 16:43:14.368895 (+455114us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:14.368943 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:14.369028 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:16.953155 (+2584127us) raft_consensus.cc:1671] finished
0925 16:43:16.953193 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:16.953329 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":454844,"threads_started":1,"wal-append.queue_time_us":1774882}
I20260925 16:43:17.238176 10841 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.156s
I20260925 16:43:17.056758 11000 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:17.383236 10904 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.428301  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:17.428800  8873 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.002s	sys 0.000s
I20260925 16:43:17.061086 10908 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.433815  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 1999) took 1324 ms. Trace:
I20260925 16:43:17.237030 10907 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:16.934245 10969 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:17.447222  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 384708us
I20260925 16:43:17.380440 10857 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:17.632725  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.155s	user 0.002s	sys 0.012s
I20260925 16:43:17.457096 10950 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.459470  9697 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:17.308756 10812 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.411538 10915 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.046s
I20260925 16:43:17.433478 10833 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:17.308601 10995 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.350929 10972 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:17.439132 10919 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.353838 10991 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:17.630755  9121 rpcz_store.cc:276] 0925 16:43:16.109577 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.287052 (+1177475us) service_pool.cc:227] Handling call
0925 16:43:17.287383 (+   331us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:17.433524 (+146141us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:17.433746 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:17.638504 10966 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.638700 10967 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.639173 10952 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.666023 10907 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:17.642284  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:17.453238 10682 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:17.476503 10958 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.631233 10840 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:17.656418 11005 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:17.464447 10723 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.646111  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:17.535648 10986 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.642s	user 0.001s	sys 0.001s
I20260925 16:43:17.583660 10949 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:17.671793  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:17.560567 10832 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:17.640399 10826 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.461079 10901 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.210s
W20260925 16:43:17.685570  9050 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.379s	user 0.019s	sys 0.015s
I20260925 16:43:17.686200  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:17.735394  9050 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.429s	user 0.019s	sys 0.015s
I20260925 16:43:17.696429 10907 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:17.446846 10973 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.706570 10840 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:17.596803  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.536s (SENT) [suppressed 24 similar messages]
I20260925 16:43:17.578886 10988 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.658895 10950 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:17.678937 10863 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.005s	sys 0.019s
I20260925 16:43:17.477834 10979 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:17.472762 10905 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.199s
I20260925 16:43:17.472990 10999 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:17.722906 10968 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:17.745597 10907 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:17.676388 10974 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.473243 10829 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.690147 10966 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:17.690129 10821 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:17.661429 10953 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.734217 10786 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.686323  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:17.736688  9121 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:17.736441 10832 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.702777  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:17.646078 10984 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.074s
I20260925 16:43:17.712405 10958 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:17.724819 10666 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:17.537639 10911 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:17.757807 10863 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.005s	sys 0.020s
I20260925 16:43:17.706311 10682 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:17.748492  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:17.630857  8873 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.003s	sys 0.006s
I20260925 16:43:18.030031  9696 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:17.889081 10748 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.033324 10682 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.693851  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:17.991120  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:17.993124  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:17.734932  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 88931.6us
I20260925 16:43:17.757915  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.053241  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 329) took 1923 ms. Trace:
I20260925 16:43:18.054073  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 327) took 1946 ms. Trace:
I20260925 16:43:18.054497  9047 rpcz_store.cc:276] 0925 16:43:16.107762 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.107892 (+   130us) service_pool.cc:227] Handling call
0925 16:43:16.108188 (+   296us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:16.273342 (+165154us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:16.273375 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:16.273415 (+    40us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:16.273440 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.053629 (+1780189us) spinlock_profiling.cc:243] Waited 165 ms on lock 0x7b54002b5cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.053680 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.053900 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":379403520}
I20260925 16:43:17.828573  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.057262  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.011010  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1630) took 2239 ms. Trace:
I20260925 16:43:18.473263  8968 rpcz_store.cc:276] 0925 16:43:15.749510 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.749635 (+   125us) service_pool.cc:227] Handling call
0925 16:43:17.987032 (+2237397us) spinlock_profiling.cc:243] Waited 4.65 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:17.987578 (+   546us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:17.988090 (+   512us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:17.988152 (+    62us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:17.988209 (+    57us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:17.988316 (+   107us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:17.988449 (+   133us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:17.988657 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10701696}
I20260925 16:43:17.913141 10971 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.668298 10976 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:17.755967 10977 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.912870 10972 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.911516 10973 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.792133 10981 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.864214 10969 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:17.949743  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 520931us
W20260925 16:43:17.944180  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.000s	sys 0.020s
I20260925 16:43:18.004809 10974 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:18.613665 10974 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.614265 11006 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:18.614933 11006 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:17.744663 10985 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:17.688228 10991 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:17.888437 10994 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260925 16:43:18.618458 10912 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:17.767016 10996 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:18.619302 10991 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.619191 10912 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.617761 11006 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.620013 10996 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.621309 10912 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.622160 10996 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.621846  8871 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:18.623167  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 375) took 2881 ms. Trace:
I20260925 16:43:18.623251  8871 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 3, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 3 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:17.910691 10995 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:18.010931 10997 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.012s	sys 0.012s
I20260925 16:43:17.777207 10999 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:17.665771 11000 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.629315 11000 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:17.758632 11005 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.630087  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.630880  9695 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:17.750906 11018 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:17.812829 10966 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:17.797796 10979 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.047093 10957 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:18.635632 10966 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:18.045194 11009 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:18.065737  9042 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:18.064706  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.051362  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:43:18.651400  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 600403us
I20260925 16:43:18.651582 10966 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:18.652289 10966 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:17.752202  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.066932  9121 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:18.655961  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1803) took 1204 ms. Trace:
I20260925 16:43:18.656068  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 248) took 1199 ms. Trace:
I20260925 16:43:18.656322  9118 rpcz_store.cc:276] 0925 16:43:17.451945 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.717905 (+265960us) service_pool.cc:227] Handling call
0925 16:43:18.655659 (+937754us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.657994  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:18.047981  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 451033us
I20260925 16:43:17.998183  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:17.768833 10693 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:18.011801 10723 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.085669 10987 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.897455 10821 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.004364 10826 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.669131 10821 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.020814 10832 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.896849 10812 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.010095 10829 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.670181 10833 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.676905 10833 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.053243  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.091681 10953 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:17.896526 10857 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:17.751065 10904 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:18.686535 10904 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:18.686983 10904 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:18.687158  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.688009  9042 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:17.909096 10911 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.096191 10907 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.698855 10907 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.896344 10919 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.863927 10948 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.744010 10949 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.695057 10904 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.703612 10904 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.703744 10949 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:17.767329 10950 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.706956 10950 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:18.137514  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 330) took 2002 ms. Trace:
I20260925 16:43:18.163436  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1627) took 2418 ms. Trace:
I20260925 16:43:18.270087 10878 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.303231 10951 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:43:18.311004  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 374) took 2570 ms. Trace:
I20260925 16:43:18.324836  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.053735  9046 rpcz_store.cc:276] 0925 16:43:16.129649 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.136643 (+  6994us) service_pool.cc:227] Handling call
0925 16:43:16.329153 (+192510us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:16.897943 (+568790us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.052684 (+1154741us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54002a2e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.053018 (+   334us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":708902272}
I20260925 16:43:18.707561  9048 rpcz_store.cc:276] 0925 16:43:16.135519 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.135740 (+   221us) service_pool.cc:227] Handling call
0925 16:43:16.136062 (+   322us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:16.542876 (+406814us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:16.542914 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:16.542950 (+    36us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:16.542977 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.137168 (+1594191us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b54002b61d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.137211 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.137387 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":935112960}
I20260925 16:43:18.709106  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.709602  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.707643  8969 rpcz_store.cc:276] 0925 16:43:15.745010 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.747153 (+  2143us) service_pool.cc:227] Handling call
0925 16:43:18.162570 (+2415417us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:18.162793 (+   223us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:18.163057 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:18.163074 (+    17us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:18.163117 (+    43us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:18.163144 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.163183 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.163293 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9017216}
I20260925 16:43:18.710332  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:18.710616  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.339735 10960 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.350116  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.712353  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 333) took 1172 ms. Trace:
I20260925 16:43:18.712689  9041 rpcz_store.cc:276] 0925 16:43:17.539674 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.559381 (+ 19707us) service_pool.cc:227] Handling call
0925 16:43:18.349929 (+790548us) spinlock_profiling.cc:243] Waited 3.84 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:18.712292 (+362363us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8826112}
I20260925 16:43:18.372507 10970 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.373528  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1633) took 2613 ms. Trace:
I20260925 16:43:18.714049  9124 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:18.713871  8966 rpcz_store.cc:276] 0925 16:43:15.760052 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.760189 (+   137us) service_pool.cc:227] Handling call
0925 16:43:18.372790 (+2612601us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:18.373017 (+   227us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:18.373213 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:18.373226 (+    13us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:18.373262 (+    36us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:18.373303 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.373338 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.373411 (+    73us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46085504}
W20260925 16:43:18.714777  9124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1802) took 1783 ms (client timeout 2082 ms). Trace:
W20260925 16:43:18.715185  9124 rpcz_store.cc:269] 0925 16:43:16.931809 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.324271 (+1392462us) service_pool.cc:227] Handling call
0925 16:43:18.714724 (+390453us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.716176  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.716298  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:18.716938  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:18.717214 10960 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:18.380409  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:18.384014 11029 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.305s	user 0.003s	sys 0.001s
I20260925 16:43:18.386356  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1632) took 2627 ms. Trace:
I20260925 16:43:18.392016  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 240) took 3951 ms. Trace:
I20260925 16:43:18.394435  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 1997) took 2358 ms. Trace:
I20260925 16:43:18.397547  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.397913  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.458293 10965 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.474009  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 1986) took 4359 ms. Trace:
I20260925 16:43:17.897655 10958 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:18.476426 10840 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.707s	user 0.012s	sys 0.004s
I20260925 16:43:18.477932 10976 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:18.483624 10921 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 3.380s	user 0.001s	sys 0.045s
I20260925 16:43:18.487654 10749 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:18.493117 10992 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:18.493458  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 332) took 1038 ms. Trace:
I20260925 16:43:18.493988  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 331) took 2318 ms. Trace:
I20260925 16:43:18.496630  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 377) took 2752 ms. Trace:
I20260925 16:43:18.499114 10981 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:18.509608  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:18.516077  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 567) took 4051 ms. Trace:
I20260925 16:43:18.525908  9117 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:18.528697 10838 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.117s	user 0.014s	sys 0.007s
I20260925 16:43:18.542666 10847 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:18.546116  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1635) took 2785 ms. Trace:
I20260925 16:43:18.552510  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.549324  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:18.560025  8873 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 338) took 4560 ms. Trace:
I20260925 16:43:18.566186 10908 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.570300  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 568) took 1113 ms. Trace:
I20260925 16:43:18.573136  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2000) took 2448 ms. Trace:
I20260925 16:43:18.579909 10819 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:18.588416 10920 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.604836  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.606496  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:18.612193  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:18.623636  8972 rpcz_store.cc:276] 0925 16:43:15.741365 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.741492 (+   127us) service_pool.cc:227] Handling call
0925 16:43:15.741773 (+   281us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:16.123550 (+381777us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:16.123583 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:16.135170 (+ 11587us) log.cc:842] Serialized 26 byte log entry
0925 16:43:16.555577 (+420407us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:16.555621 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.517064 (+1961443us) spinlock_profiling.cc:243] Waited 381 ms on lock 0x7b54003e8854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.517133 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:18.622726 (+105593us) raft_consensus.cc:1671] finished
0925 16:43:18.622743 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.622982 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":696,"raft.queue_time_us":824,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":46626,"spinlock_wait_cycles":875443456,"thread_start_us":265365,"threads_started":1,"wal-append.queue_time_us":1236628}
W20260925 16:43:17.824082 11007 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.149s	user 0.000s	sys 0.001s
I20260925 16:43:18.631822  8871 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:18.633412  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.636489 11009 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.635646 10957 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.608570 10975 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.016s
I20260925 16:43:18.637518 11018 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:18.641121 10997 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.688s	user 0.013s	sys 0.013s
W20260925 16:43:18.639654  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.748s	user 0.000s	sys 0.025s
I20260925 16:43:18.645690 10979 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.646056  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 328) took 2527 ms. Trace:
I20260925 16:43:18.646556 11005 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.647176 10999 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:18.647655 10974 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.649446  9047 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:18.717447  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 245) took 1261 ms. Trace:
I20260925 16:43:18.797168  9124 rpcz_store.cc:276] 0925 16:43:17.456121 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.715864 (+1259743us) service_pool.cc:227] Handling call
0925 16:43:18.717360 (+  1496us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.798329  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.656494  9121 rpcz_store.cc:276] 0925 16:43:17.457136 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.992278 (+535142us) service_pool.cc:227] Handling call
0925 16:43:18.656012 (+663734us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.660753 10815 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:18.799157  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:18.658890  9118 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:18.663094  9702 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:18.663353  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:18.800128  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 619) took 1121 ms. Trace:
I20260925 16:43:18.800575  9702 rpcz_store.cc:276] 0925 16:43:17.679021 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.863431 (+184410us) service_pool.cc:227] Handling call
0925 16:43:18.800040 (+936609us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.800920 11018 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:18.800534  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 137397us
I20260925 16:43:18.801961  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.802215  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:18.803161  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.037256  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:18.807541  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 298184us
I20260925 16:43:18.808139  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 620) took 1124 ms. Trace:
I20260925 16:43:18.808542  9701 rpcz_store.cc:276] 0925 16:43:17.683761 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.036602 (+352841us) service_pool.cc:227] Handling call
0925 16:43:18.808074 (+771472us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.809422  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:18.810057  9701 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:18.689635  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.811965 10970 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:18.690696  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.812397 10970 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:18.691466  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.691998  9693 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:18.814047  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.694247 10953 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:18.819923  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 579) took 1067 ms. Trace:
I20260925 16:43:18.820073 10953 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:18.820333  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2007) took 2344 ms (client timeout 2517 ms). Trace:
I20260925 16:43:18.820385  9696 rpcz_store.cc:276] 0925 16:43:17.752961 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.379862 (+626901us) service_pool.cc:227] Handling call
0925 16:43:18.819865 (+440003us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.708245  8974 rpcz_store.cc:276] 0925 16:43:15.741011 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.741805 (+   794us) service_pool.cc:227] Handling call
0925 16:43:15.742101 (+   296us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:15.782974 (+ 40873us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:15.783017 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:18.021776 (+2238759us) spinlock_profiling.cc:243] Waited 8.63 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:43:18.022625 (+   849us) log.cc:842] Serialized 26 byte log entry
0925 16:43:18.058404 (+ 35779us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:18.058458 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.058605 (+   147us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:18.310504 (+251899us) raft_consensus.cc:1671] finished
0925 16:43:18.310525 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.310828 (+   303us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40485,"raft.queue_time_us":47060,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":23202,"spinlock_wait_cycles":19848960,"thread_start_us":22752,"threads_started":1,"wal-append.queue_time_us":75344}
I20260925 16:43:18.802232  9045 rpcz_store.cc:276] 0925 16:43:16.114667 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.114927 (+   260us) service_pool.cc:227] Handling call
0925 16:43:18.562291 (+2447364us) spinlock_profiling.cc:243] Waited 47 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:18.562593 (+   302us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:18.634241 (+ 71648us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:18.634729 (+   488us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:18.638803 (+  4074us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:18.638843 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.641547 (+  2704us) spinlock_profiling.cc:243] Waited 62 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.641602 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.641748 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":250692224}
I20260925 16:43:18.797996 10840 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.799499  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.801087 10815 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260925 16:43:18.820978  9115 rpcz_store.cc:269] 0925 16:43:16.476289 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.604287 (+2127998us) service_pool.cc:227] Handling call
0925 16:43:18.820275 (+215988us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.819213  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.824065  9698 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:18.824644  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 247) took 1367 ms. Trace:
I20260925 16:43:18.817662  9699 rpcz_store.cc:276] 0925 16:43:17.457226 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.457549 (+   323us) service_pool.cc:227] Handling call
0925 16:43:17.457917 (+   368us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:17.541102 (+ 83185us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:17.541146 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:17.541201 (+    55us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:17.541248 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.569851 (+1028603us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.569933 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.570122 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":190673152}
I20260925 16:43:18.825063  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.799978  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1806) took 1126 ms. Trace:
I20260925 16:43:18.825757  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.825359  8872 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:18.825865  9118 rpcz_store.cc:276] 0925 16:43:17.673358 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.657567 (+984209us) service_pool.cc:227] Handling call
0925 16:43:18.799893 (+142326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.826361  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:18.806703  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 104215us
I20260925 16:43:18.826918  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.827090  8872 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:18.828044  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:18.828399  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.812130 11018 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:18.805294  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.825095  9121 rpcz_store.cc:276] 0925 16:43:17.456867 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.799184 (+1342317us) service_pool.cc:227] Handling call
0925 16:43:18.824570 (+ 25386us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.800823 10749 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.812876 10970 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:18.665040 10693 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.653417 10966 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.837306  8871 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 3, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 3 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:18.799746  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 249) took 1342 ms. Trace:
I20260925 16:43:18.817854  9050 rpcz_store.cc:276] 0925 16:43:16.175163 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.175903 (+   740us) service_pool.cc:227] Handling call
0925 16:43:16.176280 (+   377us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:17.735825 (+1559545us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:17.735858 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:17.736300 (+   442us) log.cc:842] Serialized 26 byte log entry
0925 16:43:18.474170 (+737870us) spinlock_profiling.cc:243] Waited 3.63 ms on lock 0x7b54001255a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beb8771 00007f719bec3220 00007f719bec31c8 00007f719bec3148 00007f719bec3103 00007f719bec238c 00007f71a1f33206 00007f71a1f2b808 00007f719beff38b 00007f719bf01e80
0925 16:43:18.492590 (+ 18420us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:18.492640 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.492762 (+   122us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:18.492800 (+    38us) raft_consensus.cc:1671] finished
0925 16:43:18.492815 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.493800 (+   985us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":394702,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5399,"spinlock_wait_cycles":8340352,"thread_start_us":1468545,"threads_started":2,"wal-append.queue_time_us":69604}
I20260925 16:43:18.819401  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 1989) took 2851 ms. Trace:
I20260925 16:43:18.829180  9118 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
I20260925 16:43:18.842922  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.840355  9701 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:18.839304 10957 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.838583  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:18.818974  8873 rpcz_store.cc:276] 0925 16:43:13.999384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:13.999536 (+   152us) service_pool.cc:227] Handling call
0925 16:43:18.559875 (+4560339us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:17.900375 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:17.904446 (+  4071us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:17.904499 (+    53us) write_op.cc:435] Acquired schema lock
0925 16:43:17.904520 (+    21us) tablet.cc:660] Decoding operations
0925 16:43:17.905649 (+  1129us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:17.905732 (+    83us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:17.905772 (+    40us) tablet.cc:683] Acquiring locks for 6 operations
0925 16:43:17.906467 (+   695us) tablet.cc:699] Row locks acquired
0925 16:43:17.906495 (+    28us) write_op.cc:260] PREPARE: finished
0925 16:43:17.906686 (+   191us) write_op.cc:270] Start()
0925 16:43:17.906814 (+   128us) write_op.cc:276] Timestamp: P: 1790354597906619 usec, L: 0
0925 16:43:17.906844 (+    30us) op_driver.cc:331] REPLICATION: starting
0925 16:43:17.920612 (+ 13768us) log.cc:842] Serialized 2462 byte log entry
0925 16:43:18.105397 (+184785us) op_driver.cc:444] REPLICATION: finished
0925 16:43:18.109130 (+  3733us) write_op.cc:301] APPLY: starting
0925 16:43:18.109348 (+   218us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:18.109701 (+   353us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:18.109882 (+   181us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:18.111398 (+  1516us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:18.111847 (+   449us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0925 16:43:18.111935 (+    88us) write_op.cc:312] APPLY: finished
0925 16:43:18.112522 (+   587us) log.cc:842] Serialized 53 byte log entry
0925 16:43:18.112717 (+   195us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:18.112879 (+   162us) write_op.cc:454] Released schema lock
0925 16:43:18.112938 (+    59us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:18.116675 (+  3737us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:18.116697 (+    22us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":85,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":3304,"apply.run_cpu_time_us":3881,"apply.run_wall_time_us":7880,"num_ops":6,"prepare.queue_time_us":1063856,"prepare.run_cpu_time_us":10561,"prepare.run_wall_time_us":193761,"raft.queue_time_us":1323,"raft.run_cpu_time_us":2418,"raft.run_wall_time_us":3217,"replication_time_us":198379,"thread_start_us":1359063,"threads_started":4,"wal-append.queue_time_us":179188}]]}
I20260925 16:43:18.846643  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.844379  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.816947  8971 rpcz_store.cc:276] 0925 16:43:15.760648 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.288708 (+528060us) service_pool.cc:227] Handling call
0925 16:43:16.289099 (+   391us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:16.781603 (+492504us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.545649 (+1764046us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54001c4b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.545936 (+   287us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":732690176}
I20260925 16:43:18.846130  9116 rpcz_store.cc:276] 0925 16:43:15.968223 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.976486 (+  8263us) service_pool.cc:227] Handling call
0925 16:43:16.172491 (+196005us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:16.578075 (+405584us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:16.581360 (+  3285us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:16.682212 (+100852us) log.cc:842] Serialized 26 byte log entry
0925 16:43:17.356469 (+674257us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:17.384696 (+ 28227us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:17.400908 (+ 16212us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:18.815122 (+1414214us) raft_consensus.cc:1671] finished
0925 16:43:18.819096 (+  3974us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.819255 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":779225,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":234651,"thread_start_us":758341,"threads_started":2,"wal-append.queue_time_us":635086}
I20260925 16:43:18.815532  8967 rpcz_store.cc:276] 0925 16:43:15.744630 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.744758 (+   128us) service_pool.cc:227] Handling call
0925 16:43:15.745060 (+   302us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:16.191789 (+446729us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.496128 (+2304339us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54003e8354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.496421 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1026064128}
I20260925 16:43:18.824193 10815 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:18.824590  9693 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:18.849833 10815 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:18.842710 10975 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:18.850431  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.811758  9122 rpcz_store.cc:276] 0925 16:43:14.440464 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:14.440582 (+   118us) service_pool.cc:227] Handling call
0925 16:43:14.440867 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:15.804944 (+1364077us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:15.804978 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:15.805014 (+    36us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:15.805044 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.391587 (+2586543us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b540010bb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.391645 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.391843 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3136648576}
I20260925 16:43:18.813076  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45950 (request call id 1995) took 2813 ms. Trace:
I20260925 16:43:18.832460 11018 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:18.852028 11018 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:18.851742  9117 rpcz_store.cc:276] 0925 16:43:15.999500 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.318967 (+319467us) service_pool.cc:227] Handling call
0925 16:43:18.523372 (+2204405us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b5400142b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf21da7 00007f71a0e6dee0 00007f719a55f784 00007f719a55f712 00007f719a55f641 00007f719a55f5bc 00007f719a55e872 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:18.812973 (+289601us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15657216}
I20260925 16:43:18.826924  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.854601  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.854969  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:18.812942  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 201006us
I20260925 16:43:18.829265 10987 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:18.855988 10987 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:18.856362 10987 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:18.854631  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.857038 11009 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.800558  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 622) took 1062 ms. Trace:
I20260925 16:43:18.857445  9049 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260925 16:43:18.816931  9120 rpcz_store.cc:276] 0925 16:43:14.114360 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:14.114503 (+   143us) service_pool.cc:227] Handling call
0925 16:43:14.114861 (+   358us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:16.125599 (+2010738us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:16.125642 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:16.125693 (+    51us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:16.125735 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.473568 (+2347833us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b5400164754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.473623 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.473822 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4623641984}
I20260925 16:43:18.817140  8970 rpcz_store.cc:276] 0925 16:43:15.759588 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:15.759806 (+   218us) service_pool.cc:227] Handling call
0925 16:43:18.385123 (+2625317us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:18.385516 (+   393us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:18.385865 (+   349us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:18.385897 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:18.385945 (+    48us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:18.385982 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.386040 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.386156 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":46757120}
I20260925 16:43:18.826987  9698 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:18.818781  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:18.833369  9702 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:18.833649  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:18.798847 10960 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:18.816256 10847 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:18.834539  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.93899e+06us
I20260925 16:43:18.850447 10975 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:18.835012 10838 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:18.813481  9694 rpcz_store.cc:276] 0925 16:43:14.464715 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:14.473857 (+  9142us) service_pool.cc:227] Handling call
0925 16:43:14.987624 (+513767us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:15.687500 (+699876us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:15.689415 (+  1915us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:15.699242 (+  9827us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:43:15.701128 (+  1886us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.515488 (+2814360us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b5400436054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.515559 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.515835 (+   276us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1574347648}
I20260925 16:43:18.844637 10992 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:18.815234  9123 rpcz_store.cc:276] 0925 16:43:16.036280 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:16.569294 (+533014us) service_pool.cc:227] Handling call
0925 16:43:18.393293 (+1823999us) spinlock_profiling.cc:243] Waited 1.44 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:18.393564 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:18.393975 (+   411us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:18.394004 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:18.394055 (+    51us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:18.394087 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.394151 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.394277 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3318528}
I20260925 16:43:18.851752 10953 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.855654  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.848212  9124 rpcz_store.cc:276] 0925 16:43:17.457371 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.798013 (+1340642us) service_pool.cc:227] Handling call
0925 16:43:18.799672 (+  1659us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.857667  9697 rpcz_store.cc:276] 0925 16:43:17.738182 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.552087 (+813905us) service_pool.cc:227] Handling call
0925 16:43:18.800480 (+248393us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:18.860469  9693 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:18.840852 10693 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:18.861289  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.861389  9695 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:18.862227  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.862317  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.862818 10829 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:18.862884 10951 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:18.863803  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.865769  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:18.855607  9041 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:18.866875  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:18.835632  9700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 573) took 1377 ms (client timeout 1779 ms). Trace:
I20260925 16:43:18.846609  8871 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:18.847721 10976 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:18.846510  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.872429  9121 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:18.884663  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:19.219745  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45898.5us
I20260925 16:43:19.269524  9701 raft_consensus.cc:2396] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260925 16:43:19.252435 10815 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:19.270655  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:19.271265  9701 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:18.913059 10987 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.246158 11018 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.273613 10987 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.274400 11018 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:19.274794  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:19.066073  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:18.988193 10832 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260925 16:43:19.007803  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 401498us
I20260925 16:43:19.282270  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.282728 10832 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:19.283181  9121 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:19.283205 10832 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.284269  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.284973  9121 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:19.276880  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.285669  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:19.287388  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.288277  9121 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:19.282342  9118 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:19.289680  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.289069  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.290285  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 623) took 1543 ms. Trace:
I20260925 16:43:19.278285  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:18.872598 11005 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:19.291294 11005 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.291713 11005 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:19.292253  9695 raft_consensus.cc:2396] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:19.272061 10815 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:19.279306  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 413578us
I20260925 16:43:19.294945  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 624) took 1259 ms. Trace:
I20260925 16:43:18.815407  9119 rpcz_store.cc:276] 0925 16:43:16.124663 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.444385 (+1319722us) service_pool.cc:227] Handling call
0925 16:43:17.449992 (+  5607us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:18.478843 (+1028851us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:18.478911 (+    68us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:18.478981 (+    70us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:18.479038 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.572636 (+ 93598us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54000113d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.572693 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.572945 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2352901504}
I20260925 16:43:19.298667  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:19.279753  9700 rpcz_store.cc:269] 0925 16:43:17.459814 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.652028 (+192214us) service_pool.cc:227] Handling call
0925 16:43:18.397623 (+745595us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:18.835554 (+437931us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3012480}
I20260925 16:43:18.870517 10975 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:18.951478  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.925727  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.285413 10829 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:19.286279  9043 raft_consensus.cc:2396] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260925 16:43:19.277382 10976 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.290480  9118 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:19.283393 10987 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:19.298995  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.280280 10958 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:18.913014 10847 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.020767  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:19.278635  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:19.279590  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 407169us
I20260925 16:43:19.276048  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:19.340086  9117 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:19.305447  9048 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:19.340037  8871 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:19.291293  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:18.971253  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 159638us
I20260925 16:43:18.868168 10960 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:19.340296  9120 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:18.965279  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:18.902985  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.287286  9693 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:18.902500  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.372047  9698 rpcz_store.cc:276] 0925 16:43:17.746490 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.288836 (+1542346us) service_pool.cc:227] Handling call
0925 16:43:19.289347 (+   511us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.289721 (+   374us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.289775 (+    54us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.289847 (+    72us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:19.289927 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.290030 (+   103us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.290170 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.421761  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.422550  9117 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:43:19.401492  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 394156us
I20260925 16:43:19.416658  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.300683  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.392077  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:19.357542  8921 auto_rebalancer.cc:254] failed to send replica move request: Aborted: Op aborted by new leader
W20260925 16:43:19.115054  8904 debug-util.cc:398] Leaking SignalData structure 0x7b080002d440 after lost signal to thread 7806
I20260925 16:43:19.429824  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.430043  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.924708  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.431384  9701 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
W20260925 16:43:19.436326  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800310d60 after lost signal to thread 8907
W20260925 16:43:19.441742  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800038660 after lost signal to thread 8999
W20260925 16:43:19.442463  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800038640 after lost signal to thread 9000
W20260925 16:43:19.443635  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08001366a0 after lost signal to thread 9074
W20260925 16:43:19.444738  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08002561e0 after lost signal to thread 9148
W20260925 16:43:19.445130  8904 debug-util.cc:398] Leaking SignalData structure 0x7b080035c9c0 after lost signal to thread 9149
I20260925 16:43:19.444813  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:19.446316  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800330f40 after lost signal to thread 9726
I20260925 16:43:19.295564  9695 rpcz_store.cc:276] 0925 16:43:18.035217 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.293411 (+1258194us) service_pool.cc:227] Handling call
0925 16:43:19.293968 (+   557us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.294456 (+   488us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.294484 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.294543 (+    59us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:19.294603 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.294685 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.294869 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.374841 10976 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:19.458859  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:18.992660  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.460078  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.461268  9115 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:19.461191  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.463052  9049 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:19.463985  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1792) took 2903 ms. Trace:
I20260925 16:43:19.464205  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.464412  9115 rpcz_store.cc:276] 0925 16:43:16.560854 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.462920 (+2902066us) service_pool.cc:227] Handling call
0925 16:43:19.463313 (+   393us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.463623 (+   310us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.463652 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.463711 (+    59us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:19.463751 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.463805 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.463902 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.465757  9049 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:19.466409  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1793) took 2905 ms. Trace:
I20260925 16:43:19.466792  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.456256  9696 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:19.468149  9123 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:19.468276  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.469838  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.470134  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1794) took 2908 ms. Trace:
I20260925 16:43:19.470552  9123 rpcz_store.cc:276] 0925 16:43:16.561407 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.468872 (+2907465us) service_pool.cc:227] Handling call
0925 16:43:19.469177 (+   305us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.469826 (+   649us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.469853 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.469892 (+    39us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:19.469926 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.469989 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.470085 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":140,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92}
I20260925 16:43:19.471122  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.461238  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2005) took 3129 ms. Trace:
I20260925 16:43:19.472172  9049 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:19.472543  9116 rpcz_store.cc:276] 0925 16:43:16.332142 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.460316 (+3128174us) service_pool.cc:227] Handling call
0925 16:43:19.460678 (+   362us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.460869 (+   191us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.460898 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.460970 (+    72us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:19.461018 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.461080 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.461175 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.473338  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.475023  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1800) took 2638 ms. Trace:
I20260925 16:43:19.476301 10840 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.476923  9694 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:18.987776 10749 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.372952 10987 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.492219 10987 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.439944  9122 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:19.380971 10829 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:19.453604  9124 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:19.461133  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:19.487133  9045 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:19.451347 10838 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.477804  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:19.453238  9089 connection.cc:232] RPC call timeout handler was delayed by -3.0125594999999521s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
I20260925 16:43:19.457808  9042 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
W20260925 16:43:19.500089  9089 connection.cc:232] RPC call timeout handler was delayed by -2.9063594999997804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20750000000000002s for a response
I20260925 16:43:19.313210  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:19.475801  9116 rpcz_store.cc:276] 0925 16:43:16.836953 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.473613 (+2636660us) service_pool.cc:227] Handling call
0925 16:43:19.473963 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.474668 (+   705us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.474702 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.474761 (+    59us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:19.474797 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.474852 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.474966 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:19.449396  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800095b40 after lost signal to thread 9727
I20260925 16:43:18.913317 10992 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:19.495465  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:19.436230  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 510016us
W20260925 16:43:19.500847  9089 connection.cc:232] RPC call timeout handler was delayed by -2.8703594999999495s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260925 16:43:19.300783 10832 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.504703  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 455) took 1014 ms. Trace:
I20260925 16:43:19.506240 11018 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:19.516052  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1804) took 2054 ms. Trace:
I20260925 16:43:19.522866  9120 rpcz_store.cc:276] 0925 16:43:17.452299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.492641 (+2040342us) service_pool.cc:227] Handling call
0925 16:43:19.506360 (+ 13719us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.506614 (+   254us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.506657 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.506703 (+    46us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:19.506744 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.506787 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.506867 (+    80us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:19.513863  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 123732us
I20260925 16:43:19.301877 11005 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:19.518253  9698 rpcz_store.cc:276] 0925 16:43:18.489909 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.434458 (+944549us) service_pool.cc:227] Handling call
0925 16:43:19.478474 (+ 44016us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.494851 (+ 16377us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.494883 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.498548 (+  3665us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:19.504487 (+  5939us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.504545 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.504656 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:19.529374  9089 connection.cc:232] RPC call timeout handler was delayed by -2.8046594999998433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21880000000000002s for a response
W20260925 16:43:19.529700  9089 connection.cc:232] RPC call timeout handler was delayed by -2.7794594999998026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260925 16:43:19.497912 10958 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260925 16:43:19.530483  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.531461  9116 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:19.533187 10981 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:19.533547 10981 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:18.817349  9044 rpcz_store.cc:276] 0925 16:43:17.454375 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:17.461955 (+  7580us) service_pool.cc:227] Handling call
0925 16:43:17.669709 (+207754us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:17.697589 (+ 27880us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:17.701794 (+  4205us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:17.713649 (+ 11855us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:17.717719 (+  4070us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:18.492861 (+775142us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b540008d754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:18.492925 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:18.493207 (+   282us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":33058048}
W20260925 16:43:19.539916  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 87100.8us
I20260925 16:43:19.553738  9702 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:19.554075 10693 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:19.554471 10693 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.554816 10693 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.555681  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 463) took 1064 ms. Trace:
I20260925 16:43:19.560062  9702 rpcz_store.cc:276] 0925 16:43:18.491737 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.858968 (+367231us) service_pool.cc:227] Handling call
0925 16:43:19.555503 (+696535us) spinlock_profiling.cc:243] Waited 257 ms on lock 0x7b5400534154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:19.555628 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":590523776}
W20260925 16:43:19.557492  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 339567us
I20260925 16:43:19.558952  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:19.563755  9120 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:19.521836 11018 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.564252  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1805) took 1981 ms. Trace:
I20260925 16:43:19.564671  9120 rpcz_store.cc:276] 0925 16:43:17.582670 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.563054 (+1980384us) service_pool.cc:227] Handling call
0925 16:43:19.563365 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.564046 (+   681us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.564209 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.566319 10976 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:19.568379  9121 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 2: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:19.569270  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1813) took 1076 ms. Trace:
I20260925 16:43:19.569597  9121 rpcz_store.cc:276] 0925 16:43:18.492499 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.291054 (+798555us) service_pool.cc:227] Handling call
0925 16:43:19.569111 (+278057us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:19.569220 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":436781312}
I20260925 16:43:19.571123  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1808) took 1577 ms. Trace:
I20260925 16:43:19.503909  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.571414  9121 rpcz_store.cc:276] 0925 16:43:17.994234 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.570337 (+1576103us) service_pool.cc:227] Handling call
0925 16:43:19.570626 (+   289us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.570847 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.570875 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.570926 (+    51us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:19.570957 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.571002 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.571077 (+    75us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.463330 10957 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.557756  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2001) took 3421 ms. Trace:
I20260925 16:43:19.575330  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1807) took 1892 ms. Trace:
W20260925 16:43:19.575819  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53161.6us
I20260925 16:43:19.598879  9045 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:19.598363  9120 rpcz_store.cc:276] 0925 16:43:17.683352 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.565347 (+1881995us) service_pool.cc:227] Handling call
0925 16:43:19.565633 (+   286us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.565828 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.565858 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.565935 (+    77us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:19.566008 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.566077 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.575278 (+  9201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.599308  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:19.585227  9050 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:19.524513 10749 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:19.622105  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:19.623092  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:19.623775  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:19.624466  9042 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.604290 10749 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.627250  9122 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:19.627915  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 246) took 2171 ms. Trace:
I20260925 16:43:19.631261  9122 rpcz_store.cc:276] 0925 16:43:17.456606 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.503567 (+2046961us) service_pool.cc:227] Handling call
0925 16:43:19.599914 (+ 96347us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.627618 (+ 27704us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.627858 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.564303 11018 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:19.534476 10981 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.626145 10992 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:19.629797  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:19.466797  9115 rpcz_store.cc:276] 0925 16:43:16.561148 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.465511 (+2904363us) service_pool.cc:227] Handling call
0925 16:43:19.465874 (+   363us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.466096 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.466122 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.466185 (+    63us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:19.466219 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.466270 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.466362 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.628876 10749 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.679816  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1814) took 1174 ms. Trace:
I20260925 16:43:19.683266  9121 rpcz_store.cc:276] 0925 16:43:18.492840 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.596325 (+1103485us) service_pool.cc:227] Handling call
0925 16:43:19.626512 (+ 30187us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.654700 (+ 28188us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.654725 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.654765 (+    40us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:19.666724 (+ 11959us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.666806 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.666934 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.635607 10997 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:19.692435  9043 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:19.664289 10976 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:19.693958  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 255) took 1183 ms. Trace:
I20260925 16:43:19.697626  9122 rpcz_store.cc:276] 0925 16:43:18.506688 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.640040 (+1133352us) service_pool.cc:227] Handling call
0925 16:43:19.664978 (+ 24938us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.681873 (+ 16895us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.681909 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.681982 (+    73us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:19.689480 (+  7498us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.689578 (+    98us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.689704 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:19.694828  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 149289us
I20260925 16:43:19.676362  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:19.700719  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 100523us
I20260925 16:43:19.702543  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1815) took 1187 ms. Trace:
I20260925 16:43:19.675034 10992 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:19.693200 10970 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.846s	user 0.009s	sys 0.001s
I20260925 16:43:19.705737  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.705736  9121 rpcz_store.cc:276] 0925 16:43:18.515345 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.684390 (+1169045us) service_pool.cc:227] Handling call
0925 16:43:19.696886 (+ 12496us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.702214 (+  5328us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.702246 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.702311 (+    65us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:19.702341 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.702387 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.702480 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:19.716653  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 414501us
I20260925 16:43:19.651227 10957 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:19.728287  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.695523  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:19.751111  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45172.1us
I20260925 16:43:19.691643 10997 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:19.716187 10992 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.756032  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:19.752727 10997 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:19.598294  9118 rpcz_store.cc:276] 0925 16:43:16.136488 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.431682 (+3295194us) service_pool.cc:227] Handling call
0925 16:43:19.502480 (+ 70798us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.515357 (+ 12877us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.515401 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.515475 (+    74us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:19.515541 (+    66us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.515610 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.557528 (+ 41918us) spinlock_profiling.cc:243] Waited 32.7 ms on lock 0x7b540010c050. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:19.557681 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":75212032}
I20260925 16:43:19.760864  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:19.762012  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.720412 10832 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.759644  9050 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.762573 10957 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.762575  9043 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
W20260925 16:43:19.764813  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:19.768227  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:19.769356  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:19.772607  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.773228 10832 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:19.773290  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:19.773820 10832 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.774291  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:19.774300 10832 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:19.775180  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:19.774623 10878 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:19.776680 10957 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:19.777061 10957 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:19.777400 10957 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.757800 11005 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:19.770495  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:19.720489 10970 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.770649 10847 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:19.811203 10999 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:19.799896  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.882933  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 263) took 1069 ms. Trace:
I20260925 16:43:19.883472  9122 rpcz_store.cc:276] 0925 16:43:18.813549 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.703108 (+889559us) service_pool.cc:227] Handling call
0925 16:43:19.881711 (+178603us) spinlock_profiling.cc:243] Waited 8.87 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:19.881958 (+   247us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.882484 (+   526us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.882520 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.882575 (+    55us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:19.882624 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.882700 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.882860 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20400512}
W20260925 16:43:19.884507  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 69390.2us
I20260925 16:43:19.827591 10953 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:19.820823  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1816) took 1281 ms. Trace:
I20260925 16:43:19.889335  9700 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260925 16:43:19.828629 10999 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:19.909677  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 134549us
W20260925 16:43:19.911572  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 141818us
I20260925 16:43:19.910598  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:19.912609  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:19.919095 10995 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:19.893503 10953 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:19.907722 10999 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:19.919509 10995 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:19.931036  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 625) took 1543 ms. Trace:
I20260925 16:43:19.931381  9700 rpcz_store.cc:276] 0925 16:43:18.387277 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.299768 (+912491us) service_pool.cc:227] Handling call
0925 16:43:19.300088 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:19.894085 (+593997us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.930823 (+ 36738us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54004c40d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:19.930987 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1338085120}
I20260925 16:43:19.935096  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.926450 10953 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:19.945299 10832 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:19.979126  9050 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260925 16:43:19.948299 10960 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.518s	user 0.010s	sys 0.000s
I20260925 16:43:19.960247  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.964078  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.965312 10970 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:19.967021 10908 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:19.931937 10995 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
W20260925 16:43:20.017649  9047 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.002s	sys 0.020s
W20260925 16:43:20.018129  9047 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.002s	sys 0.020s
I20260925 16:43:19.991291  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:20.022154  9123 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.012s	sys 0.011s
W20260925 16:43:20.022501  9123 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.550s	user 0.012s	sys 0.011s
W20260925 16:43:20.024305  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 402243us
I20260925 16:43:20.028234  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:19.892719  9115 rpcz_store.cc:276] 0925 16:43:18.539185 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.692126 (+1152941us) service_pool.cc:227] Handling call
0925 16:43:19.755435 (+ 63309us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.771871 (+ 16436us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.778642 (+  6771us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:19.800113 (+ 21471us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:19.809347 (+  9234us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:19.811240 (+  1893us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:19.811366 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:19.989423 10815 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260925 16:43:20.031469  9701 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.570s	user 0.007s	sys 0.018s
I20260925 16:43:20.023595  9046 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:20.031862  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:20.049221  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.012s	sys 0.016s
I20260925 16:43:19.994520 10908 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:20.055598  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.012s	sys 0.016s
W20260925 16:43:20.055966  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 772684us
W20260925 16:43:20.054553  9701 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.007s	sys 0.022s
W20260925 16:43:20.028987 10987 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.016s
I20260925 16:43:20.029528  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.054446 10815 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.060504  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:20.061409 10981 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:20.057302 10908 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.090754 10953 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.092113  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:20.106462  9124 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.568s	user 0.012s	sys 0.013s
W20260925 16:43:20.107913  8940 outbound_call.cc:322] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.7.158.254:39187, user_credentials={real_user=slave}} blocked reactor thread for 48611.4us
I20260925 16:43:20.109798  9124 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
W20260925 16:43:20.110723  9124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1822) took 1411 ms (client timeout 1675 ms). Trace:
I20260925 16:43:20.109862  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:20.111315  9124 rpcz_store.cc:269] 0925 16:43:18.699146 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.281207 (+582061us) service_pool.cc:227] Handling call
0925 16:43:20.110674 (+829467us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:20.112100  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.041s
W20260925 16:43:20.112519  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.001s	sys 0.041s
W20260925 16:43:20.113112  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.018s	sys 0.026s
I20260925 16:43:20.113211  9120 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
W20260925 16:43:20.113500  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.018s	sys 0.026s
I20260925 16:43:20.112022  9045 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:20.016180 10960 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:20.107241 10975 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.689s	user 0.012s	sys 0.007s
W20260925 16:43:20.130715  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70321.8us
I20260925 16:43:20.111539 10815 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:20.138888  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 252) took 1623 ms. Trace:
I20260925 16:43:20.140880  9120 rpcz_store.cc:276] 0925 16:43:18.505693 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.599618 (+1093925us) service_pool.cc:227] Handling call
0925 16:43:20.110674 (+511056us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:20.118541 (+  7867us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.128933 (+ 10392us) spinlock_profiling.cc:243] Waited 486 ms on lock 0x7b54003bf6d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:20.129091 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1116694784}
I20260925 16:43:20.107507  9044 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:20.099282 10749 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.055344 10693 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.172813  9048 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:20.107443 10987 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.185590  9043 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260925 16:43:20.175177 10958 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:20.197919  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:20.132200 10975 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:20.191756  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 288979us
W20260925 16:43:20.191255  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 280736us
I20260925 16:43:20.202234  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:20.184795  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:20.193372 11042 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.390s	user 0.001s	sys 0.004s
W20260925 16:43:20.209324  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 179843us
I20260925 16:43:20.210305  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1317) took 1129 ms. Trace:
I20260925 16:43:20.210671  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:20.213924  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1795) took 3652 ms. Trace:
I20260925 16:43:20.219830 11000 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:20.212435  9695 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
W20260925 16:43:20.215099  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 222559us
I20260925 16:43:20.228000  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:20.206816 10832 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.238520  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 466) took 1745 ms. Trace:
I20260925 16:43:20.222026  9047 rpcz_store.cc:276] 0925 16:43:19.081364 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.090503 (+  9139us) service_pool.cc:227] Handling call
0925 16:43:19.100766 (+ 10263us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.101053 (+   287us) raft_consensus.cc:1520] Early marking committed up to index 3
0925 16:43:19.461390 (+360337us) log.cc:842] Serialized 14 byte log entry
0925 16:43:20.209927 (+748537us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:20.209990 (+    63us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:20.210051 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.210128 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.210247 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":432847,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":193896,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":1209,"thread_start_us":1039170,"threads_started":3,"wal-append.queue_time_us":670809}
I20260925 16:43:20.222605  9123 rpcz_store.cc:276] 0925 16:43:16.561693 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.471714 (+2910021us) service_pool.cc:227] Handling call
0925 16:43:19.472018 (+   304us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.472296 (+   278us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:43:20.022817 (+550521us) log.cc:842] Serialized 14 byte log entry
0925 16:43:20.213147 (+190330us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:20.213238 (+    91us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:20.213384 (+   146us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.213528 (+   144us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.213792 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":704599,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":8937,"thread_start_us":642013,"threads_started":2}
I20260925 16:43:20.212553 10951 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:20.239089  9701 rpcz_store.cc:276] 0925 16:43:18.492884 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.460119 (+967235us) service_pool.cc:227] Handling call
0925 16:43:19.460419 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.460650 (+   231us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:20.056641 (+595991us) log.cc:842] Serialized 14 byte log entry
0925 16:43:20.237774 (+181133us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:20.237903 (+   129us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:20.238040 (+   137us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.238181 (+   141us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.238397 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":505792,"prepare.run_cpu_time_us":22,"prepare.run_wall_time_us":23,"raft.queue_time_us":11728,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":7815,"thread_start_us":773213,"threads_started":3}
I20260925 16:43:20.238102  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.221357  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:20.252981  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50846.9us
I20260925 16:43:20.187147  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "12359c2bff0b46de91daa934c219103c"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:20.253258  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:20.227871 11000 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:20.256263  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 251) took 2792 ms. Trace:
I20260925 16:43:20.233285  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 586) took 1735 ms. Trace:
I20260925 16:43:20.254572  8967 raft_consensus.cc:595] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:20.248348 10970 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260925 16:43:20.257055 11018 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.586s	user 0.018s	sys 0.009s
I20260925 16:43:20.287163  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:20.287720  9665 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:20.287242  9050 raft_consensus.cc:2396] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260925 16:43:20.288511  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59068.9us
I20260925 16:43:20.277210  9116 rpcz_store.cc:276] 0925 16:43:17.457796 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.532573 (+2074777us) service_pool.cc:227] Handling call
0925 16:43:19.533022 (+   449us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.533376 (+   354us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:20.056814 (+523438us) log.cc:842] Serialized 14 byte log entry
0925 16:43:20.210513 (+153699us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:20.221044 (+ 10531us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:20.224202 (+  3158us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.236960 (+ 12758us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.250096 (+ 13136us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":671456,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":112,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"thread_start_us":640291,"threads_started":2,"wal-append.queue_time_us":143799}
W20260925 16:43:20.297792 11053 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:43:20.299419  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2002) took 4108 ms. Trace:
I20260925 16:43:20.277319 11000 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:20.313470  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:20.241606 10840 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260925 16:43:20.282989  9046 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
W20260925 16:43:20.306945  8941 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.779s (SENT)
I20260925 16:43:20.302445  9117 rpcz_store.cc:276] 0925 16:43:16.191115 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.439538 (+3248423us) service_pool.cc:227] Handling call
0925 16:43:19.512640 (+ 73102us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:19.531758 (+ 19118us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.531786 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:19.532192 (+   406us) log.cc:842] Serialized 26 byte log entry
0925 16:43:20.114012 (+581820us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:20.114061 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.114146 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:20.299185 (+185039us) raft_consensus.cc:1671] finished
0925 16:43:20.299208 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.299355 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":897,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":581479,"threads_started":1,"wal-append.queue_time_us":656208}
I20260925 16:43:20.290644 10953 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:43:20.281422 10976 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:20.329623  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:20.313342 10997 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.553s	user 0.014s	sys 0.017s
W20260925 16:43:20.332216  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 98671.9us
I20260925 16:43:20.280659  9697 rpcz_store.cc:276] 0925 16:43:18.488845 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.340388 (+851543us) service_pool.cc:227] Handling call
0925 16:43:19.340735 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:19.341022 (+   287us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:19.917174 (+576152us) log.cc:842] Serialized 14 byte log entry
0925 16:43:20.198144 (+280970us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:20.204876 (+  6732us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:20.210171 (+  5295us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.213824 (+  3653us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.224213 (+ 10389us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":589212,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":20506,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":4395,"thread_start_us":687157,"threads_started":2,"wal-append.queue_time_us":270672}
I20260925 16:43:20.285708 11069 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:20.285864 10970 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:20.286366 10838 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:20.321892 11005 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:20.328366 10960 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.331729 10966 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:20.361869 10966 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.362493 10966 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:20.330355 10749 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.349752 10987 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:20.330777 11071 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260925 16:43:20.343844  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 90000us
I20260925 16:43:20.300024 11018 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.322083 10847 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260925 16:43:20.340143 10970 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.330555 10976 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.362957 11072 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:20.336066 11069 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:20.369640  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 168907us
W20260925 16:43:20.374571  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49974.5us
I20260925 16:43:20.386277 11082 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
W20260925 16:43:20.381312  9042 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.736s	user 0.018s	sys 0.001s
I20260925 16:43:20.369629 11071 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.378680 11064 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:20.393527 11071 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.393755 11064 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.393469  9044 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:20.390856  9042 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:20.396318  9048 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:20.398654  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:20.398985 11051 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260925 16:43:20.408820  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.409153  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.409464  9116 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:20.390308 11060 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:20.409521 11018 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.410418 11060 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.410560  9043 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:20.410817 11060 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.412572 10693 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.357704 10951 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:20.379988 11067 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260925 16:43:20.434722 10987 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:20.452522  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.435431 10749 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:20.453531 11074 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:20.436506  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.453966 11074 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:20.452785  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:20.454510  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:20.378386 11055 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:43:20.437465 10953 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:20.455639 10953 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:20.456001 10953 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:20.438102  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47698.1us
I20260925 16:43:20.438580  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.439157 10847 consensus_queue.cc:1225] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260925 16:43:20.441349  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.441849  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:20.442034  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.443001  9694 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:20.443490  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.444082  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.444666  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.447161 10832 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:20.447991  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 590) took 1638 ms. Trace:
W20260925 16:43:20.448424 10829 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.941s	user 0.013s	sys 0.009s
W20260925 16:43:20.432335 10957 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.655s	user 0.001s	sys 0.010s
W20260925 16:43:20.449319  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.536s (SENT)
I20260925 16:43:20.450073 10995 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.450466  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:20.450929 10992 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.683s	user 0.004s	sys 0.004s
I20260925 16:43:20.338678 10997 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.453756  9120 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:20.454867  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.452831  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.440503 11064 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.406991 11071 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.452144 10970 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.519568 11071 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.375133 10975 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.416787 10976 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.520485 10970 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.521204  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.522055  9118 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:20.522864  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.496906  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.454808 11074 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.524608  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.525705  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.526063 11061 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:20.526414 11061 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:20.526727  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.499728  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:20.530408  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81103.6us
I20260925 16:43:20.533450  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.500254 11087 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:20.506208 10847 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260925 16:43:20.506135  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64349.1us
I20260925 16:43:20.554117  9042 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:20.554065  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.443194 11000 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.416656 11069 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:20.507300  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.452857 10951 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:20.511494  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1333) took 1051 ms. Trace:
I20260925 16:43:20.513849  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.513931  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.572757  9120 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:20.517302  9693 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.536628  9043 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:43:20.536814  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.537413  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.537631  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.456736 10953 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.501667  9695 rpcz_store.cc:276] 0925 16:43:18.809656 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.465569 (+655913us) service_pool.cc:227] Handling call
0925 16:43:19.465846 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:20.233589 (+767743us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.447740 (+214151us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400532354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:20.447937 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1693411584}
W20260925 16:43:20.540366 11059 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260925 16:43:20.545408 11078 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:20.547766 10815 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.497490 10832 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:20.548319 11064 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:20.548696 11085 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:20.423904 10908 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.568002  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.577672  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.562757 10847 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:20.580693  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 269279us
I20260925 16:43:20.569196  9049 rpcz_store.cc:276] 0925 16:43:19.459805 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.476259 (+ 16454us) service_pool.cc:227] Handling call
0925 16:43:19.500259 (+ 24000us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:19.506195 (+  5936us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:19.506236 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:19.506772 (+   536us) log.cc:842] Serialized 26 byte log entry
0925 16:43:20.112897 (+606125us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:20.291049 (+178152us) log.cc:842] Serialized 14 byte log entry
0925 16:43:20.311437 (+ 20388us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.311523 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:20.455964 (+144441us) raft_consensus.cc:1671] finished
0925 16:43:20.455981 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:20.506972 (+ 50991us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b540011e750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:20.511403 (+  4431us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8924,"prepare.queue_time_us":91499,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":63,"raft.queue_time_us":62303,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":20290,"spinlock_wait_cycles":54450560,"thread_start_us":704032,"threads_started":2,"wal-append.queue_time_us":706934}
I20260925 16:43:20.581283 10997 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.583341  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.583899  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.510308 10957 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.584093  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.578398  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.589272  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.591576  9124 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:20.452893 10999 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.592847  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.598065  9117 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:20.595597  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.509801 10829 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.514976 10992 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.597438  9045 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:20.602244  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.583185 10953 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:20.527215 11061 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.584704 11078 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:20.609573  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.612612  9697 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.611891  9050 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:20.612785 11078 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.595299 10847 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.610390  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.622171  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:20.620306  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.625584 11056 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260925 16:43:20.626701 11056 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:20.627137 11056 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:20.627946  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.627894 10975 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:20.628849 10975 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:20.629164 10975 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:20.629870 10975 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.630930 10975 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:20.622412  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.639971  8970 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:20.640097  9041 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:20.640777  8971 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:20.585072 11072 consensus_queue.cc:1159] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "225d3432101a4758bb9a6b0efeae09c5" responder_term: 4 status { last_received { term: 2 index: 5 } last_committed_idx: 4 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:43:20.589318 11060 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.645603 10966 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.646456 11087 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:20.647017 11060 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.648324 11000 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.648576 10815 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:20.648854 10832 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.650367 11078 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:20.651083 10957 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.652706 10829 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.615444  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.653357 10999 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:20.653661  9118 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:20.654141  9695 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:20.654716  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.654763 10951 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.609114 11082 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.049s
I20260925 16:43:20.639151  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.687877  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:20.665217  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73415.3us
I20260925 16:43:20.695747  9124 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:20.684734  9120 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:20.697055  9121 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260925 16:43:20.647558 10966 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:20.656359 11061 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
W20260925 16:43:20.703428  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64344.6us
I20260925 16:43:20.705404  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.706202  8967 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:20.708472  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.715929  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:20.718523 10981 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.604s	user 0.002s	sys 0.007s
I20260925 16:43:20.712321  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.720023  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.718353  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:20.723110  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 170722us
I20260925 16:43:20.724603  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.726090  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:20.729255 11062 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:20.729728  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.695173 10815 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260925 16:43:20.739840  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:20.727634 11079 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.111s	user 0.001s	sys 0.000s
I20260925 16:43:20.703972 10693 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
I20260925 16:43:20.740025 10847 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.745326  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.739032 11062 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:20.746526 10847 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.746716 10908 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.747841 11086 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:20.748385  9693 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:20.749248 10992 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.749423 10951 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.726558 11081 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:20.752614  8967 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:20.730278 10981 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:20.757910  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.759788  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.737265  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:20.763767  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c6030f186a664452b127609fadec766b, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.763121  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.742432 11087 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260925 16:43:20.766729  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c6030f186a664452b127609fadec766b, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.765017  8971 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:20.767419  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.767807  9693 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:20.775677  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.776710  8972 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:20.777288  9698 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:20.770623 11087 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.778095 11087 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:20.778880  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.782847  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.784369  9119 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:20.784787 11056 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.785550  9119 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:20.786012 11056 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:20.789047  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.789443 10999 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:20.790220 10999 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:20.793083 10995 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:20.793367  9117 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:20.756879 11062 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:20.757052 11081 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:20.810053  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.810829  9696 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.811584  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:20.845064  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 82078us
I20260925 16:43:20.845276  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.845875  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.845836  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.808708  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:20.776346 11074 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:20.847738  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 242252us
I20260925 16:43:20.852669  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 453) took 2363 ms. Trace:
W20260925 16:43:20.852870  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45704.5us
I20260925 16:43:20.853796  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.854337  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:20.853067  9699 rpcz_store.cc:276] 0925 16:43:18.489530 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.341650 (+852120us) service_pool.cc:227] Handling call
0925 16:43:19.342126 (+   476us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:20.622584 (+1280458us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:20.852464 (+229880us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540079e5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:20.852617 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2929212288}
W20260925 16:43:20.847563  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46427.3us
I20260925 16:43:20.846419  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.805967 11081 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:20.849694  9697 raft_consensus.cc:2362] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3. Re-sending same reply.
I20260925 16:43:20.845831 10838 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:20.850386  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.869553  9693 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.871748  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.859479  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:20.812270  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:20.876457  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.858108  8970 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:20.875218  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.875572  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:20.887271  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.888041  9699 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.844370 11085 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:20.879762 10951 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:20.888922  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.889561  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:20.904856  9050 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:20.890920  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.891275  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.892333  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.857920 10995 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:20.906247 10951 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:20.850912 11086 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260925 16:43:20.909178 10995 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:20.797155 10999 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.887943  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:20.895854 10749 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:20.912935 10749 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:20.913650 11087 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.913862 10749 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.909654 10995 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:20.899830 10976 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:20.861330  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:20.901494  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.902020 11062 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.887400  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:20.907827  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.911850  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.855911 10953 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:20.915941  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.925990  8966 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:20.932214  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44894.2us
W20260925 16:43:20.939839  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49600.2us
I20260925 16:43:20.919274  9694 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.943604  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.944383  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.944720  9701 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:20.943811  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:20.945881  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:20.925047 11072 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:20.918814 10976 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:20.915673 11087 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:20.932804 11086 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:20.932991 10981 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:20.993497 10981 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:20.994666 10981 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:20.915867  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.971279  8974 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:20.997476 10981 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:20.965332  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:20.927517 10838 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:20.947710  8966 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:21.017453  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:21.018793  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:21.019048  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:20.957904 10878 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260925 16:43:21.023300  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56718.7us
I20260925 16:43:21.025893  9050 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:21.026697  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.026870  9700 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:21.024102  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 74631.7us
I20260925 16:43:21.027454  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:21.028355  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:21.029788  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 63888.4us
I20260925 16:43:21.030442 10838 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:21.030593 11057 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:20.918354 11100 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260925 16:43:21.030944  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.030958 10838 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:20.911643 10951 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.035557  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:21.035557  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 327132us
I20260925 16:43:21.035774  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:21.023097 10829 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:21.019639  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:21.026590 10878 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:20.999493 11081 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.018494 10975 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260925 16:43:21.035462 10976 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
W20260925 16:43:21.048295 11098 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
I20260925 16:43:20.932462 11085 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.047874 10878 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:21.059129  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.038611 10838 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:21.041335 11086 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:21.113833  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.275945  9702 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:21.188197  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.301592  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:21.302222  9117 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.303350  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.296511  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.306208  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:21.308035  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 254448us
I20260925 16:43:21.307087  9122 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:21.311383  8970 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:21.062633 11082 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:21.313555  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:21.316541  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:21.205643 11104 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260925 16:43:21.321902  9120 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
W20260925 16:43:21.150326 11101 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260925 16:43:21.318810  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 256098us
W20260925 16:43:21.312655 11069 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.722s	user 0.008s	sys 0.003s
I20260925 16:43:21.126379 11087 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:21.188881 11105 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.002s
W20260925 16:43:21.317929  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 256134us
I20260925 16:43:21.322850  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.100620 10976 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:21.323813  8971 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.324208  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.150765 11099 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:21.325150  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.325234  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.326313  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.318965 11086 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:21.323096 11078 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:21.344184 11078 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:21.344635 11078 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:21.344527 11092 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:21.108342 10966 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:21.344195  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.349486  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.339500  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:21.350569  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.347327 10966 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.351290  9123 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:21.307878 10975 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:21.351871 10975 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:21.352428 10966 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:21.352941 10966 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:21.352648 10975 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.353622 10975 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:21.354782 10976 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.329864  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.327543  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.317231 11081 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:21.336184  8970 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.353668  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.336714  8966 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:21.335265 11087 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.121057 10958 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.208s
I20260925 16:43:21.336843  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.341763  9701 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:21.358268  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.342139  9695 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:21.358803  8968 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.360652 11083 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:21.361732 11083 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:21.361778  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:21.362154 11083 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:21.363152 10958 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:21.363947  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.328550 11069 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.363722 11083 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.365585  9047 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260925 16:43:21.366425 11081 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:21.366779 11081 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:21.367035 11069 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:21.367282  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 1956) took 1248 ms. Trace:
I20260925 16:43:21.363586 10958 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.367971  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.369030  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:21.334661 11082 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:21.368881 11083 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:21.371042 11082 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.367558 11081 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.372802 11081 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:21.373502  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.259068  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:21.374485  9118 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:21.375375 11087 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:21.359592  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:21.150648 10981 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.177s
I20260925 16:43:21.342621 10878 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.206131 10995 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.367654  9047 rpcz_store.cc:276] 0925 16:43:20.118789 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.262297 (+143508us) service_pool.cc:227] Handling call
0925 16:43:20.284905 (+ 22608us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:21.365943 (+1081038us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:21.367068 (+  1125us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54002a2954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:21.367234 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2484744960}
I20260925 16:43:21.369978 10958 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:21.337265  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.377347  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:21.389009  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:21.433511  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56237.3us
I20260925 16:43:21.433123  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.406204  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.434872  8967 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.435153  8968 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.403813  9700 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:21.431433  8973 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.434033  9117 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:21.393499  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.391258  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.440238  8966 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:21.450280  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:21.405457 11056 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.619s	user 0.004s	sys 0.004s
I20260925 16:43:21.400818 10981 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:21.440708  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.439028  9118 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:21.436672 11080 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260925 16:43:21.458376  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 105153us
I20260925 16:43:21.452381  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.459017  8970 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:21.468269  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 142023us
I20260925 16:43:21.457708 11108 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:21.458160 10960 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:21.402312 10878 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:21.482087  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.510664  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:21.512123  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 193470us
I20260925 16:43:21.517110  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.517858  8967 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:21.487272  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:21.518042 11102 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.409s	user 0.008s	sys 0.010s
I20260925 16:43:21.518453  8970 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:21.519994 11087 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:21.520684 11087 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.522671  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.522936 11087 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:21.523720  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.524659  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:21.362161 11078 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:21.491919  9694 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:21.494506  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:21.495222  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:21.496112 11109 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:21.496954 11111 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:43:21.498327 11116 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:21.458190  8969 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.501339  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.479033 10981 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:21.508620  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.509011  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 642) took 1086 ms. Trace:
I20260925 16:43:21.548110  9702 rpcz_store.cc:276] 0925 16:43:20.422930 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.509859 (+ 86929us) service_pool.cc:227] Handling call
0925 16:43:21.508839 (+998980us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:21.508961 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1612437888}
I20260925 16:43:21.518491  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.448246 11099 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:21.526842  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.527382  9117 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:21.520589  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.421883 10995 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:21.489147  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:21.531330  9699 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:21.553807  8966 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:21.540583  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:21.555218  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:21.552356  9700 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:21.552717  9697 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:21.557399  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:21.549396  8967 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:21.559197  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:21.560369  9043 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
W20260925 16:43:21.564318  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75590us
I20260925 16:43:21.564541  9045 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:21.565290  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:21.568789  9701 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:21.545820 10960 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:21.547278 10958 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.104s
I20260925 16:43:21.545480 11108 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
W20260925 16:43:21.712535  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50968.1us
I20260925 16:43:21.682412  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:21.574066  9050 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:21.697388  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 236189us
W20260925 16:43:21.767088  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 200153us
I20260925 16:43:21.771441  8966 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:21.773999  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:21.771978  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 214634us
I20260925 16:43:21.844434  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:21.923069 11082 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:21.923970 11082 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.929183 11082 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:21.656610 10878 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
W20260925 16:43:22.049290  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 266111us
I20260925 16:43:22.050601  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:22.056030  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 281336us
I20260925 16:43:22.056798  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:22.052438  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:22.061606  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 276547us
I20260925 16:43:22.062005  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2024) took 1533 ms. Trace:
I20260925 16:43:21.563956 10749 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.396s
I20260925 16:43:22.062383  9120 rpcz_store.cc:276] 0925 16:43:20.529015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.702285 (+173270us) service_pool.cc:227] Handling call
0925 16:43:20.702660 (+   375us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:21.323491 (+620831us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.061789 (+738298us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400143f54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:22.061951 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1420394752}
I20260925 16:43:22.063131  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 280) took 1194 ms. Trace:
I20260925 16:43:21.770174  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.063534  9122 rpcz_store.cc:276] 0925 16:43:20.868301 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.890695 (+ 22394us) service_pool.cc:227] Handling call
0925 16:43:22.062921 (+1172226us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.063060 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":715672960}
I20260925 16:43:22.064726  9121 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260925 16:43:22.066246  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1641) took 1398 ms (client timeout 1574 ms). Trace:
W20260925 16:43:22.066713  8974 rpcz_store.cc:269] 0925 16:43:20.667804 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.687503 (+ 19699us) service_pool.cc:227] Handling call
0925 16:43:22.066114 (+1378611us) spinlock_profiling.cc:243] Waited 282 ms on lock 0x7b54003e7e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.066199 (+    85us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":649680128}
W20260925 16:43:22.067539 11114 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.392s	user 0.001s	sys 0.000s
I20260925 16:43:22.067796  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.067873 10958 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:22.068939  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1650) took 1216 ms. Trace:
I20260925 16:43:22.066339  9693 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:22.062862  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.069651  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 276) took 1270 ms. Trace:
I20260925 16:43:22.077438  9049 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 2: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:22.067173 11126 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:21.661867 11072 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.398s
I20260925 16:43:21.766091 11111 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.424s
I20260925 16:43:21.719605 10981 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:21.956828 11115 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.460s
I20260925 16:43:21.675688 11116 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:21.566622 10908 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:22.227458  9120 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:21.625728 10951 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:22.069267  8972 rpcz_store.cc:276] 0925 16:43:20.852207 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.854270 (+  2063us) service_pool.cc:227] Handling call
0925 16:43:20.876980 (+ 22710us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:20.948606 (+ 71626us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:20.948647 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:21.020868 (+ 72221us) log.cc:842] Serialized 26 byte log entry
0925 16:43:21.305835 (+284967us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:21.546681 (+240846us) log.cc:842] Serialized 14 byte log entry
0925 16:43:21.612528 (+ 65847us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:21.612604 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:22.068754 (+456150us) raft_consensus.cc:1671] finished
0925 16:43:22.068779 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.068887 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":138090,"prepare.queue_time_us":456262,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":138886,"raft.run_cpu_time_us":267,"raft.run_wall_time_us":28285,"thread_start_us":490815,"threads_started":2,"wal-append.queue_time_us":519130}
I20260925 16:43:22.193114  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:22.236436  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:22.165164  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:22.072764  9121 rpcz_store.cc:276] 0925 16:43:20.799408 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.912877 (+113469us) service_pool.cc:227] Handling call
0925 16:43:21.371451 (+458574us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:22.064330 (+692879us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fcab7c 00007f7198fca73b 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:22.064493 (+   163us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:22.065487 (+   994us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.069596 (+  4109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":53940352}
I20260925 16:43:21.961414  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:22.228463  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.009s	sys 0.000s
I20260925 16:43:22.119875  8966 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:22.228343  8973 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.002s	sys 0.007s
W20260925 16:43:22.423487  9090 leader_election.cc:334] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 2.008s (SENT)
I20260925 16:43:22.424104  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.431522  8967 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:22.282171  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:22.048601 10878 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.209908  8969 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:22.458657  9694 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:22.451427 10693 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.013s
I20260925 16:43:22.463887 11127 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:22.464296 11127 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:22.458704 11092 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.113s	user 0.006s	sys 0.003s
I20260925 16:43:22.464684 10693 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:22.465044 11092 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:22.465680  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.466102  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.466316  8969 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:22.466869  8974 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:22.467557  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.010s	sys 0.006s
W20260925 16:43:22.468371  8973 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.794s	user 0.008s	sys 0.008s
I20260925 16:43:22.469367  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:22.073942 11083 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.702s	user 0.008s	sys 0.000s
I20260925 16:43:22.469136  9701 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:22.470803  9042 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
W20260925 16:43:22.468114  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 890413us
I20260925 16:43:22.464963  9049 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:43:22.450186  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.478336  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.459564  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:22.481490  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 199437us
I20260925 16:43:22.482595  8972 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
W20260925 16:43:22.450424 11118 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.788s	user 0.001s	sys 0.000s
W20260925 16:43:22.460011 10838 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.136s	user 0.011s	sys 0.000s
W20260925 16:43:22.456271 11120 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.690s	user 0.001s	sys 0.000s
W20260925 16:43:22.450969 11123 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.381s	user 0.000s	sys 0.000s
I20260925 16:43:22.388375 11080 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:22.441805 11126 consensus_queue.cc:1225] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260925 16:43:22.456386 11122 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.680s	user 0.001s	sys 0.000s
I20260925 16:43:22.194520 11106 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:22.192272 11108 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.303s
I20260925 16:43:22.430872 11128 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:22.354771 10749 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:22.477334 11099 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.912s	user 0.004s	sys 0.004s
I20260925 16:43:22.469125 11116 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:22.530583 11116 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:21.960160  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:22.490013 11005 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260925 16:43:22.537602 10832 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:22.494575 10953 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260925 16:43:22.541026 11057 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:22.537247 11005 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:22.542058 11005 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:22.542768 11005 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.543720  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1351) took 1003 ms. Trace:
I20260925 16:43:22.543920 11005 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:22.544377 11081 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:22.544791 11081 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.503111 11092 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:22.496196  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 445665us
W20260925 16:43:22.499233  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 75784.5us
I20260925 16:43:22.506618  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.117838 10975 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.373s
I20260925 16:43:22.538766 10878 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.141280 10847 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:22.521987 11061 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:22.522030  9042 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:22.493455 10908 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:22.541548 11057 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.269989 11078 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:22.448705 10999 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:22.519752 10981 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:22.572908  9120 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:22.471840 10693 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:22.226488 10960 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.494831 10951 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260925 16:43:22.564230  8966 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:22.565230  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:22.569902  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 507063us
I20260925 16:43:22.591192  9117 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:22.545600 11081 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.465068 11127 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.573998  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.560093 11099 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:22.585289  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 512825us
I20260925 16:43:22.600389  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.602142  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.503506 10838 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.604342 10838 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:22.604988 10838 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:22.606015  8971 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:22.571345 11064 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:22.595232  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.529176 11085 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.051s
I20260925 16:43:22.571826 11134 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:22.522185 11080 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:22.582136  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90047.8us
I20260925 16:43:22.614300  9122 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:22.573861 11137 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:22.523833 11106 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.605381 10838 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.621722 11137 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.622551 11137 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.623281 11106 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:22.622692 10838 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.574847 11061 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.623970 10838 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:22.625322 11061 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:22.625522 11141 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:22.616712 11064 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.626479 11057 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.584615 10908 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:22.620628 11080 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:22.621357  9666 connection.cc:232] RPC call timeout handler was delayed by -1.8077167260000806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22360000000000002s for a response
I20260925 16:43:22.651502  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:22.652300  9666 connection.cc:232] RPC call timeout handler was delayed by -1.2304042170001139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
W20260925 16:43:22.652740  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0740066959999695s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1874s for a response
I20260925 16:43:22.618093 11134 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.548834 10749 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.632630  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:22.659817  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1352) took 1093 ms. Trace:
I20260925 16:43:22.649938  9701 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:22.544212  9041 rpcz_store.cc:276] 0925 16:43:21.539938 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.546333 (+  6395us) service_pool.cc:227] Handling call
0925 16:43:22.542837 (+996504us) spinlock_profiling.cc:243] Waited 134 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:22.543072 (+   235us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:22.543273 (+   201us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:22.543316 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:22.543374 (+    58us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:22.543423 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.543497 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.543643 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":307677568}
I20260925 16:43:22.611729 10878 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:22.653119  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:22.662380  9120 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:22.653681  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.510s (SENT)
I20260925 16:43:22.655021  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.663143  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.597657 11128 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:22.575665 11092 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.052s
I20260925 16:43:22.660166  9043 rpcz_store.cc:276] 0925 16:43:21.565955 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.566090 (+   135us) service_pool.cc:227] Handling call
0925 16:43:22.632450 (+1066360us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:22.659759 (+ 27309us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":294942592}
I20260925 16:43:22.658594  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:22.666121  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:22.663611  8972 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:22.649437 11057 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:22.672801  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.516s (SENT)
I20260925 16:43:22.680707  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.676384 11064 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:22.676524  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.668471 11128 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:43:22.676991  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.008s	sys 0.019s
I20260925 16:43:22.677333  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:22.682438  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:22.682950 11069 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:22.684105 10987 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:22.649307 11132 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260925 16:43:22.687273  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:22.693881  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:22.694751  9117 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:22.696954  9697 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:22.665194 11081 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:22.700009  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 378) took 1166 ms. Trace:
W20260925 16:43:22.692869  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.008s	sys 0.020s
W20260925 16:43:22.695685 11130 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.119s	user 0.001s	sys 0.001s
I20260925 16:43:22.708101  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:22.701539  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.518s (SENT) [suppressed 82 similar messages]
W20260925 16:43:22.712880  9089 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.566s (SENT)
I20260925 16:43:22.698606 11069 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:22.705209  8973 rpcz_store.cc:276] 0925 16:43:21.533781 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.552077 (+ 18296us) service_pool.cc:227] Handling call
0925 16:43:21.570071 (+ 17994us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:21.637109 (+ 67038us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:22.468723 (+831614us) log.cc:842] Serialized 14 byte log entry
0925 16:43:22.699676 (+230953us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:22.699740 (+    64us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:22.699791 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.699855 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.699957 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":541792,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":22216,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":85,"thread_start_us":987908,"threads_started":3,"wal-append.queue_time_us":182258}
W20260925 16:43:22.719107  9089 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.575s (SENT)
I20260925 16:43:22.719529  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:22.720829  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.633s (SENT)
I20260925 16:43:22.725767  9701 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
W20260925 16:43:22.732424  9089 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.679s (SENT)
I20260925 16:43:22.732942  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:22.702848  9694 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:22.661168 10693 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.736330 11139 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:22.737550  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:22.704690  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1831) took 1395 ms. Trace:
I20260925 16:43:22.768496  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.764104 11018 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:22.792040 11018 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:22.792495  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:22.793089 11089 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:22.793655  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:22.718034 11056 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:22.796139 11056 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:22.797073 11056 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.745225  9046 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:22.722920 11069 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:22.804554 11128 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:22.805388 11143 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260925 16:43:22.807443 11146 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260925 16:43:22.807969 11132 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:22.810937 11147 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260925 16:43:22.723906 11138 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:22.725023  9693 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:22.726529 11061 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:22.814757 11099 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:22.794981  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.845580 10749 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:22.847826  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 110375us
I20260925 16:43:22.792551 11018 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:22.854028  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.533s (SENT)
I20260925 16:43:22.855407  9701 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:22.725644 10908 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.867199  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.704468 10987 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:22.858004  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125589us
I20260925 16:43:22.860370  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1841) took 1423 ms. Trace:
I20260925 16:43:22.857295 11132 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:22.863816  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1668) took 1581 ms (client timeout 1680 ms). Trace:
I20260925 16:43:22.864943  8872 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 338) took 4058 ms. Trace:
W20260925 16:43:22.869098  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.756s (SENT)
W20260925 16:43:22.875754  8971 rpcz_store.cc:269] 0925 16:43:21.282253 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.333380 (+ 51127us) service_pool.cc:227] Handling call
0925 16:43:22.863606 (+1530226us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54002cb5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.863757 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2854634880}
I20260925 16:43:22.876730  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:22.882753  9015 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.574s (SENT)
W20260925 16:43:22.884451  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.957s (SENT)
I20260925 16:43:22.884864  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:22.885553 11061 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:22.888274  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.577s (SENT)
W20260925 16:43:22.892108  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.075s (SENT)
I20260925 16:43:22.889827  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:22.894282  8971 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:22.896498  9015 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.630s (SENT)
I20260925 16:43:22.889261 11099 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:22.804049 11139 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.087s
I20260925 16:43:22.900125  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:22.902463  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.115s (SENT)
I20260925 16:43:22.906818  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.886607 11106 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:22.903867  9666 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.508s (SENT)
I20260925 16:43:22.905874  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.905138 11093 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260925 16:43:22.911962 11061 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:22.914408  9089 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.793s (SENT)
I20260925 16:43:22.875720 11116 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.918903  8972 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:22.914798  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:22.922154 10958 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:22.922539 10958 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.744900  9115 rpcz_store.cc:276] 0925 16:43:21.309381 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.311359 (+  1978us) service_pool.cc:227] Handling call
0925 16:43:21.342425 (+ 31066us) spinlock_profiling.cc:243] Waited 7.07 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:21.342628 (+   203us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:21.342872 (+   244us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:21.342908 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:21.343327 (+   419us) log.cc:842] Serialized 26 byte log entry
0925 16:43:21.545357 (+202030us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:21.551945 (+  6588us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:21.563950 (+ 12005us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:22.686220 (+1122270us) spinlock_profiling.cc:243] Waited 5.32 ms on lock 0x7b24001afaf8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198e5acf4 00007f7198e58dfb 00007f7198ee7559 00007f7198ee71e5 00007f7198ee6740 00007f719bbd9578 00007f719bbd9cd8 00007f719bbb16e8 00007f719bbacaea 00007f719bbabf36
0925 16:43:22.688363 (+  2143us) raft_consensus.cc:1671] finished
0925 16:43:22.690999 (+  2636us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.702790 (+ 11791us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28500224,"thread_start_us":188271,"threads_started":1,"wal-append.queue_time_us":303863}
I20260925 16:43:22.924693  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 380) took 1351 ms. Trace:
I20260925 16:43:22.924959  9696 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:22.925110  8968 rpcz_store.cc:276] 0925 16:43:21.573262 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.573431 (+   169us) service_pool.cc:227] Handling call
0925 16:43:21.775096 (+201665us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:22.383587 (+608491us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:22.383633 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:22.426613 (+ 42980us) log.cc:842] Serialized 26 byte log entry
0925 16:43:22.572060 (+145447us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:22.572101 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.572303 (+   202us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:22.924496 (+352193us) raft_consensus.cc:1671] finished
0925 16:43:22.924522 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.924644 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":104080,"raft.queue_time_us":311568,"raft.run_cpu_time_us":201,"raft.run_wall_time_us":132087,"thread_start_us":325514,"threads_started":2,"wal-append.queue_time_us":242055}
W20260925 16:43:22.926688  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 382) took 1262 ms (client timeout 1536 ms). Trace:
I20260925 16:43:22.926828  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:22.927068  8967 rpcz_store.cc:269] 0925 16:43:21.681871 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.682107 (+   236us) service_pool.cc:227] Handling call
0925 16:43:22.926556 (+1244449us) spinlock_profiling.cc:243] Waited 667 ms on lock 0x7b540036ea54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.926640 (+    84us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1533731200}
I20260925 16:43:22.927908 10995 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:22.927986  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.928432 10995 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:22.929009 10987 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:22.859077 11138 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:22.933069  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.188s (SENT)
W20260925 16:43:22.926091  9696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 481) took 2128 ms (client timeout 2008 ms). Trace:
W20260925 16:43:22.951594  9696 rpcz_store.cc:269] 0925 16:43:20.797900 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:20.811334 (+ 13434us) service_pool.cc:227] Handling call
0925 16:43:22.925904 (+2114570us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b540079f754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.926007 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4770063232}
I20260925 16:43:22.875872  8872 rpcz_store.cc:276] 0925 16:43:18.806650 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.807887 (+  1237us) service_pool.cc:227] Handling call
0925 16:43:22.864868 (+4056981us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:19.649554 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:19.886044 (+236490us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:19.901198 (+ 15154us) write_op.cc:435] Acquired schema lock
0925 16:43:19.901224 (+    26us) tablet.cc:660] Decoding operations
0925 16:43:20.016921 (+115697us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:20.029531 (+ 12610us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:20.054883 (+ 25352us) tablet.cc:683] Acquiring locks for 2 operations
0925 16:43:20.194101 (+139218us) tablet.cc:699] Row locks acquired
0925 16:43:20.198755 (+  4654us) write_op.cc:260] PREPARE: finished
0925 16:43:20.219746 (+ 20991us) write_op.cc:270] Start()
0925 16:43:20.219915 (+   169us) write_op.cc:276] Timestamp: P: 1790354600211291 usec, L: 0
0925 16:43:20.219939 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:43:20.220601 (+   662us) log.cc:842] Serialized 924 byte log entry
0925 16:43:20.614235 (+393634us) op_driver.cc:444] REPLICATION: finished
0925 16:43:20.851114 (+236879us) write_op.cc:301] APPLY: starting
0925 16:43:20.856184 (+  5070us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:20.872182 (+ 15998us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:20.918441 (+ 46259us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:20.918813 (+   372us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:20.918970 (+   157us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0925 16:43:20.919016 (+    46us) write_op.cc:312] APPLY: finished
0925 16:43:20.919196 (+   180us) log.cc:842] Serialized 29 byte log entry
0925 16:43:20.919360 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:20.919436 (+    76us) write_op.cc:454] Released schema lock
0925 16:43:20.919474 (+    38us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:20.928780 (+  9306us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:20.933677 (+  4897us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":7,"reported_tablets":5,"child_traces":[["op",{"apply.queue_time_us":189576,"apply.run_cpu_time_us":2462,"apply.run_wall_time_us":86322,"num_ops":2,"prepare.queue_time_us":689950,"prepare.run_cpu_time_us":20829,"prepare.run_wall_time_us":697254,"raft.queue_time_us":295928,"raft.run_cpu_time_us":65340,"raft.run_wall_time_us":281396,"replication_time_us":394190,"thread_start_us":529190,"threads_started":4,"wal-append.queue_time_us":114155,"wal-append.run_cpu_time_us":39149,"wal-append.run_wall_time_us":1599221}]]}
I20260925 16:43:22.923225 10958 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.953457  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:22.953714 10958 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:22.954097  9122 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:22.956096  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:22.929073  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.936841 11138 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:22.957261  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:22.938410 11155 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:43:22.938835 11092 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:22.940609 11132 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:22.964392  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.216s (SENT)
I20260925 16:43:22.941715 11117 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:22.942020  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:22.974088  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.942498  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1830) took 1638 ms. Trace:
I20260925 16:43:22.943311  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:22.974615  9701 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:22.944310  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 384) took 1204 ms. Trace:
I20260925 16:43:22.944454  9700 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:22.976490 11117 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:22.944996  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:22.977439 11117 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:22.976576  8969 rpcz_store.cc:276] 0925 16:43:21.740029 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:22.466978 (+726949us) service_pool.cc:227] Handling call
0925 16:43:22.481860 (+ 14882us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:22.525610 (+ 43750us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:22.528383 (+  2773us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:22.540226 (+ 11843us) log.cc:842] Serialized 26 byte log entry
0925 16:43:22.633018 (+ 92792us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:22.683710 (+ 50692us) log.cc:842] Serialized 14 byte log entry
0925 16:43:22.683909 (+   199us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.683995 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:22.944106 (+260111us) raft_consensus.cc:1671] finished
0925 16:43:22.944127 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.944259 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20810,"prepare.queue_time_us":25050,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":43,"raft.queue_time_us":80107,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":24880,"thread_start_us":70518,"threads_started":1,"wal-append.queue_time_us":131591}
I20260925 16:43:22.978654 11117 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:22.978844  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.887035 10878 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260925 16:43:22.939640  9695 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260925 16:43:22.949174 11124 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.698s	user 0.002s	sys 0.000s
I20260925 16:43:22.950743  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:22.957273  8967 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:22.958201  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.591s (SENT)
I20260925 16:43:22.972419  8968 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:22.940827  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 1962) took 1400 ms. Trace:
I20260925 16:43:22.874522  9116 rpcz_store.cc:276] 0925 16:43:21.437432 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.525459 (+ 88027us) service_pool.cc:227] Handling call
0925 16:43:21.525737 (+   278us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:21.526086 (+   349us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:21.526122 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:21.634322 (+108200us) log.cc:842] Serialized 26 byte log entry
0925 16:43:22.434652 (+800330us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:22.456358 (+ 21706us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.456445 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:22.858061 (+401616us) raft_consensus.cc:1671] finished
0925 16:43:22.858734 (+   673us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.860291 (+  1557us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":366,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":14488,"thread_start_us":546485,"threads_started":1,"wal-append.queue_time_us":812482}
W20260925 16:43:22.992012  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1349) took 1452 ms (client timeout 1707 ms). Trace:
W20260925 16:43:22.992463  9044 rpcz_store.cc:269] 0925 16:43:21.539211 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.545301 (+  6090us) service_pool.cc:227] Handling call
0925 16:43:22.943147 (+1397846us) spinlock_profiling.cc:243] Waited 88.4 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fcab7c 00007f7198fca73b 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:22.991945 (+ 48798us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":203325824}
I20260925 16:43:22.994536  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 653) took 1624 ms. Trace:
I20260925 16:43:22.996841  8974 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:22.998682  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.000196 11112 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:23.000691 11112 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:23.001623 11112 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.002466 11069 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.003026 11112 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:23.004007  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66306.3us
I20260925 16:43:22.979900  9118 rpcz_store.cc:276] 0925 16:43:21.304340 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.307781 (+  3441us) service_pool.cc:227] Handling call
0925 16:43:22.942296 (+1634515us) spinlock_profiling.cc:243] Waited 16.3 ms on lock 0x7b54003bf1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.942427 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":37569920}
I20260925 16:43:23.007349 11099 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.017475  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:22.981664  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.864s (SENT)
I20260925 16:43:23.020771  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:22.984710  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:22.932224 11134 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:22.975701 10749 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:22.986528  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:22.986605  9048 rpcz_store.cc:276] 0925 16:43:21.540496 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.541066 (+   570us) service_pool.cc:227] Handling call
0925 16:43:22.939998 (+1398932us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:22.940224 (+   226us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:22.940433 (+   209us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:22.940469 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:22.940523 (+    54us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:22.940578 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.940645 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:22.940765 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":279579008}
W20260925 16:43:23.030668  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72497.9us
I20260925 16:43:22.988246  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:22.989074  9115 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:22.989156 10966 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
W20260925 16:43:22.990192  9045 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.507s	user 0.011s	sys 0.011s
W20260925 16:43:22.986459  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89993.9us
I20260925 16:43:23.024623  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:23.029119  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47478us
I20260925 16:43:22.980456 10976 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:22.980883 11106 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:23.033970  9045 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:23.037278  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:23.037717  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.984s (SENT)
W20260925 16:43:23.032428  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.665s (SENT)
I20260925 16:43:23.036715  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.086318  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 373) took 1010 ms. Trace:
I20260925 16:43:23.148289  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.148488  9045 rpcz_store.cc:276] 0925 16:43:22.075564 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:22.459318 (+383754us) service_pool.cc:227] Handling call
0925 16:43:23.086265 (+626947us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:23.012217  8969 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:23.035884 11113 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:23.149943 11086 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:23.150472  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.150385 11113 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.151405  8969 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:23.151810 11069 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.152231  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.148927  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.129700 11138 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:23.153121 11113 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.153390 11116 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.153367  8967 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:23.088685 11135 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:23.154871  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:23.146040  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 111287us
I20260925 16:43:23.155656  8967 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:23.155865  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.680s (SENT)
I20260925 16:43:23.030004 10749 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.156322  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.156494 10749 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:23.158275 11083 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.096947  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:23.160271  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63422.1us
I20260925 16:43:23.036315 10966 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:23.154645 11135 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.149267  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.162567  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.100281  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.148877  9124 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:23.165433  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.753s (SENT)
I20260925 16:43:23.173599  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.096104  8974 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:23.172942  8967 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:23.175388  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.176084  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.028483 11137 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
W20260925 16:43:23.176961  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 144556us
I20260925 16:43:23.177289  8971 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:23.179442  8967 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:23.180045  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.180609  8971 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:23.177551  8974 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
W20260925 16:43:23.132354 10981 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.548s	user 0.013s	sys 0.009s
I20260925 16:43:23.182137  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:23.183267  9015 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.766s (SENT)
I20260925 16:43:23.183825  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:23.184093  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.827s (SENT)
I20260925 16:43:23.184598  9697 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:23.185015  9015 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.848s (SENT)
I20260925 16:43:23.185415  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.188093  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:23.118409 10999 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.536s	user 0.013s	sys 0.011s
I20260925 16:43:23.181478  8873 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:23.188827  9043 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
W20260925 16:43:23.191474  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.782s (SENT)
I20260925 16:43:23.035481 11134 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:23.036248 11080 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:23.150349 11086 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:23.039023 11099 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.191771  8966 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:23.192417  9042 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:23.087354  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:23.189927  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:23.192847  9666 leader_election.cc:334] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.843s (SENT)
I20260925 16:43:23.199153  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:22.994946  9695 rpcz_store.cc:276] 0925 16:43:21.369702 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.369827 (+   125us) service_pool.cc:227] Handling call
0925 16:43:22.939299 (+1569472us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:22.986107 (+ 46808us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.994332 (+  8225us) spinlock_profiling.cc:243] Waited 1.56 s on lock 0x7b540079f750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:22.994478 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3590679808}
I20260925 16:43:23.199910  8971 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:23.117472  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.101101 11129 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.196373  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:23.196444  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.096418 10908 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:23.193547  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.194427  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.191248 11005 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.200574  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.178342 10829 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:23.210484  8967 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:23.205025  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 167325us
W20260925 16:43:23.200048  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.869s (SENT)
I20260925 16:43:23.215394  9700 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:23.215407  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.214756  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:23.218518  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.001s (SENT)
I20260925 16:43:23.219125  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:23.193882 10960 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.014s	sys 0.009s
I20260925 16:43:23.197383  8969 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7.
I20260925 16:43:23.219547  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.220481  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.153393 11138 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.218618  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.197148 11076 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:23.221989  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.223847  8967 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:23.228948  9666 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.871s (SENT)
I20260925 16:43:23.229362  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.233948  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.234850  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:23.235476  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50481.3us
I20260925 16:43:23.236892  9694 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:23.238379  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.949s (SENT)
I20260925 16:43:23.238756  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.202363 11092 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.218063 10829 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.214776 11080 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:23.242355  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.214660  9118 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:23.205191  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.254824  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.255569  9048 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:23.223878 10960 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.014s	sys 0.009s
I20260925 16:43:23.223536 11018 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.251847 11144 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.254329 10829 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:23.263303 10999 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:23.288172 10999 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.290086 10999 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.218504 10908 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.243650 11106 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260925 16:43:23.291806 10908 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.245769 11087 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:23.243527 10966 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.238193 11072 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.265174  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.297854  8966 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:23.298069 11128 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:23.298609  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.299328  8966 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:23.265506 11086 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.266434  8968 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:23.197911 11134 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:23.273353  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.955s (SENT)
I20260925 16:43:23.307849  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:23.309616  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.978s (SENT)
I20260925 16:43:23.309952  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.306351  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.312207  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.313184 11078 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:23.314656  9015 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.978s (SENT)
W20260925 16:43:23.315367  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.984s (SENT)
I20260925 16:43:23.315642  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:23.316356  9700 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:23.316489 10995 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.278297  8971 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:23.265985 11080 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:23.268640 11005 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.285895 10749 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.327906 11134 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.329327 10749 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:23.286579 11136 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.636s	user 0.000s	sys 0.002s
I20260925 16:43:23.238066 11083 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:23.293785  8974 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
W20260925 16:43:23.294010  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65088.4us
I20260925 16:43:23.294925  9123 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:23.291532  8871 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 216) took 4925 ms. Trace:
I20260925 16:43:23.297035 10966 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:23.296283  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.270130  9044 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:23.338735  9697 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:23.302848 11138 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.303479 11018 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.304697 11071 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:23.315685  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.343336  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.995s (SENT)
I20260925 16:43:23.343662  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.284350 11135 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.346733  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.348052  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.325816 10999 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:23.323555  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.323796  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.326999  9696 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:23.327328  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.330003  9699 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:23.331604  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.873s (SENT)
W20260925 16:43:23.356487  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.998s (SENT)
I20260925 16:43:23.356559  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.309398 11076 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.344122 11078 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:23.343951  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:23.357963 11078 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.358343 11078 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:23.358608  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.308171  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.361019  8966 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:23.361747  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.362465 11127 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.362666  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.362923 11111 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.363302  8966 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:23.350569  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.331990 11085 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:23.331972  8871 rpcz_store.cc:276] 0925 16:43:18.366178 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:18.366437 (+   259us) service_pool.cc:227] Handling call
0925 16:43:23.291474 (+4925037us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:20.330102 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:20.382226 (+ 52124us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:20.382274 (+    48us) write_op.cc:435] Acquired schema lock
0925 16:43:20.382298 (+    24us) tablet.cc:660] Decoding operations
0925 16:43:20.383276 (+   978us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:20.383321 (+    45us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:20.383350 (+    29us) tablet.cc:683] Acquiring locks for 6 operations
0925 16:43:20.383886 (+   536us) tablet.cc:699] Row locks acquired
0925 16:43:20.383911 (+    25us) write_op.cc:260] PREPARE: finished
0925 16:43:20.384076 (+   165us) write_op.cc:270] Start()
0925 16:43:20.384200 (+   124us) write_op.cc:276] Timestamp: P: 1790354600384022 usec, L: 0
0925 16:43:20.384226 (+    26us) op_driver.cc:331] REPLICATION: starting
0925 16:43:20.384907 (+   681us) log.cc:842] Serialized 2452 byte log entry
0925 16:43:20.855370 (+470463us) op_driver.cc:444] REPLICATION: finished
0925 16:43:20.934119 (+ 78749us) write_op.cc:301] APPLY: starting
0925 16:43:20.934190 (+    71us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:20.934399 (+   209us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:20.934499 (+   100us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:20.935233 (+   734us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:20.935423 (+   190us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0925 16:43:20.935468 (+    45us) write_op.cc:312] APPLY: finished
0925 16:43:20.935729 (+   261us) log.cc:842] Serialized 53 byte log entry
0925 16:43:20.936471 (+   742us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:20.936572 (+   101us) write_op.cc:454] Released schema lock
0925 16:43:20.936614 (+    42us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:20.937607 (+   993us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:20.937636 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1236881,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":77462,"apply.run_cpu_time_us":2444,"apply.run_wall_time_us":3806,"num_ops":6,"prepare.queue_time_us":864151,"prepare.run_cpu_time_us":3913,"prepare.run_wall_time_us":60991,"replication_time_us":465842,"thread_start_us":96213,"threads_started":1}]]}
I20260925 16:43:23.365087 11111 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.364868 11085 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.341699 11071 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:23.351266  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.366420 11071 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.362794 11135 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:23.368520  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1691) took 1865 ms. Trace:
I20260925 16:43:23.369830  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.371640  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.368892  8975 rpcz_store.cc:276] 0925 16:43:21.503498 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.544247 (+ 40749us) service_pool.cc:227] Handling call
0925 16:43:21.567602 (+ 23355us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:21.674880 (+107278us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:21.674929 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:21.768817 (+ 93888us) log.cc:842] Serialized 26 byte log entry
0925 16:43:22.430894 (+662077us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:22.430934 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:22.431009 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:23.286021 (+855012us) spinlock_profiling.cc:243] Waited 5.24 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:23.368261 (+ 82240us) raft_consensus.cc:1671] finished
0925 16:43:23.368282 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:23.368468 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":199196,"raft.queue_time_us":84170,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":12101,"spinlock_wait_cycles":12047232,"thread_start_us":361352,"threads_started":1,"wal-append.queue_time_us":523673}
I20260925 16:43:23.352340 11005 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:23.352313  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.355582  9042 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:23.363504 10960 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:23.373224  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.367411 11071 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.376739  8971 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 3 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260925 16:43:23.377694  9702 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:23.382467  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.356967  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:23.379280 11165 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260925 16:43:23.371024 11083 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:23.406991 11083 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.407998  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.407970 10999 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:23.410247  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.410851  9048 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:23.411759  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:23.413458  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.414240  9121 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:23.414851  9120 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:23.383770  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:23.416316 11087 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:23.416795 11087 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.417203 11087 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:23.384910  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53331.1us
W20260925 16:43:23.419077  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.893s (SENT)
I20260925 16:43:23.420126  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.420871  8971 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:23.422003  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.385044  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.367548 11085 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.377665 11135 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:23.395790  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.398517  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:23.399268  8972 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
W20260925 16:43:23.437969  9666 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.900s (SENT)
I20260925 16:43:23.401062  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.401808  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.375393 11111 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.404913 11078 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.395467 10829 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.449108 10829 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.450577  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.454620  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.432268  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:23.423936  8971 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:23.457808  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.459149  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:23.435469  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78997.3us
W20260925 16:43:23.460529  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.061s (SENT)
I20260925 16:43:23.461076  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:23.439440  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.219s (SENT)
I20260925 16:43:23.436872  8968 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:23.443116  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.462673  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.465129  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.384352 10749 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:23.465978  8971 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:23.468459  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:23.469107  9117 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:23.468591  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.470695  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.474480  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.443603 10960 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.475196  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.475991 11072 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:23.476594 11072 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:23.477718 11072 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.479921  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.480688  8975 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:23.482321  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.482821  8975 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:23.483583  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.484834  8975 raft_consensus.cc:2396] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:23.485545 11078 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.485643  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.486495  9694 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:23.486665  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.487315  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:23.487665  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.471288  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:23.488683  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.489511 10832 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:23.489879 10832 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.490207 10832 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.490818  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.491461  8975 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:23.492269  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.493175  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.493741  8975 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:23.495153  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.495936  8975 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:23.496564  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.497452  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.498360  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.499383  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.500455  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.501159  8975 raft_consensus.cc:2396] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:23.501818  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.503504  8971 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:23.509528  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.520797  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:23.523416  9089 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.004s (SENT)
I20260925 16:43:23.501638 10832 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.527171  9700 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
W20260925 16:43:23.528594  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 68105.6us
W20260925 16:43:23.530416  9015 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.080s (SENT)
I20260925 16:43:23.530798  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.507961 11132 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.017s	sys 0.035s
I20260925 16:43:23.508534 11056 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260925 16:43:23.534966 11132 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.017s	sys 0.035s
W20260925 16:43:23.537364  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.021s (SENT)
I20260925 16:43:23.539880  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.544006  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:23.544590  8974 raft_consensus.cc:595] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.544926  8974 raft_consensus.cc:603] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:23.547845  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:49990 (request call id 852) took 2014 ms. Trace:
I20260925 16:43:23.548219  8970 rpcz_store.cc:276] 0925 16:43:21.533940 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.552137 (+ 18197us) service_pool.cc:227] Handling call
0925 16:43:23.547274 (+1995137us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54003c4bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:23.547786 (+   512us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3753348864}
I20260925 16:43:23.559216  8966 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:23.559665  8971 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:23.560393  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:23.561431  8966 raft_consensus.cc:595] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.561810  8966 raft_consensus.cc:603] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:23.561925 11083 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:23.562402 11083 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.563685  8966 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:23.566406  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:23.569847  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:23.569252  8966 raft_consensus.cc:595] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.570792  9123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1832) took 2261 ms (client timeout 2078 ms). Trace:
W20260925 16:43:23.571151  9123 rpcz_store.cc:269] 0925 16:43:21.309738 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:21.356774 (+ 47036us) service_pool.cc:227] Handling call
0925 16:43:23.570642 (+2213868us) spinlock_profiling.cc:243] Waited 1.82 s on lock 0x7b5400010254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:23.570732 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4194789760}
W20260925 16:43:23.574944  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.035s (SENT)
I20260925 16:43:23.575351  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.584311 10693 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:23.585258  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.585906  9696 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:23.533813 11076 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.473793 11129 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.086s
W20260925 16:43:23.589393  9089 leader_election.cc:334] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.053s (SENT)
I20260925 16:43:23.589821  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.589553  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.594420  9121 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:23.596521  8971 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:23.564468 11083 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.599864  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.604039 11018 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.605602  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.609901  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.617048  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.590801 11085 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.617662  8971 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:23.617350  8966 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:23.624054  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:23.624711  8966 raft_consensus.cc:595] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.613533  9089 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.057s (SENT)
I20260925 16:43:23.625360  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.630676  9121 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:23.632818  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.641652  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.616480 10999 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:23.648548  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 118146us
W20260925 16:43:23.649457  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.110s (SENT)
I20260925 16:43:23.649981  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.641671  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.631711 10966 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.649026 11056 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:23.661767 11056 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:23.639925 11132 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:23.568424 11135 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.654862 11080 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:23.648550 11076 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:23.673427  8966 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
W20260925 16:43:23.677462  9015 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.110s (SENT)
I20260925 16:43:23.662689 11056 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:23.677906  9089 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.128s (SENT)
W20260925 16:43:23.728945  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51062us
W20260925 16:43:23.732610  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.134s (SENT)
I20260925 16:43:23.677914  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.730329  9121 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: [2.5-2.5]
I20260925 16:43:23.679282 11005 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.677896  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.734797  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57361.8us
I20260925 16:43:23.679939 11076 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.670837 11080 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:23.734305  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.182s (SENT)
I20260925 16:43:23.738219  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:23.735338  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.115s (SENT)
I20260925 16:43:23.690233  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:23.744184  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54066.1us
I20260925 16:43:23.744724  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.734268  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.676132 11132 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:23.748401  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.746804  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:23.751246  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.752839  8973 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:23.754307  8968 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:23.701428 10999 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.720108 10832 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.736769 10693 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:23.757288  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.745539 11080 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:23.756963  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.748232 11092 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:23.767059  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:23.767957  9015 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.173s (SENT)
I20260925 16:43:23.768311  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.761176  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.224s (SENT)
I20260925 16:43:23.762784  9042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:23.763908  8966 raft_consensus.cc:2362] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2. Re-sending same reply.
I20260925 16:43:23.769001  9042 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.769335  9042 raft_consensus.cc:603] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:23.757751 11135 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:23.737618 11072 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260925 16:43:23.755167 11064 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.752642  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.687640 11087 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.766817  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 417) took 1082 ms. Trace:
I20260925 16:43:23.769719  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.756386 11111 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:23.780085  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:23.778592  8974 rpcz_store.cc:276] 0925 16:43:22.684549 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:23.552101 (+867552us) service_pool.cc:227] Handling call
0925 16:43:23.552346 (+   245us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:23.552515 (+   169us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:23.645458 (+ 92943us) log.cc:842] Serialized 14 byte log entry
0925 16:43:23.766381 (+120923us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:23.766504 (+   123us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:23.766558 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:23.766641 (+    83us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:23.766753 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":137875,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":8387,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":4222,"thread_start_us":192061,"threads_started":2}
I20260925 16:43:23.776262 11144 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:23.782785  8966 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:23.784723  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.786163  8966 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:43:23.783459  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:23.787823  8974 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:23.789642  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.779264 11182 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:23.778345  9119 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.791316  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:43:23.795516  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.781581 11111 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:23.783922 11117 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:23.782344 11072 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:23.794144 11138 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.815094 11072 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:23.815637 11111 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.816270 11072 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.818074 11072 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:23.798758  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:23.800946  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 416) took 1116 ms. Trace:
I20260925 16:43:23.820924  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.801209  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.784783 11144 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.803153  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.803910  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.804255  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.793195  8969 raft_consensus.cc:2362] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4. Re-sending same reply.
I20260925 16:43:23.807938  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.821336  8970 rpcz_store.cc:276] 0925 16:43:22.684290 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:23.550431 (+866141us) service_pool.cc:227] Handling call
0925 16:43:23.550659 (+   228us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:23.550852 (+   193us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:23.736022 (+185170us) log.cc:842] Serialized 14 byte log entry
0925 16:43:23.800631 (+ 64609us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:23.800678 (+    47us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:23.800746 (+    68us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:23.800809 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:23.800899 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":123767,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":355,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":70,"thread_start_us":227091,"threads_started":2}
I20260925 16:43:23.825073  9043 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:23.809137  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.784595 11132 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.793882 10958 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.810433  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.811241 11076 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.821794  9045 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:23.822605  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.828411  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.808657  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.831802  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:23.832015  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.833419  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.824734 11144 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:23.842121  9121 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:23.842188  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.849649  9043 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
W20260925 16:43:23.850658  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47553us
I20260925 16:43:23.830300 10832 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:23.853528  9050 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:23.842177 11129 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:23.862521  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:43:23.868275 11178 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260925 16:43:23.846171 10958 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.842126 11134 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.862859  9119 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:23.842280 11156 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.876667  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:23.877429 10832 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:23.878082 10832 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:23.880405 10987 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:23.880990 10987 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:23.882045 10987 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.856536  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:23.885108  9696 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:23.851794  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.873834  9043 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:23.859719 11083 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.029s
I20260925 16:43:23.871031 11129 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:23.890240 11129 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.852212  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:23.895812 11087 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:23.898053  9116 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:23.899631  9115 raft_consensus.cc:2354] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:23.906447 10958 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 16:43:23.907883  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56225.4us
I20260925 16:43:23.911393  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.913812 10958 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:23.917708 11086 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.915505  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:23.887176 11127 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.003s
W20260925 16:43:23.926918  9015 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.627s (SENT)
I20260925 16:43:23.927454  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.933140  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.910796 11129 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.937496 11129 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.937753  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:23.938133  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.938617  9116 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:23.938972  9045 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:23.943784  9014 leader_election.cc:398] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:23.944195  9014 leader_election.cc:401] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:23.947093  9045 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:23.943212  9695 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:23.949400  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.951749  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:23.952714  9043 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:23.956399  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:23.933602  9046 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
W20260925 16:43:23.961532  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 412) took 1278 ms (client timeout 1591 ms). Trace:
W20260925 16:43:23.962046  8973 rpcz_store.cc:269] 0925 16:43:22.683160 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:22.794715 (+111555us) service_pool.cc:227] Handling call
0925 16:43:23.961333 (+1166618us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b54002ff654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:23.961465 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2057625472}
I20260925 16:43:23.961966  8972 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:23.964990  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:23.970391 10749 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:23.980396  9115 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260925 16:43:23.983016  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49990.5us
I20260925 16:43:23.988543  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.879201 10832 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:23.932865 11064 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:23.949966 10958 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:23.951280 11056 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
W20260925 16:43:24.006609  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.347s (SENT)
I20260925 16:43:24.007172  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:23.988618 10749 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:23.991055 10829 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:24.017124 10829 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.017993 10829 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.018157 11117 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:24.020082 11117 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:24.020422 11117 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:24.020361 10749 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.021389 11117 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.022647 11117 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:24.023197 11144 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.025317 11144 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:24.026480 11111 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.028034 11142 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:24.028358 11111 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:23.932031 11076 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.069s
I20260925 16:43:24.028535 11142 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.030402 11142 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.012142 11140 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:23.996948 11138 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:24.033520  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:23.999516 11087 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:24.034618 11087 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:24.034989 11087 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:24.016511  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:23.943574 11083 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260925 16:43:24.035959 11083 consensus_queue.cc:1225] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:43:24.036409 11083 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:24.036717 11083 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:24.036746  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.037472 11083 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.038712 11083 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:24.038892 11138 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:24.039503 11138 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:24.030226 11106 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:24.040586 11182 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:24.042130  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.042506 11080 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.042945  9115 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:24.048656  9048 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:24.050192  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.050855  9048 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:24.053421  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71630.6us
I20260925 16:43:24.057725  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:24.059798  9124 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:24.059798  9122 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:23.999550 10958 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:24.040621 11138 raft_consensus.cc:979] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:24.062278  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:24.069556  9124 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:24.079766  9121 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:23.999830 11129 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260925 16:43:24.077356 11111 raft_consensus.cc:1067] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:24.079463 11072 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.086771  8967 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:24.088480  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:24.089804  9123 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:24.087842  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:24.091529  9124 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:24.068962 10958 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:24.064213 11005 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260925 16:43:24.081825  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.090703 10953 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.005s
I20260925 16:43:24.095456 11156 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:24.096395 10953 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:24.096735 10953 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.097498 10953 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.098054 11156 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:24.098402 11156 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.098569  9124 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:24.098845 10953 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.102603  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:24.104637  9116 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:24.099123 11156 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.125808  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.126910 11111 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.127076 11085 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:24.127590 11080 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.127746 11085 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.100090 11144 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.025s
I20260925 16:43:24.106164 11087 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.085318 11072 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.138345 11087 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.138911  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:24.139503  9695 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.141434 11072 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:24.141842  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.142584  9044 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:24.148306  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:24.149390  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:24.149986  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:24.156167 11156 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:24.163869  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:24.164559  9041 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:24.166090  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:24.205873 11072 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:24.214301 11085 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.178452 11156 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:24.220300  9119 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:24.226804  9048 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:24.227792  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.228865  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.229835  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.230700  8973 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:24.207409  9695 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:24.229455  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:24.261250  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.239014  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.264276  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.233382  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.268417  8971 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:24.269243  8971 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:24.269546  8971 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:24.265319  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.251588  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.273672  8974 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:24.248431  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.232645  8973 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:24.233011  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:24.276741  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44390us
I20260925 16:43:24.277700  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.277657  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:24.156776  9694 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:24.267505  8970 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:24.284724  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.286090  9119 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260925 16:43:24.274463  8975 raft_consensus.cc:2362] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4. Re-sending same reply.
I20260925 16:43:24.285751  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.284067  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.287118 10966 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:24.291040  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.295233 11117 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.295863 11117 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.298202 11117 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.299803  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:24.283910  8971 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.285353  8967 raft_consensus.cc:2362] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3. Re-sending same reply.
I20260925 16:43:24.306175  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.287559  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.288379  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.221108 11156 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:24.264397 11087 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.290663  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.305037  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.275130 10999 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.316294  8975 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:24.279860  8966 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:24.307415  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.221781  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:24.266109 11086 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.313355  8973 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:24.317517  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.318022  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.318396  8966 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:24.319139  8973 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:24.320832  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.282999 11092 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:24.323261  8967 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:24.323680  8975 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:24.227420 11140 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.078s
I20260925 16:43:24.325599  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.325090  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.321560  8973 raft_consensus.cc:2362] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2. Re-sending same reply.
I20260925 16:43:24.289470 11072 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:24.335714  8966 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:24.339319  8971 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.342237  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.342667  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.345525  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.346048  8968 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:24.304069 11132 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:24.316035 11156 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:24.282861 11089 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260925 16:43:24.327389 11092 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:24.356310  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 51339.7us
I20260925 16:43:24.308496 11182 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260925 16:43:24.361044  8971 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:24.344597 11018 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.375365  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.350499 11072 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.360214  9041 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:24.372078  8966 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:24.354065  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.355151 11132 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:24.333758 11086 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.358021 10966 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:24.360464 11092 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:24.384972  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.360633 10999 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
W20260925 16:43:24.383158  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117925us
I20260925 16:43:24.363184 11089 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:24.395063 11089 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:24.395991 11089 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.371462 10958 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.401645 10958 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.402343 11072 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.403174  9694 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:24.405279 10966 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.378319 11018 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:24.407670 11200 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260925 16:43:24.433743  8873 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 336) took 5353 ms. Trace:
I20260925 16:43:24.408277  8970 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:24.436936  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:24.409471  9696 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260925 16:43:24.437881  9696 pending_rounds.cc:76] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 4
I20260925 16:43:24.438092  9696 pending_rounds.cc:97] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260925 16:43:24.438339  9696 raft_consensus.cc:2866] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:24.412734  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.413162  9695 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260925 16:43:24.415153  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:24.441917 11128 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:24.415589  9700 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:24.442301 11128 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:24.442714 11128 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:24.415843  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.443461  9694 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:24.444371 11156 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.447117  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:24.421885  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.422660  9117 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.449465  9702 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:24.450627  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.451807  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.385686  8966 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.388865 11206 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.389115 11086 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.389292 10999 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:24.393126 11132 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.447888 11080 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:24.434159  8873 rpcz_store.cc:276] 0925 16:43:19.080404 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:19.080581 (+   177us) service_pool.cc:227] Handling call
0925 16:43:24.433682 (+5353101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:23.322831 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:23.323338 (+   507us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:23.323368 (+    30us) write_op.cc:435] Acquired schema lock
0925 16:43:23.323384 (+    16us) tablet.cc:660] Decoding operations
0925 16:43:23.323856 (+   472us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:23.323931 (+    75us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:23.323966 (+    35us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:43:23.324145 (+   179us) tablet.cc:699] Row locks acquired
0925 16:43:23.326462 (+  2317us) write_op.cc:260] PREPARE: finished
0925 16:43:23.344578 (+ 18116us) write_op.cc:270] Start()
0925 16:43:23.351859 (+  7281us) write_op.cc:276] Timestamp: P: 1790354603340576 usec, L: 0
0925 16:43:23.357483 (+  5624us) op_driver.cc:331] REPLICATION: starting
0925 16:43:23.471146 (+113663us) log.cc:842] Serialized 541 byte log entry
0925 16:43:23.844697 (+373551us) spinlock_profiling.cc:243] Waited 8.29 ms on lock 0x7b540038b1a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beb8771 00007f719bec3220 00007f719bec31c8 00007f719bec3148 00007f719bec3103 00007f719bec238c 00007f71a1f33206 00007f71a1f2b808 00007f719beff38b 00007f719bf01e80
0925 16:43:24.095368 (+250671us) op_driver.cc:444] REPLICATION: finished
0925 16:43:24.176696 (+ 81328us) write_op.cc:301] APPLY: starting
0925 16:43:24.176780 (+    84us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:24.176879 (+    99us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:24.176899 (+    20us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:24.177148 (+   249us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:24.177297 (+   149us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 16:43:24.184475 (+  7178us) write_op.cc:312] APPLY: finished
0925 16:43:24.221291 (+ 36816us) log.cc:842] Serialized 23 byte log entry
0925 16:43:24.238051 (+ 16760us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:24.276265 (+ 38214us) write_op.cc:454] Released schema lock
0925 16:43:24.280084 (+  3819us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:24.312625 (+ 32541us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:24.315117 (+  2492us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1761201,"reported_tablets":12,"child_traces":[["op",{"apply.queue_time_us":81078,"apply.run_cpu_time_us":2298,"apply.run_wall_time_us":157545,"num_ops":1,"prepare.queue_time_us":28092,"prepare.run_cpu_time_us":78640,"prepare.run_wall_time_us":288387,"raft.queue_time_us":227198,"raft.run_cpu_time_us":14939,"raft.run_wall_time_us":82505,"replication_time_us":737792,"spinlock_wait_cycles":19064576,"thread_start_us":357983,"threads_started":4,"wal-append.queue_time_us":130371}]]}
I20260925 16:43:24.431530  8972 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:24.447325  8871 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 3 to 4, term changed from 2 to 3, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to <none>, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:24.387451  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.461112  8966 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:24.408491  9041 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:24.459390 10958 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:24.506953 10958 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:24.507344 10958 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:24.420953 11018 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.426985 11089 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.424188 11085 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
W20260925 16:43:24.509341  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 50084.3us
I20260925 16:43:24.457126 11140 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.512518  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:24.513971  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 126574us
I20260925 16:43:24.511431  8974 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:24.521353  8975 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:24.522358  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.520828  8972 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:24.531143  8969 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:24.532145  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:24.532812  8974 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:24.533026 10999 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.536302  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.536424  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.537343  8966 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:24.539135 11005 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:24.541092 11140 raft_consensus.cc:465] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Not starting pre-election -- already a leader
I20260925 16:43:24.541558 11140 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:24.541857 11140 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:24.542049  8974 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:24.456914 11206 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.543783 11087 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:24.458026 11083 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260925 16:43:24.547962 11083 consensus_queue.cc:1225] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260925 16:43:24.544929 11182 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:24.549398 11182 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:24.520828 11085 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:24.550227 11085 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.457019 11117 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.066s
I20260925 16:43:24.512892 11076 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:24.550168 11182 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:24.557116  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85114.3us
I20260925 16:43:24.561446  9117 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:24.561270  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:24.571110  9119 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:43:24.582259  9119 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:24.582743  9119 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:24.556674 11076 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:24.585201  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.587734  8973 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:24.542205 11140 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:24.581868 11078 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.038s
I20260925 16:43:24.625995  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.627410  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.632337  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:24.588647 11076 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.587008 11086 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.624711 11156 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:24.619752  9119 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.570638 10953 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
W20260925 16:43:24.639251  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 101181us
I20260925 16:43:24.642460  9015 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.598053 11085 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:24.643208  9123 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:24.646163  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.649071  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.613389  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:24.579879 11128 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.651793  9119 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:24.638814 11134 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:24.656589  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.656985 10693 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:24.657943 11072 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.648371  9693 pending_rounds.cc:76] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 4
I20260925 16:43:24.655025 11206 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.654784 10953 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.681794  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.642225 11111 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260925 16:43:24.671274  9693 pending_rounds.cc:97] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260925 16:43:24.645720 11086 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:24.694662  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 172387us
I20260925 16:43:24.695422  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.666435 11080 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:24.662830  9115 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:24.684049 11209 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:24.699775  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.702143  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.687780 11127 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:24.709859  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.710180 11205 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:24.711266  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.692914  9693 raft_consensus.cc:2866] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:24.692482 11134 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.697657 11080 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:24.713048 11210 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260925 16:43:24.712404 11214 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260925 16:43:24.764147  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46689.6us
W20260925 16:43:24.716043 11207 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
I20260925 16:43:24.712898 11182 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:24.717530 11127 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:24.707760 11206 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:24.700348 11071 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260925 16:43:24.755460  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44255.5us
I20260925 16:43:24.773494 11080 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.706881 11208 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:24.713155 10953 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:24.711920 11144 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:24.703608 10999 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:24.699148 11092 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.711397 11205 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.045s
I20260925 16:43:24.777840 10749 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
W20260925 16:43:24.808841  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 159826us
W20260925 16:43:24.826407  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 227362us
W20260925 16:43:24.828850  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 123025us
I20260925 16:43:24.828086  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:24.816180  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 182785us
I20260925 16:43:24.799449 11127 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:24.762624 11140 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.707307 11209 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:24.846624  9119 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:24.846143  9123 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:24.852923  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.850399  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.855299  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:24.861296  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:24.865386  9124 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:24.865952  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:24.866520  9048 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:24.845319  9117 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260925 16:43:24.864061  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 122889us
I20260925 16:43:24.869187  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.870339  9119 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:24.870358  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.875952  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.876556  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:24.877377 10999 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:24.878151  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:24.884389  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.829046 11128 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.900034  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.824620 10953 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.831471 10749 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:24.853641 11106 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:24.876562  9046 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:24.886767 11223 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:24.890583 11205 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:24.890939 11140 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:24.890595 11086 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:24.878551  9695 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:24.924077 11209 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:24.926189 11092 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:24.893863 11218 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.894425 10693 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:24.897009  9121 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:24.930097 10958 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.908430  9124 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:24.887545 11117 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:24.901753 11229 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:24.919837  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:24.940302  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.832367 11132 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.065s
I20260925 16:43:24.827785 11134 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:24.963524  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.878903 11074 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260925 16:43:24.911770 11087 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:24.957376  9700 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
W20260925 16:43:24.967804  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45405.2us
I20260925 16:43:24.974337  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:24.976490  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.977218  9048 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:24.965013 11225 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.123s	user 0.000s	sys 0.002s
I20260925 16:43:24.980997  9048 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:24.931030 11106 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:24.956409 11117 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:24.920665 11156 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.059s
W20260925 16:43:24.992486  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61291.3us
W20260925 16:43:24.971136 11221 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:43:24.913128 10829 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260925 16:43:24.965807 11142 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:24.976142 11086 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:24.975976 11087 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:25.028914  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:43:25.021420  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 127678us
I20260925 16:43:25.020464  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:25.035905  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:25.048327  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:24.956265 11078 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.038s
I20260925 16:43:25.054661  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:25.049464  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:25.065845  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:25.066917  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:25.069650  9121 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260925 16:43:24.954576 11228 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.098s
I20260925 16:43:25.058415  8967 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:25.077971 11194 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:25.078146 11217 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:25.078590 11209 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:25.078438 11144 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:25.054214 11092 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:25.059788 11087 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:25.018484  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:24.989238 11128 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:25.127096  8968 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:25.017473 10693 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.073s
I20260925 16:43:25.073138  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:25.079502 10999 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:25.085381  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:25.103977 11194 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:25.104502 11089 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.082s
I20260925 16:43:24.991161 11229 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.139s
W20260925 16:43:25.196624  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 119103us
W20260925 16:43:25.178102 11220 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.347s	user 0.001s	sys 0.003s
I20260925 16:43:25.017067 10953 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.056740 10749 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.182235 11128 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:25.208381  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 119202us
I20260925 16:43:25.133634 11227 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:25.260558  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 264255us
I20260925 16:43:25.196672  9044 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:25.203778  9695 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:25.284924  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:25.132746 11092 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:25.284269 11085 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.636s	user 0.009s	sys 0.000s
I20260925 16:43:25.096515 11117 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.290349  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:25.242947 11086 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:25.133818 11127 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.269042 11128 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:25.297369  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45028.6us
I20260925 16:43:25.130306 11106 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:25.310200  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 233531us
I20260925 16:43:25.287827 10958 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.336565  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:25.297834 11235 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:25.317790 11240 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:25.379998  9119 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:25.323938 11005 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:25.382810 11235 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:25.296471 11242 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.116s
I20260925 16:43:25.394714  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:25.338016 11117 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:25.338479 11085 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:25.368448 11140 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:25.402161  9042 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:25.277479 11227 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.369084 11111 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.306838 11086 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.382906 11240 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:25.391223 11005 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:25.425627  9043 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:25.414068  9042 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:25.368221 11237 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:25.304376 11239 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.107s
I20260925 16:43:25.428745  9050 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260925 16:43:25.388511 11241 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:25.395474  9044 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:25.482173  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:25.410977  9046 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:25.412866 11140 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:25.495754  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:25.499382  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 116895us
I20260925 16:43:25.501932  9119 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 6
W20260925 16:43:25.501098  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 98498us
I20260925 16:43:25.398830 10832 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.081s
W20260925 16:43:25.495863 11222 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:43:25.448714 11227 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:25.497193 11230 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.389s	user 0.001s	sys 0.000s
I20260925 16:43:25.445245 11250 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:25.549336  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:25.550369  8967 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:25.561210  9119 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:25.413798 11085 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.564016  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:25.565366  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:25.531236 11236 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.374s	user 0.001s	sys 0.000s
I20260925 16:43:25.444754 11111 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.521467 11229 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.505599 11242 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.573928  8968 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:25.533937 11140 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:25.541334 10966 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:25.568868 10693 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:25.558701 11238 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.397941 11194 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.587896  9700 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:25.587937  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:25.664441  9119 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:25.543608 11156 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260925 16:43:25.665531  8968 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:25.552003 11144 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260925 16:43:25.395460 11235 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:25.681201  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 116007us
W20260925 16:43:25.691783  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 100272us
W20260925 16:43:25.696226  8975 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.633s	user 0.006s	sys 0.003s
I20260925 16:43:25.696806  8975 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:25.698969  8975 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:25.666435 10999 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:25.708288  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:25.680155 11087 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.001s
I20260925 16:43:25.665863 10966 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.503894 11241 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.499382 11237 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:25.692755 11230 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260925 16:43:25.561306 11005 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.717046  9702 raft_consensus.cc:2354] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5.
I20260925 16:43:25.676576 11092 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.697901 11127 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:25.592819 11242 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.651295 10693 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.590500 11229 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.666950 11238 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.732728  8970 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:43:25.760057  8970 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:25.755913  9090 leader_election.cc:398] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5.
I20260925 16:43:25.792477  9090 leader_election.cc:401] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:25.719296 11258 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:25.794672 11258 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:25.794250  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46534.1us
I20260925 16:43:25.796275 11252 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:25.791226  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 441) took 1261 ms. Trace:
I20260925 16:43:25.821897  8972 rpcz_store.cc:276] 0925 16:43:24.529458 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:24.563074 (+ 33616us) service_pool.cc:227] Handling call
0925 16:43:24.597474 (+ 34400us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:24.610375 (+ 12901us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:24.610401 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:24.612146 (+  1745us) log.cc:842] Serialized 26 byte log entry
0925 16:43:24.911468 (+299322us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:24.932502 (+ 21034us) log.cc:842] Serialized 14 byte log entry
0925 16:43:24.932764 (+   262us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:24.932850 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:25.308000 (+375150us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b18001df8c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:43:25.746699 (+438699us) raft_consensus.cc:1671] finished
0925 16:43:25.790947 (+ 44248us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:25.791156 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":344,"prepare.queue_time_us":23504,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":4886,"raft.queue_time_us":8131,"raft.run_cpu_time_us":369,"raft.run_wall_time_us":21994,"spinlock_wait_cycles":45951232,"thread_start_us":263380,"threads_started":1,"wal-append.queue_time_us":379564}
W20260925 16:43:25.722963 11223 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.794s	user 0.011s	sys 0.000s
I20260925 16:43:25.845193  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:25.715730 11087 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.760814  8970 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.845943  9117 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
W20260925 16:43:25.725649 11080 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.907s	user 0.009s	sys 0.001s
I20260925 16:43:25.744967  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 686) took 1172 ms. Trace:
W20260925 16:43:25.759629 11076 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.114s	user 0.011s	sys 0.000s
I20260925 16:43:25.826052  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:25.852756  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:43:25.826705 11254 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260925 16:43:25.833349 10693 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:25.834259 11111 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.571485 11240 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.838646 11129 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:25.853961 11129 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:25.854784  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:25.855370 11262 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260925 16:43:25.855181 11129 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.855988 11076 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.857122  9045 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:25.857862 11239 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.858515 11076 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:25.811070 11249 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.374s	user 0.002s	sys 0.000s
I20260925 16:43:25.841138 11235 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:25.861991 11080 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.859067  9693 rpcz_store.cc:276] 0925 16:43:24.572359 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:24.578246 (+  5887us) service_pool.cc:227] Handling call
0925 16:43:24.631967 (+ 53721us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:24.819428 (+187461us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:24.821179 (+  1751us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:24.917232 (+ 96053us) log.cc:842] Serialized 52 byte log entry
0925 16:43:25.064236 (+147004us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:25.072378 (+  8142us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:25.085579 (+ 13201us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:25.729351 (+643772us) raft_consensus.cc:1671] finished
0925 16:43:25.730823 (+  1472us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:25.744897 (+ 14074us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6710,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":8014,"thread_start_us":101429,"threads_started":1,"wal-append.queue_time_us":144135}
I20260925 16:43:25.721971 10999 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:25.717712 10966 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.879102  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:25.879858  9693 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:25.880102 11142 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:25.880409 11256 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.880981 11256 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.881668  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:25.883253 11256 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:25.840385 11245 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:25.883812 11245 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.885701 11245 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.885860 11240 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:25.858309 11239 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.889241 11239 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:25.889751 11239 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:25.890501 11239 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:25.890815 11239 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:25.862597  8970 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:25.865594 11111 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.895946 11111 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.897817 11111 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:25.734464 11243 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:25.875332  9695 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260925 16:43:25.898646 11243 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:25.876185 10999 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:25.839856 11260 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:25.878872 11241 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:25.936813  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 234672us
I20260925 16:43:25.880522 11142 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:25.883101  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:25.901458 11085 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.812944 11086 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.860311 11223 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:25.908577 11092 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:25.846711 11078 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.116s
I20260925 16:43:25.998888 11237 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:25.999411 10966 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:25.999904  9702 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:25.720696 11255 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260925 16:43:25.913507  9121 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260925 16:43:25.877840 11229 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.875165 11238 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:25.899561 11243 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:25.918442  8970 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
W20260925 16:43:25.939780  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 457085us
W20260925 16:43:25.985790  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 293691us
I20260925 16:43:26.020864  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1356) took 1001 ms. Trace:
I20260925 16:43:26.021411  8970 rpcz_store.cc:276] 0925 16:43:25.019144 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.019270 (+   126us) service_pool.cc:227] Handling call
0925 16:43:25.732584 (+713314us) spinlock_profiling.cc:243] Waited 393 ms on lock 0x7b5400012aa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2deff 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86
0925 16:43:26.020797 (+288213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":904537344}
I20260925 16:43:26.025036  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:25.990702  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 426726us
W20260925 16:43:25.989571  8921 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet adae4a9dd16346529fe4ff004abc3603
W20260925 16:43:26.026336  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet adae4a9dd16346529fe4ff004abc3603
I20260925 16:43:25.910508  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:25.867532 11080 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:25.937006 11182 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.132s	user 0.006s	sys 0.006s
I20260925 16:43:25.885717 11242 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:26.193776  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:25.989913 11142 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:26.003356  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:26.195017  9700 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:26.005281  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:26.025838  9122 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
W20260925 16:43:26.193945  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 172941us
I20260925 16:43:26.033560  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:26.198243  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:26.212908  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:26.216733  9120 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
W20260925 16:43:26.234714  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.010s	sys 0.032s
W20260925 16:43:26.236135  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.010s	sys 0.032s
I20260925 16:43:26.241751  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:26.005640 11250 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:26.242849  8970 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:26.296196  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.000s	sys 0.055s
I20260925 16:43:26.296404  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:26.297843  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.000s	sys 0.055s
I20260925 16:43:26.194778 11085 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:26.233942 11223 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:26.252813 11134 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.017s	sys 0.029s
I20260925 16:43:25.984575 11260 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:26.252337 11229 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.326479  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.238273 11205 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:26.309173  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:26.310720 11086 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:26.314709  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 116637us
I20260925 16:43:26.307713  9695 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:26.313231  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.042s	sys 0.108s
W20260925 16:43:26.374655  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.042s	sys 0.108s
W20260925 16:43:26.374960  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 580445us
I20260925 16:43:26.287194  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:26.310598 11255 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.097s	user 0.001s	sys 0.001s
W20260925 16:43:26.324276 10953 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.112s	sys 0.170s
I20260925 16:43:26.291991 11237 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:26.292088 11089 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:26.391963  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:26.348124  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 92780.9us
W20260925 16:43:26.314934  8967 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.006s	sys 0.004s
W20260925 16:43:26.316339 11134 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.017s	sys 0.029s
I20260925 16:43:26.252969 11206 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260925 16:43:26.372000 11092 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:26.440567  8967 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.007s	sys 0.005s
I20260925 16:43:26.373076  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:26.428248  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:26.367475  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.006s
I20260925 16:43:26.324956 11132 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:26.380491  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:26.381052  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:26.449045  8975 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:26.382879  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.450358  9042 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:26.450908  8974 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:26.451195  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.451792  9042 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:26.307405 10749 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.046s
I20260925 16:43:26.378649  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.377214 11270 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:26.441879  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.006s
I20260925 16:43:26.395008  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:26.483212  8970 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:26.385790 10953 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.112s	sys 0.172s
I20260925 16:43:26.349309 11229 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.441833  9045 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
W20260925 16:43:26.378790 11106 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.024s	sys 0.047s
W20260925 16:43:26.452687  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 218644us
I20260925 16:43:26.497933  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.436573 11234 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:26.438442  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.485651  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1357) took 1466 ms. Trace:
I20260925 16:43:26.448194  9041 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:26.390455  9693 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:26.320783 11223 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:26.441216  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68209.5us
W20260925 16:43:26.497452 11106 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.031s	sys 0.057s
I20260925 16:43:26.380527 11086 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:26.317559 11085 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:26.486390 11194 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.027s	sys 0.072s
I20260925 16:43:26.501674  8973 rpcz_store.cc:276] 0925 16:43:25.019475 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.026981 (+  7506us) service_pool.cc:227] Handling call
0925 16:43:25.027373 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:25.172916 (+145543us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:25.172958 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:25.182520 (+  9562us) log.cc:842] Serialized 26 byte log entry
0925 16:43:25.317680 (+135160us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:25.341460 (+ 23780us) log.cc:842] Serialized 14 byte log entry
0925 16:43:25.500877 (+159417us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b18003dcba0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:43:25.501062 (+   185us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:25.501167 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:26.455382 (+954215us) raft_consensus.cc:1671] finished
0925 16:43:26.485456 (+ 30074us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:26.485596 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37313,"prepare.queue_time_us":50777,"prepare.run_cpu_time_us":79,"prepare.run_wall_time_us":3681,"raft.queue_time_us":321376,"raft.run_cpu_time_us":438,"raft.run_wall_time_us":79521,"spinlock_wait_cycles":7171328,"thread_start_us":215913,"threads_started":2,"wal-append.queue_time_us":298701}
I20260925 16:43:26.478398 10749 consensus_queue.cc:1225] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260925 16:43:26.508985 11111 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.454573 11092 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:26.552156 11092 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:26.420769 11205 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:26.553391 11229 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:26.554524 11205 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:26.541288 11281 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:26.555086 11277 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.555634 11277 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.555567 11281 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.557629 11277 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:26.558229 11281 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:26.559242 11235 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.693s	user 0.002s	sys 0.005s
W20260925 16:43:26.560240 10958 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260925 16:43:26.561609  9120 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:26.486079 11208 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
W20260925 16:43:26.499629 11128 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.166s	user 0.007s	sys 0.003s
I20260925 16:43:26.454782 11087 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:26.544348 11106 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:26.517587  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:26.613898  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 96381.9us
W20260925 16:43:26.500042 11209 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.375s	user 0.010s	sys 0.001s
W20260925 16:43:26.513408  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 272770us
I20260925 16:43:26.393150 11237 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.492293 11263 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:26.621394  9049 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:26.439682 11089 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:26.526695 11071 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.540010  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.518456  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:26.448515 11132 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:26.501572 11226 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:26.608909 10958 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:26.489522 11182 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
W20260925 16:43:26.528394 11194 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.027s	sys 0.073s
W20260925 16:43:26.564916 11117 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.156s	user 0.011s	sys 0.000s
W20260925 16:43:26.502837 11140 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.856s	user 0.006s	sys 0.003s
I20260925 16:43:26.612762  8975 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:26.390829 11238 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.222s
I20260925 16:43:26.622586  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:26.610535 10999 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.009s	sys 0.021s
I20260925 16:43:26.565510 11111 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.495323 11270 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:26.508188 11234 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.571991 11208 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:26.611037 11281 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:26.660982  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:26.609432  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:26.454463 11253 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.752s	user 0.004s	sys 0.010s
I20260925 16:43:26.441813 11250 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:26.646198  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 127804us
I20260925 16:43:26.611270 11128 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.924679  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 334) took 1832 ms. Trace:
W20260925 16:43:26.985445  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 415025us
I20260925 16:43:26.979209  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:26.695448 11206 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.314s
I20260925 16:43:26.948662 11076 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.670337  9697 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:27.010051 10958 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:27.011675  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 389121us
I20260925 16:43:27.010620 11281 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.011147 11208 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.021664  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:26.657773 11229 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:27.021912 11227 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:26.975076 11089 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:27.021776 11208 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:27.022452 11227 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.915385 11248 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.449s
I20260925 16:43:27.007856 11129 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:27.015997 11076 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.633862  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:27.008831 10999 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.022s	sys 0.044s
I20260925 16:43:27.027835  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:27.028993  8974 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:27.030124 11076 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.030694 11076 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:27.014333  9124 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:27.022677  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:27.018932 10953 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.020346  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:27.023130  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 407316us
I20260925 16:43:27.046411 11134 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:27.045481 11234 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.024866 11272 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.663520 11071 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.047927 11272 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.049871 11272 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.017825  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:27.046563 11076 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:27.050683 11270 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:27.047237  9044 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.514s	user 0.011s	sys 0.001s
I20260925 16:43:27.050982  8973 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:27.052661  9044 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:27.053534  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 407) took 1667 ms. Trace:
I20260925 16:43:27.051806 11076 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.054179  9044 rpcz_store.cc:276] 0925 16:43:25.386380 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.389705 (+  3325us) service_pool.cc:227] Handling call
0925 16:43:27.053456 (+1663751us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:27.015267 11238 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:27.057149  8970 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:27.057865 11281 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.043881 10953 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.065862 10953 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:27.062433 11142 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.822s	user 0.008s	sys 0.001s
W20260925 16:43:26.971448 11282 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260925 16:43:27.017825 11117 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.058995 11018 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:27.019788 10958 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.053404  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:27.063573 11071 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.068228 11259 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:27.009816 11140 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:26.930513 11284 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.321s	user 0.000s	sys 0.001s
I20260925 16:43:26.915126 11266 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:27.071044  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1716) took 1525 ms. Trace:
I20260925 16:43:27.008658  9121 rpcz_store.cc:276] 0925 16:43:25.092638 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.092783 (+   145us) service_pool.cc:227] Handling call
0925 16:43:25.177640 (+ 84857us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:26.004917 (+827277us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:26.924390 (+919473us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b5400144454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:26.924614 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1691821952}
I20260925 16:43:27.074584  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:27.050146 11252 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.185s	user 0.000s	sys 0.009s
I20260925 16:43:27.069096 11142 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:26.672554  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:26.960280 11239 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.069s	user 0.009s	sys 0.003s
I20260925 16:43:26.634538 11277 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:43:27.079404  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56795.2us
I20260925 16:43:27.072770  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:26.634428 11209 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:26.644177 11087 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:26.634250 11263 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:27.157765  8971 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:26.942788 11237 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.025205 11294 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
W20260925 16:43:26.929183 11290 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.294s	user 0.000s	sys 0.000s
I20260925 16:43:27.196070  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:27.197716  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:27.155155 11018 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.198344  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:26.793640 11205 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:27.198868 11266 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.190641  8967 rpcz_store.cc:276] 0925 16:43:25.545764 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.560145 (+ 14381us) service_pool.cc:227] Handling call
0925 16:43:25.560395 (+   250us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:25.560652 (+   257us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:25.560676 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:25.567252 (+  6576us) log.cc:842] Serialized 26 byte log entry
0925 16:43:26.441057 (+873805us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:26.607447 (+166390us) log.cc:842] Serialized 14 byte log entry
0925 16:43:26.609989 (+  2542us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:26.610059 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:27.058029 (+447970us) spinlock_profiling.cc:243] Waited 18 ms on lock 0x7b180015a3c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:43:27.070748 (+ 12719us) raft_consensus.cc:1671] finished
0925 16:43:27.070854 (+   106us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:27.070973 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":439,"prepare.queue_time_us":167301,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":7234,"raft.queue_time_us":136596,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":48552,"spinlock_wait_cycles":42775168,"thread_start_us":775273,"threads_started":1,"wal-append.queue_time_us":1040339}
I20260925 16:43:27.200604  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:26.937741 11085 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.024518 11227 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:27.074048 11253 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.372s	user 0.005s	sys 0.014s
W20260925 16:43:26.915928 11287 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.403s	user 0.001s	sys 0.000s
I20260925 16:43:26.906572 11260 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:26.829172 11297 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.087708 10999 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:27.156616 11144 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.011s	sys 0.026s
W20260925 16:43:27.299405  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 68991.6us
I20260925 16:43:26.842738 11132 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.088302 11206 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:26.633934 11106 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.199971  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:26.689822 11226 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:27.290794  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60394.8us
W20260925 16:43:27.482936  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.019s	sys 0.025s
W20260925 16:43:27.523221  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.890s	user 0.023s	sys 0.026s
I20260925 16:43:27.523937  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:27.524569  8975 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
W20260925 16:43:27.483019 11273 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260925 16:43:27.526841  9050 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:27.527215 11018 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.528461  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2051) took 1683 ms. Trace:
I20260925 16:43:27.529320 11271 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.529568 11142 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.529907 11271 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.528818  9118 rpcz_store.cc:276] 0925 16:43:25.844719 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.844855 (+   136us) service_pool.cc:227] Handling call
0925 16:43:25.849700 (+  4845us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:25.850082 (+   382us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:25.850119 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:25.850607 (+   488us) log.cc:842] Serialized 26 byte log entry
0925 16:43:26.314690 (+464083us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:43:26.314730 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:26.314795 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:27.528287 (+1213492us) raft_consensus.cc:1671] finished
0925 16:43:27.528306 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:27.528412 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9792,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8038,"thread_start_us":447085,"threads_started":1,"wal-append.queue_time_us":643268}
I20260925 16:43:27.531005 11106 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.524292  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:26.670742 11278 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.155471 11270 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:27.155284 11259 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:26.935945 11279 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:27.202088 11071 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.229945 10958 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:27.430548  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 409) took 2039 ms. Trace:
W20260925 16:43:27.482759 11288 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.226s	user 0.000s	sys 0.001s
W20260925 16:43:27.576179  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 501662us
I20260925 16:43:27.292577 11277 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:27.458720 11076 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.464860 11223 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.291812 11272 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.603261  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:27.521965 11144 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.912s	user 0.012s	sys 0.035s
I20260925 16:43:27.604315  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:27.575383 11296 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:27.338507  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.031s	sys 0.110s
W20260925 16:43:27.576568  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54535.5us
W20260925 16:43:27.585526  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64785.4us
I20260925 16:43:27.603681  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:27.521498  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 849191us
I20260925 16:43:27.397500  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:27.419655  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:27.574482 11085 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
W20260925 16:43:27.394682  9116 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.019s	sys 0.041s
I20260925 16:43:27.569969 11086 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.390069 11209 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:27.450925  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 295097us
I20260925 16:43:27.573834 11229 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:27.584021  9048 rpcz_store.cc:276] 0925 16:43:25.391126 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.391297 (+   171us) service_pool.cc:227] Handling call
0925 16:43:25.391575 (+   278us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:25.561345 (+169770us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:25.561364 (+    19us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:25.561747 (+   383us) log.cc:842] Serialized 26 byte log entry
0925 16:43:26.298938 (+737191us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:26.298975 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:26.299033 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:27.430271 (+1131238us) raft_consensus.cc:1671] finished
0925 16:43:27.430294 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:27.430479 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1107,"raft.queue_time_us":57557,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":16568,"thread_start_us":906230,"threads_started":2,"wal-append.queue_time_us":943685}
I20260925 16:43:27.182022 11117 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.482065 11280 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:27.624508 11304 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260925 16:43:27.394412  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 1990) took 1033 ms. Trace:
I20260925 16:43:27.566450 11263 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:27.522682  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:27.218106 11252 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5.
W20260925 16:43:27.436573 11243 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.002s	sys 0.003s
I20260925 16:43:27.570254 11206 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.574218 10999 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.571648 11087 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.576079 11297 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.678432 11314 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.907866 11314 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.853570 11298 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.910192 11314 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:27.910104 11298 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.669821  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:27.732821  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:27.571429 11205 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:27.911777  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.259s	user 0.052s	sys 0.161s
I20260925 16:43:27.576404 11106 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:27.618656 11311 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:27.655407  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52231.3us
W20260925 16:43:27.917677  9116 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.221s	user 0.019s	sys 0.056s
I20260925 16:43:27.580165 11132 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:27.736297  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:27.619156 11235 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.675207  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:27.940065  8972 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:27.632318 11140 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:27.924366 11301 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:27.925153  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:27.730261 10958 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:27.748091 11111 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.925173  9049 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260925 16:43:27.593411 11071 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.926592  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 520) took 1922 ms. Trace:
I20260925 16:43:27.583612 11279 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.582847 11271 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:27.660130 11272 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.429885 11089 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:27.928158 11129 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:27.957598  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:27.958396  9695 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:27.958027 11089 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.928400 11280 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.619129 11277 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:27.605151 11270 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:27.763020 11259 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.930526  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1923) took 2239 ms. Trace:
I20260925 16:43:27.578548 11278 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:27.879685 11292 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260925 16:43:27.932333  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:27.926239 11209 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.911796  9122 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:27.995903  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:27.996814  9122 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:43:27.748553 11302 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260925 16:43:27.934352  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:28.013121  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 78824.2us
I20260925 16:43:27.957988 11076 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:27.934083  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 411438us
W20260925 16:43:27.678227 11303 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260925 16:43:27.919950 11243 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.065s	user 0.009s	sys 0.009s
I20260925 16:43:27.923044  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:27.930719 11229 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.924273  9115 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:27.934703 11106 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.940291 11308 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:27.912070  9046 rpcz_store.cc:276] 0925 16:43:26.325799 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.563266 (+237467us) service_pool.cc:227] Handling call
0925 16:43:27.359059 (+795793us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:27.944077  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:27.944669 11266 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.944767  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:27.922394 11250 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.945498 11314 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.937176 11311 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:27.934584 11267 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:27.654959 11128 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.940189  9121 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:27.675782 11293 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:27.290766 11239 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.932281 11086 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.954988  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:27.951438  9702 rpcz_store.cc:276] 0925 16:43:26.004007 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.004203 (+   196us) service_pool.cc:227] Handling call
0925 16:43:26.037307 (+ 33104us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:26.480470 (+443163us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:26.480513 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:26.485221 (+  4708us) log.cc:842] Serialized 26 byte log entry
0925 16:43:26.675794 (+190573us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:26.675843 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:26.675919 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:27.926422 (+1250503us) raft_consensus.cc:1671] finished
0925 16:43:27.926443 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:27.926545 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":165642,"raft.queue_time_us":177799,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15660,"thread_start_us":449758,"threads_started":2,"wal-append.queue_time_us":896346}
I20260925 16:43:27.951129 11301 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:27.959905  9124 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:27.764685 11226 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:27.985025  9119 rpcz_store.cc:276] 0925 16:43:25.691611 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.691764 (+   153us) service_pool.cc:227] Handling call
0925 16:43:27.929680 (+2237916us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:27.929864 (+   184us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:27.930213 (+   349us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:27.930240 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:27.930281 (+    41us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:27.930307 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:27.930365 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:27.930463 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6846336}
I20260925 16:43:27.988413  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:27.942850 11085 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:27.951792 10958 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:27.956291  9044 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:27.957684 11232 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:28.014338  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:27.916558  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:28.016639  9697 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:27.941995 11208 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:28.017851  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:27.976541 11316 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:27.942149 11235 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.040431 11117 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.040566  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:27.932756 11296 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.042346 11278 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.012957 11018 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:28.047721 11279 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.024849  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:28.049403 11280 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.408885 11239 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.409430  9118 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:28.409852 11314 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.411125  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.411873 11314 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:28.413048 11071 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:28.413127  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.063510 11223 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:28.049229 11229 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.415391  9045 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:28.083160 11106 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.021293 11129 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:28.052646  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:28.473942  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 421369us
I20260925 16:43:28.414763  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.022781 11271 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:28.052093 11308 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:28.468911  9124 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260925 16:43:28.430792 10958 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:28.496588  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 451769us
I20260925 16:43:28.430296 11140 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:28.499365 11209 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:28.415468 11085 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.454687  9694 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:28.250052 11206 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.025224 11076 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.417645 11272 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.344457 11087 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.276620 11298 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.472888 11223 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.366739 11263 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.431586 11018 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.437044 11086 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.500051 11235 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.453966 11208 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.500993 11314 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:43:28.505038 11292 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.425s	user 0.000s	sys 0.008s
I20260925 16:43:28.477665 11232 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.472621 11129 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:28.504343 11271 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:28.580211 11223 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.580600 11018 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.460018 11250 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.454190 11267 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.620208 11267 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.620455 11301 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.551430 11140 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.622373 11250 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.460600 11293 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.126796 11270 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.613981 11271 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:28.573563 11272 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:28.626245 11272 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.627903 11208 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:28.628865 11272 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.625548 11076 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.631671 11232 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.634809 11311 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:28.637398 11293 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:28.638895 11086 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.588305 11314 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:28.641021 11314 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:28.648181 11327 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:28.648947 11327 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:28.551211 11308 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:28.685225 11324 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:28.690199 11263 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.691074 11324 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:28.694703 11324 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:28.696681 11327 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:28.477495 11316 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:28.761809  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 747293us
W20260925 16:43:28.764675  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 746714us
I20260925 16:43:28.781597  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 449) took 3234 ms. Trace:
I20260925 16:43:28.782231  8968 rpcz_store.cc:276] 0925 16:43:25.546934 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.676794 (+129860us) service_pool.cc:227] Handling call
0925 16:43:25.708747 (+ 31953us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:26.018089 (+309342us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:26.018157 (+    68us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:26.018676 (+   519us) log.cc:842] Serialized 26 byte log entry
0925 16:43:26.567495 (+548819us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:27.090029 (+522534us) log.cc:842] Serialized 14 byte log entry
0925 16:43:27.090444 (+   415us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:27.090534 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:28.780871 (+1690337us) raft_consensus.cc:1671] finished
0925 16:43:28.780950 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.781341 (+   391us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40941,"prepare.queue_time_us":102941,"prepare.run_wall_time_us":58,"raft.queue_time_us":211694,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":31480,"spinlock_wait_cycles":55128192,"thread_start_us":834657,"threads_started":3,"wal-append.queue_time_us":1500882}
I20260925 16:43:28.786553  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.793180  8969 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:28.804719  8972 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:28.805337  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1734) took 1274 ms (client timeout 1693 ms). Trace:
W20260925 16:43:28.805745  8972 rpcz_store.cc:269] 0925 16:43:27.531204 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.940785 (+409581us) service_pool.cc:227] Handling call
0925 16:43:28.805223 (+864438us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:28.807385  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.808375  8972 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:28.809652  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.810636  8972 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:28.811753  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.812629  8972 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:28.813792  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.815043  8972 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:28.816473  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.842681  8972 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:28.843683  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.845067  8973 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
W20260925 16:43:28.849373  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1732) took 1644 ms (client timeout 1541 ms). Trace:
I20260925 16:43:28.838487  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 457) took 1640 ms. Trace:
I20260925 16:43:28.866053  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.867110  9124 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 2: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:28.867710  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.874064  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:28.824126  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 454) took 1627 ms. Trace:
I20260925 16:43:28.879958  8974 rpcz_store.cc:276] 0925 16:43:27.196715 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.200174 (+  3459us) service_pool.cc:227] Handling call
0925 16:43:28.822366 (+1622192us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:28.822891 (+   525us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.823459 (+   568us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:28.823516 (+    57us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:28.823601 (+    85us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:28.823651 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.823760 (+   109us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.823918 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3363072}
I20260925 16:43:28.881049  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.882136  9119 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:28.869612  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.865391  8975 rpcz_store.cc:276] 0925 16:43:27.197541 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.525171 (+327630us) service_pool.cc:227] Handling call
0925 16:43:28.835950 (+1310779us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.836542 (+   592us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:28.836577 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:28.836649 (+    72us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:28.836696 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.836766 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.838126 (+  1360us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b54003e8850. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:28.838295 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3013549952}
W20260925 16:43:28.846163  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.003s	sys 0.016s
W20260925 16:43:28.884722  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.003s	sys 0.016s
W20260925 16:43:28.846756  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.006s	sys 0.021s
W20260925 16:43:28.887898  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.006s	sys 0.021s
W20260925 16:43:28.888422  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 868692us
I20260925 16:43:28.890170  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:28.891837  8973 rpcz_store.cc:269] 0925 16:43:27.204514 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.292343 (+ 87829us) service_pool.cc:227] Handling call
0925 16:43:28.843240 (+1550897us) spinlock_profiling.cc:243] Waited 3.12 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:28.849287 (+  6047us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7183616}
I20260925 16:43:28.893182  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.894623  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:28.894833  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:28.836249  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1730) took 1816 ms (client timeout 1643 ms). Trace:
I20260925 16:43:28.417311  9048 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:28.850893  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:28.852857  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1403) took 2344 ms (client timeout 1842 ms). Trace:
W20260925 16:43:28.854544  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 379133us
W20260925 16:43:28.494372  9116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.014s
I20260925 16:43:28.857038  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:28.857438  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1399) took 2468 ms. Trace:
I20260925 16:43:28.858301  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 345) took 2997 ms. Trace:
I20260925 16:43:28.859324  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 455) took 1662 ms. Trace:
I20260925 16:43:28.426918  9118 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:28.863898  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.864761  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1925) took 2840 ms. Trace:
I20260925 16:43:28.883246  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.834944  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1724) took 2454 ms. Trace:
I20260925 16:43:28.895454  8975 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
W20260925 16:43:28.898468  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.768s (SENT) [suppressed 33 similar messages]
I20260925 16:43:28.905894  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:28.906718  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:28.908109  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.839s	user 0.003s	sys 0.018s
W20260925 16:43:28.908653  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.011s
I20260925 16:43:28.844099  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:28.847649  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1723) took 2467 ms (client timeout 1990 ms). Trace:
W20260925 16:43:28.915525  8970 rpcz_store.cc:269] 0925 16:43:27.020007 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.020138 (+   131us) service_pool.cc:227] Handling call
0925 16:43:28.835650 (+1815512us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b54003e8854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:28.835899 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":29420800}
I20260925 16:43:28.957538  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 458) took 1759 ms. Trace:
I20260925 16:43:28.972491 11085 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:28.973703 11208 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:28.968106  9117 rpcz_store.cc:276] 0925 16:43:25.860391 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.861506 (+  1115us) service_pool.cc:227] Handling call
0925 16:43:28.856563 (+2995057us) spinlock_profiling.cc:243] Waited 3.59 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:28.857065 (+   502us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.857613 (+   548us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:28.857648 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:28.857726 (+    78us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:28.857770 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.857874 (+   104us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.858037 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8262400}
W20260925 16:43:28.964564  9050 rpcz_store.cc:269] 0925 16:43:26.508321 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.509402 (+  1081us) service_pool.cc:227] Handling call
0925 16:43:28.852327 (+2342925us) spinlock_profiling.cc:243] Waited 882 ms on lock 0x7b54000d43d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:28.852551 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2028993920}
I20260925 16:43:28.968394  8966 rpcz_store.cc:276] 0925 16:43:27.197004 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.200246 (+  3242us) service_pool.cc:227] Handling call
0925 16:43:28.858191 (+1657945us) spinlock_profiling.cc:243] Waited 40.1 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:28.858525 (+   334us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.858761 (+   236us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:28.858786 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:28.858870 (+    84us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:28.858901 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.858987 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.859166 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":92278528}
I20260925 16:43:28.697436 11129 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.121860 11338 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.342096  8974 rpcz_store.cc:276] 0925 16:43:27.197786 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.881644 (+1683858us) service_pool.cc:227] Handling call
0925 16:43:28.882257 (+   613us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.957028 (+ 74771us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:28.957066 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:28.957121 (+    55us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:28.957233 (+   112us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.957310 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.957444 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":230352,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":107,"thread_start_us":74233,"threads_started":1}
I20260925 16:43:28.968048  9042 rpcz_store.cc:276] 0925 16:43:26.388351 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.452349 (+ 63998us) service_pool.cc:227] Handling call
0925 16:43:26.493858 (+ 41509us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:26.494244 (+   386us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:26.494280 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:26.494801 (+   521us) log.cc:842] Serialized 26 byte log entry
0925 16:43:26.764229 (+269428us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:26.764284 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:26.764384 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:28.042604 (+1278220us) raft_consensus.cc:1671] finished
0925 16:43:28.042627 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.856765 (+814138us) spinlock_profiling.cc:243] Waited 41.2 ms on lock 0x7b5400126950. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:28.857132 (+   367us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":28336,"raft.run_cpu_time_us":341,"raft.run_wall_time_us":14705,"spinlock_wait_cycles":94749440,"thread_start_us":236143,"threads_started":1,"wal-append.queue_time_us":970620}
I20260925 16:43:28.976580 11117 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:29.271652 11332 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.110018  8973 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
W20260925 16:43:29.113570  8940 connection.cc:232] RPC call timeout handler was delayed by -1.066673160999926s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16210000000000002s for a response
I20260925 16:43:29.155133  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:29.297730  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 456) took 1757 ms. Trace:
I20260925 16:43:29.301625  8871 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 339) took 5925 ms. Trace:
W20260925 16:43:29.300107  9048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1407) took 1257 ms (client timeout 1535 ms). Trace:
W20260925 16:43:29.212368  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 235944us
I20260925 16:43:29.114545  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 344) took 3266 ms. Trace:
I20260925 16:43:29.404290  9044 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:29.405074  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1405) took 1491 ms. Trace:
I20260925 16:43:29.405426  9044 rpcz_store.cc:276] 0925 16:43:27.913985 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.914133 (+   148us) service_pool.cc:227] Handling call
0925 16:43:29.404997 (+1490864us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.406407  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.407799  9045 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260925 16:43:29.407152  9044 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
W20260925 16:43:29.404554  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.059s	user 0.002s	sys 0.023s
I20260925 16:43:29.410008 11266 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.401297  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1412) took 1456 ms. Trace:
W20260925 16:43:29.175910  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.010s	sys 0.021s
W20260925 16:43:29.344751  8971 rpcz_store.cc:269] 0925 16:43:26.379835 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.380282 (+   447us) service_pool.cc:227] Handling call
0925 16:43:28.847064 (+2466782us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540036f454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:28.847370 (+   306us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1629960064}
W20260925 16:43:29.399498  9048 rpcz_store.cc:269] 0925 16:43:27.915982 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.916269 (+   287us) service_pool.cc:227] Handling call
0925 16:43:29.168456 (+1252187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.412164  9049 rpcz_store.cc:276] 0925 16:43:27.944742 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.442690 (+497948us) service_pool.cc:227] Handling call
0925 16:43:29.386467 (+943777us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:29.176069  9116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.116s	user 0.001s	sys 0.014s
I20260925 16:43:29.177677  9046 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:29.417188  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.110456 11250 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:29.416456  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.005s	sys 0.029s
I20260925 16:43:29.278584 11229 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:29.213084 11341 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260925 16:43:29.420549  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.011s	sys 0.027s
I20260925 16:43:29.410683 11266 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.425216  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.176236 11223 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.110149 11128 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.386715 11117 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:29.278950 11263 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:29.386499  8967 rpcz_store.cc:276] 0925 16:43:27.197291 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.522268 (+324977us) service_pool.cc:227] Handling call
0925 16:43:28.854056 (+1331788us) spinlock_profiling.cc:243] Waited 1.54 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:28.854439 (+   383us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.947451 (+ 93012us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:28.947483 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:28.947551 (+    68us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:28.947595 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.947683 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:28.954352 (+  6669us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":257676,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":251,"spinlock_wait_cycles":3542912,"thread_start_us":92268,"threads_started":1}
I20260925 16:43:29.111045 11278 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:29.301146 11316 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:29.111441 11279 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.470690 11279 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.472342  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.474303 11279 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.435376  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.475047  8966 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:29.474803 11229 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.114953 11086 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:29.382473  9115 rpcz_store.cc:276] 0925 16:43:26.023917 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.034221 (+ 10304us) service_pool.cc:227] Handling call
0925 16:43:26.297447 (+263226us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.036090 (+1738643us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.864214 (+828124us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b5400166054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:28.864565 (+   351us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3738421632}
I20260925 16:43:29.400378  9123 rpcz_store.cc:276] 0925 16:43:25.848443 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.848609 (+   166us) service_pool.cc:227] Handling call
0925 16:43:28.870362 (+3021753us) spinlock_profiling.cc:243] Waited 9.25 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:28.870839 (+   477us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.871509 (+   670us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:28.955597 (+ 84088us) log.cc:842] Serialized 14 byte log entry
0925 16:43:29.114117 (+158520us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:29.114161 (+    44us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:29.114197 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:29.114265 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:29.114395 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":83920,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":38314,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":206,"spinlock_wait_cycles":21266304,"thread_start_us":104571,"threads_started":2}
W20260925 16:43:29.461923  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1940) took 1389 ms (client timeout 1693 ms). Trace:
I20260925 16:43:29.462198  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:29.465068 11087 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.468964 11128 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.109965 11239 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.365s
I20260925 16:43:29.476272  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.175719  8872 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 3, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:29.462775  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.463029  8972 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:29.436652 11117 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:29.111897 11280 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:29.112346 11337 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:29.482548  9118 rpcz_store.cc:269] 0925 16:43:28.035330 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.412851 (+377521us) service_pool.cc:227] Handling call
0925 16:43:29.420838 (+1007987us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:29.482309  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.40825e+06us
I20260925 16:43:29.437000  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.463651  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.461827  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:29.428812 11341 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:29.474327 11308 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.759s	user 0.010s	sys 0.000s
I20260925 16:43:29.343086 11338 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:29.494074  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56961.1us
I20260925 16:43:29.463092 11208 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.175392 11301 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.316s
I20260925 16:43:29.503258  8966 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:29.481868 11263 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:29.530448 11086 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.345151  8969 rpcz_store.cc:276] 0925 16:43:26.380127 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.383362 (+  3235us) service_pool.cc:227] Handling call
0925 16:43:26.498385 (+115023us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:28.793945 (+2295560us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.834540 (+ 40595us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54002fec54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:28.834862 (+   322us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5266106240}
I20260925 16:43:29.499501 11341 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:29.538335 11263 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:29.548988  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:29.549600 11271 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.846s	user 0.006s	sys 0.008s
W20260925 16:43:29.549933  9694 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.576s	user 0.012s	sys 0.001s
I20260925 16:43:29.550606 11208 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.550345 11337 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.502959 11250 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.552392  9698 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:29.552799  8971 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:29.536548  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.501358 11128 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.591907 11330 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.591529  8972 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:29.603382  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:29.605829  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 707356us
I20260925 16:43:29.605298  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1375) took 1662 ms. Trace:
I20260925 16:43:29.609558  8972 rpcz_store.cc:276] 0925 16:43:27.942913 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.843639 (+900726us) service_pool.cc:227] Handling call
0925 16:43:29.605231 (+761592us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.549041  8872 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:29.638964 11320 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.499882 11085 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.640028 11320 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.502460 11087 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:29.653317  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60120.4us
I20260925 16:43:29.499603 11308 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.592594 11330 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.511816  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:29.611310  9694 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:29.608052 11269 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:29.389284  8871 rpcz_store.cc:276] 0925 16:43:23.368241 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:23.368553 (+   312us) service_pool.cc:227] Handling call
0925 16:43:23.817724 (+449171us) spinlock_profiling.cc:243] Waited 75.8 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:43:29.276559 (+5458835us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:24.808097 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:24.886461 (+ 78364us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:24.886491 (+    30us) write_op.cc:435] Acquired schema lock
0925 16:43:24.886504 (+    13us) tablet.cc:660] Decoding operations
0925 16:43:24.886855 (+   351us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:24.886916 (+    61us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:24.886942 (+    26us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:43:24.887113 (+   171us) tablet.cc:699] Row locks acquired
0925 16:43:24.887125 (+    12us) write_op.cc:260] PREPARE: finished
0925 16:43:24.887286 (+   161us) write_op.cc:270] Start()
0925 16:43:24.887409 (+   123us) write_op.cc:276] Timestamp: P: 1790354604887234 usec, L: 0
0925 16:43:24.887425 (+    16us) op_driver.cc:331] REPLICATION: starting
0925 16:43:24.888033 (+   608us) log.cc:842] Serialized 565 byte log entry
0925 16:43:25.188327 (+300294us) op_driver.cc:444] REPLICATION: finished
0925 16:43:25.558787 (+370460us) write_op.cc:301] APPLY: starting
0925 16:43:25.564732 (+  5945us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:25.578538 (+ 13806us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:25.697285 (+118747us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:25.734763 (+ 37478us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:25.812158 (+ 77395us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0925 16:43:25.843323 (+ 31165us) write_op.cc:312] APPLY: finished
0925 16:43:25.881924 (+ 38601us) log.cc:842] Serialized 23 byte log entry
0925 16:43:25.882088 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:25.882620 (+   532us) write_op.cc:454] Released schema lock
0925 16:43:25.882655 (+    35us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:25.882931 (+   276us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:25.882957 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27653,"reported_tablets":13,"spinlock_wait_cycles":174315264,"child_traces":[["op",{"apply.queue_time_us":295086,"apply.run_cpu_time_us":3765,"apply.run_wall_time_us":351953,"num_ops":1,"prepare.queue_time_us":263296,"prepare.run_cpu_time_us":2780,"prepare.run_wall_time_us":89502,"replication_time_us":290665,"thread_start_us":186735,"threads_started":2}]]}
I20260925 16:43:29.639016  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 347) took 3139 ms. Trace:
I20260925 16:43:29.679512  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:29.553999 11278 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.553560 11223 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.706342  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:29.692289  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 418) took 4226 ms (client timeout 2990 ms). Trace:
I20260925 16:43:29.500149 11332 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.603930 11271 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.710573  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:29.712234  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50377us
W20260925 16:43:29.711650  9047 rpcz_store.cc:269] 0925 16:43:25.465517 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:25.465675 (+   158us) service_pool.cc:227] Handling call
0925 16:43:27.200484 (+1734809us) spinlock_profiling.cc:243] Waited 4.42 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:29.691901 (+2491417us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54000b0ed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:29.692058 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4049302144}
I20260925 16:43:29.712877  9048 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:29.698639  8975 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:29.716997  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 459) took 2519 ms. Trace:
I20260925 16:43:29.717344  8975 rpcz_store.cc:276] 0925 16:43:27.198002 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.512360 (+2314358us) service_pool.cc:227] Handling call
0925 16:43:29.643982 (+131622us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:29.716804 (+ 72822us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:29.716934 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.698434  8872 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 3, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:43:29.721117 11277 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.730s	user 0.004s	sys 0.009s
I20260925 16:43:29.720793  8872 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 3 to 4, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 4 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:29.721553 11277 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.724597  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:29.724980 11250 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.724597  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 460) took 2526 ms. Trace:
I20260925 16:43:29.641752 11280 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.726439 11232 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:29.726701 11223 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.722958  8872 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 5, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:29.728157  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.731302 11347 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.731501 11280 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.731590 11244 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:29.732111 11301 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260925 16:43:29.732290 11342 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260925 16:43:29.736158  9041 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:29.737510  8974 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
I20260925 16:43:29.726528  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.741331  8967 raft_consensus.cc:595] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:29.743809  8967 raft_consensus.cc:603] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:29.736577  9121 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:29.753468  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1369) took 1838 ms. Trace:
I20260925 16:43:29.745744 11223 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.757262 11229 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:29.757500 11223 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.744964 11277 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.759095 11085 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.732065 11129 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:29.760560  8971 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260925 16:43:29.756431  8966 rpcz_store.cc:276] 0925 16:43:27.914790 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.564302 (+1649512us) service_pool.cc:227] Handling call
0925 16:43:29.730586 (+166284us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:29.740543 (+  9957us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:29.740572 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:29.744900 (+  4328us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:29.753226 (+  8326us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:29.753300 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:29.753417 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.732056 11087 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.743201 11301 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:29.746731 11244 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:29.851572  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 302829us
W20260925 16:43:29.835361  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63504.9us
I20260925 16:43:29.743191  8872 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:43:29.758021 11278 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:29.801295  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:29.854350  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:29.878168 11005 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:29.861531  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 137134us
I20260925 16:43:29.837482  9047 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:29.756011  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 640) took 1801 ms. Trace:
I20260925 16:43:29.759647 11223 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.850555 11086 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:29.886130  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.887933  9047 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:29.888209 11338 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.888883  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.889786 11271 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:29.890053  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.871572 11332 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.791287 11320 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.897022  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:29.897262  9698 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:29.841342 11337 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:29.846932 11314 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.140s	user 0.009s	sys 0.007s
I20260925 16:43:29.725757  8969 rpcz_store.cc:276] 0925 16:43:27.198262 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.564557 (+2366295us) service_pool.cc:227] Handling call
0925 16:43:29.704422 (+139865us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:29.724069 (+ 19647us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:29.724130 (+    61us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:29.724197 (+    67us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:29.724304 (+   107us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:29.724374 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:29.724521 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.736159 11347 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.886746  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.891387  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.856755 11350 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:29.800202 11352 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.901737  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:29.902407 11330 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:29.904143  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:29.904516 10958 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.334s	user 0.009s	sys 0.002s
I20260925 16:43:29.905196  8966 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:29.884614  8872 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 3 to 4, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 4 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:29.704438  9116 rpcz_store.cc:276] 0925 16:43:26.499523 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.503191 (+  3668us) service_pool.cc:227] Handling call
0925 16:43:26.546263 (+ 43072us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:26.609552 (+ 63289us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:27.950430 (+1340878us) log.cc:842] Serialized 14 byte log entry
0925 16:43:29.491141 (+1540711us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:29.537369 (+ 46228us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:29.638606 (+101237us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:29.638790 (+   184us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:29.638958 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1015266,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":62,"raft.queue_time_us":14209,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":12123,"thread_start_us":2693973,"threads_started":2,"wal-append.queue_time_us":623212,"wal-append.run_cpu_time_us":1468,"wal-append.run_wall_time_us":1075127}
I20260925 16:43:29.918869  9702 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
W20260925 16:43:29.932387  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45928.2us
I20260925 16:43:29.866547 11301 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:29.906697 11271 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:29.908138 11308 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:29.935362 11332 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.934643  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:29.941028 11352 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.941236 11332 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.885447  9694 rpcz_store.cc:276] 0925 16:43:27.941777 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.944519 (+  2742us) service_pool.cc:227] Handling call
0925 16:43:29.737049 (+1792530us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:29.945834  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:29.947034  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:29.945149  9047 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:29.952338 11348 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:29.953081 11348 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.957898 11144 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:29.926236 11223 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:29.963326 11247 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 4.275s	user 0.036s	sys 0.094s
I20260925 16:43:29.963259 11294 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:29.963583  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:29.963610  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1374) took 2021 ms. Trace:
I20260925 16:43:29.969623  8872 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:29.953693 11348 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.969637  8971 rpcz_store.cc:276] 0925 16:43:27.942589 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.606716 (+1664127us) service_pool.cc:227] Handling call
0925 16:43:29.676025 (+ 69309us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:29.762466 (+ 86441us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:29.963346 (+200880us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54003c41d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:29.963537 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":164951808}
I20260925 16:43:29.975975 11156 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:29.978497  9698 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:29.958456 11144 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.961550  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.920724 11314 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.964243 11330 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.018s
I20260925 16:43:29.993428  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:29.968642 11244 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:29.990296  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46624.3us
I20260925 16:43:29.989920  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:29.945816 10958 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:29.946717 11271 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:29.968166  9044 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:29.976593 11332 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:29.982403  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.001590 11347 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.002431 11341 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.008776 11354 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:30.012393  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:30.012398  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:29.998620  8872 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:30.014523  9121 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:30.011848  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 1999) took 1043 ms. Trace:
I20260925 16:43:30.017076 11337 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:30.019127  8968 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:30.019722  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.020279  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:30.021361  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:30.025509  8971 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:30.030066  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.027298  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.031826  8975 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:30.033859  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.003816 11244 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:29.992242 11223 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.012540  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.037060  9698 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:30.034925  8969 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:30.027745 11337 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:30.043046  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70219.1us
W20260925 16:43:30.044974  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83565.5us
W20260925 16:43:30.046772  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 83323us
I20260925 16:43:30.048517 11134 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:30.048956 11134 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:30.049377 11134 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:30.051440  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:30.033865 11297 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.052611 11338 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:30.053391 11338 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:43:30.054466  9046 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.001s
I20260925 16:43:30.054881  9046 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:30.054587 11338 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.024605  9044 rpcz_store.cc:276] 0925 16:43:28.968348 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.903840 (+935492us) service_pool.cc:227] Handling call
0925 16:43:30.011773 (+107933us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:30.055792 11270 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.043955  9117 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:30.056303 11270 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.056555  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.057401  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.058876 11270 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.067183  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
W20260925 16:43:30.069222  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 85008.9us
I20260925 16:43:30.061328  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:30.071580  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.072903  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:30.040550 11354 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:30.059638  9694 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:30.077042  8971 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:30.062038 11018 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.078920  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.080709 11354 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.087200  9696 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:30.087796 11244 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.092487  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:30.093324 11223 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.094408 11271 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.095055 11314 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:30.085598 11117 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.545s	user 0.001s	sys 0.008s
W20260925 16:43:30.055408  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1411) took 2118 ms (client timeout 2758 ms). Trace:
I20260925 16:43:30.045002 11337 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.102455  9698 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
W20260925 16:43:30.113407  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44605.7us
I20260925 16:43:30.115571  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:30.113106 11245 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.597s	user 0.025s	sys 0.050s
I20260925 16:43:30.120877  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:30.154642  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 108935us
I20260925 16:43:30.145444  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.116675 11128 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:30.163295  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:30.160959  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.161670  9122 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260925 16:43:30.266561  9121 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:30.120079  9117 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:30.123818  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:30.285213 11343 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260925 16:43:30.183799 11244 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.273586 11144 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:30.282924 11245 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.896s	user 0.030s	sys 0.053s
I20260925 16:43:30.353248  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.358508 11348 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.186944 11301 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.272683 11362 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.359827 11223 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:30.161206 11352 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.123652  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.362438 11134 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:30.363547 11263 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.645s	user 0.003s	sys 0.008s
I20260925 16:43:30.284577 11314 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:30.341782 11341 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.362304  9016 leader_election.cc:398] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:30.273249  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.163689  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.109033 11018 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.433687  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1376) took 2490 ms. Trace:
I20260925 16:43:30.472617  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.474145  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.510160  9016 leader_election.cc:401] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260925 16:43:30.510808  9698 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
W20260925 16:43:30.509902  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 388998us
I20260925 16:43:30.182152 11297 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.413065  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:30.411363  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 310236us
I20260925 16:43:30.404707  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:30.367903  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.476742  8971 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:30.273425 10958 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:30.518149  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 168204us
I20260925 16:43:30.367113  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.517127  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:30.517877  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:30.532418  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:30.509884  8972 rpcz_store.cc:276] 0925 16:43:27.943153 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.623913 (+1680760us) service_pool.cc:227] Handling call
0925 16:43:30.432750 (+808837us) spinlock_profiling.cc:243] Waited 957 us on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:30.432990 (+   240us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:30.433263 (+   273us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:30.433299 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:30.433368 (+    69us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:30.433412 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:30.433481 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:30.433606 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2200320}
I20260925 16:43:30.457221 11087 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.456954 11208 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:30.537043  9050 raft_consensus.cc:2354] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3.
W20260925 16:43:30.540086  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 209800us
I20260925 16:43:30.411634 11320 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:30.538956  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.540956  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:30.432112 11356 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:30.458034 11347 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:30.544500  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.145020 11117 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.545374  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:30.143798  9046 rpcz_store.cc:269] 0925 16:43:27.936681 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.856333 (+919652us) service_pool.cc:227] Handling call
0925 16:43:30.055347 (+1199014us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:30.542415 11208 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:30.547212  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:30.548411  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 709) took 1636 ms (client timeout 1643 ms). Trace:
I20260925 16:43:30.558069  9702 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:30.518448  8969 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:30.548828  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 708) took 1637 ms. Trace:
I20260925 16:43:30.551985  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.552048  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.371968 11258 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.564808  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:30.516916 11297 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.548854  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.514683 11263 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.575239  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.543517 11341 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:30.564289  9701 rpcz_store.cc:276] 0925 16:43:28.911648 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.965261 (+ 53613us) service_pool.cc:227] Handling call
0925 16:43:30.366874 (+1401613us) spinlock_profiling.cc:243] Waited 2.07 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:30.548766 (+181892us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4757376}
I20260925 16:43:30.547060 11244 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:30.550496  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:30.546515 11356 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:30.571947  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:30.558691  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 438172us
I20260925 16:43:30.572748  9047 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:30.548390 11087 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.574823  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:30.558350  9697 rpcz_store.cc:269] 0925 16:43:28.912100 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.966248 (+ 54148us) service_pool.cc:227] Handling call
0925 16:43:30.367667 (+1401419us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:30.548352 (+180685us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4536576}
I20260925 16:43:30.558226 11308 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:30.544009 11314 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.559998 11208 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:30.540257 11362 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.573501 11005 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:30.588626  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:30.586539  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43925us
I20260925 16:43:30.593372  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.592965  9049 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:30.579455 11341 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:30.573257 11364 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:30.621174  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.584235 11308 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:30.592237  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.624291  8972 raft_consensus.cc:2362] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
I20260925 16:43:30.635939  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.589447 11258 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:30.589274  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:30.644025  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.590920 11005 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:30.583041 11320 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.637413  9702 raft_consensus.cc:2396] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260925 16:43:30.836977  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 323098us
W20260925 16:43:30.849543  9666 connection.cc:232] RPC call timeout handler was delayed by -2.2183507130000635s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15080000000000002s for a response
W20260925 16:43:30.850935  9666 connection.cc:232] RPC call timeout handler was delayed by -1.94115071300007s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260925 16:43:30.687774  9117 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:30.689011 11301 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:30.851414  9666 connection.cc:232] RPC call timeout handler was delayed by -1.6630507130000751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21250000000000002s for a response
I20260925 16:43:30.851614 11117 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.852056  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:30.851869  9666 connection.cc:232] RPC call timeout handler was delayed by -1.6612507130000722s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2127s for a response
I20260925 16:43:30.680680  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:30.852659  9117 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:30.697172  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.627568 11308 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.625541 11341 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:30.695978  8921 placement_policy_util.cc:244] tablet adae4a9dd16346529fe4ff004abc3603: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260925 16:43:30.651087  9701 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:30.856127  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 175542us
I20260925 16:43:30.644850  8972 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
W20260925 16:43:30.696990 11370 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:43:30.860828  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.862743 11263 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.640636 11258 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:30.831923 11134 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.854512 11005 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:43:30.844010  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 425) took 3642 ms (client timeout 1816 ms). Trace:
I20260925 16:43:30.715440 11080 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.643253  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.871497  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.697012 11089 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.865245 11372 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:30.871827 11297 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:30.879995  8972 raft_consensus.cc:2354] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:30.891122  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:30.691812 11364 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:30.858547 11197 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:30.679406  9694 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.856607 11117 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:30.880005 11375 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.904634 11375 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.906531 10999 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:30.907809 11362 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.907601 11005 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.908416  9123 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:30.909638 11005 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.872809 11258 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.741359 11337 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:30.911286  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52906.8us
I20260925 16:43:30.913501  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.916529  8971 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:30.888824 11372 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.916977 11375 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.915688  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.884859 11373 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:30.886216  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:30.923777  9693 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:30.924113 11372 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.919541 11314 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.928231 11296 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:30.928887  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.929584  8970 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 1.
W20260925 16:43:30.930074  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1744) took 2029 ms (client timeout 2102 ms). Trace:
W20260925 16:43:30.930550  8970 rpcz_store.cc:269] 0925 16:43:28.900614 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.401858 (+501244us) service_pool.cc:227] Handling call
0925 16:43:30.928726 (+1526868us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:30.930020 (+  1294us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3930880}
I20260925 16:43:30.930960  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:45470 (request call id 28) took 1496 ms. Trace:
I20260925 16:43:30.931653  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.931421  8967 rpcz_store.cc:276] 0925 16:43:29.463842 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.489338 (+ 25496us) service_pool.cc:227] Handling call
0925 16:43:30.930779 (+1441441us) spinlock_profiling.cc:243] Waited 37.6 ms on lock 0x7b54003c41d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:30.930885 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":86527232}
I20260925 16:43:30.915014  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:30.869897 11301 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.044s
I20260925 16:43:30.695881 11356 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.911227 11117 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:30.878490  9041 rpcz_store.cc:269] 0925 16:43:27.201246 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.218350 (+ 17104us) service_pool.cc:227] Handling call
0925 16:43:30.843635 (+3625285us) spinlock_profiling.cc:243] Waited 1.81 s on lock 0x7b54002a2e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:30.843904 (+   269us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4155679104}
W20260925 16:43:30.935191  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2816030690000844s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1821s for a response
I20260925 16:43:30.935094  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:30.935750  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:30.937830  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1385030690000804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260925 16:43:30.938256  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1385030690000804s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
I20260925 16:43:30.938694  8970 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:43:30.910040 11197 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.931906 11373 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:30.938303  8972 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:30.922420  8969 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:30.938887  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1746) took 1052 ms. Trace:
I20260925 16:43:30.947278  8971 rpcz_store.cc:276] 0925 16:43:29.886239 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.921488 (+1035249us) service_pool.cc:227] Handling call
0925 16:43:30.938820 (+ 17332us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:30.947481  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.946362  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.951071 10958 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:30.953675 10958 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:30.954118 10958 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.954347  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.956382  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:30.957706 11318 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 2.374s	user 0.008s	sys 0.020s
I20260925 16:43:30.959532  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 426) took 3046 ms. Trace:
I20260925 16:43:30.960011  9043 rpcz_store.cc:276] 0925 16:43:27.912499 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.918843 (+  6344us) service_pool.cc:227] Handling call
0925 16:43:27.921066 (+  2223us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:27.921259 (+   193us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:27.921282 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:27.921685 (+   403us) log.cc:842] Serialized 26 byte log entry
0925 16:43:28.091299 (+169614us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:28.091347 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:28.091436 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:30.956846 (+2865410us) spinlock_profiling.cc:243] Waited 4.11 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:30.959025 (+  2179us) raft_consensus.cc:1671] finished
0925 16:43:30.959051 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:30.959335 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9449216,"thread_start_us":169306,"threads_started":1,"wal-append.queue_time_us":625440}
I20260925 16:43:30.950958  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.962235  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.939447 11117 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.965438  8970 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:30.939903 11338 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:30.968215 11356 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:30.971513  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73869.3us
I20260925 16:43:30.971823  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:30.972430  8971 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 1.
I20260925 16:43:30.957623  9041 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:30.976255  9693 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:30.978263 11197 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:30.945576 11373 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:30.996670  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:30.997530  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2012) took 1107 ms. Trace:
I20260925 16:43:30.997867  9046 rpcz_store.cc:276] 0925 16:43:29.889680 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.996375 (+1106695us) service_pool.cc:227] Handling call
0925 16:43:30.997475 (+  1100us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:30.998791  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:31.000243  9696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 524) took 4484 ms (client timeout 3366 ms). Trace:
W20260925 16:43:31.000650  9696 rpcz_store.cc:269] 0925 16:43:26.515512 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:26.515671 (+   159us) service_pool.cc:227] Handling call
0925 16:43:30.021079 (+3505408us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:31.000049 (+978970us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400670554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.000163 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140438016}
I20260925 16:43:30.978451 11266 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.005084  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.005820  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1956) took 1008 ms. Trace:
I20260925 16:43:31.006105  9119 rpcz_store.cc:276] 0925 16:43:29.997065 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.997174 (+   109us) service_pool.cc:227] Handling call
0925 16:43:31.004948 (+1007774us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:31.005770 (+   822us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13831552}
I20260925 16:43:31.007957  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.014039  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:30.981724  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.003620  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:31.018971  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2001) took 1734 ms. Trace:
I20260925 16:43:30.979136 11320 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.983865 11338 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:30.985169  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.018936  9700 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:30.985508  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1949) took 1051 ms. Trace:
I20260925 16:43:30.985742  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:30.988333 11337 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:30.988708 11140 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:30.989375 11371 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260925 16:43:30.922549 11080 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:30.991598  8972 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:30.992650  9122 raft_consensus.cc:2396] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:30.992709  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:30.995507  8967 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:31.001981 11223 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:31.008255  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:31.010589 11341 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.030442  9043 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:30.978124 11208 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.014740  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.008072 10958 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.016197  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.017525  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:30.983495 11364 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.042886  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1951) took 1074 ms. Trace:
I20260925 16:43:31.043262  9118 rpcz_store.cc:276] 0925 16:43:29.968965 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.017233 (+1048268us) service_pool.cc:227] Handling call
0925 16:43:31.042828 (+ 25595us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:31.043586  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1370) took 3127 ms (client timeout 1535 ms). Trace:
I20260925 16:43:31.044147  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.019622  9049 rpcz_store.cc:276] 0925 16:43:29.294104 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.472004 (+177900us) service_pool.cc:227] Handling call
0925 16:43:31.015522 (+1543518us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b54000a87d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.015631 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2569496448}
I20260925 16:43:31.045881  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.046674 11208 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.046940  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.048013  9116 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:31.047565  9049 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:31.048699  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 353) took 3413 ms. Trace:
I20260925 16:43:31.049515  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.050092  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.050721  8966 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:31.051198  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1745) took 1190 ms. Trace:
I20260925 16:43:31.051723  8966 rpcz_store.cc:276] 0925 16:43:29.860751 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.938902 (+ 78151us) service_pool.cc:227] Handling call
0925 16:43:31.049952 (+1111050us) spinlock_profiling.cc:243] Waited 4.78 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:31.051146 (+  1194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10999168}
W20260925 16:43:31.044013  8968 rpcz_store.cc:269] 0925 16:43:27.916539 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.785813 (+869274us) service_pool.cc:227] Handling call
0925 16:43:31.043417 (+2257604us) spinlock_profiling.cc:243] Waited 1.23 s on lock 0x7b5400137754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.043523 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2826391808}
I20260925 16:43:31.050719  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.044715  9118 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 1.
I20260925 16:43:31.053943  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.054010  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1955) took 1057 ms. Trace:
I20260925 16:43:31.054047  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.055004  9116 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:31.026769  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.055907 11080 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.056205  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2003) took 1564 ms. Trace:
I20260925 16:43:31.056393 11301 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:31.056440  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:31.056875 11374 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260925 16:43:31.057075 11301 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:31.057497 11080 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:31.027724  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62766.9us
I20260925 16:43:31.028725  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.056612  9048 rpcz_store.cc:276] 0925 16:43:29.494534 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.644416 (+149882us) service_pool.cc:227] Handling call
0925 16:43:31.056069 (+1411653us) spinlock_profiling.cc:243] Waited 7.27 ms on lock 0x7b540008d754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.056157 (+    88us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16726784}
I20260925 16:43:31.059345  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:31.060158  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 107675us
I20260925 16:43:31.060353  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.033972  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.037024 10953 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.064191 10953 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:31.064610 10953 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.066428 11087 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.037169  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.032235 11266 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:31.040680  9115 raft_consensus.cc:2396] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260925 16:43:31.042034  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 69741.2us
I20260925 16:43:31.042258 11338 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.042548 11337 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.049024  9120 rpcz_store.cc:276] 0925 16:43:27.635115 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.635288 (+   173us) service_pool.cc:227] Handling call
0925 16:43:27.635721 (+   433us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:27.986525 (+350804us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:27.986566 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:28.861876 (+875310us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b2c000d80e8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:43:28.862737 (+   861us) log.cc:842] Serialized 26 byte log entry
0925 16:43:28.977084 (+114347us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:29.065404 (+ 88320us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.048326 (+1982922us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b5400010254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:31.048367 (+    41us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:31.048408 (+    41us) raft_consensus.cc:1671] finished
0925 16:43:31.048417 (+     9us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.048554 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10293,"raft.queue_time_us":14569,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":25954,"spinlock_wait_cycles":700448896,"thread_start_us":154947,"threads_started":2,"wal-append.queue_time_us":544965,"wal-append.run_cpu_time_us":1974,"wal-append.run_wall_time_us":1004649}
I20260925 16:43:31.054607  9124 rpcz_store.cc:276] 0925 16:43:29.996790 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.996922 (+   132us) service_pool.cc:227] Handling call
0925 16:43:31.053237 (+1056315us) spinlock_profiling.cc:243] Waited 5.76 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:31.053413 (+   176us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.053682 (+   269us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.053705 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.053760 (+    55us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:31.053796 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.053851 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.053942 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13249792}
I20260925 16:43:31.024845  9121 rpcz_store.cc:276] 0925 16:43:29.934433 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.938013 (+  3580us) service_pool.cc:227] Handling call
0925 16:43:30.985337 (+1047324us) spinlock_profiling.cc:243] Waited 68 ms on lock 0x7b54001c9654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:30.985434 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":156319488}
W20260925 16:43:31.031312  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46185.3us
I20260925 16:43:31.062546  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.019977  9119 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:31.073508  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.166843  9048 raft_consensus.cc:2396] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:31.077009  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.102964  9116 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:31.084278 11338 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:31.093653 11341 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.089658  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.058015 11301 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.089308 11258 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.111196  9694 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:31.098585  9117 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:31.189100  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.071378 11266 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:31.092105 11308 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.190734  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 648) took 1075 ms. Trace:
I20260925 16:43:31.192901  9047 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260925 16:43:31.194597 11308 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.195106  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 642) took 3214 ms. Trace:
I20260925 16:43:31.074635  9046 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:31.106649  9701 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260925 16:43:31.195886  9701 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 6
I20260925 16:43:31.196341  9701 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260925 16:43:31.196789  9701 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:31.087270  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.100172  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.103955 11373 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.197961  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1413) took 1156 ms. Trace:
I20260925 16:43:31.198228  9118 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:31.102150  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:31.199136  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2011) took 1309 ms. Trace:
I20260925 16:43:31.199514  9046 rpcz_store.cc:276] 0925 16:43:29.889359 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.999580 (+1110221us) service_pool.cc:227] Handling call
0925 16:43:31.199082 (+199502us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.199836 11234 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.123788  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.200564  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.201993  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.117741  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.107713  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.210022  9123 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:31.091658  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:31.102082 10693 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:31.047991 10958 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.142048  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.158209  9043 raft_consensus.cc:2396] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:31.087440  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.214143  9121 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260925 16:43:31.103381  8969 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260925 16:43:31.089470  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 1954) took 1093 ms. Trace:
W20260925 16:43:31.149375  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 116910us
I20260925 16:43:31.172463  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.173233 11337 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:31.173411  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1380) took 1477 ms. Trace:
I20260925 16:43:31.156390 10953 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.220245  8975 rpcz_store.cc:276] 0925 16:43:29.696364 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.725725 (+ 29361us) service_pool.cc:227] Handling call
0925 16:43:31.173230 (+1447505us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.173358 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":691605248}
I20260925 16:43:31.221798  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:31.177332  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1415) took 1135 ms. Trace:
I20260925 16:43:31.178599  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.224205  9048 rpcz_store.cc:276] 0925 16:43:30.041946 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.073186 (+1031240us) service_pool.cc:227] Handling call
0925 16:43:31.177275 (+104089us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.182176  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.182399  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:31.182753 11289 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 3.744s	user 0.037s	sys 0.026s
I20260925 16:43:31.183143 11205 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.183347  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.228626  8967 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:31.208829 11266 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.187079  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:31.190435  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.198333  9041 rpcz_store.cc:276] 0925 16:43:30.041425 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.034431 (+993006us) service_pool.cc:227] Handling call
0925 16:43:31.197908 (+163477us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.234486  8966 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:31.234236  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.234695  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.236552  8973 raft_consensus.cc:2354] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
W20260925 16:43:31.236840  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 159911us
I20260925 16:43:31.195616  9695 rpcz_store.cc:276] 0925 16:43:27.980937 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:27.983685 (+  2748us) service_pool.cc:227] Handling call
0925 16:43:29.100652 (+1116967us) spinlock_profiling.cc:243] Waited 5.53 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:31.166791 (+2066139us) spinlock_profiling.cc:243] Waited 11.1 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fcac6c 00007f7198fcabd6 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:31.168498 (+  1707us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.168771 (+   273us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:43:31.169100 (+   329us) log.cc:842] Serialized 14 byte log entry
0925 16:43:31.194517 (+ 25417us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.194589 (+    72us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:43:31.194654 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.194751 (+    97us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.194891 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":180,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":30,"raft.queue_time_us":418,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":38261376,"thread_start_us":24814,"threads_started":1,"wal-append.queue_time_us":23534}
I20260925 16:43:31.176816 11338 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.217227  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2020) took 1265 ms. Trace:
I20260925 16:43:31.292726  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.292893 11338 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:31.292949  9043 rpcz_store.cc:276] 0925 16:43:29.952060 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.992240 (+1040180us) service_pool.cc:227] Handling call
0925 16:43:31.217180 (+224940us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.192574  9697 rpcz_store.cc:276] 0925 16:43:30.115215 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.587219 (+472004us) service_pool.cc:227] Handling call
0925 16:43:30.623679 (+ 36460us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:30.684065 (+ 60386us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:30.684112 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:30.857774 (+173662us) log.cc:842] Serialized 26 byte log entry
0925 16:43:31.029385 (+171611us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.029444 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.029532 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:31.190591 (+161059us) raft_consensus.cc:1671] finished
0925 16:43:31.190604 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.190695 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12379,"raft.queue_time_us":50536,"raft.run_cpu_time_us":163,"raft.run_wall_time_us":7429,"thread_start_us":121358,"threads_started":1,"wal-append.queue_time_us":196309}
I20260925 16:43:31.294068  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.217820  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.218289  9124 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
W20260925 16:43:31.226773  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 124703us
I20260925 16:43:31.295459  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.296190  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.296371  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.296538  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.297027  9124 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:31.297312  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:31.297576  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.298488  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:31.298605 11264 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:31.299101 11264 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:31.299202  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.188211 11341 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:31.299548 11264 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.300118 11233 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:31.300537 11233 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:31.229378  8972 raft_consensus.cc:2362] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8. Re-sending same reply.
I20260925 16:43:31.299875 11341 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.301754  8968 pending_rounds.cc:76] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 4
I20260925 16:43:31.301424 11233 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.302547 11233 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:31.302596  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.303342  8967 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 1.
I20260925 16:43:31.304236  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:31.304764  8967 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.305610  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 428) took 3380 ms. Trace:
I20260925 16:43:31.306015  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:31.306789  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2004) took 1742 ms (client timeout 1631 ms). Trace:
I20260925 16:43:31.307766  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.308007  9120 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:31.308126  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.309113  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.310118 11132 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:31.310603 11132 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.306013  9045 rpcz_store.cc:276] 0925 16:43:27.925167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.874520 (+949353us) service_pool.cc:227] Handling call
0925 16:43:29.407393 (+532873us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:29.408249 (+   856us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.305406 (+1897157us) spinlock_profiling.cc:243] Waited 532 ms on lock 0x7b54002a3d50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.305549 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1223767296}
I20260925 16:43:31.312912 11132 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.313544  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.314690  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:31.307232  9050 rpcz_store.cc:269] 0925 16:43:29.581542 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.603992 (+ 22450us) service_pool.cc:227] Handling call
0925 16:43:31.306596 (+1702604us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b5400252bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.306723 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1850684672}
I20260925 16:43:31.315349 11373 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.315368  9697 raft_consensus.cc:2354] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
W20260925 16:43:31.317018  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 1998) took 2413 ms (client timeout 3054 ms). Trace:
W20260925 16:43:31.317482  9042 rpcz_store.cc:269] 0925 16:43:28.919983 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.462407 (+542424us) service_pool.cc:227] Handling call
0925 16:43:31.316881 (+1854474us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002611d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.316968 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2344721664}
I20260925 16:43:31.317001  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.228360  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.219208  9115 rpcz_store.cc:276] 0925 16:43:29.996244 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.003343 (+  7099us) service_pool.cc:227] Handling call
0925 16:43:31.016059 (+1012716us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:31.089409 (+ 73350us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17963904}
I20260925 16:43:31.319988  8970 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:31.320163  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.320652  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.320834  9697 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:31.320874  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.321354  9115 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:31.321677  8970 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:31.321805  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.208439 11269 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:31.237607  8940 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:31.236245  9699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 712) took 2303 ms (client timeout 2155 ms). Trace:
W20260925 16:43:31.238122  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1743) took 2338 ms (client timeout 1741 ms). Trace:
I20260925 16:43:31.238960 11194 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:31.239017  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.240010 10953 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.239943  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.228502  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.241847 11258 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.247790 11337 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.252008  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.285521  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.247568  8971 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:31.229533 11087 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:43:31.238478  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146896us
I20260925 16:43:31.330981  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:31.297993 11018 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.297891  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.298208 11083 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.301944 11341 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.302057  8968 pending_rounds.cc:97] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260925 16:43:31.310861  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.180691  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1423) took 1090 ms. Trace:
I20260925 16:43:31.299785  9117 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.232082  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:31.369858  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 70311.9us
I20260925 16:43:31.370462  9049 rpcz_store.cc:276] 0925 16:43:30.090636 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.049446 (+958810us) service_pool.cc:227] Handling call
0925 16:43:31.180647 (+131201us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.370807  9121 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:31.322526  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.234241  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1379) took 1619 ms. Trace:
I20260925 16:43:31.232017  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.230695  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:31.292173  9119 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:31.227576  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.323766  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.325547  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.369220 11117 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.390060  9015 leader_election.cc:398] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:31.371974 11083 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:31.390920 11083 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.324687  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.377620  8970 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:31.397823  9123 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:31.369517  8968 raft_consensus.cc:2866] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:43:31.360196  9699 rpcz_store.cc:269] 0925 16:43:28.928510 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:28.970337 (+ 41827us) service_pool.cc:227] Handling call
0925 16:43:31.172227 (+2201890us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:31.231445 (+ 59218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4349312}
I20260925 16:43:31.319053  8967 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:31.339529  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.384441 11264 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.391435 11117 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.386169  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:31.401619  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62174.5us
I20260925 16:43:31.387197  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.386893  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.321967  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:31.390924  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.385735 11156 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.395244  8966 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:31.360467  9698 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 3: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:31.300539  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2016) took 1409 ms (client timeout 1844 ms). Trace:
I20260925 16:43:31.406723  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 651) took 1224 ms. Trace:
W20260925 16:43:31.406797  9047 rpcz_store.cc:269] 0925 16:43:29.890918 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.644145 (+753227us) service_pool.cc:227] Handling call
0925 16:43:31.249194 (+605049us) spinlock_profiling.cc:243] Waited 339 ms on lock 0x7b54000d43d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.300486 (+ 51292us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":780272896}
I20260925 16:43:31.323025  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.407788  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:31.360548  8973 rpcz_store.cc:269] 0925 16:43:28.900210 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.402360 (+502150us) service_pool.cc:227] Handling call
0925 16:43:31.186941 (+1784581us) spinlock_profiling.cc:243] Waited 1.96 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:31.238062 (+ 51121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4496768}
W20260925 16:43:31.399603  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 181252us
I20260925 16:43:31.397697  9042 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:31.415396  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 649) took 1262 ms. Trace:
I20260925 16:43:31.416662  9701 rpcz_store.cc:276] 0925 16:43:30.153331 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.864070 (+710739us) service_pool.cc:227] Handling call
0925 16:43:30.878962 (+ 14892us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.197386 (+318424us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.415190 (+217804us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540071e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:31.415347 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":522921728}
I20260925 16:43:31.366617 11087 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:31.386855  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1741) took 2487 ms (client timeout 1567 ms). Trace:
I20260925 16:43:31.425032  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:31.425293  8974 rpcz_store.cc:269] 0925 16:43:28.899342 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:29.384748 (+485406us) service_pool.cc:227] Handling call
0925 16:43:31.386705 (+2001957us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400136854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:31.386792 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":725883776}
I20260925 16:43:31.425787  9697 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:31.403175  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.399580  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:31.372866  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 135329us
I20260925 16:43:31.413180  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.425530  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.407397  9698 rpcz_store.cc:276] 0925 16:43:30.182668 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.307505 (+1124837us) service_pool.cc:227] Handling call
0925 16:43:31.406669 (+ 99164us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.427862  9120 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:31.375495  9696 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:31.415525  9121 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:31.374539 11258 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.388816  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.319093 11259 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.322410  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.412575 11018 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:31.420814  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.421165  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:31.421911  8975 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:31.372781  9116 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:31.423102  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 431) took 3497 ms. Trace:
I20260925 16:43:31.423570 11080 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.438302  9124 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:31.452700  8974 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:31.379959 11194 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:31.429149  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.439584  9119 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:31.309530 11235 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.441636  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:31.375159  8969 rpcz_store.cc:276] 0925 16:43:29.624434 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.995024 (+1370590us) service_pool.cc:227] Handling call
0925 16:43:31.072136 (+ 77112us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.217003 (+144867us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.233289 (+ 16286us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.442575  9122 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:31.427904  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:31.444190  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.429997 11087 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:31.408507 11269 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:31.447816  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 117053us
I20260925 16:43:31.447489  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.412822 11156 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:31.305651 11338 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.471163  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.471014  9047 rpcz_store.cc:276] 0925 16:43:27.926019 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.408284 (+3482265us) service_pool.cc:227] Handling call
0925 16:43:31.422627 (+ 14343us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.422824 (+   197us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.422847 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.422887 (+    40us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.422911 (+    24us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.422959 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.423042 (+    83us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.405444  9041 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:31.369515  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1748) took 1366 ms. Trace:
I20260925 16:43:31.485368  9042 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:31.485314  8971 rpcz_store.cc:276] 0925 16:43:30.002760 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.246974 (+1244214us) service_pool.cc:227] Handling call
0925 16:43:31.247274 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.369297 (+122023us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.369467 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.429337 10958 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.474249  9118 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:31.451911  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 429) took 3519 ms. Trace:
I20260925 16:43:31.451968  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.452849  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.446192  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:31.481364  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60260.6us
I20260925 16:43:31.488988  9049 rpcz_store.cc:276] 0925 16:43:27.925472 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.397306 (+3471834us) service_pool.cc:227] Handling call
0925 16:43:31.441568 (+ 44262us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.444895 (+  3327us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.444935 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.444989 (+    54us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:31.445031 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.445104 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.445228 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:31.496488  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49078.7us
I20260925 16:43:31.499238  9120 raft_consensus.cc:2396] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260925 16:43:31.428925 11385 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:31.482347  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:31.484234  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.477267 11387 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:31.502347  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.475314  9695 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:31.500267  9015 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:31.501719  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:31.499936  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47168.3us
I20260925 16:43:31.500618 11106 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:31.503077  8970 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:31.508627  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 367) took 1384 ms. Trace:
I20260925 16:43:31.508976  9124 rpcz_store.cc:276] 0925 16:43:30.117082 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.473129 (+1356047us) service_pool.cc:227] Handling call
0925 16:43:31.487083 (+ 13954us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.494673 (+  7590us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.494704 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.500976 (+  6272us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.501022 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.501074 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.501170 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:31.510659  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 70489.8us
I20260925 16:43:31.513474  9117 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:31.506377  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 373) took 1125 ms. Trace:
I20260925 16:43:31.516921  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.487761 11308 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:31.519343  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.506569  9115 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:31.523957  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1421) took 1429 ms. Trace:
I20260925 16:43:31.524312  9047 rpcz_store.cc:276] 0925 16:43:30.090015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.487652 (+1397637us) service_pool.cc:227] Handling call
0925 16:43:31.504996 (+ 17344us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.519053 (+ 14057us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.519070 (+    17us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.519096 (+    26us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:31.519118 (+    22us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.519154 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.519217 (+    63us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.526002  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.519270  9122 rpcz_store.cc:276] 0925 16:43:30.375378 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.484702 (+1109324us) service_pool.cc:227] Handling call
0925 16:43:31.499929 (+ 15227us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.500076 (+   147us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.500097 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.500131 (+    34us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.500164 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.500208 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.500313 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.527509  9697 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:31.504281 10958 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.523137  8940 leader_election.cc:398] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3.
I20260925 16:43:31.532181  8940 leader_election.cc:401] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:31.532523  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.504961 11117 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:31.505106 11385 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:31.534121  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.508636 11387 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:31.531498  9090 leader_election.cc:398] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:31.556583  9090 leader_election.cc:401] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260925 16:43:31.530031 10953 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:31.540961  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:31.533618 10958 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.520936 11258 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.517139 11106 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.520273 10693 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.538765  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:31.533466 11332 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:31.533324 11018 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.543712  9119 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:43:31.560120  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52502.1us
I20260925 16:43:31.574256  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.558718  9122 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
W20260925 16:43:31.587474  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62074.8us
W20260925 16:43:31.609203  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77902.4us
I20260925 16:43:31.611792  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.568269 11106 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:31.568452 11337 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.561702 11308 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:31.568390 10693 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:31.626827  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 100875us
I20260925 16:43:31.631031  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:43:31.626713  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52533.6us
I20260925 16:43:31.589922 11018 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.562479 11261 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:31.637059  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:31.588820 11264 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.559077 11385 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:31.568030  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:31.564540 10953 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:31.624882 11132 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:31.556523  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:31.569959 10958 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:31.645190  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70410.4us
I20260925 16:43:31.559726 11387 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:31.625321  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 374) took 1156 ms. Trace:
I20260925 16:43:31.634776 10693 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.654794  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.644094 11209 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.634034 11235 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:31.632591  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:31.638655 11018 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.639252 11078 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:43:31.538888 11194 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.676829  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:31.692206  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:31.678066  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:31.681696  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 171553us
I20260925 16:43:31.650142 10953 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:31.648543 11132 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:31.647944  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1422) took 1549 ms. Trace:
I20260925 16:43:31.672659 11261 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.652472 11360 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:31.628317 11341 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.658360 11085 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:31.693230  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.672326 11209 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:31.624833 11269 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.680779 11270 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:31.655233  9116 rpcz_store.cc:276] 0925 16:43:30.469167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.487369 (+1018202us) service_pool.cc:227] Handling call
0925 16:43:31.530403 (+ 43034us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.547183 (+ 16780us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.550636 (+  3453us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.559896 (+  9260us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:31.564072 (+  4176us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.591943 (+ 27871us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.618128 (+ 26185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.689412 11337 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.680397 11338 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:31.688112 11235 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:31.689036 11078 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:31.717943  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:31.711912 11209 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.700489 11092 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:31.731258  9042 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:31.732609 11313 raft_consensus.cc:2741] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260925 16:43:31.704584 11261 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:31.733182 11373 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:31.740439 11235 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.701294  9046 rpcz_store.cc:276] 0925 16:43:30.090327 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.489654 (+1399327us) service_pool.cc:227] Handling call
0925 16:43:31.538650 (+ 48996us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.567509 (+ 28859us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.609071 (+ 41562us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.613059 (+  3988us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:31.617663 (+  4604us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.626881 (+  9218us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.639625 (+ 12744us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:31.744395 11132 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:31.708348 11360 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:31.748104  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70119.7us
I20260925 16:43:31.719799  9115 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:31.701886  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:31.750252  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 366) took 1654 ms. Trace:
I20260925 16:43:31.719249 11246 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:31.708998 11085 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.719470 11270 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:31.765407  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47558.2us
I20260925 16:43:31.754093 11078 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:31.794327  9121 rpcz_store.cc:276] 0925 16:43:30.095478 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.452607 (+1357129us) service_pool.cc:227] Handling call
0925 16:43:31.479238 (+ 26631us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.487052 (+  7814us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:31.639213 (+152161us) log.cc:842] Serialized 14 byte log entry
0925 16:43:31.749960 (+110747us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.750005 (+    45us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:31.750047 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.750106 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.750205 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":258110,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":38803,"thread_start_us":219498,"threads_started":2}
I20260925 16:43:31.753973 11205 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:31.763482 11373 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:31.762804 11261 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:31.800304  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 106096us
I20260925 16:43:31.800976  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:31.799142 11085 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:31.808122  9119 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:31.803651 11270 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:31.820791  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:31.822222  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:31.733975 11308 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:31.811566 11373 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:31.822991  9049 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:31.824280 11388 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
W20260925 16:43:31.840211  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 321464us
I20260925 16:43:31.840843 10749 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:31.899940  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 206774us
I20260925 16:43:31.900648  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:31.903604 11341 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:31.926152  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1962) took 1341 ms. Trace:
I20260925 16:43:31.936951  9120 rpcz_store.cc:276] 0925 16:43:30.584861 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.500114 (+915253us) service_pool.cc:227] Handling call
0925 16:43:31.925324 (+425210us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:31.925554 (+   230us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.925779 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.925812 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:31.925864 (+    52us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:31.925904 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.925969 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:31.926089 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5409024}
I20260925 16:43:31.912243 11234 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:31.981114  9118 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:31.992998  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.994851  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:31.996891  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:31.999467  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.003156  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.003541 11234 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:32.004944 11234 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:32.010401  9046 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 3
I20260925 16:43:32.012575  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:31.958660 11092 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:31.959139 11341 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260925 16:43:32.055866 11233 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.753s	user 0.002s	sys 0.014s
W20260925 16:43:32.038738 11390 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.284s	user 0.001s	sys 0.001s
W20260925 16:43:32.062616  9124 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.506s	user 0.005s	sys 0.011s
I20260925 16:43:32.063063  9124 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:32.028784 11092 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:32.035202 11341 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:32.079847  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 187792us
W20260925 16:43:32.136801  9015 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.567s (SENT)
I20260925 16:43:32.137485  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:32.074484 11266 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.782s	user 0.011s	sys 0.007s
I20260925 16:43:32.069015 11337 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 2. Current term is 3.
W20260925 16:43:32.143671  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 269246us
I20260925 16:43:32.141355  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2081) took 1012 ms. Trace:
I20260925 16:43:32.075634 11140 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:32.081009 11341 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:32.082391 11092 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:32.146709  9119 rpcz_store.cc:276] 0925 16:43:31.128822 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.812576 (+683754us) service_pool.cc:227] Handling call
0925 16:43:31.818690 (+  6114us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.818891 (+   201us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:43:31.839732 (+ 20841us) log.cc:842] Serialized 14 byte log entry
0925 16:43:32.140948 (+301216us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:32.141017 (+    69us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:43:32.141069 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.141133 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.141287 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8341,"prepare.queue_time_us":18761,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"thread_start_us":231483,"threads_started":1}
W20260925 16:43:32.215777  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 232752us
I20260925 16:43:32.114790 11338 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:32.130633 11360 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:32.220906 11337 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:32.227679 11405 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:32.228173 11405 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:32.228534 11405 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:32.230085 11391 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.312s	user 0.001s	sys 0.000s
I20260925 16:43:32.229882 11337 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260925 16:43:32.232335  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 431394us
W20260925 16:43:32.249380 11080 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.770s	user 0.016s	sys 0.019s
I20260925 16:43:32.249887 11080 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:32.250648  9043 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:32.247038 11234 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.253779  9697 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:43:32.255477  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:32.258203  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.149369 11266 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:32.259606  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 122851us
W20260925 16:43:32.254963 11392 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.359s	user 0.000s	sys 0.001s
I20260925 16:43:32.269109  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2014) took 2374 ms. Trace:
I20260925 16:43:32.269519  9042 rpcz_store.cc:276] 0925 16:43:29.890298 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.423947 (+1533649us) service_pool.cc:227] Handling call
0925 16:43:31.485257 (+ 61310us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.758330 (+273073us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.264573 (+506243us) spinlock_profiling.cc:243] Waited 61 ms on lock 0x7b54002526d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:32.264691 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":140291968}
I20260925 16:43:32.270798  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:32.267083 11246 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:32.273548 11246 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:32.273947 11246 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:32.274049 11083 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.869s	user 0.009s	sys 0.000s
I20260925 16:43:32.274502 11083 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.276109  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:32.277266  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.278692  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:32.280184  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:32.278868 10693 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.019s
I20260925 16:43:32.271452 10749 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:32.287981  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 442) took 1308 ms. Trace:
I20260925 16:43:32.288594 11132 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:32.289388 10749 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:32.289913 10749 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.292124 10749 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.288422  9047 rpcz_store.cc:276] 0925 16:43:30.979732 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.547637 (+567905us) service_pool.cc:227] Handling call
0925 16:43:31.608947 (+ 61310us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:31.644699 (+ 35752us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:31.680325 (+ 35626us) log.cc:842] Serialized 14 byte log entry
0925 16:43:31.908282 (+227957us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:31.908780 (+   498us) log.cc:842] Serialized 26 byte log entry
0925 16:43:31.908902 (+   122us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.908933 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.909802 (+   869us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:32.287677 (+377875us) raft_consensus.cc:1671] finished
0925 16:43:32.287721 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.287905 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11463,"prepare.queue_time_us":32273,"raft.queue_time_us":14214,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":4082,"spinlock_wait_cycles":11383552,"thread_start_us":173711,"threads_started":1,"wal-append.queue_time_us":515835}
I20260925 16:43:32.292618  9695 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:32.293279  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.293994  9047 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:32.294152  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:32.296207 11156 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.792s	user 0.005s	sys 0.010s
I20260925 16:43:32.296815  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.296689 11156 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.298252  9696 raft_consensus.cc:2354] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
W20260925 16:43:32.298934 11399 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.397s	user 0.001s	sys 0.000s
W20260925 16:43:32.300844 11397 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.256s	user 0.000s	sys 0.002s
I20260925 16:43:32.301633  9090 leader_election.cc:398] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:32.301963  9090 leader_election.cc:401] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260925 16:43:32.292622 11410 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:32.266990 11080 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:32.304344 11080 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:32.308133 11385 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.635s	user 0.012s	sys 0.003s
I20260925 16:43:32.308720  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 432) took 4382 ms. Trace:
I20260925 16:43:32.308519 11385 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.309249 11080 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.284336  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.309062 11246 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.310088 11410 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:32.310467 11410 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:32.310503 11385 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.310966 11246 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:32.311162 11410 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:32.311383  9120 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:32.285293 11234 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:32.286015 11395 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260925 16:43:32.305074 11266 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.305608  8972 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:32.295518 11018 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.592s	user 0.006s	sys 0.006s
I20260925 16:43:32.282559  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:32.324947  8966 raft_consensus.cc:595] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:32.325336  8966 raft_consensus.cc:603] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:32.313681  9042 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:32.282670  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.295542  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.309150  9043 rpcz_store.cc:276] 0925 16:43:27.926297 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.412251 (+3485954us) service_pool.cc:227] Handling call
0925 16:43:31.472115 (+ 59864us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:32.251002 (+778887us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.308493 (+ 57491us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54001bfdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:32.308643 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1789978368}
I20260925 16:43:32.266746  9048 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:32.318246  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:32.327939  9047 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:32.348213  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65621.3us
W20260925 16:43:32.325603 10958 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.652s	user 0.010s	sys 0.005s
W20260925 16:43:32.352936 11391 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260925 16:43:32.350358  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 380) took 1219 ms. Trace:
I20260925 16:43:32.356768  9043 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:32.354007 10958 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.358390  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 370) took 2196 ms. Trace:
I20260925 16:43:32.358752  9123 rpcz_store.cc:276] 0925 16:43:30.161932 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.479578 (+1317646us) service_pool.cc:227] Handling call
0925 16:43:31.490078 (+ 10500us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:31.499021 (+  8943us) raft_consensus.cc:1520] Early marking committed up to index 3
0925 16:43:31.499049 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:31.499434 (+   385us) log.cc:842] Serialized 26 byte log entry
0925 16:43:31.634537 (+135103us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:31.634573 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:31.634635 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:32.358214 (+723579us) raft_consensus.cc:1671] finished
0925 16:43:32.358232 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.358342 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1472,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":17388,"thread_start_us":96972,"threads_started":1,"wal-append.queue_time_us":285451}
I20260925 16:43:32.360992  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 468) took 1059 ms. Trace:
I20260925 16:43:32.361337  8972 rpcz_store.cc:276] 0925 16:43:31.301811 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.305781 (+  3970us) service_pool.cc:227] Handling call
0925 16:43:32.360795 (+1055014us) spinlock_profiling.cc:243] Waited 999 ms on lock 0x7b5400135e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:32.360940 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2297027968}
I20260925 16:43:32.362718  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 444) took 1382 ms. Trace:
I20260925 16:43:32.363050  9048 rpcz_store.cc:276] 0925 16:43:30.980419 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.230520 (+250101us) service_pool.cc:227] Handling call
0925 16:43:32.362578 (+1132058us) spinlock_profiling.cc:243] Waited 681 ms on lock 0x7b54002512d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:32.362670 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1565555968}
I20260925 16:43:32.368855  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 443) took 1388 ms. Trace:
I20260925 16:43:32.369259  9041 rpcz_store.cc:276] 0925 16:43:30.980090 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.694992 (+714902us) service_pool.cc:227] Handling call
0925 16:43:31.744338 (+ 49346us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.744594 (+   256us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:32.129255 (+384661us) log.cc:842] Serialized 14 byte log entry
0925 16:43:32.316767 (+187512us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:32.346779 (+ 30012us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:32.351339 (+  4560us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.354974 (+  3635us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.368797 (+ 13823us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":292929,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6513,"raft.queue_time_us":30424,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":30180,"thread_start_us":449792,"threads_started":2}
I20260925 16:43:32.346107 11018 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:32.372864 11387 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.700s	user 0.011s	sys 0.005s
I20260925 16:43:32.373256 11387 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.373749 11018 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.358184 11385 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:32.375238  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:32.354956  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.377352 11083 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.378497  9046 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:32.378655 11140 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:32.379025 11354 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:32.379154 11140 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:32.380036 11259 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.898s	user 0.009s	sys 0.015s
I20260925 16:43:32.324734 11404 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:32.382021  9044 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:32.382654 11277 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:32.383072 11277 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.383869 11258 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:32.384490 11258 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:32.373461 11412 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260925 16:43:32.392580  9049 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.501s	user 0.012s	sys 0.003s
I20260925 16:43:32.349718 11276 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.004s
I20260925 16:43:32.386461  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 430) took 4460 ms. Trace:
W20260925 16:43:32.393545  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 109298us
W20260925 16:43:32.437182  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49837.1us
W20260925 16:43:32.408389  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.013s	sys 0.017s
W20260925 16:43:32.437747  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.017s
I20260925 16:43:32.427999  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:32.438596  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.424292  9049 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
W20260925 16:43:32.438097  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 734485us
I20260925 16:43:32.345974 11156 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.355490 11266 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:32.448697  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:32.449131  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.449549  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:32.439275  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:32.288002 10693 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:32.439795  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.010s	sys 0.000s
I20260925 16:43:32.459621  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:32.359237  9043 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:32.440928 11276 consensus_queue.cc:1225] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:43:32.436235  9045 rpcz_store.cc:276] 0925 16:43:27.925749 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.403546 (+3477797us) service_pool.cc:227] Handling call
0925 16:43:31.471677 (+ 68131us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:31.484006 (+ 12329us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.484037 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:31.487941 (+  3904us) log.cc:842] Serialized 26 byte log entry
0925 16:43:31.690440 (+202499us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.816820 (+126380us) log.cc:842] Serialized 14 byte log entry
0925 16:43:31.819069 (+  2249us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.353113 (+534044us) spinlock_profiling.cc:243] Waited 8.92 ms on lock 0x7b5400362754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:32.353156 (+    43us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:32.353199 (+    43us) raft_consensus.cc:1671] finished
0925 16:43:32.386278 (+ 33079us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.386410 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27211,"prepare.queue_time_us":266809,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":6827,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":17319,"spinlock_wait_cycles":21906432,"thread_start_us":270333,"threads_started":2,"wal-append.queue_time_us":292442}
I20260925 16:43:32.473062  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:32.474787  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.354710  9115 rpcz_store.cc:276] 0925 16:43:31.130582 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.815083 (+684501us) service_pool.cc:227] Handling call
0925 16:43:31.837808 (+ 22725us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:31.893582 (+ 55774us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:31.930887 (+ 37305us) log.cc:842] Serialized 14 byte log entry
0925 16:43:32.350028 (+419141us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:32.350080 (+    52us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:32.350119 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.350185 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.350307 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":13052,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":27696,"thread_start_us":366350,"threads_started":1}
I20260925 16:43:32.482182 11410 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.484021 11419 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:32.484300 11360 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Stepping down as leader of term 3
W20260925 16:43:32.484714 11087 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.988s	user 0.016s	sys 0.000s
I20260925 16:43:32.484845 11360 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:32.485225 11087 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.486620  9117 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:32.486945 11411 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:32.487304 11087 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:32.487586  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:32.488981 10958 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.489210 10693 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.489707 11405 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.484443 11419 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:32.490917 11419 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:32.456694 11338 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:32.450140 11259 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260925 16:43:32.485864 11360 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.468376  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:32.399209 11092 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.477578 11412 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:32.473043 11266 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:32.491660 11405 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:32.501714 11270 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.675s	user 0.012s	sys 0.015s
W20260925 16:43:32.493925 10953 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.014s
I20260925 16:43:32.502509  9123 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
W20260925 16:43:32.478658  8968 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.005s	sys 0.014s
I20260925 16:43:32.453413  9120 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:32.495918  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1965) took 1851 ms. Trace:
W20260925 16:43:32.521484 11117 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.959s	user 0.015s	sys 0.016s
W20260925 16:43:32.521842 11117 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.966s	user 0.015s	sys 0.016s
W20260925 16:43:32.516083  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 404845us
I20260925 16:43:32.517304  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:32.522684  8966 raft_consensus.cc:595] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:32.523083  8966 raft_consensus.cc:603] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:32.520682  9117 rpcz_store.cc:276] 0925 16:43:30.644748 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.522039 (+877291us) service_pool.cc:227] Handling call
0925 16:43:31.522262 (+   223us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:32.486962 (+964700us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.488409 (+  1447us) spinlock_profiling.cc:243] Waited 964 ms on lock 0x7b5400143a54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:32.495862 (+  7453us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2217387776}
W20260925 16:43:32.468880  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.558s	user 0.010s	sys 0.000s
I20260925 16:43:32.526378  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.527114  9042 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:32.494084 11209 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.706s	user 0.005s	sys 0.028s
W20260925 16:43:32.523908  8968 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.005s	sys 0.014s
W20260925 16:43:32.496480 11078 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.679s	user 0.003s	sys 0.013s
I20260925 16:43:32.602324  9117 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:43:32.604308  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:43:32.500871 11085 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.667s	user 0.002s	sys 0.013s
W20260925 16:43:32.529757  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55061.4us
I20260925 16:43:32.607329  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.610294  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:32.498863 11373 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.607s	user 0.010s	sys 0.003s
W20260925 16:43:32.499920  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2015) took 2609 ms (client timeout 1739 ms). Trace:
I20260925 16:43:32.522171 11117 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:32.503176 11277 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:32.616418  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85423.5us
I20260925 16:43:32.494217 11338 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:32.606099  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 466) took 1305 ms. Trace:
I20260925 16:43:32.499025 11385 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:32.495473 11404 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:32.631495  8968 rpcz_store.cc:276] 0925 16:43:31.301104 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.301217 (+   113us) service_pool.cc:227] Handling call
0925 16:43:31.301559 (+   342us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:31.452268 (+150709us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:31.452297 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:31.480540 (+ 28243us) log.cc:842] Serialized 52 byte log entry
0925 16:43:31.649409 (+168869us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:31.921662 (+272253us) log.cc:842] Serialized 14 byte log entry
0925 16:43:32.605818 (+684156us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:32.605883 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:32.605920 (+    37us) raft_consensus.cc:1671] finished
0925 16:43:32.605930 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:32.606047 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41452,"prepare.queue_time_us":395372,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":378253,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":6246,"thread_start_us":1063641,"threads_started":3,"wal-append.queue_time_us":337613}
I20260925 16:43:32.499475 11092 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.499464 11360 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:32.597419  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 332495us
I20260925 16:43:32.603988  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.497308 11259 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:32.519508 11412 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:32.662302  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:32.641510  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:32.523211 11270 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.500425 11266 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:32.497400 11232 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260925 16:43:32.674767  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:32.688807  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 227987us
I20260925 16:43:32.613557 11411 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:32.639667  8941 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.495119 11341 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.611178 11373 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:32.676717  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66334us
I20260925 16:43:32.688915  9117 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:32.497677 11387 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.683379  9119 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:32.641902 10958 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:32.619098 11258 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260925 16:43:32.699368  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82180.1us
W20260925 16:43:32.700744  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61172.1us
I20260925 16:43:32.706979  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:32.639927 11413 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:32.674719 11261 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.852s	user 0.012s	sys 0.004s
W20260925 16:43:32.689010 11106 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.053s	user 0.012s	sys 0.024s
I20260925 16:43:32.648082 11259 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:32.527805 10953 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.660539  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:32.726187  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:32.758527  9115 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:32.742096  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:32.612010  9044 rpcz_store.cc:269] 0925 16:43:29.890629 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:30.056272 (+165643us) service_pool.cc:227] Handling call
0925 16:43:32.499687 (+2443415us) spinlock_profiling.cc:243] Waited 2.32 s on lock 0x7b54001afc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:32.499825 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5346388352}
I20260925 16:43:32.612630 11078 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.614459 11085 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.743566  8968 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:32.605542 11209 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.742429  9048 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:32.642385 11087 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.084s
I20260925 16:43:32.729882  9122 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:32.747879  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.748301  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.749197  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:32.785812  9117 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:32.750845  9042 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:32.664392 11385 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260925 16:43:32.791249  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:32.754834  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.640s (SENT)
I20260925 16:43:32.728916 11410 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.763101  9124 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:32.763985  9120 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:43:32.783118  8968 raft_consensus.cc:595] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:32.797945  8968 raft_consensus.cc:603] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:32.763062  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.787887  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:32.744551  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:32.792359  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:32.793262  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45487.6us
I20260925 16:43:32.799713  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.800784  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:32.795553  9050 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
W20260925 16:43:32.794394  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50492us
I20260925 16:43:32.759209 10958 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:32.796743  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:32.806092  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:32.799728  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:32.782717  9694 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:32.806991  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58813.9us
I20260925 16:43:32.804085 11421 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:32.788378  9046 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260925 16:43:32.812253  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70250.1us
I20260925 16:43:32.817430  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:32.817725  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62914.4us
I20260925 16:43:32.821574  9120 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:43:32.801519 11083 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:32.760826 10693 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.061s
I20260925 16:43:32.836164 11373 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:32.837251 11418 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
W20260925 16:43:32.837610 11426 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260925 16:43:32.840997 11270 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.842144 11246 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:32.843828 10953 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.843890 11405 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:32.844436 11432 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:32.844592 11405 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:32.845534 11405 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.846822 11085 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:32.758010 11106 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.757380 11261 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.802107 11412 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.850042 11261 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.759999 11419 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.666014 10749 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:32.809878 11404 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:32.851969 11410 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:32.852036 11404 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:32.852538 11404 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:32.818478 11411 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:32.854004 11411 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:32.854328 11411 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:32.818421 11018 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:32.856185 10958 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.857007 11078 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.857491 11259 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.858397 11106 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.858639 11259 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:32.801245 11364 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260925 16:43:32.860030  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:32.785266 11235 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260925 16:43:32.861832 11341 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:32.863197 11209 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.805095 11427 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:32.808974 11387 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:32.803104 11258 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:32.848984 11140 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.890180  9115 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:32.816985  9116 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:32.794978 11338 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.916028  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:32.818334 11413 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:32.917644 11411 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.913898  8968 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45470
I20260925 16:43:32.946961  8968 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:32.910305  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:32.796739 11117 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:32.921994  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:32.899861 11419 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:32.955097  8972 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:32.811731 11421 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:32.960353  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 149935us
I20260925 16:43:32.961779  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:32.962430  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:32.963513  8972 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:32.979147  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:32.974299  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 161055us
I20260925 16:43:32.982465  8970 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:32.981273  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 171572us
I20260925 16:43:32.808841 11266 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:32.984660  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:32.988708  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:32.985401  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:32.990896  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:32.963053 11421 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:32.993736  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:32.954835 11427 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:32.997627  8971 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:32.987150  9694 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:32.954926 11258 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:32.957561 11413 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:33.002372  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.001479 11427 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.003016  9695 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:33.003921  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.004691  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:33.005153  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.005581  8969 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:33.005316 11413 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.006345  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.007731  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.007858 11140 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.008263  9698 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:33.009251 11258 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.008190 11427 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:32.995872  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:33.011902  9695 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:33.020371  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:33.016733  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:33.016022  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:33.018641  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.017640  8975 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
W20260925 16:43:33.024765 11430 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:43:33.018756  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1424) took 2927 ms. Trace:
I20260925 16:43:33.021339  9696 pending_rounds.cc:76] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 5
I20260925 16:43:33.022181  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2061) took 2068 ms. Trace:
W20260925 16:43:33.059090  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73765us
I20260925 16:43:33.061997  8967 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:33.066715  8970 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:33.067413  8974 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:33.025854 11421 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.069664  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 375) took 2083 ms. Trace:
W20260925 16:43:33.107687  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75238.8us
I20260925 16:43:33.070699 11354 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:33.114491  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:33.059773  9698 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:33.071914  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:33.072485  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 271018us
I20260925 16:43:33.074819  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:33.075233  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:33.076644  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 259946us
I20260925 16:43:33.092681  9122 rpcz_store.cc:276] 0925 16:43:30.953740 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.588537 (+634797us) service_pool.cc:227] Handling call
0925 16:43:32.353076 (+764539us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:32.353279 (+   203us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:32.792636 (+439357us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:33.021967 (+229331us) spinlock_profiling.cc:243] Waited 376 ms on lock 0x7b540010c554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:33.022126 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":871194880}
I20260925 16:43:33.067049  9050 rpcz_store.cc:276] 0925 16:43:30.090990 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.490752 (+1399762us) service_pool.cc:227] Handling call
0925 16:43:31.514960 (+ 24208us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:32.802117 (+1287157us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:33.018506 (+216389us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54000bf9d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:33.018661 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2944513408}
I20260925 16:43:33.100914  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.070335  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.027143 11425 raft_consensus.cc:2741] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260925 16:43:33.071295  9693 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:33.060932 11412 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.124s
I20260925 16:43:33.076900 11313 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:33.237129  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:33.102025  9696 pending_rounds.cc:97] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260925 16:43:33.247479  9696 raft_consensus.cc:2866] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:33.223572 11235 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:33.225788 11232 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:33.225538 11234 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:33.248831  9041 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:33.248514 11232 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.248594 11234 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.250603 11232 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.250876  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:33.240804 11354 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:33.251739  9046 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:33.247527  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61653.3us
I20260925 16:43:33.252178 11354 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:33.171204  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74216.5us
I20260925 16:43:33.254331  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:33.254549  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:33.255491  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.256138 11209 raft_consensus.cc:2741] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260925 16:43:33.256450 11447 raft_consensus.cc:2741] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260925 16:43:33.202425 11083 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:33.172099  9698 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260925 16:43:33.246158 11258 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.262388 11276 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:33.115836 11080 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.156s
I20260925 16:43:33.263125 11276 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.265626 11276 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.263145  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.266659  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.268541  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.269177  9699 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:33.270001  8972 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:33.272189  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:33.122756  9123 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:33.194310 11087 raft_consensus.cc:2741] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260925 16:43:33.185796  9121 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
W20260925 16:43:33.225029  9015 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.673s (SENT)
I20260925 16:43:33.294173  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:33.077404 11442 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.217s
I20260925 16:43:33.307374  8971 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:43:33.307624  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.508s (SENT)
I20260925 16:43:33.286002 11234 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.286191 11410 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:33.196406 11270 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:33.075255 11404 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.288759 10958 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:33.290767 11385 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:33.108075  9116 rpcz_store.cc:276] 0925 16:43:30.986556 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.755817 (+769261us) service_pool.cc:227] Handling call
0925 16:43:31.806096 (+ 50279us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:32.926948 (+1120852us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:33.069422 (+142474us) spinlock_profiling.cc:243] Waited 995 ms on lock 0x7b540007e254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:33.069604 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2288348928}
I20260925 16:43:33.247426 11313 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:33.260186 11083 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:33.116061  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51883.4us
I20260925 16:43:33.326258  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.330602  9120 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:33.123088  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.303494  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:33.277832 11421 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:33.308197  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:33.310758  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:33.310988  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85996.6us
I20260925 16:43:33.314492  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.334179  9119 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 7
W20260925 16:43:33.320170  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53947.9us
I20260925 16:43:33.326769  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.311843 11092 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:33.347944  8970 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:33.327538 11313 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:33.332084  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:33.332907  9117 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:33.333765  8967 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:33.363220  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.367959  8966 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:33.292147 11235 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.323966  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:33.314682 11080 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:33.332664 11441 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:33.338439  9115 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
W20260925 16:43:33.339113  9015 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.694s (SENT)
I20260925 16:43:33.368710  8967 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:33.341555 11385 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.325547 11234 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260925 16:43:33.317293 11132 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:33.353681  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:33.395188  8971 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:33.315431 11270 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:33.356407 11276 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:33.388510  9016 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c694676902c54ad8bfe8e7fd5a725e33. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:43:33.403919  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82736us
I20260925 16:43:33.388407 11441 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:33.384490  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:33.340410 11360 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:33.323863  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:33.410355 11449 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260925 16:43:33.393599 11442 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:33.352674 11085 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:33.371644  8975 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:33.379522 11354 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:33.417918 11360 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:33.428061 11276 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.357893 11259 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.071s
W20260925 16:43:33.429200  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 121596us
I20260925 16:43:33.417821 11083 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.432235 11270 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.386817  9050 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:33.466498  9050 raft_consensus.cc:595] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:33.325587 10958 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.479060  8966 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:33.446775  8968 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:33.392791 11080 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:33.426044 11085 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:33.557853  8967 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260925 16:43:33.492667 11083 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:33.503801 11270 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:33.558373 11080 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:33.638839  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 302612us
W20260925 16:43:33.639904  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 235275us
I20260925 16:43:33.640327  9119 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:33.641348  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:33.650403  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 311295us
I20260925 16:43:33.650884  9117 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:33.650832  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:33.652514  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.731s (SENT)
I20260925 16:43:33.653322  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.648968  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.657615  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:33.665513  9119 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:33.663549  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.659809  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:33.671203  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:33.702409  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:33.648073 11276 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:33.708756  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.654536 11301 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:33.648695 11234 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:33.710502  9115 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 1. Current term is 2. Ops: []
W20260925 16:43:33.777060  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 66606.3us
I20260925 16:43:33.711687  9117 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260925 16:43:33.709725  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57247us
I20260925 16:43:33.720742  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:33.803128  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.741s (SENT)
W20260925 16:43:33.805935  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 99468.8us
I20260925 16:43:33.657325 11354 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:33.621382 11360 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:33.810456  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 89667.6us
W20260925 16:43:33.815160  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 364470us
I20260925 16:43:33.672465 11421 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:33.675101 11209 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:33.667936 11425 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:33.672799 11401 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:33.815447  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:33.673895 11404 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:33.708920 11132 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:33.693202 11117 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:33.831296  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.723393 11092 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:33.832774  9121 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:33.843950  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:33.872967  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46607.2us
W20260925 16:43:33.815938 11405 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.019s	sys 0.072s
I20260925 16:43:33.816172 11385 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:33.813246 11457 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260925 16:43:33.898928  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:33.899256  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.817659 11087 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:33.552543 11441 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:33.866590  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59336.9us
W20260925 16:43:33.830415  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.125s (SENT)
I20260925 16:43:33.819908 11209 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:33.883335  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:33.796692 11234 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:33.797256 11412 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260925 16:43:33.833645 11401 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:33.895193  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.889743  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:33.964598  9050 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:33.926855  9043 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:33.820657  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:33.818154 11421 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:33.702288 11453 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.207s
I20260925 16:43:33.885390 11235 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.937083  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.875432 11404 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:33.975658  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:33.977100  9118 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:33.977161  8972 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:33.944141  9049 raft_consensus.cc:2362] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6. Re-sending same reply.
I20260925 16:43:33.884199  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:33.958122  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62207us
I20260925 16:43:33.958184  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:33.959688  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:33.884770 11405 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.022s	sys 0.078s
I20260925 16:43:33.709654 11085 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:33.963406  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 133024us
I20260925 16:43:33.966416 11401 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:33.834710 11364 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.107s
I20260925 16:43:33.916121 11092 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:33.915786 11132 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:33.835057 11427 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.125s
I20260925 16:43:33.869937 11301 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.094s
I20260925 16:43:33.957705 11425 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:33.959117 11209 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:33.970884 10953 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
W20260925 16:43:33.975047  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 171200us
W20260925 16:43:33.985064  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.127s (SENT)
I20260925 16:43:33.966634  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:33.834692  9042 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:33.986917 10693 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:33.987632  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:33.971206 11385 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:33.974556 11452 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.418s	user 0.000s	sys 0.001s
I20260925 16:43:33.973083 10958 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:33.971832 11441 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:33.963145 11232 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260925 16:43:33.882586 11117 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:33.971464 11354 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:33.972297 11421 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:33.974225  9046 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:33.996052  8973 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:33.996469  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:34.039486  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 224069us
W20260925 16:43:34.113830  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 290867us
W20260925 16:43:34.147825  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.955s (SENT) [suppressed 38 similar messages]
I20260925 16:43:34.127974  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:34.048533 11454 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.466s	user 0.001s	sys 0.000s
I20260925 16:43:34.019541  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:34.145090  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 206072us
I20260925 16:43:34.149973  8972 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:34.150076  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.134931  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:34.138200  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1782) took 1123 ms. Trace:
I20260925 16:43:34.152112  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.151974  8967 rpcz_store.cc:276] 0925 16:43:33.014780 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.386041 (+371261us) service_pool.cc:227] Handling call
0925 16:43:33.387737 (+  1696us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:33.558503 (+170766us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.137993 (+579490us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54002fec54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:34.138150 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":390256896}
W20260925 16:43:34.072261 11458 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260925 16:43:34.018600  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:33.991063 11235 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:34.156812  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:34.157393  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:34.048316 11085 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:33.986937 11276 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.161725  8972 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 2: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:33.997892 11194 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.166941 11194 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.160813  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:34.169500 11194 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:34.013290 11266 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.058784  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:34.170799 11266 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.171259  9116 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 2: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:34.164300  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:34.174009  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 188966us
I20260925 16:43:34.172442  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:34.184315  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:34.059453 11269 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.108s
I20260925 16:43:34.162978 10958 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:34.158061 11132 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:34.190335  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:34.162755 11235 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:34.173487 10953 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:34.144146 11092 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:34.190076 11413 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.005s	sys 0.005s
I20260925 16:43:34.173147 11453 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
W20260925 16:43:34.193564  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 206199us
W20260925 16:43:34.192019  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 187197us
I20260925 16:43:34.198417  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:34.199097  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:34.202916  9119 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:34.204445  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:34.189704 11194 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.198804 11246 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:34.155475 11385 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.153939 11467 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.052s
I20260925 16:43:34.176106 11427 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.029s
I20260925 16:43:34.052822 11234 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.195098 11235 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:34.210830  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:34.211170  9116 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:34.214001  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:34.235373  9118 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:34.175966 11276 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:34.200106 11413 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.005s	sys 0.006s
I20260925 16:43:34.200992 11453 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:34.242203  9119 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:34.226156 11410 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:34.196681 10958 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.251003 11087 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:34.312842  9119 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: [5.8-5.8]
W20260925 16:43:34.314348  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 164321us
I20260925 16:43:34.240867 11466 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:34.315187  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.246417 11428 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:34.226246 11194 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:34.251684 11083 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.688s	user 0.007s	sys 0.004s
I20260925 16:43:34.247045 11246 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
W20260925 16:43:34.339741  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 187708us
W20260925 16:43:34.340315  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 192862us
W20260925 16:43:34.340791  9047 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.008s	sys 0.010s
W20260925 16:43:34.347807  9047 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.008s	sys 0.010s
W20260925 16:43:34.334517  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 184271us
I20260925 16:43:34.247539 11410 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:34.353981  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.354961  9050 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260925 16:43:34.314159 11460 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.300s	user 0.001s	sys 0.000s
I20260925 16:43:34.251623 11404 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:34.209216 11425 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:34.360544  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.000s (SENT)
I20260925 16:43:34.366642  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.342443 11234 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:34.368196 11410 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.368798 11385 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:34.370393 10958 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:34.372383  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.372507 11092 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:34.374696 11401 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.350351 11301 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:34.376201 11313 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.971s	user 0.010s	sys 0.000s
I20260925 16:43:34.376662 11401 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:34.376724 11313 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.378057 11401 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.378518 11401 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.379262 11313 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:34.379967  9048 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:34.381783 11083 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:34.382189 11083 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:34.382936 11083 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.383872 11083 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:34.385563 11411 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:34.386253 11411 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:34.386637 11411 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:34.387042 11411 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:34.354166 11453 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.388502  9121 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:34.388794  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.365127  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.391346  9042 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:34.391961  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.392522 11488 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:34.392603  9046 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:34.393478 11087 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.324173 11266 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:34.337597 11428 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:34.417172  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56653.6us
I20260925 16:43:34.353206 11246 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:34.427305  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:34.439298  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1767) took 1477 ms (client timeout 1955 ms). Trace:
W20260925 16:43:34.439822  8968 rpcz_store.cc:269] 0925 16:43:32.961492 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:32.979124 (+ 17632us) service_pool.cc:227] Handling call
0925 16:43:34.439103 (+1459979us) spinlock_profiling.cc:243] Waited 326 ms on lock 0x7b54003566d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:34.439233 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":749435776}
I20260925 16:43:34.443655  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1764) took 1516 ms. Trace:
I20260925 16:43:34.444161  8973 rpcz_store.cc:276] 0925 16:43:32.926903 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:32.943133 (+ 16230us) service_pool.cc:227] Handling call
0925 16:43:32.959716 (+ 16583us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:34.147100 (+1187384us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.443375 (+296275us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54001e3554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:34.443587 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2365392768}
I20260925 16:43:34.363294 11117 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:34.252698 11132 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.388715 11453 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:34.365139  8969 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:34.366052 11427 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:34.447891  8971 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:34.449667  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:34.484593  9698 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:43:34.362800  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 751) took 1835 ms. Trace:
I20260925 16:43:34.489601  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:34.488813  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 259526us
I20260925 16:43:34.491622  9047 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:34.492985  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 282803us
I20260925 16:43:34.493005  9698 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:34.494930  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:34.495718  9049 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:34.436862  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 241178us
W20260925 16:43:34.476608  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 110207us
I20260925 16:43:34.421793 11428 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:34.498944  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:34.480454  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1786) took 1432 ms. Trace:
I20260925 16:43:34.495067  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1785) took 1479 ms. Trace:
I20260925 16:43:34.486141  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:34.486256  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:34.500933  8975 rpcz_store.cc:276] 0925 16:43:33.015676 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.442024 (+1426348us) service_pool.cc:227] Handling call
0925 16:43:34.479448 (+ 37424us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:34.485479 (+  6031us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:34.485509 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:34.494782 (+  9273us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:34.494825 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.494887 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:34.495010 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1309,"raft.queue_time_us":4753}
W20260925 16:43:34.484246 11270 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.851s	user 0.007s	sys 0.003s
I20260925 16:43:34.486265 11427 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:34.503166 11276 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:34.489348 11421 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.423877  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:34.489171  9696 rpcz_store.cc:276] 0925 16:43:32.515748 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:32.518336 (+  2588us) service_pool.cc:227] Handling call
0925 16:43:33.020928 (+502592us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:33.021123 (+   195us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:33.315144 (+294021us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:33.316999 (+  1855us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:33.342397 (+ 25398us) log.cc:842] Serialized 52 byte log entry
0925 16:43:33.566093 (+223696us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:33.566836 (+   743us) log.cc:842] Serialized 14 byte log entry
0925 16:43:33.637660 (+ 70824us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:33.637742 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:34.133349 (+495607us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b4800251f58. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:43:34.315124 (+181775us) raft_consensus.cc:1671] finished
0925 16:43:34.316067 (+   943us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:34.351329 (+ 35262us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":60271,"prepare.queue_time_us":184,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":69080,"raft.run_cpu_time_us":15372,"raft.run_wall_time_us":814134,"spinlock_wait_cycles":37154432,"thread_start_us":197874,"threads_started":1,"wal-append.queue_time_us":472805}
I20260925 16:43:34.505856  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:34.506091  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 190801us
I20260925 16:43:34.525326 11478 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:43:34.527544  9089 connection.cc:232] RPC call timeout handler was delayed by -2.8914873580001768s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2122s for a response
I20260925 16:43:34.500010  8966 rpcz_store.cc:276] 0925 16:43:33.048330 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.442296 (+1393966us) service_pool.cc:227] Handling call
0925 16:43:34.442660 (+   364us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:34.480005 (+ 37345us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:34.480047 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:34.480104 (+    57us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:34.480152 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.480234 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:34.480376 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":38044,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":9887}
I20260925 16:43:34.568415  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:34.568698 11477 ts_tablet_manager.cc:927] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:34.569048 11412 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:34.447635 11471 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.099s
I20260925 16:43:34.576485  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:34.571242  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2000) took 1201 ms. Trace:
I20260925 16:43:34.543202  9050 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
W20260925 16:43:34.571381  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 147596us
I20260925 16:43:34.572005  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:34.569993  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 358198us
I20260925 16:43:34.489239 11308 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:34.577656  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:34.588023  9123 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:34.577208  9120 rpcz_store.cc:276] 0925 16:43:33.369782 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.642653 (+272871us) service_pool.cc:227] Handling call
0925 16:43:33.643058 (+   405us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:33.658907 (+ 15849us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:33.658953 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:33.703424 (+ 44471us) log.cc:842] Serialized 26 byte log entry
0925 16:43:34.299441 (+596017us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:34.299488 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.299571 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:34.570554 (+270983us) raft_consensus.cc:1671] finished
0925 16:43:34.571021 (+   467us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:34.571184 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7885,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":12134,"thread_start_us":464286,"threads_started":1,"wal-append.queue_time_us":586251}
I20260925 16:43:34.580675  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:34.498652 10958 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:34.588915  9047 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:34.589926  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:34.596837  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.597671  9043 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:34.601068  9042 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:34.544875 11483 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.158s
I20260925 16:43:34.575086 11246 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.732328  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:34.609570  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 82984.9us
I20260925 16:43:34.834837  9699 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:34.626091  8968 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260925 16:43:34.846534 10693 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:34.706795  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:34.688854  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51510.2us
W20260925 16:43:34.745253  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146580us
I20260925 16:43:34.622226  9702 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:34.854190  8974 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:34.854418  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.852036  9047 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
W20260925 16:43:34.714272 11080 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.051s	user 0.011s	sys 0.000s
I20260925 16:43:34.704489  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:34.590440 11478 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:34.579310 11401 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:34.843431 11266 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.597257 11364 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:34.834630  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:34.856578 11092 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.627430  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:34.732193 11194 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:34.706597  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62721.9us
I20260925 16:43:34.688987  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:34.702253  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9707187619999331s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
I20260925 16:43:34.625068  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:34.847659  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1789) took 1731 ms. Trace:
I20260925 16:43:34.853539 10693 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:34.858487  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:34.662313  8967 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:34.863994  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:34.904814  9089 connection.cc:232] RPC call timeout handler was delayed by -1.85911876199998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18420000000000003s for a response
I20260925 16:43:34.905033  8971 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:43:34.906348  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7349187620000066s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.198s for a response
W20260925 16:43:34.906633  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1760187620000124s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2601s for a response
W20260925 16:43:34.906905  9089 connection.cc:232] RPC call timeout handler was delayed by -1.012218761999975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2783s for a response
I20260925 16:43:34.907815  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:34.839643 11085 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.673s	user 0.006s	sys 0.000s
I20260925 16:43:34.845422  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:34.875399 11497 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.143s	user 0.001s	sys 0.000s
I20260925 16:43:34.876809  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.603118 10958 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.880635  9047 pending_rounds.cc:76] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 2
I20260925 16:43:34.596305  9046 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:34.663267 11487 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.854866 11385 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.891263  8975 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:34.938737  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62030.1us
I20260925 16:43:34.722754 11474 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:43:34.656258 11477 tablet_copy_client.cc:316] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:43:34.891553  9045 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:34.897172 11478 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.898883  9049 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:34.661571 11427 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.901991  9119 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:34.903182 11441 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.759s	user 0.009s	sys 0.000s
I20260925 16:43:34.860129 11258 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:34.956646  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 106920us
I20260925 16:43:34.913769  8971 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:43:34.869052 11080 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:34.873008 11235 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.008s
I20260925 16:43:34.919922  8973 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:34.920944  9042 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:34.927045 10693 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.944905 11308 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:34.962435 11308 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:34.961925 10693 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:34.928639  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.905133  8970 rpcz_store.cc:276] 0925 16:43:33.115809 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.846745 (+1730936us) service_pool.cc:227] Handling call
0925 16:43:34.847069 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:34.847333 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:34.847361 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:34.847397 (+    36us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:34.847434 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.847494 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:34.847604 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":72,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":96}
I20260925 16:43:34.935562  9047 pending_rounds.cc:97] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260925 16:43:34.964223  9047 raft_consensus.cc:2866] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:34.937980  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:34.837684  9120 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:34.903662 11421 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:34.590648 11404 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.935351  9041 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:34.946923  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:34.941987 11480 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.332s	user 0.001s	sys 0.000s
I20260925 16:43:34.935897 11364 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.940768 11474 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:34.968719  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:34.904592 11266 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.975808 11512 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:34.921449 11092 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.958421 11504 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:43:34.988513  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59975.2us
I20260925 16:43:34.970685 11509 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:34.995278  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:34.997970  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 134045us
I20260925 16:43:34.947000 11385 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:34.941299 11487 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:35.005054  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 147919us
I20260925 16:43:35.002879 11486 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:35.018002 10693 raft_consensus.cc:979] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:34.981195 11308 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:34.993076 11421 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:34.970811 11235 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.001077 11512 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:34.994971 11504 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:35.101341  9043 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:35.130661  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:43:35.098740 11501 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260925 16:43:35.132599 11469 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.134961 11083 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:35.135650 10693 raft_consensus.cc:1067] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Signalling peer 225d3432101a4758bb9a6b0efeae09c5 to start an election
I20260925 16:43:34.971561 11441 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260925 16:43:35.166025 11080 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.169292  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:35.169853  8966 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:34.971314 11489 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.140s
I20260925 16:43:35.131276 11258 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:35.153384 11456 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.041s	user 0.002s	sys 0.000s
I20260925 16:43:35.153878  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:35.154161 11269 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:35.154901 11504 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:35.157001 11519 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:35.157258 11209 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.995s	user 0.003s	sys 0.006s
I20260925 16:43:34.978047 11499 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.182s
I20260925 16:43:35.013449 11508 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:35.157716  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 458) took 1336 ms. Trace:
I20260925 16:43:35.218502  9045 rpcz_store.cc:276] 0925 16:43:33.821018 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.834513 (+ 13495us) service_pool.cc:227] Handling call
0925 16:43:35.157576 (+1323063us) spinlock_profiling.cc:243] Waited 888 ms on lock 0x7b5400126e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:35.157671 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2041558784}
I20260925 16:43:35.219966  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:35.220613  9045 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:35.161950  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.989138 11364 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.225970 11364 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.145687  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:34.991520 11194 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.110s
I20260925 16:43:35.176859  8966 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:35.180374  8975 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:35.181579 11506 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:43:35.212090  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 253398us
I20260925 16:43:35.171875 11421 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:35.003073 11509 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.172287 11469 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.188560 11413 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.112s
W20260925 16:43:35.382072  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 222240us
I20260925 16:43:35.195458 11442 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
W20260925 16:43:35.412271  9015 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.644s (SENT)
I20260925 16:43:35.299873  9120 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260925 16:43:35.290872  9045 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:35.419631  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:35.226693  9050 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:35.290249  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:35.420759  9045 raft_consensus.cc:2396] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:35.372205  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:43:35.425987  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:35.426898  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 401) took 1290 ms. Trace:
W20260925 16:43:35.413944  9666 connection.cc:232] RPC call timeout handler was delayed by -1.3374899060002008s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260925 16:43:35.339218  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 394) took 1514 ms. Trace:
I20260925 16:43:35.178974 11083 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:35.349785 11461 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.248s	user 0.003s	sys 0.000s
I20260925 16:43:35.288640  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:35.427320  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:35.403657 11489 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.427232  9118 rpcz_store.cc:276] 0925 16:43:34.136743 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.238256 (+101513us) service_pool.cc:227] Handling call
0925 16:43:34.248951 (+ 10695us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:34.336291 (+ 87340us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:34.336331 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:34.347165 (+ 10834us) log.cc:842] Serialized 26 byte log entry
0925 16:43:34.651925 (+304760us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:34.651981 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:34.652073 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:35.426722 (+774649us) raft_consensus.cc:1671] finished
0925 16:43:35.426741 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:35.426849 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36742,"raft.queue_time_us":147829,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":43176,"thread_start_us":230532,"threads_started":1,"wal-append.queue_time_us":561207}
I20260925 16:43:35.427858  9117 rpcz_store.cc:276] 0925 16:43:33.824494 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.824612 (+   118us) service_pool.cc:227] Handling call
0925 16:43:33.824945 (+   333us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:33.884236 (+ 59291us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:33.884274 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:33.884316 (+    42us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:33.884353 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:35.338957 (+1454604us) spinlock_profiling.cc:243] Waited 59.1 ms on lock 0x7b5400010254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:35.339013 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:35.339165 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":135917312}
I20260925 16:43:35.416669  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.195238 11269 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:35.430145  9666 connection.cc:232] RPC call timeout handler was delayed by -1.3208379580000837s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20299999999999999s for a response
W20260925 16:43:35.226296 11087 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.002s	sys 0.014s
I20260925 16:43:35.436017  9120 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:35.372557  9116 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:35.218437 11508 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:35.458676 11511 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.467s	user 0.001s	sys 0.000s
I20260925 16:43:35.347832 11360 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:35.439940  9117 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:35.415220 11421 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:35.494942 11421 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:35.496011 11269 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.456117 11525 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:35.498095 11525 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.499835 11505 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.500355 11505 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.500677 11525 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:35.502345 11525 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:35.195777 11258 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.162962 11474 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.517783 11474 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:35.482250 11508 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:35.520776 11525 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.371932 11514 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:35.450927  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1106899060000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20650000000000002s for a response
I20260925 16:43:35.289700 10958 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.452466  9119 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260925 16:43:35.426093 11475 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:35.425246 11364 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.238121 11209 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.544160 11364 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.545485 11209 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.547071 11209 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:35.547968  9115 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:35.548053 11083 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.549111  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 393) took 1724 ms. Trace:
I20260925 16:43:35.549433  9115 rpcz_store.cc:276] 0925 16:43:33.824219 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.824336 (+   117us) service_pool.cc:227] Handling call
0925 16:43:33.824575 (+   239us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:35.548404 (+1723829us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:35.548915 (+   511us) spinlock_profiling.cc:243] Waited 1.72 s on lock 0x7b54001a04d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:35.549063 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3963012864}
I20260925 16:43:35.549837 11083 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:35.459602  9043 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:35.432956 11194 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:35.462468  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 300623us
I20260925 16:43:35.550604 11083 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.483506  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:35.551261 11194 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.551771  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:35.552067  9046 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:35.422818 11518 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260925 16:43:35.555325  9047 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260925 16:43:35.455190 11266 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:35.486515 11413 consensus_queue.cc:1225] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260925 16:43:35.507351 11487 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:35.515899 11521 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.557688 11487 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:35.557745 11521 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.559773 11499 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:35.560005 11521 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:35.415078 11506 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:35.417683 11442 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:35.560652 11506 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:35.560319 11499 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.561282 11442 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.465016 11092 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.537806  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.563995 11509 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.542227  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:35.542337 11441 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.542412 11502 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.543004 11360 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:35.543058 11475 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:35.596026  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 450400us
I20260925 16:43:35.238585 11519 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.550777 11523 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:35.553203  9046 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:35.547509 11209 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.592454  9048 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:35.633882  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1443) took 1102 ms. Trace:
I20260925 16:43:35.634217  9048 rpcz_store.cc:276] 0925 16:43:34.531206 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.531400 (+   194us) service_pool.cc:227] Handling call
0925 16:43:35.591956 (+1060556us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:35.592207 (+   251us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:35.633635 (+ 41428us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:35.633830 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":31180032}
I20260925 16:43:35.604777  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:35.605919  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.610002  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.610351  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 1995) took 2289 ms. Trace:
I20260925 16:43:35.635987  9124 rpcz_store.cc:276] 0925 16:43:33.320984 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.321113 (+   129us) service_pool.cc:227] Handling call
0925 16:43:33.321394 (+   281us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:33.321738 (+   344us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:33.321770 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:33.352330 (+ 30560us) log.cc:842] Serialized 26 byte log entry
0925 16:43:33.712393 (+360063us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:33.712445 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:33.712529 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:35.349193 (+1636664us) spinlock_profiling.cc:243] Waited 34.9 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:35.594020 (+244827us) raft_consensus.cc:1671] finished
0925 16:43:35.594046 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:35.610270 (+ 16224us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":2077,"spinlock_wait_cycles":80338304,"thread_start_us":323361,"threads_started":1,"wal-append.queue_time_us":649263}
I20260925 16:43:35.531291 11087 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:35.624846 11360 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.631060 11525 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.565516 11441 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.450042 11489 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:35.641767 11132 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:35.523880 11313 consensus_queue.cc:1159] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "225d3432101a4758bb9a6b0efeae09c5" responder_term: 8 status { last_received { term: 7 index: 5 } last_committed_idx: 5 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:43:35.571995 11514 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.692600  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:35.742286  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.978042  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1445) took 1405 ms. Trace:
I20260925 16:43:35.763954  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:35.773818  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46439.1us
I20260925 16:43:35.709497  9117 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:35.842599  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:35.720434  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 178275us
I20260925 16:43:35.594894 11521 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:35.774334  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:35.727118  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 174240us
I20260925 16:43:36.096235  9049 rpcz_store.cc:276] 0925 16:43:34.572662 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.572780 (+   118us) service_pool.cc:227] Handling call
0925 16:43:35.977788 (+1405008us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54000a78d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:35.977964 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":623088896}
I20260925 16:43:35.691033  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.980505  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:43:35.980320  8871 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:36.192159 10693 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.194031  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.192700 10693 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.196363  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.190006  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 396) took 2365 ms. Trace:
I20260925 16:43:36.197784  9123 rpcz_store.cc:276] 0925 16:43:33.825020 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.825161 (+   141us) service_pool.cc:227] Handling call
0925 16:43:33.885006 (+ 59845us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:34.590504 (+705498us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.189681 (+1599177us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b540009f454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:36.189932 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1616324864}
I20260925 16:43:36.199054  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:36.199610  9117 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:36.214996  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 522429us
W20260925 16:43:36.215034  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 451182us
I20260925 16:43:36.215987  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:36.222043 10693 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.225234  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.227072  9117 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:36.229017  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.230291  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1448) took 1077 ms. Trace:
W20260925 16:43:35.692240 11411 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.305s	user 0.011s	sys 0.002s
W20260925 16:43:35.844020 11512 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.681s	user 0.001s	sys 0.007s
W20260925 16:43:35.693622 11462 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.660s	user 0.011s	sys 0.007s
I20260925 16:43:36.231184  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:36.230679  9043 rpcz_store.cc:276] 0925 16:43:35.152516 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.551007 (+398491us) service_pool.cc:227] Handling call
0925 16:43:36.229848 (+678841us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:36.230010 (+   162us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:36.230039 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:36.230078 (+    39us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:36.230104 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.230153 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:36.230243 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34432}
I20260925 16:43:36.153678  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:35.665499 11453 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.174s	user 0.000s	sys 0.011s
I20260925 16:43:35.862666 11445 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:35.859447  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2048) took 1285 ms. Trace:
I20260925 16:43:36.240190 11338 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:43:36.251912 11445 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:35.695258 11269 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:35.841617 11478 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:36.232239  9700 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:35.856982  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:35.689116 11258 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.785112 11498 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:35.790920 11442 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:36.242484  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.233134  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.244050  9045 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:36.245651  9117 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260925 16:43:36.244745  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48451.9us
I20260925 16:43:35.689779 11504 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:35.642675  9046 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:35.694324  9116 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:35.594795 11502 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:35.848842 11428 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.298s	user 0.008s	sys 0.003s
I20260925 16:43:35.817763 11508 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.056164 11520 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:35.852907 11083 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.233204  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:36.229740  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.251924  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.231004 10693 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:36.261468 11537 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:35.694229  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:36.232172  9701 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:35.691267 11519 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:35.993664 10749 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:35.760663 11235 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.045296 11364 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.223579 11523 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:36.222142 11525 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:35.836606 11469 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:35.854571 11499 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.268935  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.252604 11338 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:36.300778  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:35.905828 11421 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.270850 11505 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.265165 11478 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.299499 11498 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.253250 11259 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:36.305610  9117 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:43:36.247318 11512 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:36.233901 11536 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:36.232002 11530 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:36.306321  9115 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:35.857014 11506 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.316051  9697 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:36.320024  9050 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:36.253940  9120 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.688s	user 0.010s	sys 0.037s
I20260925 16:43:36.222005 11132 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.252936  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:36.307816 11209 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.247367 11411 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.304472 11258 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:36.313903 11194 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:36.382759  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 188874us
I20260925 16:43:36.429391 11538 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:35.691318 11475 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.417830  9121 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260925 16:43:36.418960  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 118443us
I20260925 16:43:36.474268  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:36.416857  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62171.9us
I20260925 16:43:36.301949  9696 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260925 16:43:36.383263 11308 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:36.484485  8972 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:36.329682  9694 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:36.383158 11525 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:36.445384  9120 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.010s	sys 0.038s
I20260925 16:43:36.349134  9695 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
W20260925 16:43:36.447665  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 291761us
I20260925 16:43:36.383435 11537 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:36.453161  9047 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:36.315599 11428 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.452571  9049 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:36.455420  9124 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:36.457800  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.465317 11360 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:36.433831 11499 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:36.349685  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 250609us
I20260925 16:43:36.571177  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.348995 10749 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.313545 11445 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.480648  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.577391  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:36.476373  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:36.579011  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 102740us
I20260925 16:43:36.579932  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.581305  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:36.321633 11520 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.533766 11475 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:36.535346 11209 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:36.537890  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.480090  9696 pending_rounds.cc:76] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 5
W20260925 16:43:36.549382  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91664.6us
I20260925 16:43:36.434051 11535 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:36.518373 11538 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.530905 11525 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:36.468571 11083 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:36.482868 11385 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.476600  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.442294 11259 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.480223 11235 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.486002 11401 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:36.591253  9015 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.577s (SENT)
I20260925 16:43:36.706180  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:36.484340 11308 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:36.534557  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59519.3us
W20260925 16:43:36.637761  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64805.5us
W20260925 16:43:36.637960  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 410299us
I20260925 16:43:36.544181 11500 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.714043 11259 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.714644 11259 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:36.714461 11500 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.715025 11259 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:36.715404 11259 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:36.448318 11536 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.716683 11441 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:36.553442 11523 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:36.717458 11536 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.476293 11258 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.701277 11537 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.693526 11445 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:36.732215  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 154926us
W20260925 16:43:36.702837 11544 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260925 16:43:36.555274 11514 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:36.736223 11542 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.307s	user 0.000s	sys 0.001s
I20260925 16:43:36.570320 11521 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:36.639093 11364 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:36.714875  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 683) took 1071 ms. Trace:
I20260925 16:43:36.626892 11534 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.720000  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.752868  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:36.749382  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.553651 11505 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.141s
I20260925 16:43:36.736256 11421 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:36.755656  9115 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:36.755918 11132 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.756170 11428 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.756385 11514 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:36.756958  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:36.725304 11401 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.760562  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.650146 11533 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:36.728559  9666 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.606s (SENT)
I20260925 16:43:36.627967 11489 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.709085 11502 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.697012 11508 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.704864 11538 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.738322  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2050) took 2156 ms. Trace:
I20260925 16:43:36.627287 11499 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.728803 11553 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:36.709182  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:36.750643  9697 rpcz_store.cc:276] 0925 16:43:35.643960 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.644102 (+   142us) service_pool.cc:227] Handling call
0925 16:43:35.722489 (+ 78387us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:36.447396 (+724907us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.714642 (+267246us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b540066dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:36.714823 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1364639104}
I20260925 16:43:36.650261  9696 pending_rounds.cc:97] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260925 16:43:36.784034  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:36.766222  9700 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.509s	user 0.006s	sys 0.000s
I20260925 16:43:36.705603 11083 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.772151  9042 rpcz_store.cc:276] 0925 16:43:34.581601 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.601907 (+ 20306us) service_pool.cc:227] Handling call
0925 16:43:34.602233 (+   326us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:34.961362 (+359129us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.738165 (+1776803us) spinlock_profiling.cc:243] Waited 318 ms on lock 0x7b54002625d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:36.738279 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":732212096}
I20260925 16:43:36.709527 11235 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.731403 11194 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.035s
I20260925 16:43:36.746920 11504 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:36.764221  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:36.775416  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:36.785130  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.785198  9700 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:36.732933 11117 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260925 16:43:36.252243  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:36.791440  8871 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:36.800173  9115 raft_consensus.cc:2396] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260925 16:43:36.708093 11550 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.125s
I20260925 16:43:36.766992 11484 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:36.783460 11536 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.774530 11085 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:36.811139  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.769284 11514 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.774511 11522 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:36.799337  9697 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:36.799328  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 70788.4us
I20260925 16:43:36.252208  9044 rpcz_store.cc:276] 0925 16:43:34.574424 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.578993 (+  4569us) service_pool.cc:227] Handling call
0925 16:43:34.954566 (+375573us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:34.962158 (+  7592us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:34.962191 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:34.962793 (+   602us) log.cc:842] Serialized 52 byte log entry
0925 16:43:34.977485 (+ 14692us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:35.345117 (+367632us) spinlock_profiling.cc:243] Waited 3.81 ms on lock 0x7b18000fe860. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bebdfb3 00007f719bf2af0f 00007f719bf2999e
0925 16:43:35.346249 (+  1132us) spinlock_profiling.cc:243] Waited 5.04 ms on lock 0x7b540033eb20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bebdfb3 00007f719bf2af0f 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c
0925 16:43:35.346308 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:35.346422 (+   114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:35.346484 (+    62us) raft_consensus.cc:1671] finished
0925 16:43:35.346503 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:35.859243 (+512740us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54002a2950. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:35.859381 (+   138us) inbound_call.cc:173] Queueing success response
0925 16:43:35.861347 (+  1966us) spinlock_profiling.cc:243] Waited 6.86 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
Metrics: {"raft.queue_time_us":1215,"raft.run_cpu_time_us":2572,"raft.run_wall_time_us":892020,"spinlock_wait_cycles":851083392,"thread_start_us":14276,"threads_started":1,"wal-append.queue_time_us":13049,"wal-append.run_cpu_time_us":2087,"wal-append.run_wall_time_us":1021640}
I20260925 16:43:36.783811 11132 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.027s
I20260925 16:43:36.814364  9693 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:36.774601 11478 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.783751 11385 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:36.787171  9696 raft_consensus.cc:2866] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:36.789726  9694 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:36.777453 11506 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.789110 11411 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.788839 11530 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:36.847827 11530 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.850225 11530 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.769846 10953 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260925 16:43:36.775120 11498 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.851500  9693 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260925 16:43:36.795737 11490 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:36.774605 11553 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:36.804448 11441 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:36.770370 11308 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:36.801568  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.827417  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.884688  9115 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:36.827965  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.884855  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.885918  9123 raft_consensus.cc:2396] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:36.818183 11536 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.835299 10749 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:36.822835 11564 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.018s
I20260925 16:43:36.837119 11258 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:36.814486 11521 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.895298 11538 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.829579 11428 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260925 16:43:36.838399 11520 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.840920  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 469) took 1411 ms. Trace:
I20260925 16:43:36.899353  9048 rpcz_store.cc:276] 0925 16:43:35.429071 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.644160 (+215089us) service_pool.cc:227] Handling call
0925 16:43:35.644528 (+   368us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:35.644881 (+   353us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:35.644919 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:36.757069 (+1112150us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:43:36.757413 (+   344us) log.cc:842] Serialized 26 byte log entry
0925 16:43:36.806541 (+ 49128us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:36.806572 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.806647 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:36.840629 (+ 33982us) raft_consensus.cc:1671] finished
0925 16:43:36.840647 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:36.840862 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":421,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":84,"spinlock_wait_cycles":7378816,"thread_start_us":48828,"threads_started":1,"wal-append.queue_time_us":81343}
I20260925 16:43:36.821969 11514 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.804265 11338 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260925 16:43:36.819406 11484 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:36.821223  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:36.844245 11401 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.818415 11085 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.845052 11259 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.852761 11235 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.852852 11083 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.763388 11534 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.771730 11533 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:36.832057  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:36.878746  8939 connection.cc:232] RPC call timeout handler was delayed by -1.7919956540001749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19590000000000002s for a response
W20260925 16:43:36.880228  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60063.1us
W20260925 16:43:36.880861  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 289628us
I20260925 16:43:36.826527 11117 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:36.883783  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 197563us
I20260925 16:43:36.821043 11552 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:36.888226  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2057) took 1115 ms. Trace:
I20260925 16:43:36.894040  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:36.901700  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2059) took 1128 ms. Trace:
I20260925 16:43:36.879876 11490 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.829392 11385 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:36.908452  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:36.926532  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:37.144304  9123 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:37.144773  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.950s (SENT)
I20260925 16:43:37.145320  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:37.145740  9047 rpcz_store.cc:276] 0925 16:43:35.773546 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.221650 (+448104us) service_pool.cc:227] Handling call
0925 16:43:36.901520 (+679870us) spinlock_profiling.cc:243] Waited 55.9 ms on lock 0x7b5400261bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:36.901637 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":128593152}
I20260925 16:43:37.145095  9049 rpcz_store.cc:276] 0925 16:43:35.772980 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.232904 (+459924us) service_pool.cc:227] Handling call
0925 16:43:36.888088 (+655184us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b54002b5cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:36.888174 (+    86us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":336669056}
I20260925 16:43:36.972488  8871 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 3, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:37.156471  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:37.158078  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.158473  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.160465  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:36.970747  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 409) took 1281 ms. Trace:
I20260925 16:43:37.167029  9124 rpcz_store.cc:276] 0925 16:43:35.689744 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.689877 (+   133us) service_pool.cc:227] Handling call
0925 16:43:35.690186 (+   309us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:36.548963 (+858777us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.970505 (+421542us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:36.970688 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1759387392}
W20260925 16:43:36.948598  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 410767us
I20260925 16:43:37.129261 11560 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:37.161588 10749 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:43:37.161427 11538 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:37.171177 11538 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.172253  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:37.172791 11385 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:37.173211 11538 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.173899  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:37.176203 11533 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.176963 11534 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.177132 11085 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.177407 11556 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.177801  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.177892 11556 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.180033 11259 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.181389 11083 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:37.181332  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:37.137379 11269 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.873s	user 0.005s	sys 0.005s
W20260925 16:43:37.138954 11442 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.827s	user 0.008s	sys 0.000s
I20260925 16:43:37.182034  9047 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
W20260925 16:43:36.966830 11549 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.214s	user 0.000s	sys 0.000s
I20260925 16:43:37.181934  9115 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:37.185115  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:36.879781 11553 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:37.293090  9050 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:36.920126  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:37.293896  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 114218us
I20260925 16:43:37.057054 11523 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:36.887147 11427 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:37.295760  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 110736us
I20260925 16:43:37.198007  9123 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:37.309255  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:37.309880  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:37.187340  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 297053us
I20260925 16:43:37.292209  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:37.293934  9042 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:36.891003 11499 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:37.181978 11083 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:37.331207  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:37.354274  9115 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:43:36.951334 11500 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:37.356314  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64235.3us
I20260925 16:43:37.181910 11556 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:36.955298  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.158414 11117 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.212620 11560 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.173s
I20260925 16:43:37.359812 11505 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
I20260925 16:43:37.399667  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.221199 11533 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:37.358515 10958 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.300038 11235 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.210891 11490 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:37.394804  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:36.955181 11525 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.358222 11466 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:37.367925  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:37.435747  9697 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:37.404520  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:37.404349  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:37.370995  9122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2088) took 3472 ms (client timeout 1959 ms). Trace:
I20260925 16:43:37.372033  9117 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:37.288750 11535 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:37.329739 11269 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.392948  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:37.469300  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64853.7us
W20260925 16:43:37.393533  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62427.7us
I20260925 16:43:37.419138  8968 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:37.399027  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.476800  9045 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:37.393816  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2018) took 2012 ms. Trace:
W20260925 16:43:37.377436  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.761s (SENT)
I20260925 16:43:37.393548  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.419602  9047 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:37.477537  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:37.365931  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.433425  8967 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:37.387872 11570 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:37.368069 11541 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:37.465502  9117 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:37.385620  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:37.381400 11117 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:37.362196 11232 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:37.366881  9116 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:37.431617  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:37.478518  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 101118us
W20260925 16:43:37.479368  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 75112.9us
I20260925 16:43:37.520952  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:37.477345  9120 rpcz_store.cc:276] 0925 16:43:35.381279 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.476509 (+ 95230us) service_pool.cc:227] Handling call
0925 16:43:35.476859 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:35.525329 (+ 48470us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:36.531062 (+1005733us) log.cc:842] Serialized 14 byte log entry
0925 16:43:36.668880 (+137818us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:36.668956 (+    76us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:36.669011 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.384323 (+715312us) spinlock_profiling.cc:243] Waited 6.62 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:37.393600 (+  9277us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b54003becd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:37.393649 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:37.393762 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6240,"prepare.queue_time_us":1238870,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":92701,"raft.run_cpu_time_us":157,"raft.run_wall_time_us":13223,"spinlock_wait_cycles":126190080,"thread_start_us":1101796,"threads_started":3,"wal-append.queue_time_us":173132}
I20260925 16:43:37.364863  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:37.384929 11558 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.626s	user 0.000s	sys 0.011s
I20260925 16:43:37.506839 11570 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.523680  8969 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.523955 11525 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.524952 11570 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.524822  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.396646 11556 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.110s
I20260925 16:43:37.434062  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.393831 11092 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:37.374851 11536 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:37.416157 11475 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:37.390012 11505 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:37.488684  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.489821  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.536605  8971 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:37.536872  8974 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:37.507143 11541 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:37.466089  9122 rpcz_store.cc:269] 0925 16:43:33.898185 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.899001 (+   816us) service_pool.cc:227] Handling call
0925 16:43:37.370780 (+3471779us) spinlock_profiling.cc:243] Waited 1.92 s on lock 0x7b540010bb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:37.370911 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4416109440}
I20260925 16:43:37.388729 11563 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.103s
W20260925 16:43:37.508894  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7614015270000891s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
W20260925 16:43:37.565896  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7389015270000527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1535s for a response
W20260925 16:43:37.566218  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6867015269999683s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260925 16:43:37.386817 11467 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260925 16:43:37.465901 11466 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:37.506737  9117 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.401702 11478 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.086s
I20260925 16:43:37.513675  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.583968  9047 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:37.364874 11083 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.509827  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.585857  8968 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.515507  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.464154 11412 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.468719 11385 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.394469 11313 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.113s
I20260925 16:43:37.482236 11489 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:37.526480  8970 raft_consensus.cc:2354] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6.
I20260925 16:43:37.484700  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.491771 11441 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:37.488641 11490 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:37.429425 11533 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.601106  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.601873  8968 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.583238 11467 consensus_queue.cc:1225] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:43:37.602553 11533 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:37.602993 11547 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.909s	user 0.003s	sys 0.009s
I20260925 16:43:37.596235 11441 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:37.608057 11441 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:37.608929  9122 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:37.528976  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2014) took 2160 ms. Trace:
I20260925 16:43:37.609958  9122 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:37.534932  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.610044  9118 rpcz_store.cc:276] 0925 16:43:35.368475 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.438211 (+ 69736us) service_pool.cc:227] Handling call
0925 16:43:35.457060 (+ 18849us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:35.687376 (+230316us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:35.687424 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:35.818210 (+130786us) log.cc:842] Serialized 26 byte log entry
0925 16:43:36.318341 (+500131us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:36.318408 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:36.318482 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:36.966233 (+647751us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:37.518788 (+552555us) raft_consensus.cc:1671] finished
0925 16:43:37.518809 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:37.528913 (+ 10104us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":82505,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":15741184,"thread_start_us":610369,"threads_started":2,"wal-append.queue_time_us":860775}
I20260925 16:43:37.360747 11574 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:37.541239 11092 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:37.611896 11574 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:37.612300 11574 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:37.612663 11092 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.583630 11360 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.541657 11475 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.616606  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.617061 11475 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:37.618908 11580 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260925 16:43:37.583454 11466 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:37.620186  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.620494 11535 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.611807  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.621173 11490 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:37.621743 11490 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:37.622117  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.537253 11556 consensus_queue.cc:1225] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 6.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260925 16:43:37.608008  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 781) took 1510 ms. Trace:
I20260925 16:43:37.633724  9118 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:37.519740  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.550683  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 684) took 1860 ms. Trace:
I20260925 16:43:37.634631  9701 rpcz_store.cc:276] 0925 16:43:35.690666 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.690812 (+   146us) service_pool.cc:227] Handling call
0925 16:43:37.550504 (+1859692us) spinlock_profiling.cc:243] Waited 37.8 ms on lock 0x7b5400691754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:37.550625 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":86978944}
I20260925 16:43:37.626982  8974 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:37.636768  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.552907 11514 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.553560  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.554956 11453 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:37.648619 11453 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:37.648904 11574 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.649736 11453 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.556931  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 783) took 1023 ms. Trace:
I20260925 16:43:37.436208 11235 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.469161 11364 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260925 16:43:37.623657 11412 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:37.566457  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.021s (SENT)
I20260925 16:43:37.651340  9694 rpcz_store.cc:276] 0925 16:43:36.533313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.846701 (+313388us) service_pool.cc:227] Handling call
0925 16:43:36.847037 (+   336us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:37.139297 (+292260us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:37.139340 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:37.139398 (+    58us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:37.139452 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.556620 (+417168us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b540062f2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:37.556679 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:37.556861 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":797,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":103,"spinlock_wait_cycles":671173888}
I20260925 16:43:37.578790  8971 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
W20260925 16:43:37.580621  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.955s (SENT)
I20260925 16:43:37.584812  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.653559 11412 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:37.580024 11552 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.653995  9047 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:37.531095 11500 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:37.654331 11552 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.655148 11500 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:37.656286 11552 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.656008 11500 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.656678  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.657526  9046 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:37.486897 11269 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.658275  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.588218  9117 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:37.641587  9698 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:37.603585 11385 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.536311 11505 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:37.542599  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.581816 11541 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:37.602567  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.547962  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet c694676902c54ad8bfe8e7fd5a725e33 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:43:37.469106 11484 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.633553  9699 rpcz_store.cc:276] 0925 16:43:36.097762 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.153634 (+ 55872us) service_pool.cc:227] Handling call
0925 16:43:36.153924 (+   290us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:36.695071 (+541147us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:36.695119 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:36.695175 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:36.695215 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.607798 (+912583us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:37.607850 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:37.607951 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1242330496}
I20260925 16:43:37.642782 11475 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:37.673724  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.673810  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.644295  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.675173  9118 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:37.530088 11520 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
W20260925 16:43:37.566494  9089 connection.cc:232] RPC call timeout handler was delayed by -1.5481015269999716s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260925 16:43:37.683293  9089 connection.cc:232] RPC call timeout handler was delayed by -1.5283015269999396s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
W20260925 16:43:37.683717  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3591015270001208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1957s for a response
W20260925 16:43:37.684074  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3375015270000858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19810000000000003s for a response
W20260925 16:43:37.684414  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2835015269999985s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2041s for a response
W20260925 16:43:37.684739  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2403015269999287s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260925 16:43:37.685302  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1152015269999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22280000000000003s for a response
W20260925 16:43:37.652717  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 86283.7us
I20260925 16:43:37.432542 10958 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.653688  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:37.661278  9698 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 573) took 1421 ms (client timeout 1656 ms). Trace:
W20260925 16:43:37.654047  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73530.1us
W20260925 16:43:37.690946  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.103s (SENT)
I20260925 16:43:37.661904  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.599903  9697 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:37.693994  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:37.690609  9698 rpcz_store.cc:269] 0925 16:43:36.240375 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.249574 (+  9199us) service_pool.cc:227] Handling call
0925 16:43:37.553330 (+1303756us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:37.661227 (+107897us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8708480}
I20260925 16:43:37.697458  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.698199  9699 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:37.695384  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.690197 11573 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:37.706305  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:37.708043  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.710247  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.711102  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.712054  9698 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:37.712785  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.123s (SENT)
W20260925 16:43:37.713985  9015 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.227s (SENT)
W20260925 16:43:37.719463  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.539s (SENT)
I20260925 16:43:37.682242  9117 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260925 16:43:37.721084  9117 pending_rounds.cc:76] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 2
I20260925 16:43:37.722415  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.724072  9117 pending_rounds.cc:97] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260925 16:43:37.724596  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.726228  9118 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:37.726336  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.725389  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.705559 11573 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.728259  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.723255  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet c694676902c54ad8bfe8e7fd5a725e33 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-c694676902c54ad8bfe8e7fd5a725e33
I20260925 16:43:37.738087  9117 raft_consensus.cc:2866] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:37.633224 11360 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.691639  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.743182  8941 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:37.750120  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.756990  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:37.763545  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.727634  8971 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:37.765563  9046 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:43:37.763753  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 75705.5us
I20260925 16:43:37.765959  8974 raft_consensus.cc:2354] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
W20260925 16:43:37.767349  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.535s (SENT)
I20260925 16:43:37.768136  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:37.768335  9697 raft_consensus.cc:2396] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260925 16:43:37.775249  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.724133 11269 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.706214 11313 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:37.722190 11478 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:37.777992  8971 raft_consensus.cc:2362] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
I20260925 16:43:37.780414  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:37.786115  9046 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:37.781792  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2106) took 1020 ms. Trace:
I20260925 16:43:37.732602 11574 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:37.782581  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.224s (SENT)
I20260925 16:43:37.783021  8968 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:37.783649  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.787516  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:37.783651  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:37.764032 11421 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260925 16:43:37.789438  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 418) took 1007 ms. Trace:
I20260925 16:43:37.790591  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:37.793054  9117 rpcz_store.cc:276] 0925 16:43:36.761668 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.763756 (+  2088us) service_pool.cc:227] Handling call
0925 16:43:36.764005 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:37.371932 (+607927us) spinlock_profiling.cc:243] Waited 13.8 ms on lock 0x7b5400288820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:43:37.739072 (+367140us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.781731 (+ 42659us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":31690624}
I20260925 16:43:37.796407 11385 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.805861  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.797642 11466 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.799714  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:37.801054  9046 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:37.787886  8974 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:37.774339 11556 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:37.803807  9123 rpcz_store.cc:276] 0925 16:43:36.781788 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.309093 (+527305us) service_pool.cc:227] Handling call
0925 16:43:37.309400 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:37.309574 (+   174us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:37.592968 (+283394us) log.cc:842] Serialized 14 byte log entry
0925 16:43:37.789080 (+196112us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:37.789129 (+    49us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:37.789185 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.789265 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:37.789392 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":338441,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":47,"thread_start_us":435833,"threads_started":2}
I20260925 16:43:37.774605 11085 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:37.763154 11475 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260925 16:43:37.810148  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:37.811165  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.781054 11525 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:37.811547  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:37.806711  8968 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.815864  9046 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:37.816274  8971 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.906930  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.821115 10958 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:37.820976  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.910205  8974 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 2: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.802918 11405 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:37.807008 11520 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:37.805609 11526 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:37.807802 11478 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:37.916806 11478 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.917995 11441 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.812876 11556 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:37.919911 11556 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:37.920135 11412 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:37.764671 11505 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.814965 11532 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:37.815862 11085 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:37.785118 11490 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.847842  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.925307  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.789780 11313 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:37.855188 11427 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.501s	user 0.008s	sys 0.000s
I20260925 16:43:37.924396 11532 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:37.937736 11532 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:37.937543 11541 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:37.937776  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2010) took 2649 ms. Trace:
I20260925 16:43:37.938447  9119 rpcz_store.cc:276] 0925 16:43:35.288787 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.299790 (+ 11003us) service_pool.cc:227] Handling call
0925 16:43:35.371603 (+ 71813us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:35.529555 (+157952us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.937502 (+2407947us) spinlock_profiling.cc:243] Waited 78.6 ms on lock 0x7b540009ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:37.937706 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":180882176}
I20260925 16:43:37.858632  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:37.860775  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 494083us
I20260925 16:43:37.942704  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:37.943964  9122 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:37.943815  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:37.945904  8967 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:37.834702 11553 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:37.869887  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1799) took 3243 ms (client timeout 1856 ms). Trace:
I20260925 16:43:37.874270 11466 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:37.947898  8972 rpcz_store.cc:269] 0925 16:43:34.626320 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:34.627139 (+   819us) service_pool.cc:227] Handling call
0925 16:43:37.869675 (+3242536us) spinlock_profiling.cc:243] Waited 1.59 s on lock 0x7b54003e8d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:37.869819 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3653687680}
I20260925 16:43:37.875382 11573 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:37.875662 11473 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:37.876644 11442 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:37.878903  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.849848 11467 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:37.889065  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83970.1us
I20260925 16:43:37.892503  8970 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:37.894904  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 91524.8us
I20260925 16:43:37.908574  9043 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:37.961225  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.961512  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.962019  9117 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
W20260925 16:43:37.910570  8939 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50010 dropped due to backpressure. The service queue is full; it has 50 items.
I20260925 16:43:37.913074  9046 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:37.914376  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.964437  8974 raft_consensus.cc:2362] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4. Re-sending same reply.
I20260925 16:43:37.915017 11405 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:37.921157  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:37.947572 11209 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.226s	user 0.009s	sys 0.025s
I20260925 16:43:37.923408  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.927366  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:37.925467 11085 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:37.949034  8973 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:37.874123  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:37.920604 11412 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:37.949944  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:37.951485  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.952538  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.952559  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:37.973384  8970 raft_consensus.cc:2354] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
W20260925 16:43:37.921509  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 110170us
I20260925 16:43:37.948453 11360 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:37.975142  8971 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:37.949687 11364 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:37.952858 11473 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:38.086894  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:38.220547  9700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 776) took 2615 ms (client timeout 1565 ms). Trace:
I20260925 16:43:38.194008  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:38.246276  8968 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:38.242132  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92306.3us
I20260925 16:43:38.246157  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:38.007138  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:38.246203  9700 rpcz_store.cc:269] 0925 16:43:35.604437 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.604538 (+   101us) service_pool.cc:227] Handling call
0925 16:43:38.219473 (+2614935us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400333454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:38.219629 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1372074240}
W20260925 16:43:38.247116  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.811s (SENT)
I20260925 16:43:37.977939  8972 raft_consensus.cc:2362] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4. Re-sending same reply.
I20260925 16:43:37.966486 11441 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:38.250324  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:37.958349 11442 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:37.978091  9123 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:38.012300  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:38.009670  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:38.278178  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:38.261061 11360 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:38.016820 11592 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:43:37.974326  9044 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
W20260925 16:43:38.261588 11588 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260925 16:43:38.284211 11246 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:37.974948 11209 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.253s	user 0.009s	sys 0.025s
I20260925 16:43:38.284862  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:38.285188 11209 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:38.285660  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:38.286084 11209 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.285434  9044 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:38.287654 11515 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:38.288165 11515 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.288713  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:38.264209 11308 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:38.289984  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:38.290746 11483 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:38.291196 11483 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:38.292167 11235 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:38.265476 11546 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.721s	user 0.003s	sys 0.010s
I20260925 16:43:38.269340 11598 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:38.293013 11483 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:38.293404 11598 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.293927 11584 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:38.294319 11584 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:38.294634 11584 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:38.208719 11476 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:38.295943 11476 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.153946 11535 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:38.109338 11587 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.095s	user 0.001s	sys 0.000s
I20260925 16:43:38.142376 11556 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.255417  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:38.005406  8969 raft_consensus.cc:2354] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:38.278234  8973 raft_consensus.cc:2362] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6. Re-sending same reply.
I20260925 16:43:38.006796 11490 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:38.279902  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:38.280781  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2013) took 2943 ms. Trace:
I20260925 16:43:37.979372 11412 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:38.009932 11313 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:38.281816  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:37.975060 11568 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:37.963550 11498 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.320s
I20260925 16:43:38.267431  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 779) took 2662 ms. Trace:
I20260925 16:43:38.016326  9116 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:38.246413 11410 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:38.307317  9118 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:38.297701  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:38.364370  8968 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:38.293519 11483 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:38.073773 11508 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:38.311533  8975 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:38.250737 11364 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:38.142050  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 462) took 3138 ms. Trace:
I20260925 16:43:38.073963 11541 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:38.274000 11532 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.316567  9121 rpcz_store.cc:276] 0925 16:43:35.337316 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.433184 (+ 95868us) service_pool.cc:227] Handling call
0925 16:43:35.433621 (+   437us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:36.484907 (+1051286us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.280449 (+1795542us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b540007d354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:38.280692 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2254374656}
I20260925 16:43:38.385164  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:38.385437  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:38.385933  9121 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:38.295563 11598 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:38.309674 11473 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:38.331151  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2062) took 1851 ms (client timeout 2051 ms). Trace:
W20260925 16:43:38.674607  9050 rpcz_store.cc:269] 0925 16:43:36.480952 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:36.518265 (+ 37313us) service_pool.cc:227] Handling call
0925 16:43:38.331031 (+1812766us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54002b6bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:38.331105 (+    74us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1655282560}
I20260925 16:43:38.332207  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:38.332595  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:38.333907  8871 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 4 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:38.258765  9124 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:38.352327  8974 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:38.365805  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:38.253525  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:38.378353  9044 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:38.379465  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:38.383095  8975 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:38.678486  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:38.311017 11266 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:38.312908 11535 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:38.701221  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 335461us
W20260925 16:43:38.632717  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 240603us
I20260925 16:43:38.702983  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:38.637306  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:38.639204 11500 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:38.640406 11387 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:38.721395  8871 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:38.722378  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:38.724361  8871 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 4 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:38.717607  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:38.718657  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:38.642570  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 471) took 1254 ms. Trace:
I20260925 16:43:38.322333 11360 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.292s
I20260925 16:43:38.367244 11483 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:38.703738  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:38.653774 11532 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:38.370826 11508 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:38.007586 11405 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.660861 11556 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:38.665808 11515 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:38.373126 11442 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:38.376652 11553 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:38.669262  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 480) took 1138 ms. Trace:
I20260925 16:43:38.670653 11507 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:38.679092  9044 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:38.678740  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1409) took 1264 ms. Trace:
I20260925 16:43:38.686157  9124 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:38.690693  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.046s	sys 0.122s
I20260925 16:43:38.676151  9049 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:38.636373  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 474) took 1150 ms. Trace:
I20260925 16:43:38.704804  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:38.674770 11552 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:38.746279  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:38.747059  9043 rpcz_store.cc:276] 0925 16:43:37.388458 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.421814 (+ 33356us) service_pool.cc:227] Handling call
0925 16:43:37.434915 (+ 13101us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:37.960986 (+526071us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.642279 (+681293us) spinlock_profiling.cc:243] Waited 473 ms on lock 0x7b54000df554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:38.642504 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1088788352}
I20260925 16:43:38.732750  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:38.756441 10693 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:38.384256 11364 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:38.697814  9695 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:38.700408 11266 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:37.974684  8939 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:50010 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1818)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1806)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1813)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1837)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1819)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1803)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1831)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1407)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1829)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1826)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1830)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1395)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1406)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1810)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1393)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1397)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1824)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1825)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 498)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 501)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1392)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1398)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1401)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1402)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1403)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1410)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1415)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50010 (request call id 1808)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1809)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1811)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1812)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1822)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1832)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1834)
I20260925 16:43:38.674314  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 427) took 1275 ms. Trace:
I20260925 16:43:38.754751  8972 raft_consensus.cc:2362] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9. Re-sending same reply.
I20260925 16:43:38.785494  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:38.730515  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:38.720742 11269 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:39.332875  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1467) took 1001 ms. Trace:
I20260925 16:43:39.333463  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 434) took 1084 ms. Trace:
W20260925 16:43:39.339160  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.040s	sys 0.072s
I20260925 16:43:38.979604  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:39.246431  8940 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.000s	sys 0.019s
I20260925 16:43:39.094125  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:39.340134  9701 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:39.339812 10693 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:39.340787  9701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 690) took 1808 ms (client timeout 1519 ms). Trace:
I20260925 16:43:39.334622  8967 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:39.341315  9699 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:43:39.335673  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 632003us
I20260925 16:43:38.714859 11500 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:39.336179  9048 rpcz_store.cc:276] 0925 16:43:37.533604 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.642229 (+108625us) service_pool.cc:227] Handling call
0925 16:43:38.385275 (+743046us) spinlock_profiling.cc:243] Waited 19.9 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:38.669190 (+283915us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":45864192}
W20260925 16:43:39.265164  9122 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.017s	sys 0.018s
W20260925 16:43:39.364758  9122 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.019s	sys 0.019s
W20260925 16:43:39.337059  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2070) took 2178 ms (client timeout 2580 ms). Trace:
I20260925 16:43:38.980428  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:38.341239  9696 rpcz_store.cc:276] 0925 16:43:35.605236 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.605429 (+   193us) service_pool.cc:227] Handling call
0925 16:43:35.605774 (+   345us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:36.846435 (+1240661us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.267107 (+1420672us) spinlock_profiling.cc:243] Waited 642 ms on lock 0x7b5400670554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:38.267356 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1477541120}
I20260925 16:43:38.707342 11473 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:38.707957 11490 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:39.337170  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1818) took 1647 ms (client timeout 2014 ms). Trace:
I20260925 16:43:39.338519  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2033) took 1373 ms. Trace:
W20260925 16:43:38.870332 11584 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.575s	user 0.007s	sys 0.000s
W20260925 16:43:38.997159  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 369074us
W20260925 16:43:39.375432  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.590s (SENT) [suppressed 41 similar messages]
I20260925 16:43:39.336555  8970 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:38.719314 11387 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:43:39.341920  9701 rpcz_store.cc:269] 0925 16:43:37.532055 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.665503 (+133448us) service_pool.cc:227] Handling call
0925 16:43:38.979403 (+1313900us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:39.340727 (+361324us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17757952}
W20260925 16:43:39.339857  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.041s	sys 0.072s
I20260925 16:43:39.334502  9045 rpcz_store.cc:276] 0925 16:43:37.486024 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.513963 (+ 27939us) service_pool.cc:227] Handling call
0925 16:43:38.635340 (+1121377us) spinlock_profiling.cc:243] Waited 8.61 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:38.635603 (+   263us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:38.635829 (+   226us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:38.635866 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:38.635918 (+    52us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:38.635958 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.636027 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:38.636306 (+   279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19796352}
I20260925 16:43:38.829499 11478 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:39.339668  9124 rpcz_store.cc:276] 0925 16:43:38.249303 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.677005 (+427702us) service_pool.cc:227] Handling call
0925 16:43:38.685937 (+  8932us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.333229 (+647292us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.333414 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":33152}
I20260925 16:43:39.379770  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:39.380390  9124 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.342478 11469 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:38.760818 11485 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.613s
W20260925 16:43:39.378396 11412 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.027s	user 0.003s	sys 0.008s
I20260925 16:43:39.365005  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:39.366137  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1459) took 1357 ms (client timeout 1753 ms). Trace:
W20260925 16:43:39.408828  9047 rpcz_store.cc:269] 0925 16:43:38.008667 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.980165 (+971498us) service_pool.cc:227] Handling call
0925 16:43:39.366079 (+385914us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.366511  9049 rpcz_store.cc:269] 0925 16:43:37.158733 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.181060 (+ 22327us) service_pool.cc:227] Handling call
0925 16:43:38.332089 (+1151029us) spinlock_profiling.cc:243] Waited 1.17 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:39.337005 (+1004916us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2703616}
W20260925 16:43:38.807118 11246 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.000s
W20260925 16:43:39.264672 11083 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.007s	sys 0.031s
I20260925 16:43:39.336746  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:39.371260 10693 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:38.808787 11548 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 2.321s	user 0.020s	sys 0.000s
I20260925 16:43:38.783440 11483 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.371734  9117 rpcz_store.cc:276] 0925 16:43:37.965268 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.965463 (+   195us) service_pool.cc:227] Handling call
0925 16:43:37.965826 (+   363us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:37.977155 (+ 11329us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:37.977183 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:38.031857 (+ 54674us) log.cc:842] Serialized 26 byte log entry
0925 16:43:38.307129 (+275272us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:38.307165 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.307229 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:39.338307 (+1031078us) raft_consensus.cc:1671] finished
0925 16:43:39.338328 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.338464 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5938,"raft.queue_time_us":6134,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":44788,"thread_start_us":181925,"threads_started":1,"wal-append.queue_time_us":688823}
I20260925 16:43:39.379367 11478 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:39.416559  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2042) took 1094 ms. Trace:
I20260925 16:43:39.417008  9117 rpcz_store.cc:276] 0925 16:43:38.321960 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.415537 (+1093577us) service_pool.cc:227] Handling call
0925 16:43:39.415930 (+   393us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.416135 (+   205us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:39.416171 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:39.416237 (+    66us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:39.416283 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.416350 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.416482 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:38.809231 11085 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.801s	user 0.010s	sys 0.000s
I20260925 16:43:39.091853  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 425) took 1693 ms. Trace:
I20260925 16:43:39.420797  9120 rpcz_store.cc:276] 0925 16:43:37.398288 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.528999 (+130711us) service_pool.cc:227] Handling call
0925 16:43:37.530130 (+  1131us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:37.623059 (+ 92929us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:37.623102 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:37.623155 (+    53us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:37.623214 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.091508 (+1468294us) spinlock_profiling.cc:243] Waited 92.7 ms on lock 0x7b5400041ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:39.091573 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.091782 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":213194112}
I20260925 16:43:39.423152  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 438) took 1069 ms. Trace:
W20260925 16:43:39.205153 11209 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.104s	sys 0.144s
I20260925 16:43:39.374374  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:38.800921  9693 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:43:39.377593  9701 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:39.337419 11453 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:38.802546 11535 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:39.339414  9118 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:39.331910 11476 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:39.412909 11083 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.007s	sys 0.034s
I20260925 16:43:39.364609 11360 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:39.392040 11500 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.338872  9116 rpcz_store.cc:276] 0925 16:43:37.399349 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.597029 (+197680us) service_pool.cc:227] Handling call
0925 16:43:38.015808 (+418779us) spinlock_profiling.cc:243] Waited 6.07 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:38.016074 (+   266us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:38.364164 (+348090us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.616390 (+252226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13956992}
I20260925 16:43:39.378152 11490 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.396097 11508 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.412426 11539 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:39.402307 11601 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.193s	user 0.000s	sys 0.000s
I20260925 16:43:39.402878 11387 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.347966 11507 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.412493  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:39.423590  9120 rpcz_store.cc:276] 0925 16:43:38.353589 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.422187 (+1068598us) service_pool.cc:227] Handling call
0925 16:43:39.422536 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.422756 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:39.422795 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:39.422846 (+    51us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:39.422886 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.422956 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.423090 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.383836  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 582) took 1061 ms. Trace:
I20260925 16:43:39.458408 11507 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:39.458629  9695 rpcz_store.cc:276] 0925 16:43:38.319604 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.321859 (+  2255us) service_pool.cc:227] Handling call
0925 16:43:38.373775 (+ 51916us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.366676 (+992901us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.381049 (+ 14373us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.426141 11209 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.108s	sys 0.145s
I20260925 16:43:39.425904 11478 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:39.429109 11085 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.456178 11500 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:39.465081 11085 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:39.334182  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.325s	user 0.050s	sys 0.127s
I20260925 16:43:39.442414  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:43:39.401433 11410 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.031s	user 0.008s	sys 0.000s
I20260925 16:43:39.435997 11535 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:39.364297 11552 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:39.456460  9699 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:39.380334 11584 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:39.412678 11412 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:39.471957  9697 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.018s	sys 0.022s
I20260925 16:43:39.455276 11508 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:39.474601  9697 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.018s	sys 0.022s
I20260925 16:43:39.468617 11209 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:39.469515 11488 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:39.443142 11360 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.474324 11387 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:39.449021 11611 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260925 16:43:39.485561 11488 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.454439 11539 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.473963 11535 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.523574 11584 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:39.344151  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1806) took 1757 ms (client timeout 2123 ms). Trace:
I20260925 16:43:39.411062  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:39.338889  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 487659us
I20260925 16:43:39.553395  9047 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:43:39.348392  8940 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.000s	sys 0.023s
I20260925 16:43:39.555951  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:39.556524  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 938699us
I20260925 16:43:39.557044  8966 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:39.373829  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:39.558269  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:39.558673  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:39.558837  9043 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:43:39.340510  8971 raft_consensus.cc:2362] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
I20260925 16:43:39.559620  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1466) took 1242 ms. Trace:
W20260925 16:43:39.559669  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1813) took 1961 ms (client timeout 2115 ms). Trace:
I20260925 16:43:39.335817  8975 rpcz_store.cc:276] 0925 16:43:37.413982 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.255122 (+841140us) service_pool.cc:227] Handling call
0925 16:43:38.678694 (+423572us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.339318  9044 rpcz_store.cc:276] 0925 16:43:38.331561 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.678282 (+346721us) service_pool.cc:227] Handling call
0925 16:43:39.332819 (+654537us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.560470  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:39.560834  8972 rpcz_store.cc:269] 0925 16:43:37.690111 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.702690 (+1012579us) service_pool.cc:227] Handling call
0925 16:43:39.337098 (+634408us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.561444  9049 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.561841  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:39.562202  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.562402  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.563078  9044 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:39.563048  8975 raft_consensus.cc:2362] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
I20260925 16:43:39.563493  8972 raft_consensus.cc:2354] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4.
I20260925 16:43:39.377737  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:39.560297  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1819) took 1798 ms (client timeout 2016 ms). Trace:
W20260925 16:43:39.551872  8967 rpcz_store.cc:269] 0925 16:43:37.586371 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.732441 (+1146070us) service_pool.cc:227] Handling call
0925 16:43:39.344085 (+611644us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.563659  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1803) took 1982 ms (client timeout 2227 ms). Trace:
I20260925 16:43:39.573458  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:39.560339  8970 rpcz_store.cc:269] 0925 16:43:37.598275 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.730198 (+1131923us) service_pool.cc:227] Handling call
0925 16:43:39.559398 (+829200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.574421  8967 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.575188  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:38.384057  9041 rpcz_store.cc:276] 0925 16:43:35.003229 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.092813 (+ 89584us) service_pool.cc:227] Handling call
0925 16:43:35.152885 (+ 60072us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:35.471173 (+318288us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:35.803558 (+332385us) log.cc:842] Serialized 14 byte log entry
0925 16:43:36.224270 (+420712us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:36.233165 (+  8895us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:36.242660 (+  9495us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:37.602346 (+1359686us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:38.141736 (+539390us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b5400127354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:38.141810 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:38.141975 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":527,"prepare.queue_time_us":901510,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":21175,"raft.run_cpu_time_us":152,"raft.run_wall_time_us":11322,"spinlock_wait_cycles":732465280,"thread_start_us":506963,"threads_started":2,"wal-append.queue_time_us":694951,"wal-append.run_cpu_time_us":15053,"wal-append.run_wall_time_us":2083592}
W20260925 16:43:39.576164  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1407) took 2162 ms (client timeout 2568 ms). Trace:
I20260925 16:43:39.411123  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1472) took 1020 ms. Trace:
I20260925 16:43:39.560135  9043 rpcz_store.cc:276] 0925 16:43:38.317440 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.341607 (+1024167us) service_pool.cc:227] Handling call
0925 16:43:39.559556 (+217949us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.572115  8971 rpcz_store.cc:269] 0925 16:43:37.761385 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.093798 (+1332413us) service_pool.cc:227] Handling call
0925 16:43:39.560122 (+466324us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.577323  9048 rpcz_store.cc:276] 0925 16:43:38.390681 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.364756 (+974075us) service_pool.cc:227] Handling call
0925 16:43:39.411068 (+ 46312us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.578007  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:39.578655  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:39.381037  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.013s	sys 0.037s
W20260925 16:43:39.573601  8975 rpcz_store.cc:269] 0925 16:43:37.581023 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.561444 (+1980421us) service_pool.cc:227] Handling call
0925 16:43:39.563604 (+  2160us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.568256  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:39.571185  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:39.580834  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.581444  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:39.581934  8975 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:39.582283  9044 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:39.582126  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:39.582453  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1826) took 1714 ms (client timeout 2159 ms). Trace:
W20260925 16:43:39.583076  8975 rpcz_store.cc:269] 0925 16:43:37.867952 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.580431 (+1712479us) service_pool.cc:227] Handling call
0925 16:43:39.582400 (+  1969us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.579746  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.013s	sys 0.037s
I20260925 16:43:39.584299  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:39.584484  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 862072us
W20260925 16:43:39.585345  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1830) took 1716 ms (client timeout 2241 ms). Trace:
I20260925 16:43:39.585630  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:39.585817  8975 rpcz_store.cc:269] 0925 16:43:37.869311 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.583874 (+1714563us) service_pool.cc:227] Handling call
0925 16:43:39.585284 (+  1410us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.595794  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 585) took 1195 ms. Trace:
I20260925 16:43:39.596359  9697 rpcz_store.cc:276] 0925 16:43:38.400367 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.692608 (+292241us) service_pool.cc:227] Handling call
0925 16:43:38.718019 (+ 25411us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:38.745718 (+ 27699us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:38.745746 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:38.746186 (+   440us) log.cc:842] Serialized 26 byte log entry
0925 16:43:39.476311 (+730125us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:39.476363 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.476449 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:39.595191 (+118742us) raft_consensus.cc:1671] finished
0925 16:43:39.595237 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.595547 (+   310us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":27996,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":26909,"thread_start_us":683804,"threads_started":1,"wal-append.queue_time_us":724134}
W20260925 16:43:39.600337  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 253955us
I20260925 16:43:39.604591 11467 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:39.605079 11467 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:39.605419 11467 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.605512  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.606419  8968 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 2.
W20260925 16:43:39.606854  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1828) took 1738 ms (client timeout 1897 ms). Trace:
W20260925 16:43:39.607170  8968 rpcz_store.cc:269] 0925 16:43:37.868629 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.605072 (+1736443us) service_pool.cc:227] Handling call
0925 16:43:39.606807 (+  1735us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.608383  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:39.609189  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1458) took 1600 ms (client timeout 1569 ms). Trace:
I20260925 16:43:39.609553  8968 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260925 16:43:39.609637  9042 rpcz_store.cc:269] 0925 16:43:38.008411 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.608756 (+1600345us) service_pool.cc:214] Skipping call since client already timed out
0925 16:43:39.608939 (+   183us) inbound_call.cc:173] Queueing failure response
Metrics: {}
W20260925 16:43:39.610090  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1406) took 2197 ms (client timeout 2800 ms). Trace:
W20260925 16:43:39.610488  8968 rpcz_store.cc:269] 0925 16:43:37.413121 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.607950 (+2194829us) service_pool.cc:227] Handling call
0925 16:43:39.610031 (+  2081us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.610836  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:39.576557  8970 rpcz_store.cc:269] 0925 16:43:37.413394 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.574733 (+2161339us) service_pool.cc:227] Handling call
0925 16:43:39.576085 (+  1352us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.612061  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:39.557490  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1463) took 1276 ms. Trace:
I20260925 16:43:39.613214  9695 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:39.612866  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.614600 11442 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.613700  9047 rpcz_store.cc:276] 0925 16:43:38.281015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.555150 (+1274135us) service_pool.cc:227] Handling call
0925 16:43:39.557382 (+  2232us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.617834 11412 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:39.611603  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.618659  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:39.428107  9117 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:39.607426  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.707s (SENT)
I20260925 16:43:39.458282  9120 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:39.622117  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.592231  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2029) took 1640 ms. Trace:
I20260925 16:43:39.592531  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.622889  9120 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:39.592356  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:39.623929  9116 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:39.476979 11364 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:39.624971  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.625191  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.626080  9124 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 4: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:39.593662  9118 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:39.466569  9123 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:39.626652 11364 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:39.627518 11466 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:39.628247 11466 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:39.629452 11360 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:39.629575  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:39.630486  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 437) took 1290 ms. Trace:
I20260925 16:43:39.630980 11266 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:39.630860  9117 rpcz_store.cc:276] 0925 16:43:38.340094 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.418089 (+1077995us) service_pool.cc:227] Handling call
0925 16:43:39.418425 (+   336us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.629977 (+211552us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.630316 (+   339us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.632184  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 505) took 2253 ms (client timeout 2177 ms). Trace:
W20260925 16:43:39.632715  8974 rpcz_store.cc:269] 0925 16:43:37.378600 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.965061 (+586461us) service_pool.cc:227] Handling call
0925 16:43:39.631639 (+1666578us) spinlock_profiling.cc:243] Waited 93.3 ms on lock 0x7b54003c3cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:39.631907 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":214582528}
I20260925 16:43:39.595744  9702 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:39.609277  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:39.572378  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1461) took 1316 ms. Trace:
I20260925 16:43:39.619091  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1810) took 2021 ms. Trace:
I20260925 16:43:39.619748  9693 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:39.593165  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2038) took 1584 ms. Trace:
I20260925 16:43:39.634647  9045 rpcz_store.cc:276] 0925 16:43:38.256422 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.377535 (+1121113us) service_pool.cc:227] Handling call
0925 16:43:39.572186 (+194651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.635268  9121 rpcz_store.cc:276] 0925 16:43:38.008507 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.386720 (+378213us) service_pool.cc:227] Handling call
0925 16:43:38.387043 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:38.654361 (+267318us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:38.654403 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:38.654971 (+   568us) log.cc:842] Serialized 26 byte log entry
0925 16:43:39.377158 (+722187us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:39.377193 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.377255 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:39.592702 (+215447us) raft_consensus.cc:1671] finished
0925 16:43:39.592736 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.592982 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10501,"raft.queue_time_us":284217,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":81,"thread_start_us":721829,"threads_started":1,"wal-append.queue_time_us":832500}
I20260925 16:43:39.629021 11466 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:39.634859  9699 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:39.578733  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:39.640980 11466 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:39.641597  8968 rpcz_store.cc:276] 0925 16:43:37.597622 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.611261 (+2013639us) service_pool.cc:227] Handling call
0925 16:43:39.619002 (+  7741us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.579728  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:39.642729  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.643731  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1824) took 1776 ms. Trace:
I20260925 16:43:39.644078  8968 rpcz_store.cc:276] 0925 16:43:37.867109 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.642323 (+1775214us) service_pool.cc:227] Handling call
0925 16:43:39.643649 (+  1326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.644310  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1465) took 1330 ms. Trace:
I20260925 16:43:39.634217  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.645004  9043 rpcz_store.cc:276] 0925 16:43:38.313751 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.642961 (+1329210us) service_pool.cc:227] Handling call
0925 16:43:39.643485 (+   524us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.643906 (+   421us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:39.643938 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:39.644003 (+    65us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:39.644045 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.644121 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.644226 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.645989  8974 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:39.647166  9043 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:43:39.647850  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1468) took 1290 ms. Trace:
I20260925 16:43:39.647974  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1397) took 2237 ms. Trace:
I20260925 16:43:39.576870  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:39.648880 11085 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:39.651973 11085 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:39.652802  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1827) took 1784 ms (client timeout 2054 ms). Trace:
W20260925 16:43:39.653192  8972 rpcz_store.cc:269] 0925 16:43:37.868303 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.561986 (+1693683us) service_pool.cc:227] Handling call
0925 16:43:39.652718 (+ 90732us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.649467 11308 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:39.654404 11308 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:39.654610  8972 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:39.654793 11308 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:39.654882 11405 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:39.658245  8966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 490) took 2500 ms (client timeout 2021 ms). Trace:
W20260925 16:43:39.658730  8966 rpcz_store.cc:269] 0925 16:43:37.158148 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.158256 (+   108us) service_pool.cc:227] Handling call
0925 16:43:39.657962 (+2499706us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b5400225954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:39.658150 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5502664576}
I20260925 16:43:39.648442  8974 rpcz_store.cc:276] 0925 16:43:37.410439 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.633866 (+2223427us) service_pool.cc:227] Handling call
0925 16:43:39.647898 (+ 14032us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.661396 11354 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:39.663832  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 498) took 2278 ms. Trace:
I20260925 16:43:39.664234  8972 rpcz_store.cc:276] 0925 16:43:37.376924 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.653924 (+2277000us) service_pool.cc:227] Handling call
0925 16:43:39.654325 (+   401us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.655003 (+   678us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.655166 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:39.664670  9702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 682) took 4099 ms (client timeout 3333 ms). Trace:
I20260925 16:43:39.661346  8974 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:39.666705  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:39.586443  8971 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
W20260925 16:43:39.650393  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.755s (SENT)
I20260925 16:43:39.671144 11413 raft_consensus.cc:2741] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260925 16:43:39.622968  9119 rpcz_store.cc:276] 0925 16:43:37.951471 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.956010 (+  4539us) service_pool.cc:227] Handling call
0925 16:43:37.956229 (+   219us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:37.958801 (+  2572us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:37.958830 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:37.964071 (+  5241us) log.cc:842] Serialized 26 byte log entry
0925 16:43:39.465955 (+1501884us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:39.465999 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.466066 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:39.591668 (+125602us) raft_consensus.cc:1671] finished
0925 16:43:39.591737 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.592004 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2236,"raft.queue_time_us":2340,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":9388,"thread_start_us":1456613,"threads_started":1,"wal-append.queue_time_us":1030860}
I20260925 16:43:39.651059  9041 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:39.672484  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.856s (SENT)
I20260925 16:43:39.672600  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1469) took 1307 ms. Trace:
I20260925 16:43:39.673055  9041 rpcz_store.cc:276] 0925 16:43:38.365143 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.649648 (+1284505us) service_pool.cc:227] Handling call
0925 16:43:39.650449 (+   801us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.672276 (+ 21827us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.672495 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.673499  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:39.673785  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2035) took 1695 ms. Trace:
W20260925 16:43:39.663086  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1801) took 2176 ms (client timeout 1577 ms). Trace:
I20260925 16:43:39.674301  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:39.674407  8969 rpcz_store.cc:269] 0925 16:43:37.510175 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.524470 (+ 14295us) service_pool.cc:227] Handling call
0925 16:43:39.662559 (+2138089us) spinlock_profiling.cc:243] Waited 432 ms on lock 0x7b54003557d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:39.662864 (+   305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":994112896}
I20260925 16:43:39.665892  8972 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:39.673018  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:39.670866  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1829) took 1801 ms (client timeout 2138 ms). Trace:
W20260925 16:43:39.676558  8971 rpcz_store.cc:269] 0925 16:43:37.869000 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.578236 (+1709236us) service_pool.cc:227] Handling call
0925 16:43:39.670818 (+ 92582us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.596385  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.670329  9042 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
W20260925 16:43:39.668108  9702 rpcz_store.cc:269] 0925 16:43:35.565072 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:35.566146 (+  1074us) service_pool.cc:227] Handling call
0925 16:43:39.664426 (+4098280us) spinlock_profiling.cc:243] Waited 3.96 s on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:39.664587 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9105707392}
I20260925 16:43:39.638245  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:39.681638  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1392) took 2297 ms. Trace:
I20260925 16:43:39.674166  9123 rpcz_store.cc:276] 0925 16:43:37.977794 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.279028 (+301234us) service_pool.cc:227] Handling call
0925 16:43:38.279204 (+   176us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.627182 (+1347978us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.673417 (+ 46235us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54001c9654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:39.673641 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2730280192}
I20260925 16:43:39.682646  8974 rpcz_store.cc:276] 0925 16:43:37.407918 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.660538 (+2252620us) service_pool.cc:227] Handling call
0925 16:43:39.661052 (+   514us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.676402 (+ 15350us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.676655 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.681716  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1398) took 2265 ms. Trace:
I20260925 16:43:39.684610  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 501) took 2306 ms. Trace:
I20260925 16:43:39.691529  8966 rpcz_store.cc:276] 0925 16:43:37.377662 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.668650 (+2290988us) service_pool.cc:227] Handling call
0925 16:43:39.683830 (+ 15180us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.684210 (+   380us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:39.684237 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:39.684329 (+    92us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:39.684364 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.684434 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:39.684544 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.693215  9059 tablet_copy_source_session.cc:205] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:43:39.693640  8966 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:39.694409  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1403) took 2282 ms. Trace:
I20260925 16:43:39.695180  9059 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:43114 (request call id 472) took 2289 ms. Trace:
I20260925 16:43:39.708177  9059 rpcz_store.cc:276] 0925 16:43:37.425095 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.536168 (+111073us) service_pool.cc:227] Handling call
0925 16:43:38.794545 (+1258377us) spinlock_profiling.cc:243] Waited 765 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf34257 00007f71a0e475e6 00007f71a0e50e5e 00007f719892b5db 00007f71a0e50dda 00007f71a0e4beec 00007f71a0e4724b 00007f71a0e3be45 00007f719ff44a54 00007f719ff449e2
0925 16:43:39.692864 (+898319us) spinlock_profiling.cc:243] Waited 792 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e4776b 00007f71a0e50e5e 00007f719892b5db 00007f71a0e50dda 00007f71a0e4beec 00007f71a0e4724b 00007f71a0e3be45 00007f719ff44a54 00007f719ff449e2
0925 16:43:39.695048 (+  2184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3581204096}
I20260925 16:43:39.694820  8966 rpcz_store.cc:276] 0925 16:43:37.412242 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.692800 (+2280558us) service_pool.cc:227] Handling call
0925 16:43:39.693327 (+   527us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.694157 (+   830us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.694351 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.711866  9700 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:39.713635  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 800) took 1340 ms. Trace:
I20260925 16:43:39.714059  9700 rpcz_store.cc:276] 0925 16:43:38.373441 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.373585 (+   144us) service_pool.cc:227] Handling call
0925 16:43:38.691005 (+317420us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.712320 (+1021315us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.713368 (+  1048us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54006eda54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:39.713557 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2346058496}
W20260925 16:43:39.707499  8872 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 339) took 15618 ms (client timeout 15000 ms). Trace:
I20260925 16:43:39.716678  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.718597  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.719292  9119 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
W20260925 16:43:39.716068  8872 rpcz_store.cc:269] 0925 16:43:24.088602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:24.088769 (+   167us) service_pool.cc:227] Handling call
0925 16:43:24.188837 (+100068us) spinlock_profiling.cc:243] Waited 77.7 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:43:39.707162 (+15518325us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:30.359126 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:30.359728 (+   602us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:30.359798 (+    70us) write_op.cc:435] Acquired schema lock
0925 16:43:30.359830 (+    32us) tablet.cc:660] Decoding operations
0925 16:43:30.360835 (+  1005us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:30.360928 (+    93us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:30.360957 (+    29us) tablet.cc:683] Acquiring locks for 9 operations
0925 16:43:30.361715 (+   758us) tablet.cc:699] Row locks acquired
0925 16:43:30.361755 (+    40us) write_op.cc:260] PREPARE: finished
0925 16:43:30.361912 (+   157us) write_op.cc:270] Start()
0925 16:43:30.362057 (+   145us) write_op.cc:276] Timestamp: P: 1790354610361843 usec, L: 0
0925 16:43:30.362092 (+    35us) op_driver.cc:331] REPLICATION: starting
0925 16:43:30.362769 (+   677us) log.cc:842] Serialized 3617 byte log entry
0925 16:43:30.988101 (+625332us) spinlock_profiling.cc:243] Waited 3.48 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:31.366532 (+378431us) op_driver.cc:444] REPLICATION: finished
0925 16:43:31.654806 (+288274us) write_op.cc:301] APPLY: starting
0925 16:43:31.676220 (+ 21414us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:31.718982 (+ 42762us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:31.724711 (+  5729us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:32.279892 (+555181us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:32.280226 (+   334us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0925 16:43:32.280273 (+    47us) write_op.cc:312] APPLY: finished
0925 16:43:32.285556 (+  5283us) log.cc:842] Serialized 71 byte log entry
0925 16:43:32.497731 (+212175us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f7198fe45fe 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb
0925 16:43:32.786600 (+288869us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:32.797880 (+ 11280us) write_op.cc:454] Released schema lock
0925 16:43:32.809761 (+ 11881us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:32.843918 (+ 34157us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:32.843958 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":15924,"reported_tablets":22,"spinlock_wait_cycles":178715520,"child_traces":[["op",{"apply.queue_time_us":243478,"apply.run_cpu_time_us":81162,"apply.run_wall_time_us":1204474,"num_ops":9,"prepare.queue_time_us":183472,"prepare.run_cpu_time_us":34474,"prepare.run_wall_time_us":224491,"raft.queue_time_us":221109,"raft.run_cpu_time_us":28943,"raft.run_wall_time_us":218248,"replication_time_us":928835,"spinlock_wait_cycles":68892288,"thread_start_us":1083293,"threads_started":5,"wal-append.queue_time_us":1127893,"wal-append.run_cpu_time_us":10688,"wal-append.run_wall_time_us":2421422}]]}
I20260925 16:43:39.688995  8970 raft_consensus.cc:2354] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5.
I20260925 16:43:39.689357  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.648921  9043 rpcz_store.cc:276] 0925 16:43:38.357910 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.646285 (+1288375us) service_pool.cc:227] Handling call
0925 16:43:39.646735 (+   450us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.647570 (+   835us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.647793 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.686296  8975 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260925 16:43:39.675192  9041 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.731683  8973 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:39.732575  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1837) took 1861 ms (client timeout 1851 ms). Trace:
W20260925 16:43:39.733202  8973 rpcz_store.cc:269] 0925 16:43:37.871540 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.688916 (+1817376us) service_pool.cc:227] Handling call
0925 16:43:39.732451 (+ 43535us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.734365  8973 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:50010
I20260925 16:43:39.735177  8973 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:39.738329  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:39.697408  8974 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:39.739616  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1410) took 2325 ms. Trace:
I20260925 16:43:39.740031  8974 rpcz_store.cc:276] 0925 16:43:37.414271 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.696678 (+2282407us) service_pool.cc:227] Handling call
0925 16:43:39.697154 (+   476us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.739304 (+ 42150us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.739524 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.700759 11269 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:39.649498  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:39.703163  9697 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:39.704187  8871 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 3 to 4, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:39.704682 11308 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:39.704192  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 424) took 2306 ms (client timeout 2059 ms). Trace:
I20260925 16:43:39.711865  8966 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 4. Ops: []
I20260925 16:43:39.695784  8972 rpcz_store.cc:276] 0925 16:43:37.410746 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.665383 (+2254637us) service_pool.cc:227] Handling call
0925 16:43:39.665694 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.676216 (+ 10522us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:39.676378 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:39.726346  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:39.741693  8973 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:40.040091  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.003s	sys 0.006s
I20260925 16:43:39.868993  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:39.849812  9044 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:39.884632  8967 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:43:39.833065  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 160837us
I20260925 16:43:39.832952  8971 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
W20260925 16:43:39.742244  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1395) took 2333 ms (client timeout 2717 ms). Trace:
I20260925 16:43:39.843945  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:40.039840  9122 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.006s	sys 0.003s
I20260925 16:43:40.158219  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 483) took 2604 ms. Trace:
I20260925 16:43:40.161101  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1415) took 2740 ms. Trace:
I20260925 16:43:39.573915  9049 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:40.047874  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:43:40.162330  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.006s	sys 0.013s
W20260925 16:43:40.111845  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 526425us
W20260925 16:43:40.168870  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2084) took 1444 ms (client timeout 1819 ms). Trace:
I20260925 16:43:39.999684  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.169497  8966 rpcz_store.cc:276] 0925 16:43:37.417124 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.711337 (+2294213us) service_pool.cc:227] Handling call
0925 16:43:39.711670 (+   333us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.156758 (+445088us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.157460 (+   702us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:40.160202  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1831) took 2290 ms (client timeout 2105 ms). Trace:
W20260925 16:43:40.040292  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.003s	sys 0.006s
W20260925 16:43:40.169250  8975 rpcz_store.cc:269] 0925 16:43:37.409818 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.596057 (+2186239us) service_pool.cc:227] Handling call
0925 16:43:39.742175 (+146118us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:40.170038  9049 rpcz_store.cc:269] 0925 16:43:38.724917 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.559997 (+835080us) service_pool.cc:227] Handling call
0925 16:43:40.168817 (+608820us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.171449  9048 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 4. Ops: []
W20260925 16:43:40.171316  8967 rpcz_store.cc:269] 0925 16:43:37.869628 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.572994 (+1703366us) service_pool.cc:227] Handling call
0925 16:43:40.160008 (+587014us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:40.156077  9115 rpcz_store.cc:269] 0925 16:43:37.397312 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.484944 (+ 87632us) service_pool.cc:227] Handling call
0925 16:43:39.702629 (+2217685us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b5400165154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:39.703972 (+  1343us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4610723072}
I20260925 16:43:40.168442  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2086) took 1434 ms. Trace:
I20260925 16:43:40.173643  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1401) took 2762 ms. Trace:
I20260925 16:43:40.174021  9042 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
W20260925 16:43:40.038138 11559 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.013s	sys 0.029s
I20260925 16:43:40.154615 11550 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.054114 11413 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:39.970691 11469 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.029s
I20260925 16:43:39.970808 11235 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:40.177663  9122 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.006s	sys 0.014s
I20260925 16:43:40.177212  8968 raft_consensus.cc:2354] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
W20260925 16:43:39.970328  9696 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.014s	sys 0.022s
I20260925 16:43:40.176017  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1809) took 2588 ms. Trace:
I20260925 16:43:40.185906  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.176036  9044 rpcz_store.cc:276] 0925 16:43:38.725521 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.581077 (+855556us) service_pool.cc:227] Handling call
0925 16:43:40.159642 (+578565us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.178525  8971 rpcz_store.cc:276] 0925 16:43:37.411622 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.720732 (+2309110us) service_pool.cc:227] Handling call
0925 16:43:39.832679 (+111947us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.173402 (+340723us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.173587 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.048259 11453 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.043123 11467 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.169000  9047 rpcz_store.cc:276] 0925 16:43:37.549324 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.615676 (+2066352us) service_pool.cc:227] Handling call
0925 16:43:39.616364 (+   688us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.616899 (+   535us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:39.617498 (+   599us) log.cc:842] Serialized 14 byte log entry
0925 16:43:40.143073 (+525575us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:40.143143 (+    70us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:40.153341 (+ 10198us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.153440 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.153604 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":95732,"prepare.queue_time_us":181794,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":63,"raft.queue_time_us":131660,"thread_start_us":393535,"threads_started":1}
W20260925 16:43:40.176797  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.797s	user 0.007s	sys 0.012s
W20260925 16:43:40.188125  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1825) took 2320 ms (client timeout 3075 ms). Trace:
W20260925 16:43:40.192397  8968 rpcz_store.cc:269] 0925 16:43:37.867557 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.649193 (+1781636us) service_pool.cc:227] Handling call
0925 16:43:40.188068 (+538875us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.180389  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:40.187001  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.006s	sys 0.002s
I20260925 16:43:39.970525 11483 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.194746  9123 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:40.197597 11473 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.198211 11473 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.200032  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1462) took 1921 ms. Trace:
I20260925 16:43:40.200423  9048 rpcz_store.cc:276] 0925 16:43:38.278443 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.639875 (+1361432us) service_pool.cc:227] Handling call
0925 16:43:40.160745 (+520870us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.176532 (+ 15787us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.199853 (+ 23321us) spinlock_profiling.cc:243] Waited 519 ms on lock 0x7b54000d48d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:40.199977 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1194205440}
W20260925 16:43:40.195304  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.783s	user 0.006s	sys 0.003s
I20260925 16:43:40.186296  8974 rpcz_store.cc:276] 0925 16:43:37.597383 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.740936 (+2143553us) service_pool.cc:227] Handling call
0925 16:43:39.741413 (+   477us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.172292 (+430879us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:40.172326 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:40.175756 (+  3430us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:40.175802 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.175868 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.175965 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":114296,"raft.queue_time_us":430450,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":6652}
W20260925 16:43:40.191637 11469 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.804s	user 0.023s	sys 0.035s
I20260925 16:43:40.203287  9048 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:40.207507 11266 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:40.189281 11535 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.208117  8871 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:40.209893  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.211838  9041 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:40.212338 11085 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:40.189142 11413 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.223172  8972 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260925 16:43:40.225560  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 840786us
I20260925 16:43:40.229110  8969 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 6. Ops: []
I20260925 16:43:40.231302  9048 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:40.205008  9696 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.022s	sys 0.031s
I20260925 16:43:40.233987  9048 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:40.236377  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1811) took 2630 ms. Trace:
I20260925 16:43:40.234649  9049 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260925 16:43:40.235282  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.006s	sys 0.014s
I20260925 16:43:40.239251  8972 rpcz_store.cc:276] 0925 16:43:37.597816 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.180309 (+2582493us) service_pool.cc:227] Handling call
0925 16:43:40.215883 (+ 35574us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.225806 (+  9923us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.227719 (+  1913us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.240450  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.224241 11473 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.244071  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1470) took 1869 ms. Trace:
W20260925 16:43:40.244459  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.866s	user 0.007s	sys 0.014s
I20260925 16:43:40.244769  9049 rpcz_store.cc:276] 0925 16:43:38.369919 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.182564 (+1812645us) service_pool.cc:227] Handling call
0925 16:43:40.204237 (+ 21673us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.239299 (+ 35062us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.239465 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.246991  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1822) took 2422 ms. Trace:
I20260925 16:43:40.247437  8967 rpcz_store.cc:276] 0925 16:43:37.824780 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.175688 (+2350908us) service_pool.cc:227] Handling call
0925 16:43:40.189877 (+ 14189us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.242552 (+ 52675us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:40.242589 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:40.246688 (+  4099us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:40.246745 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.246813 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.246933 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9860}
W20260925 16:43:40.248893  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 522708us
I20260925 16:43:40.249809  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.250192 11488 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.250576  9041 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:40.250874 11488 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:40.252241 11505 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:40.252707 11083 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:40.253082 11083 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.254005 11083 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.256943 11266 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:40.257365 11266 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.257448  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1402) took 2845 ms. Trace:
I20260925 16:43:40.257786 11266 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:40.257959  8969 rpcz_store.cc:276] 0925 16:43:37.411950 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.677579 (+2265629us) service_pool.cc:227] Handling call
0925 16:43:39.685343 (+  7764us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.231123 (+545780us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.257167 (+ 26044us) spinlock_profiling.cc:243] Waited 530 ms on lock 0x7b54003c50d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:40.257362 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1219963264}
W20260925 16:43:40.259222 11478 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.781s	user 0.013s	sys 0.001s
I20260925 16:43:40.259754 11478 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.261335  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.262528  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.263549 11085 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:40.264089 11085 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:40.264374 11209 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:40.265276 11552 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.267163  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:40.268590  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 931852us
W20260925 16:43:40.269202  9149 heartbeater.cc:644] Failed to heartbeat to 127.7.158.254:39187 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.158.254:39187 timed out after 15.000s (SENT)
I20260925 16:43:40.270032  9043 raft_consensus.cc:2354] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7.
W20260925 16:43:40.270910 11508 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.793s	user 0.006s	sys 0.008s
I20260925 16:43:40.271039 11308 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:40.271562 11500 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.771s	user 0.013s	sys 0.000s
W20260925 16:43:40.272308  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1393) took 2864 ms (client timeout 3213 ms). Trace:
W20260925 16:43:40.272702  8970 rpcz_store.cc:269] 0925 16:43:37.408384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.612186 (+2203802us) service_pool.cc:227] Handling call
0925 16:43:40.272113 (+659927us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b54003561d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:40.272243 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":170178432}
W20260925 16:43:40.273074  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63393.4us
I20260925 16:43:40.273757  8975 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:40.274318  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1814) took 2675 ms. Trace:
I20260925 16:43:40.251482  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.262645 11478 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.204264 11453 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.222926 11469 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:40.282387 11209 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.282856 11539 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:40.284166 11512 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:40.285009  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.265354 11085 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:40.243381 11554 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 2.219s	user 0.013s	sys 0.021s
I20260925 16:43:40.287528 11615 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:43:40.287918  9047 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:40.289083 11559 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:40.290334 11473 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:40.249750 11603 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.985s	user 0.002s	sys 0.002s
I20260925 16:43:40.292112  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2039) took 2003 ms. Trace:
I20260925 16:43:40.302943  9122 rpcz_store.cc:276] 0925 16:43:38.288676 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.687962 (+399286us) service_pool.cc:227] Handling call
0925 16:43:38.688259 (+   297us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:38.688462 (+   203us) raft_consensus.cc:1520] Early marking committed up to index 2
0925 16:43:39.365179 (+676717us) log.cc:842] Serialized 14 byte log entry
0925 16:43:40.241464 (+876285us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:40.291771 (+ 50307us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:40.291845 (+    74us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.291932 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.292064 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7616,"prepare.queue_time_us":790597,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":16131,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":43928,"thread_start_us":1495077,"threads_started":2}
I20260925 16:43:40.292539 11620 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:40.274598  8975 rpcz_store.cc:276] 0925 16:43:37.623900 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.172454 (+2548554us) service_pool.cc:227] Handling call
0925 16:43:40.205196 (+ 32742us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.274120 (+ 68924us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.274275 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.294423  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.305063 11620 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.305804 11308 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:40.187328 11550 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.306644 11308 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.307019  9700 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:40.295086  9123 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:40.294965  9042 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:40.255546 11083 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.308137  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1471) took 1931 ms. Trace:
I20260925 16:43:40.307798 11308 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.308542  9042 rpcz_store.cc:276] 0925 16:43:38.377039 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.186370 (+1809331us) service_pool.cc:227] Handling call
0925 16:43:40.237410 (+ 51040us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.307894 (+ 70484us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.308072 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.309312  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.310832 11618 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.316773 11582 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:40.299455 11512 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.317864 11512 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.318854 11490 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.321660  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2089) took 1595 ms. Trace:
I20260925 16:43:40.322091  9047 rpcz_store.cc:276] 0925 16:43:38.726391 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.215538 (+1489147us) service_pool.cc:227] Handling call
0925 16:43:40.238674 (+ 23136us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.321421 (+ 82747us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.321609 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:40.301307 11554 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.360s	user 0.014s	sys 0.021s
W20260925 16:43:40.340449  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.813s (SENT)
I20260925 16:43:40.301491 11615 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.353298  8973 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.355260  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:40.360164  8966 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:40.369244 11469 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.372030  9050 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:40.352248 11488 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:40.372836 11535 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.373165 11488 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:40.373369 11535 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.374321 11488 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.375582  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:40.376159  9695 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260925 16:43:40.376967  9701 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:40.380214  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2083) took 1632 ms. Trace:
I20260925 16:43:40.380615  9044 rpcz_store.cc:276] 0925 16:43:38.724584 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.193110 (+1468526us) service_pool.cc:227] Handling call
0925 16:43:40.230665 (+ 37555us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.340880 (+110215us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:40.340909 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:40.346681 (+  5772us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:40.356359 (+  9678us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.356440 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.356585 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.357359  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:40.386430  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.387595  8973 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.351161 11615 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:40.390763 11584 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.350979  8871 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 2 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:43:40.394771  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 109969us
I20260925 16:43:40.356868  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:40.397928  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 211736us
I20260925 16:43:40.398449  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.393731  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.401556  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.399893  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50010 (request call id 1808) took 2801 ms. Trace:
I20260925 16:43:40.405323  8973 rpcz_store.cc:276] 0925 16:43:37.587017 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.734110 (+2147093us) service_pool.cc:227] Handling call
0925 16:43:40.388112 (+654002us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:40.390305  9697 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
W20260925 16:43:40.401037  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 132429us
I20260925 16:43:40.396013 11618 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:40.421401 11490 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260925 16:43:40.421828  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 112654us
I20260925 16:43:40.423117 11266 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.344357 11209 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.425168 11624 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
W20260925 16:43:40.426232  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1464) took 2116 ms (client timeout 1709 ms). Trace:
I20260925 16:43:40.426314  9045 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:40.454818  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 484) took 2905 ms. Trace:
I20260925 16:43:40.455250  9045 rpcz_store.cc:276] 0925 16:43:37.549665 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.635738 (+2086073us) service_pool.cc:227] Handling call
0925 16:43:40.426150 (+790412us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.453850 (+ 27700us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.454596 (+   746us) spinlock_profiling.cc:243] Waited 790 ms on lock 0x7b540008e650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:40.454754 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1816659840}
I20260925 16:43:40.427065  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 802) took 1616 ms. Trace:
I20260925 16:43:40.415246 11467 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.386029 11473 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.457455  9696 rpcz_store.cc:276] 0925 16:43:38.810230 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:39.383236 (+573006us) service_pool.cc:227] Handling call
0925 16:43:39.388763 (+  5527us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:39.389017 (+   254us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:39.389351 (+   334us) log.cc:842] Serialized 14 byte log entry
0925 16:43:40.404388 (+1015037us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:40.426695 (+ 22307us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:40.426785 (+    90us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.426892 (+   107us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.427010 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":54937,"prepare.queue_time_us":836250,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":96582,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":33201,"thread_start_us":848617,"threads_started":1,"wal-append.queue_time_us":1025380}
I20260925 16:43:40.427739  9119 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.430289 11634 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:40.431629 11505 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:43:40.460857 11473 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.391144 11552 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260925 16:43:40.433455 11614 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:40.437426 11413 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.438011  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.462994 11512 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.463829 11535 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:40.464509 11618 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:40.465200 11512 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.445082 11490 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.466192 11490 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:40.466681 11508 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:40.466883  9694 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:40.467245 11508 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:40.468262 11508 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.470924 11428 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:40.471511  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2081) took 2940 ms. Trace:
I20260925 16:43:40.431803 11584 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.438504 11550 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.414985  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.473430 11584 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:40.440459  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 119511us
I20260925 16:43:40.461397  9699 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:40.475160  9119 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:40.441241 11453 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.441314 11620 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:40.440501 11483 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.448721  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1812) took 2850 ms. Trace:
I20260925 16:43:40.510903  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.512308  9119 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:40.449404  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.014s (SENT)
I20260925 16:43:40.449577  8871 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:40.451785 11624 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.452186 11209 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:40.448155  9050 rpcz_store.cc:269] 0925 16:43:38.310624 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.675759 (+365135us) service_pool.cc:227] Handling call
0925 16:43:40.425985 (+1750226us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540008e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:40.426148 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3300417408}
I20260925 16:43:40.461382 11266 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:40.471956  9046 rpcz_store.cc:276] 0925 16:43:37.531426 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:37.973329 (+441903us) service_pool.cc:227] Handling call
0925 16:43:37.973605 (+   276us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:37.973920 (+   315us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:37.973941 (+    21us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:38.093895 (+119954us) log.cc:842] Serialized 26 byte log entry
0925 16:43:38.721053 (+627158us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:38.721094 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:38.721151 (+    57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:40.234479 (+1513328us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:40.471091 (+236612us) raft_consensus.cc:1671] finished
0925 16:43:40.471110 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.471341 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":260957,"raft.queue_time_us":738,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":32864,"spinlock_wait_cycles":230541184,"thread_start_us":440874,"threads_started":1,"wal-append.queue_time_us":790607}
I20260925 16:43:40.488308 11615 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.520632 11624 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.522373 11624 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:40.522678 11615 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:40.510993  8966 rpcz_store.cc:276] 0925 16:43:37.598063 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.180778 (+2582715us) service_pool.cc:227] Handling call
0925 16:43:40.196927 (+ 16149us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:40.360636 (+163709us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.448528 (+ 87892us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54001b3fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:40.448671 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":374868864}
I20260925 16:43:40.512681  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:40.529034  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 96405.9us
W20260925 16:43:40.529209  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82301.5us
I20260925 16:43:40.533851  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.538398  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:40.474476 11634 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:40.534596  9697 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:40.543422  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.475086 11623 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260925 16:43:40.548069  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 101030us
I20260925 16:43:40.528606  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.543286  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.549361  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:40.560322  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.562209  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.561770  9700 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:40.558203  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:40.565414  9702 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:40.541505 11634 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:40.573241  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:40.576361  9695 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.561040  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.561503  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.577500  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.578228  9115 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:40.580093  9120 raft_consensus.cc:1203] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 3.6->[5.7-5.7]   Dedup: 5.7->[]
I20260925 16:43:40.580574  9120 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260925 16:43:40.581689 11486 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260925 16:43:40.584812  9122 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:40.586397 11619 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:43:40.586541 11083 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:40.587133  9123 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:40.588886  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:40.592087  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 172938us
I20260925 16:43:40.592655 11209 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260925 16:43:40.593123  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.016s (SENT)
I20260925 16:43:40.593695  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.594105 11209 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:40.594924 11308 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:40.595098 11209 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:43:40.549012 11623 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:40.595853 11620 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:40.596007 11623 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:40.596284 11620 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:40.597227 11620 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.598569 11620 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:40.600837  9015 connection.cc:232] RPC call timeout handler was delayed by -1.5557072429999153s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2879s for a response
I20260925 16:43:40.603611  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:40.551456  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 583) took 2227 ms (client timeout 1709 ms). Trace:
W20260925 16:43:40.604952  9694 rpcz_store.cc:269] 0925 16:43:38.319999 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:38.322883 (+  2884us) service_pool.cc:227] Handling call
0925 16:43:39.673160 (+1350277us) spinlock_profiling.cc:243] Waited 3.73 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:40.536062 (+862902us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b54006bce54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:40.547675 (+ 11613us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1383577088}
I20260925 16:43:40.606942 11584 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:40.608079 11584 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:40.610119 11584 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:40.610496 11584 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.611325  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1834) took 2740 ms. Trace:
I20260925 16:43:40.612805 11209 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:40.611900  8968 rpcz_store.cc:276] 0925 16:43:37.870595 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.195958 (+2325363us) service_pool.cc:227] Handling call
0925 16:43:40.242792 (+ 46834us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:40.328499 (+ 85707us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:40.328537 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:40.354718 (+ 26181us) log.cc:842] Serialized 26 byte log entry
0925 16:43:40.481192 (+126474us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:40.481237 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.481317 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:40.611037 (+129720us) raft_consensus.cc:1671] finished
0925 16:43:40.611066 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.611249 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":118865,"threads_started":1,"wal-append.queue_time_us":246695}
I20260925 16:43:40.587162 11083 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.558012 11266 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:40.613837 11209 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.614387  9116 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:40.586432 11564 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.619222 11564 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.621562 11564 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:40.617214  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63472us
I20260925 16:43:40.615159 11083 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:40.633628  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2038675669998611s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260925 16:43:40.635563  9698 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:40.574914 11235 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260925 16:43:40.643901  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91740us
I20260925 16:43:40.644304 11512 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:40.643967 11488 raft_consensus.cc:2741] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260925 16:43:40.652068  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.652709  9117 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:40.653431  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.658078  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:40.660181  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.705265  9699 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:40.705754  9118 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.661295  9120 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:40.662083  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.670461  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:40.706916  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1822930729999825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260925 16:43:40.707273  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.707515  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.707930  9120 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:40.675848 11553 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:40.708590 11428 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:40.708665 11553 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.709002  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.709189 11428 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:40.710268  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.710163 11428 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.710888  9120 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:40.681022  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.689183  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:40.689435  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:40.690313  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:40.690564  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:40.684799  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:40.691360  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:40.672098  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 135607us
I20260925 16:43:40.702628  9702 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:40.710000 11553 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.708232  9123 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:40.711665  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.701233  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:40.711896  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.510s (SENT)
W20260925 16:43:40.706888  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44936.2us
I20260925 16:43:40.720835 11620 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:40.714210  9043 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:40.714745  9698 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:40.723232  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.717216  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:40.723949  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0688930730000266s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260925 16:43:40.718907  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 76864.7us
W20260925 16:43:40.725121  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0625930730000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1726s for a response
I20260925 16:43:40.718225  9123 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:40.713888  9047 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:40.717276 11553 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.724577 11413 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:40.729933 11413 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.730378 11413 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:43:40.731789  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0436930729999858s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17470000000000002s for a response
W20260925 16:43:40.737068  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 262907us
I20260925 16:43:40.742646  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:40.750511  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69605.6us
I20260925 16:43:40.641578 11266 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:40.757122  8940 leader_election.cc:398] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7.
I20260925 16:43:40.771888  8940 leader_election.cc:401] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:40.754022 11512 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:40.759922 11488 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:43:40.611462 11584 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.778358  9699 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:40.763955  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:40.764123  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.768481  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:40.768911  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:40.769590  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0238930729999538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1769s for a response
I20260925 16:43:40.769903 11235 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:40.770736  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1832) took 2900 ms. Trace:
I20260925 16:43:40.771291  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.772778  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:40.786826  9119 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:40.790036  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.781888  8971 rpcz_store.cc:276] 0925 16:43:37.869938 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:40.205400 (+2335462us) service_pool.cc:227] Handling call
0925 16:43:40.220451 (+ 15051us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:40.271618 (+ 51167us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:40.271645 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:40.272113 (+   468us) log.cc:842] Serialized 26 byte log entry
0925 16:43:40.411952 (+139839us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:40.412001 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:40.412086 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:40.770555 (+358469us) raft_consensus.cc:1671] finished
0925 16:43:40.770573 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:40.770688 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":135263,"threads_started":1,"wal-append.queue_time_us":478049}
I20260925 16:43:40.754393 11467 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election won for term 3
W20260925 16:43:40.809365  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.565s (SENT)
I20260925 16:43:40.809819  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.781741 11235 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.811761  9118 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:40.792357  9041 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:40.822127  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:40.822674  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.593s (SENT)
I20260925 16:43:40.823093  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:40.823323  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.713s (SENT)
I20260925 16:43:40.819885 11235 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:40.821099 11512 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.795301 11486 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
W20260925 16:43:40.820551  9666 leader_election.cc:334] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.970s (SENT)
I20260925 16:43:40.779373 11308 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260925 16:43:40.825637  9122 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:40.798064 11473 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:40.829762  9046 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:40.817821 11584 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:40.789069 11469 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260925 16:43:40.841216  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 84277.8us
I20260925 16:43:40.840378  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:40.845724  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.847877  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.836078 11564 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:40.850988  9115 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:40.851507  9045 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:43:40.824270 11552 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260925 16:43:40.846544 11620 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260925 16:43:40.839860 11473 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:40.855360  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:40.840142 11209 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:40.843183 11083 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:40.842155 11467 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:43:40.823818 10693 consensus_queue.cc:1159] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 6 status { last_received { term: 5 index: 7 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:43:40.865125 11473 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:40.865283  9696 pending_rounds.cc:76] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 7
I20260925 16:43:40.860462 11553 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:40.866024 11552 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Stepping down as leader of term 2
W20260925 16:43:40.866863  9015 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.851s (SENT)
W20260925 16:43:40.867966  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 214105us
W20260925 16:43:40.869513  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46859.8us
W20260925 16:43:40.870030  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49529.4us
I20260925 16:43:40.789634 11634 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:40.873379  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 73621.3us
I20260925 16:43:40.883623  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:40.848356 11486 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.858633 11085 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:40.843657 11490 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:40.887317 11308 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:40.939625  9698 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:40.887670  9696 pending_rounds.cc:97] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 5.8
W20260925 16:43:40.944629  9089 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.719s (SENT)
I20260925 16:43:40.945076  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:40.892700 11083 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.892690 11552 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:40.893249 11500 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:40.951191 11611 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:40.906530 11483 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260925 16:43:40.899127 11364 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:40.953727 11488 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:40.954146 11498 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.956172 11428 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:40.956686 11490 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:40.956856 11553 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:40.957612  9041 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:43:40.944965  9696 raft_consensus.cc:2866] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:40.960520 11662 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:40.942983 11266 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:40.964672  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105932us
I20260925 16:43:40.968122 11659 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:40.973658  9695 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
W20260925 16:43:40.974480  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77559.5us
W20260925 16:43:40.979403  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 130001us
I20260925 16:43:40.975930 11085 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:43:40.996855  8939 connection.cc:232] RPC call timeout handler was delayed by -1.2875189720000435s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16790000000000002s for a response
W20260925 16:43:40.999296  8939 connection.cc:232] RPC call timeout handler was delayed by -1.2254189719999431s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1748s for a response
W20260925 16:43:40.999719  8939 connection.cc:232] RPC call timeout handler was delayed by -1.1948189719998936s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260925 16:43:41.000068  8939 connection.cc:232] RPC call timeout handler was delayed by -1.0877189719999478s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
W20260925 16:43:41.000378  8939 connection.cc:232] RPC call timeout handler was delayed by -1.0499189719998867s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19430000000000003s for a response
I20260925 16:43:40.978777 11364 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:40.987257 11620 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:40.987229 11611 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:41.006366  9666 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.030s (SENT)
W20260925 16:43:41.007016  8939 connection.cc:232] RPC call timeout handler was delayed by -1.0139189720000559s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19830000000000003s for a response
I20260925 16:43:41.012806  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:40.992610 11553 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:41.019742  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:41.019833  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 80596.7us
I20260925 16:43:40.994992 11662 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:41.005765 11364 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:40.970548 11467 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.991420 11500 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.990917 11428 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:40.988927 11498 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.014879 11535 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260925 16:43:41.029506 11614 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.097869 11532 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:41.097681 11658 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:41.132869 11085 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.113754 11500 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:41.161294  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:41.196604  9049 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:41.052816 11083 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.160584  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:41.197225 11498 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.108289 11413 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:41.077590  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52827.9us
I20260925 16:43:41.131958  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:41.133895 11611 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.122099  9117 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
W20260925 16:43:41.062142  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55817.7us
W20260925 16:43:41.107981  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.747s (SENT)
I20260925 16:43:41.133541 11428 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:41.105664 11657 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:41.172466  9119 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:43:41.170852 11659 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:41.209936  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:41.210721  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:41.177163  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:41.211517  9046 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:41.181510  9699 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:41.024356 11552 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.183820 11634 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 4
I20260925 16:43:41.031165 11486 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.206941  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:41.217173  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:41.039197 11623 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.210704  9701 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:41.220801  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:41.212436  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:41.214412  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:41.225087  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:41.225814  9045 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:43:41.107872 11662 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.181866 11266 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.036s
I20260925 16:43:41.227151  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:41.223097  9049 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:41.236279  9044 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:41.239455 10693 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:41.239863 10693 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:41.240185 10693 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:41.244334  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 224759us
W20260925 16:43:41.244972  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.065s (SENT)
I20260925 16:43:41.225310 11659 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:41.248713 11662 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:41.249326 11659 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:41.256183  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 214117us
I20260925 16:43:41.185647 11235 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:41.266013  9046 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:41.267971 11413 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.222985 11614 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260925 16:43:41.270720  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:41.271160  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.769s (SENT)
I20260925 16:43:41.252048 11564 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:41.251829 11552 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:41.273525  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:41.244139 11584 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:41.279247  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:41.279496 11584 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.281674 11584 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.282413 11473 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:41.283077  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.807s (SENT)
I20260925 16:43:41.283213  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:41.231619 11618 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260925 16:43:41.284062  9116 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260925 16:43:41.284368 11473 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:41.284502 11618 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:41.274369  9695 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:41.286351 11512 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:41.286705 11512 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:41.283483  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:41.292471  9695 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:43:41.278240  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:41.293560  9046 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 8
I20260925 16:43:41.297164  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:41.203423 11658 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.296041 10693 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.301837  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:41.303984  9124 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:41.304210 10693 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.307435  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:41.310814  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77895.5us
W20260925 16:43:41.313386  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49011.9us
I20260925 16:43:41.313730 11532 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:41.314177 11532 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:41.314450 11678 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.314702 11658 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.315932  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:41.296303 11624 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:41.317312 11624 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.287451 11512 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.321468  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:41.314170  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:41.224321 11657 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.323879  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:41.297791 11618 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.332268  9698 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
W20260925 16:43:41.305821 11673 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260925 16:43:41.336833 11512 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:41.337965  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:41.341671  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:41.324746 11564 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:41.352881  9046 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:43:41.356617 11564 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.363720  9045 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:41.366573 11498 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:41.367141 11498 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.369165 11488 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7.
W20260925 16:43:41.370283  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 73202us
I20260925 16:43:41.370440  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:41.382686  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 99640.8us
I20260925 16:43:41.382968  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:41.337939 11553 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:41.386152  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 72064.2us
I20260925 16:43:41.387760  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:41.385351  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:41.392985  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:41.370043 11308 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:41.300979 11677 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
W20260925 16:43:41.398010  9015 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.519s (SENT)
I20260925 16:43:41.371125 11624 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.398612  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:41.377179 11658 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:41.400363  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:41.376247 11490 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:41.403244 10693 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.401443  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:41.405246 10693 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:41.369186 11498 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.376235 11687 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:41.382160 11623 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.383121 11678 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:43:41.429960  9089 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.957s (SENT)
I20260925 16:43:41.433353  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:41.430995 11665 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.147s	user 0.003s	sys 0.000s
I20260925 16:43:41.432075 11553 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:41.396468 11308 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:41.437484  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:41.403432  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:41.461221  9046 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:41.442670 11685 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:43:41.464779 11669 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:41.442381 11678 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:41.465889 11685 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:41.466297 11685 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:41.465977 11364 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.467092 11685 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:41.467834  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:41.454934 11235 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:41.471633  9042 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:41.468533 11685 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:41.474794  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81563.7us
I20260925 16:43:41.472644  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:41.442760  9121 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:41.415113 11658 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:43:41.484448  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 89567.3us
I20260925 16:43:41.485348  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:41.486114  9015 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.548s (SENT)
I20260925 16:43:41.441058 11308 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:41.491343  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:41.493642  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81004.6us
I20260925 16:43:41.462551 11657 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:41.496040  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.981s (SENT)
W20260925 16:43:41.497022  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.041s (SENT)
I20260925 16:43:41.497399  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:41.454705 11680 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:41.499959 11680 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.501873 11680 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:41.489032 11618 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.503394  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:41.503998  9123 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:41.504359 11364 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:41.505064 11678 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:41.512281  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:41.502966  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:41.509104  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:41.507768 11473 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:41.521696  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:41.523103  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:41.525381  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:41.525665  9124 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:41.579128  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 93872.6us
W20260925 16:43:41.590029  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 81158.3us
I20260925 16:43:41.527141  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:41.527958  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89565.4us
W20260925 16:43:41.609674  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 134311us
I20260925 16:43:41.518885 11364 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.526729 11235 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:41.526592 11645 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:41.527061 11490 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:41.552416  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:41.551901  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
W20260925 16:43:41.747370 11689 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.259s	user 0.000s	sys 0.001s
W20260925 16:43:41.759171 11693 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.161s	user 0.001s	sys 0.000s
W20260925 16:43:41.811661  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 314649us
I20260925 16:43:41.563721 11453 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.123s
I20260925 16:43:41.592751 11539 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:41.876452  9047 raft_consensus.cc:595] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:41.884178  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:41.764573 11673 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260925 16:43:41.656451 11677 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:41.638450 11467 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.201s
W20260925 16:43:42.281204 11664 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260925 16:43:41.835517 11687 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:42.283258 11680 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:42.282173  9047 raft_consensus.cc:603] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:41.933667 11662 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:41.909255  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
W20260925 16:43:42.281213  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 445813us
W20260925 16:43:42.014133  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.089s (SENT)
I20260925 16:43:42.291667 11584 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.293577  9123 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:42.299260  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:41.907470 11532 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.014s
W20260925 16:43:42.177877 11692 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.285s	user 0.000s	sys 0.000s
W20260925 16:43:42.015832 11689 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260925 16:43:42.281945 11694 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
W20260925 16:43:42.267027 11512 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.913s	user 0.009s	sys 0.000s
W20260925 16:43:42.249716 11552 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.953s	user 0.007s	sys 0.003s
W20260925 16:43:42.266351 11700 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.300s	user 0.002s	sys 0.000s
I20260925 16:43:42.049942  9696 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260925 16:43:42.358096 11697 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260925 16:43:42.359755  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2072) took 1071 ms. Trace:
W20260925 16:43:42.359907  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 711101us
I20260925 16:43:42.360730  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:42.362115  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:42.362931 11467 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:42.363523 11467 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:42.314296 11584 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:42.365636 11691 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.716s	user 0.001s	sys 0.000s
I20260925 16:43:42.307971 11662 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.366181  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:42.366871  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 608) took 1137 ms. Trace:
I20260925 16:43:42.032228 11688 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:42.368369 11688 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:42.351377  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 361568us
I20260925 16:43:41.840984 11658 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.296875 11680 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:42.367807 11662 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:42.381098  9123 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:43:42.340212 11083 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:42.341002 11659 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:42.302785 11687 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:42.372399  9693 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:42.411505 11680 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:42.409881  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:42.352056 11685 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.874s	user 0.009s	sys 0.000s
W20260925 16:43:42.451071  9089 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.228s (SENT)
I20260925 16:43:42.432150 10693 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260925 16:43:42.476022  9117 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:42.481082  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:42.367234  9701 rpcz_store.cc:276] 0925 16:43:41.229014 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:41.229129 (+   115us) service_pool.cc:227] Handling call
0925 16:43:41.244248 (+ 15119us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:41.244556 (+   308us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:41.244593 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:41.258400 (+ 13807us) log.cc:842] Serialized 26 byte log entry
0925 16:43:41.379005 (+120605us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:41.379040 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:41.379119 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:42.364949 (+985830us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:42.366593 (+  1644us) raft_consensus.cc:1671] finished
0925 16:43:42.366621 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:42.366813 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":9889,"spinlock_wait_cycles":32294784,"thread_start_us":80718,"threads_started":1,"wal-append.queue_time_us":213992}
I20260925 16:43:42.360176  9116 rpcz_store.cc:276] 0925 16:43:41.288136 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:41.288635 (+   499us) service_pool.cc:227] Handling call
0925 16:43:41.305646 (+ 17011us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:41.306122 (+   476us) raft_consensus.cc:1520] Early marking committed up to index 2
0925 16:43:41.306148 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:41.306735 (+   587us) log.cc:842] Serialized 26 byte log entry
0925 16:43:41.399565 (+ 92830us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:41.399601 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:41.399661 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:42.359525 (+959864us) raft_consensus.cc:1671] finished
0925 16:43:42.359552 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:42.359680 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":698,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":82,"thread_start_us":90489,"threads_started":1,"wal-append.queue_time_us":263591}
I20260925 16:43:42.466709  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:42.409158 11624 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.369475 11688 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:42.340042 11677 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.498350  9121 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 2. (index mismatch)
I20260925 16:43:42.499265  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:42.419900 11662 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.410588 11554 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:42.505069  9047 raft_consensus.cc:595] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:42.512591  9047 raft_consensus.cc:603] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:42.365646 11584 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:42.345691 11532 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.451762 11083 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:43:42.497305 11634 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.279s	user 0.006s	sys 0.005s
I20260925 16:43:42.486799 11500 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.511999 10693 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20260925 16:43:42.495044 11364 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:42.386814 11553 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.136s
W20260925 16:43:42.504582 11473 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.861s	user 0.035s	sys 0.011s
I20260925 16:43:42.527760  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 610) took 1231 ms. Trace:
I20260925 16:43:42.475353 11657 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260925 16:43:42.517330 11645 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:42.546173  9695 rpcz_store.cc:276] 0925 16:43:41.296745 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:41.296865 (+   120us) service_pool.cc:227] Handling call
0925 16:43:41.297188 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:41.310706 (+ 13518us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:41.310753 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:41.320295 (+  9542us) log.cc:842] Serialized 26 byte log entry
0925 16:43:41.427138 (+106843us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:41.427182 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:41.427270 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:42.527508 (+1100238us) raft_consensus.cc:1671] finished
0925 16:43:42.527535 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:42.527681 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":4629,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7028,"thread_start_us":93696,"threads_started":1,"wal-append.queue_time_us":637746}
I20260925 16:43:42.520998 11662 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:42.568883  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44914.6us
I20260925 16:43:42.531652 11710 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:42.542075 11473 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.035s	sys 0.012s
I20260925 16:43:42.541406 11364 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:42.510023 11624 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:42.596359  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53866.8us
W20260925 16:43:42.602771  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 181924us
I20260925 16:43:42.598331  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:42.586848 11473 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:42.611933  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:42.592144 11364 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:42.541441 11500 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.635437  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:42.597296 11539 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:42.594136  9694 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:42.640074  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a5837876dc21490e819ef69131e93921"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:42.641132  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:42.648298 11662 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:42.640043 11713 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:42.644750 11085 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:42.663416  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2105) took 1154 ms. Trace:
I20260925 16:43:42.619140 11687 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:42.594707 11710 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.685602  9047 raft_consensus.cc:595] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
W20260925 16:43:42.692266  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51208.7us
I20260925 16:43:42.695684  9047 raft_consensus.cc:603] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:42.643252 11512 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:42.689291  9042 rpcz_store.cc:276] 0925 16:43:41.509198 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:41.519359 (+ 10161us) service_pool.cc:227] Handling call
0925 16:43:41.589023 (+ 69664us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:41.648095 (+ 59072us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:41.648138 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:41.827607 (+179469us) log.cc:842] Serialized 26 byte log entry
0925 16:43:42.476391 (+648784us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:42.476537 (+   146us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:42.476862 (+   325us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:42.663187 (+186325us) raft_consensus.cc:1671] finished
0925 16:43:42.663206 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:42.663341 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":35428,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":44208,"thread_start_us":476858,"threads_started":1,"wal-append.queue_time_us":781965}
W20260925 16:43:42.699561  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 120142us
I20260925 16:43:42.682821 11645 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.643378 11453 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.060s
I20260925 16:43:42.711537  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:42.701190 11708 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.057s	user 0.001s	sys 0.002s
I20260925 16:43:42.699323 11662 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.697016 11634 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:42.709985  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260925 16:43:42.698936 11675 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.741389  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:42.741962 11714 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260925 16:43:42.742115  9046 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:42.742292  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:42.743021 11685 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:42.743279  9042 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:42.743825 11477 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c694676902c54ad8bfe8e7fd5a725e33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:43:42.701313 11085 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:42.741393  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:42.739101  9043 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:43:42.749758  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:42.752655  9047 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:42.761345 11624 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:42.641392 11083 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:42.757012  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260925 16:43:42.789443  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87605.3us
I20260925 16:43:42.737288 11532 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:42.744998 11634 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:42.834268  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:42.752440 11677 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:42.863170  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 72843.5us
I20260925 16:43:42.749294 11675 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.852819  9047 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:43:42.836493  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:42.855986  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 139754us
I20260925 16:43:42.708235 11512 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.744652 11662 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:42.835268 11634 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:42.868351  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:42.876338  9042 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:42.763329 11706 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:42.710716 11645 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:42.718514 11539 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.937440 11706 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:42.939077 11702 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.194s	user 0.000s	sys 0.000s
I20260925 16:43:42.938586 11706 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.878472 11722 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.086s
I20260925 16:43:42.940521 11706 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:42.877538  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:42.936997  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73043.7us
I20260925 16:43:42.878520  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:42.947152  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68709us
I20260925 16:43:42.950870  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:42.889796 11701 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.247s	user 0.003s	sys 0.000s
W20260925 16:43:42.890290 11308 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.366s	user 0.009s	sys 0.005s
I20260925 16:43:42.959980  9046 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:42.765057 11085 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:42.967106 11308 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:42.950776  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:42.969026  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 354698us
I20260925 16:43:42.964541  9042 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:42.970814  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:42.971336  9117 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:42.971493  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:42.972326  9693 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:42.973799  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:42.974529  9699 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:42.899181 11690 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.248s	user 0.006s	sys 0.007s
I20260925 16:43:42.904263  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 826) took 1434 ms. Trace:
W20260925 16:43:42.980111  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.014s
I20260925 16:43:42.968431 11085 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:42.896847 11662 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:42.982698  9117 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260925 16:43:42.880779 11675 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:42.895036 11512 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:42.898507 11498 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:42.882997 11710 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:42.968254  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.042s	user 0.003s	sys 0.016s
I20260925 16:43:42.831972 11473 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:43.001881  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.075s	user 0.003s	sys 0.016s
I20260925 16:43:43.004302  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:42.979125 11611 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.477s	user 0.006s	sys 0.023s
W20260925 16:43:42.980618  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.005s	sys 0.014s
I20260925 16:43:42.893090 11364 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:43.006656  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:43.025311 11453 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:43.025396 11266 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:43.025867 11453 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.028262 11453 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:43.013638 11611 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.511s	user 0.007s	sys 0.023s
I20260925 16:43:43.029788 11677 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260925 16:43:43.033269  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68236.3us
I20260925 16:43:43.034049  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:43.035230  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:43.036202 11685 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:43.037513 11659 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:43.039201  9699 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:42.985385 11085 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:43.040978  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:43.012844 11675 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:43:43.047688 11659 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:43.048875 11364 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:43.025493 11308 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.051019 11709 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:43.051760  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:43.088632  9122 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:43.052948  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2098) took 1843 ms (client timeout 2213 ms). Trace:
I20260925 16:43:43.055548 11552 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:43.012984 11498 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:43.059890 11623 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.016620 11710 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.020990 11564 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.075212  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:43.088369 11709 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:43.100170 11685 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:43:43.100805  9043 rpcz_store.cc:269] 0925 16:43:41.209668 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:41.209782 (+   114us) service_pool.cc:227] Handling call
0925 16:43:43.052807 (+1843025us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54002265d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:43.052898 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2646655872}
I20260925 16:43:43.056717  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:43.101405  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:43.321470  9050 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:43.321688  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:43.322420  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 287266us
I20260925 16:43:42.980551  9694 rpcz_store.cc:276] 0925 16:43:41.469465 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:41.470465 (+  1000us) service_pool.cc:227] Handling call
0925 16:43:41.470781 (+   316us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:42.693103 (+1222322us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:42.903940 (+210837us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54006eda54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:42.904191 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2478177664}
I20260925 16:43:43.338100  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:43.219884  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:43.325552  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:43.345180  9699 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:43.325846  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:43.220011  9044 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:43.326706  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:43.326192  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 269538us
I20260925 16:43:43.061590 11669 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.340268  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:43.067850 11659 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:43.288199  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 467822us
W20260925 16:43:43.157567  9015 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.897s (SENT)
W20260925 16:43:43.323606 11678 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.683s	user 0.018s	sys 0.023s
W20260925 16:43:43.257988 11658 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.010s	sys 0.030s
I20260925 16:43:43.164115 11308 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.324203 11266 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:43.132081 11657 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.326704 11709 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:43.139007 11364 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.262271 11500 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:43.339766 11486 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:43.356786  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:43.356442 11678 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.719s	user 0.019s	sys 0.023s
I20260925 16:43:43.132090 11675 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:43.075577 11085 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.353070  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:43.324052 11710 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:43.334518 11623 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.373454 11685 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:43.370877 11308 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.342249 11564 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.392738 11364 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.397773  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:43.361714 11645 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:43.366727 11727 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:43.402694  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0072418590000325s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1575s for a response
I20260925 16:43:43.375824  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:43.334358 11552 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.407049  9122 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:43.355861 11669 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.390509 11486 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:43.424651  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 476659us
W20260925 16:43:43.407778 11620 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.909s	user 0.013s	sys 0.021s
I20260925 16:43:43.428364  9119 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:43.433282  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.575s (SENT)
I20260925 16:43:43.378742 11657 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:43.399941  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:43.437057  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 420156us
I20260925 16:43:43.421047 11685 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:43.427407 11083 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.016s	sys 0.048s
I20260925 16:43:43.386355 11658 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.049s
I20260925 16:43:43.379199 11266 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.495134  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:43.492386 11486 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:43.541805  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 108547us
W20260925 16:43:43.542373  9666 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.590s (SENT)
I20260925 16:43:43.542699  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:43.542764 11266 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.501747  9042 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:43.543726  9041 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:43.544394 11614 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:43.545089 11614 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:43.513314  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 143947us
W20260925 16:43:43.546016  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 171734us
I20260925 16:43:43.547075  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:43.548635  9666 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.767s (SENT)
I20260925 16:43:43.514950 11685 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:43.515931 11308 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.517701 11552 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.524577 11623 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.525257 11498 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:43.526587 11657 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:43.528846 11669 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:43.500733 11620 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.995s	user 0.013s	sys 0.022s
I20260925 16:43:43.517686 11364 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:43.568333 11729 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.123s	user 0.000s	sys 0.000s
I20260925 16:43:43.568470  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:43.569020  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 411467us
I20260925 16:43:43.569355  8972 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:43.570356 11623 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:43.570566 11085 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.570889  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:43.536252 11706 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.577s	user 0.008s	sys 0.001s
I20260925 16:43:43.536590  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:43.574628  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.575387  8972 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260925 16:43:43.532250 11083 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.018s	sys 0.048s
I20260925 16:43:43.502379 11512 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:43.578279 11732 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
I20260925 16:43:43.580029 11477 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42268 (request call id 765) took 9693 ms. Trace:
I20260925 16:43:43.580430 11477 rpcz_store.cc:276] 0925 16:43:33.914937 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:33.936734 (+ 21797us) service_pool.cc:227] Handling call
0925 16:43:34.569068 (+632334us) ts_tablet_manager.cc:928] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
0925 16:43:42.531456 (+7962388us) tablet_copy_client.cc:361] Tablet copy session begun
0925 16:43:43.531667 (+1000211us) tablet_metadata.cc:641] Metadata flushed
0925 16:43:43.534839 (+  3172us) tablet_copy_client.cc:490] Wrote new tablet metadata
0925 16:43:43.579199 (+ 44360us) tablet_copy_client.cc:411] Wrote new consensus metadata
0925 16:43:43.579483 (+   284us) tablet_replica.cc:205] Creating consensus instance
0925 16:43:43.579831 (+   348us) ts_tablet_manager.cc:983] Replica registered.
0925 16:43:43.579923 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":308,"tablet-copy.queue_time_us":592770,"thread_start_us":276753,"threads_started":2}
I20260925 16:43:43.583326 11477 tablet_copy_client.cc:791] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:43:43.584385  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.584973  8972 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 7
I20260925 16:43:43.586033 11477 tablet_copy_client.cc:655] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:43:43.590853  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.591939  8968 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
W20260925 16:43:43.594056  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.502s (SENT)
I20260925 16:43:43.594489  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:43.553634  9119 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:43.556172  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:43.557042  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:43.559829  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:43.595919  9124 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260925 16:43:43.596138  9115 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:43.596408 11706 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:43.561278  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.597571  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.561986  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.562062  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.598532  8970 raft_consensus.cc:2354] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4.
I20260925 16:43:43.598600  8966 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:43.599294  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.599745  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.600616  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.600888  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.601583  8966 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:43.601629  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.602324  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.602859  8966 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:43.562822  8971 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260925 16:43:43.603860  8971 pending_rounds.cc:76] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 6
I20260925 16:43:43.604121  8971 pending_rounds.cc:97] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260925 16:43:43.604390  8971 raft_consensus.cc:2866] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:43.563061  8973 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:43.563809  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.605438  8967 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:43.540143 11675 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:43.603551  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:43.606176  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.505s (SENT)
W20260925 16:43:43.608458  9015 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.054s (SENT)
I20260925 16:43:43.608914  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:43.609105  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:43.609975  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:43.613476  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:43.554405 11539 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.002s	sys 0.033s
I20260925 16:43:43.558681 11726 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.618376  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:43.618471  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.105s (SENT)
I20260925 16:43:43.616802  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:43.619221  9124 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:43.610198  8969 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:43.617630  8966 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:43.620357 11559 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:43:43.620833 11728 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260925 16:43:43.621448  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:43.621803  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.115s (SENT)
I20260925 16:43:43.590052 11677 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:43.435513 11727 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:43.622597  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.581s	user 0.020s	sys 0.030s
W20260925 16:43:43.638001  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.020s	sys 0.030s
I20260925 16:43:43.610859 11364 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:43.643512  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:43.619925 11539 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.002s	sys 0.033s
I20260925 16:43:43.647394  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.648169  8973 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:43.656134  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 107514us
I20260925 16:43:43.673349  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.674228  8966 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:43.589437 11685 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.675017  9122 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:43.678382  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:43.678710  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.782s (SENT)
I20260925 16:43:43.678987  8967 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:43.679132  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:43.681224  8968 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:43.640203 11734 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:43.684718  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.645658  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.685444  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.688055  8971 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:43.642937 11564 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:43.689527  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:43.690210  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 333874us
I20260925 16:43:43.693176  8974 raft_consensus.cc:2354] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
W20260925 16:43:43.693959  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72178us
W20260925 16:43:43.699713  9015 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.138s (SENT)
I20260925 16:43:43.709432 11512 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.710116 11512 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:43.713418 11512 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:43.674989 11715 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:43.739475  8972 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
W20260925 16:43:43.751390  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51742us
W20260925 16:43:43.754734  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 97789.8us
I20260925 16:43:43.755260  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.756049  8968 raft_consensus.cc:2362] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6. Re-sending same reply.
I20260925 16:43:43.756253  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.756915  8971 raft_consensus.cc:2362] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3. Re-sending same reply.
W20260925 16:43:43.759001  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 57041.9us
I20260925 16:43:43.760569  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2089) took 1252 ms. Trace:
I20260925 16:43:43.636171 11726 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.686021 11539 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:43.765621  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.159s (SENT)
I20260925 16:43:43.781687  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:43.760993  9121 rpcz_store.cc:276] 0925 16:43:42.508432 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:42.508618 (+   186us) service_pool.cc:227] Handling call
0925 16:43:42.528743 (+ 20125us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:42.593750 (+ 65007us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:42.593792 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:42.601022 (+  7230us) log.cc:842] Serialized 26 byte log entry
0925 16:43:43.004459 (+403437us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:43.004511 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:43.580371 (+575860us) spinlock_profiling.cc:243] Waited 54 ms on lock 0x7b5400040954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:43.580414 (+    43us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:43.620230 (+ 39816us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:43.760342 (+140112us) raft_consensus.cc:1671] finished
0925 16:43:43.760369 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:43.760511 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9725,"raft.queue_time_us":2688,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":7011,"spinlock_wait_cycles":131850368,"thread_start_us":361663,"threads_started":1,"wal-append.queue_time_us":778632}
I20260925 16:43:43.687484 11710 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:43.790627  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.797730  8967 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:43.751035 11687 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:43.803481  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.805089  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.807449  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.808230  8971 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:43.812224  8967 raft_consensus.cc:2354] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:43.815626 11727 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:43.818106 11736 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
W20260925 16:43:43.819819 11737 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260925 16:43:43.821079  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2090) took 1271 ms. Trace:
I20260925 16:43:43.821508  9116 rpcz_store.cc:276] 0925 16:43:42.549735 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:42.582707 (+ 32972us) service_pool.cc:227] Handling call
0925 16:43:42.596072 (+ 13365us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:42.620196 (+ 24124us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:42.635998 (+ 15802us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:42.710225 (+ 74227us) log.cc:842] Serialized 26 byte log entry
0925 16:43:43.179928 (+469703us) raft_consensus.cc:1631] Marking committed up to 1
0925 16:43:43.179981 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:43.186761 (+  6780us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:43.820842 (+634081us) raft_consensus.cc:1671] finished
0925 16:43:43.820860 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:43.821004 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4292,"raft.queue_time_us":9698,"raft.run_cpu_time_us":168,"raft.run_wall_time_us":22620,"thread_start_us":415176,"threads_started":1,"wal-append.queue_time_us":855164}
I20260925 16:43:43.750080  8969 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:43:43.759802 11614 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:43.777037 11680 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:43.862804  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 97214.9us
I20260925 16:43:43.863902  8968 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:43.857905  8966 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:43:43.821434 11740 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
I20260925 16:43:43.693233 11688 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.117s
I20260925 16:43:43.739868 11734 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:43.845984 11634 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.948s	user 0.006s	sys 0.005s
I20260925 16:43:43.874203  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:43.879360  8966 raft_consensus.cc:2354] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:43.909740  8968 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 4. Ops: []
W20260925 16:43:43.909763  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 153231us
I20260925 16:43:43.910604  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:43.852406 11364 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:43.764376 11715 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:43.881202 11677 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.105s
I20260925 16:43:43.870982 11614 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.276160  9043 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:44.275094  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:44.280324  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 369778us
W20260925 16:43:44.095263  9089 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.018s	sys 0.036s
I20260925 16:43:44.274725  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:44.281100  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:44.280630  9044 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
W20260925 16:43:44.281544  9089 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.027s	sys 0.043s
I20260925 16:43:43.966017  8967 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:43.909094 11687 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:44.037761  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:44.045327  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.029s	sys 0.024s
I20260925 16:43:44.283455  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:44.295679  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.032s	sys 0.030s
I20260925 16:43:44.289860  9044 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260925 16:43:44.296677  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.056s	sys 0.106s
W20260925 16:43:44.297099  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.056s	sys 0.106s
W20260925 16:43:44.297188  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 892305us
W20260925 16:43:44.237283  9701 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.020s	sys 0.046s
I20260925 16:43:44.281703  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:44.237820 11749 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260925 16:43:44.323454  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:44.324745  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:44.325606  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:44.326536  9701 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.787s	user 0.023s	sys 0.058s
W20260925 16:43:44.283632  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 732076us
W20260925 16:43:44.327839 11762 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260925 16:43:44.327934  9089 connection.cc:232] RPC call timeout handler was delayed by -2.5486663239998961s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260925 16:43:44.328889  9089 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.568s (SENT)
I20260925 16:43:44.329478  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:44.330351  9048 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:44.330471 11620 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:43.912823 11688 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:44.331311 11688 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:44.331552  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:43.966251 11473 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:44.332254  8972 raft_consensus.cc:2354] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
W20260925 16:43:44.332041  9089 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.717s (SENT)
W20260925 16:43:44.333807  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.800s (SENT)
I20260925 16:43:44.334223  8972 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: []
W20260925 16:43:44.334676  9089 connection.cc:232] RPC call timeout handler was delayed by -2.3152362830001039s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.32130000000000003s for a response
W20260925 16:43:44.298412 11742 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.525s	user 0.001s	sys 0.001s
I20260925 16:43:44.336300  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:44.336588  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:44.337095  8972 raft_consensus.cc:2354] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
W20260925 16:43:44.337016  9089 connection.cc:232] RPC call timeout handler was delayed by -2.2693362830000297s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3264s for a response
W20260925 16:43:43.971046 11733 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.065s
W20260925 16:43:44.125159 11500 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.044s
I20260925 16:43:44.341162  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:44.351284  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:44.352658  8974 raft_consensus.cc:2354] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
W20260925 16:43:44.338405  9089 connection.cc:232] RPC call timeout handler was delayed by -1.5164795260000119s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260925 16:43:44.286309  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:44.337407  9693 raft_consensus.cc:2396] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:44.355366  9698 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:44.321048  9047 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:44.342999  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:44.288533 11486 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.744s	user 0.008s	sys 0.002s
W20260925 16:43:44.134783 11709 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.748s	user 0.007s	sys 0.003s
I20260925 16:43:44.283143 11539 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:43:44.349115 11748 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.490s	user 0.001s	sys 0.000s
I20260925 16:43:44.285585 11685 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.288475 11490 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:44.367722  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:44.337916 11620 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:44.351646 11733 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.022s	sys 0.084s
I20260925 16:43:43.911741 11634 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.090317 11745 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:44.364657  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:44.369511  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:44.370352  9046 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260925 16:43:44.369674  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:44.137955 11726 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.400944  8973 raft_consensus.cc:2354] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3.
W20260925 16:43:44.350111 11500 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.014s	sys 0.047s
I20260925 16:43:44.286216  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:44.403438  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:44.365401  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3751795260000108s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260925 16:43:44.404376  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2558754799999861s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260925 16:43:44.404704  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2387754799999584s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260925 16:43:44.405073  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2351754799999526s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1592s for a response
W20260925 16:43:44.405439  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1951795259999471s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260925 16:43:44.405779  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1519795259998773s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
I20260925 16:43:44.338841 11687 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.378146 11564 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:44.378372 11715 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:44.416219  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:44.375905  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:44.377209  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:44.341058 11706 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:44.340811 11618 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:43.984488  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:44.378769  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 95787us
I20260925 16:43:44.379506  9699 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:43:44.350342 11734 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.392091  9044 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:44.392954  9047 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:44.391819  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:44.375506 11709 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.391978 11490 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.368886 11486 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.949290  9042 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:44.501592 11564 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:44.394819 11620 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.951948 11687 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:44.884294 11680 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.013s	user 0.009s	sys 0.002s
W20260925 16:43:44.485912 11742 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260925 16:43:44.953424  8970 raft_consensus.cc:2396] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
W20260925 16:43:44.430399  9016 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:43:44.954203  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 592984us
W20260925 16:43:44.954895  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 563102us
I20260925 16:43:44.955647 11763 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:44.956029 11709 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.956284 11751 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:44.619589 11614 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:44.956099 11763 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:44.957202  8974 raft_consensus.cc:2354] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4.
I20260925 16:43:44.957448 11763 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:44.958186  8969 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:44.958873  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1434) took 1083 ms. Trace:
I20260925 16:43:44.959149  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:44.959409  8969 rpcz_store.cc:276] 0925 16:43:43.875495 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.880792 (+  5297us) service_pool.cc:227] Handling call
0925 16:43:44.958816 (+1078024us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:44.953351  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:44.856046  8972 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260925 16:43:44.871265  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:44.961427  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:44.961748  8971 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:44.948913  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:44.963068 11753 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:44.961886 11715 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:44.408301 11745 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.963632 11715 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.891835  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 726) took 1500 ms. Trace:
I20260925 16:43:44.962428 11706 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:43:44.952631  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:44.971323  8968 raft_consensus.cc:2354] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5.
W20260925 16:43:44.972316 11473 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.640s	user 0.009s	sys 0.001s
I20260925 16:43:44.952183 11618 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.972783 11473 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:44.951196 11564 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.974658 11726 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:44.975059 11726 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:44.965376  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:44.975375 11726 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:44.879910 11659 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.513s	user 0.010s	sys 0.003s
I20260925 16:43:44.975915 11659 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.966456 11645 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:44.609293  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2094) took 1905 ms. Trace:
I20260925 16:43:44.977260  8975 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:44.977483 11645 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.977511  9123 rpcz_store.cc:276] 0925 16:43:42.703888 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:42.704606 (+   718us) service_pool.cc:227] Handling call
0925 16:43:42.704970 (+   364us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:42.979799 (+274829us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:42.979834 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:43.001322 (+ 21488us) log.cc:842] Serialized 26 byte log entry
0925 16:43:43.502789 (+501467us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:43.502827 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:43.582366 (+ 79539us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b54003bf1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:43.582407 (+    41us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:44.582017 (+999610us) raft_consensus.cc:1671] finished
0925 16:43:44.582045 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:44.609204 (+ 27159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":155,"raft.queue_time_us":65543,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":599220480,"thread_start_us":434569,"threads_started":1,"wal-append.queue_time_us":709502}
I20260925 16:43:44.949952  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:44.953483 11620 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.982196  9696 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260925 16:43:44.982512 11620 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:44.982781  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 839) took 1127 ms. Trace:
I20260925 16:43:44.983098 11620 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:44.983566 11726 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:44.985409 11726 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.987210  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:44.987764  9116 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:44.989187  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:44.574958 11539 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:43:44.407622  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.536s (SENT) [suppressed 53 similar messages]
I20260925 16:43:44.990118  9116 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260925 16:43:44.990697  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:44.948993  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 470) took 1909 ms. Trace:
I20260925 16:43:44.965531 11715 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:44.994182  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:44.994867  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:44.995683  9119 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:43:44.997048  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 589405us
W20260925 16:43:44.997591  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.569s (SENT)
I20260925 16:43:44.997906  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:44.967780  9701 rpcz_store.cc:276] 0925 16:43:43.391242 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.391366 (+   124us) service_pool.cc:227] Handling call
0925 16:43:43.419431 (+ 28065us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:43.435758 (+ 16327us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:43.435807 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:43.501452 (+ 65645us) log.cc:842] Serialized 26 byte log entry
0925 16:43:44.327086 (+825634us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:44.327158 (+    72us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:44.327246 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:44.891574 (+564328us) raft_consensus.cc:1671] finished
0925 16:43:44.891601 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:44.891768 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":74103,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":25197,"thread_start_us":787045,"threads_started":1,"wal-append.queue_time_us":1377161}
I20260925 16:43:44.965330 11745 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:45.000339  9700 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:43:45.003712  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1419) took 1409 ms (client timeout 1864 ms). Trace:
I20260925 16:43:44.974252 11618 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:45.001554  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:45.004117  8970 rpcz_store.cc:269] 0925 16:43:43.594417 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.601423 (+  7006us) service_pool.cc:227] Handling call
0925 16:43:44.996197 (+1394774us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001e3554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:45.003631 (+  7434us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3106729216}
I20260925 16:43:44.992252  9117 rpcz_store.cc:276] 0925 16:43:43.039851 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.039995 (+   144us) service_pool.cc:227] Handling call
0925 16:43:43.040284 (+   289us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:43.040591 (+   307us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:43.040629 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:43.041066 (+   437us) log.cc:842] Serialized 26 byte log entry
0925 16:43:43.638402 (+597336us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:43.638444 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:43.638504 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:44.611178 (+972674us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b24001afb88. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198e5acf4 00007f7198e58dfb 00007f7198ee7559 00007f7198ee71e5 00007f7198ee6740 00007f719bbd9578 00007f719bbd9cd8 00007f719bbb16e8 00007f719bbacaea 00007f719bbabf36
0925 16:43:44.656328 (+ 45150us) raft_consensus.cc:1671] finished
0925 16:43:44.656358 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:44.948934 (+292576us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17326,"raft.queue_time_us":394897,"raft.run_cpu_time_us":5837,"raft.run_wall_time_us":57903,"spinlock_wait_cycles":241436416,"thread_start_us":597028,"threads_started":1,"wal-append.queue_time_us":840203}
I20260925 16:43:45.018290  9050 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:45.020758  8941 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.026s	sys 0.077s
W20260925 16:43:45.021164  8941 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.026s	sys 0.077s
I20260925 16:43:45.022560  9121 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:43:44.979624 11645 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:44.618901 11634 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:45.005821 11734 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:45.005326 11539 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:45.049499  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:45.050264  9121 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:45.051410  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.010478 11680 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:45.008955 11706 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:43:45.016242  9089 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.588s (SENT)
I20260925 16:43:45.015913  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.019083 11620 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:45.056411  9116 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:45.065320  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:45.056345  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 773663us
I20260925 16:43:45.070290 11753 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:45.015784 11675 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.028s	sys 0.087s
I20260925 16:43:45.080386  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.081240  8970 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:45.058230 11645 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:45.083298  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:45.085554  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77451.2us
W20260925 16:43:45.090646  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.592s (SENT)
I20260925 16:43:45.091112  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.062073 11706 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:45.077569 11675 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.028s	sys 0.087s
I20260925 16:43:45.067878 11726 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:45.058977 11680 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:45.114683  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 842) took 1238 ms. Trace:
I20260925 16:43:45.115504  9699 rpcz_store.cc:276] 0925 16:43:43.875928 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.876067 (+   139us) service_pool.cc:227] Handling call
0925 16:43:44.325424 (+449357us) spinlock_profiling.cc:243] Waited 1.15 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:45.114346 (+788922us) spinlock_profiling.cc:243] Waited 53.1 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:45.114603 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":124734592}
I20260925 16:43:45.121033  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.121793  8970 raft_consensus.cc:2354] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:45.085196 11763 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:45.122624  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.123188  8970 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:45.113109 11453 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:45.124200 11453 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.125404  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.125973  8972 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:45.126823 11453 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.124171 11763 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.129980 11490 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.130606 11490 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260925 16:43:45.132150 11754 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.993s	user 0.006s	sys 0.006s
I20260925 16:43:45.082273 11734 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:45.132648 11680 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:44.983281  9696 rpcz_store.cc:276] 0925 16:43:43.855187 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.860227 (+  5040us) service_pool.cc:227] Handling call
0925 16:43:44.949836 (+1089609us) spinlock_profiling.cc:243] Waited 9.13 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcabce 000000000034aea9 00007f71a0df6a30 00007f71a0ebc7b4 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:44.982690 (+ 32854us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":20989696}
I20260925 16:43:45.133955  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.110471 11706 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:45.136585  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.131798 11726 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.142309  9121 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:45.153342  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:43:45.142989  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.787s	user 0.006s	sys 0.011s
W20260925 16:43:45.154386  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.006s	sys 0.011s
I20260925 16:43:45.154459  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.147382  8972 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
W20260925 16:43:45.135835  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.864s (SENT)
I20260925 16:43:45.155280  8970 raft_consensus.cc:2396] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:45.155151  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:45.107720 11620 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:43:45.156263  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 815101us
I20260925 16:43:45.159121  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.157353  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.164148  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.134011 11486 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:45.165946  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1420) took 1571 ms (client timeout 1569 ms). Trace:
W20260925 16:43:45.168565  8975 rpcz_store.cc:269] 0925 16:43:43.594779 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.597332 (+  2553us) service_pool.cc:227] Handling call
0925 16:43:45.165758 (+1568426us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b54001c4b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:45.165878 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3171339520}
I20260925 16:43:45.166916  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.169850  8967 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 6 because replica has last-logged OpId of term: 5 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260925 16:43:45.170446  8974 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:45.171357  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.841s	user 0.009s	sys 0.007s
W20260925 16:43:45.171648  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.842s	user 0.009s	sys 0.007s
I20260925 16:43:45.184273  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.185111  8966 raft_consensus.cc:2362] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6. Re-sending same reply.
I20260925 16:43:45.186846  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.189203  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.189308  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.112301 11645 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.195689  8972 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:45.190062  8971 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:45.187544  8968 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
W20260925 16:43:45.171311  9015 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.021s	sys 0.010s
I20260925 16:43:45.191923  9121 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:45.192634  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.200178  8973 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
W20260925 16:43:45.193116  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57320.4us
W20260925 16:43:45.201895  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.941s (SENT)
I20260925 16:43:45.195904  8975 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260925 16:43:45.203240  9015 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.863s	user 0.022s	sys 0.010s
W20260925 16:43:45.203641  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 883922us
W20260925 16:43:45.165824 11733 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.005s	sys 0.007s
W20260925 16:43:45.210925  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.241s (SENT)
W20260925 16:43:45.212074  9089 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.027s (SENT)
I20260925 16:43:45.212590  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:45.173205 11659 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.186316 11675 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:45.219468 11620 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260925 16:43:45.218281  9089 leader_election.cc:334] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.213s (SENT)
I20260925 16:43:45.212811 11618 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260925 16:43:45.221143 11645 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:45.216527  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.222385  9116 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
W20260925 16:43:45.222668  9015 connection.cc:232] RPC call timeout handler was delayed by -1.189941220000037s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2949s for a response
I20260925 16:43:45.220597  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:45.223061  9015 connection.cc:232] RPC call timeout handler was delayed by -1.1862772320000659s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1547s for a response
W20260925 16:43:45.223567  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.532s (SENT)
I20260925 16:43:45.149127 11539 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:45.224062  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.264s (SENT)
W20260925 16:43:45.224391  9015 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.640s (SENT)
W20260925 16:43:45.225071  9015 connection.cc:232] RPC call timeout handler was delayed by -1.076541220000081s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30750000000000005s for a response
W20260925 16:43:45.225471  9015 connection.cc:232] RPC call timeout handler was delayed by -1.0734603539999625s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
W20260925 16:43:45.225939  9015 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.834s (SENT)
W20260925 16:43:45.226795  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.835s (SENT)
I20260925 16:43:45.227159  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.228339 11618 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:45.214789 11733 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.788s	user 0.005s	sys 0.008s
I20260925 16:43:45.229988 11645 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:45.230696 11645 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.232304 11486 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:43:45.233409  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.879s (SENT)
I20260925 16:43:45.233477 11645 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:45.235031 11618 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:45.235491 11618 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:45.235932 11634 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:45.237316 11618 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:45.237589 11726 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:45.238859  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 725) took 1866 ms. Trace:
I20260925 16:43:45.239869 11634 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:45.239202  9695 rpcz_store.cc:276] 0925 16:43:43.373057 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:43.373236 (+   179us) service_pool.cc:227] Handling call
0925 16:43:43.382189 (+  8953us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:43.382622 (+   433us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:43.382664 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:43.390160 (+  7496us) log.cc:842] Serialized 26 byte log entry
0925 16:43:43.799430 (+409270us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:43.799481 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:43.799568 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:45.131542 (+1331974us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:45.238552 (+107010us) raft_consensus.cc:1671] finished
0925 16:43:45.238574 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:45.238808 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2952,"raft.run_cpu_time_us":203,"raft.run_wall_time_us":32245,"spinlock_wait_cycles":299760384,"thread_start_us":371529,"threads_started":1,"wal-append.queue_time_us":667728}
I20260925 16:43:45.245319  9700 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:45.247203  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.247591  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.248749  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.249790  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.250535  9700 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:45.240881 11745 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:45.253829  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.254582  9701 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:45.255606  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.256285  9121 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:45.244316 11659 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:45.260139  9045 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.009s	sys 0.020s
W20260925 16:43:45.264159  9045 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.009s	sys 0.020s
I20260925 16:43:45.267132  9044 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:45.273456  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.274226  9044 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:43:45.275254  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.275873  9050 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
W20260925 16:43:45.280493  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.006s	sys 0.011s
I20260925 16:43:45.277791  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.282665  9693 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:45.284914  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.286650  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:45.287786  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.006s	sys 0.011s
I20260925 16:43:45.283512 11680 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.254240 11745 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:43:45.290910  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 286023us
I20260925 16:43:45.291493  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.292641  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:45.296339  9697 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:45.251709 11734 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260925 16:43:45.264879  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:45.305845  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 294312us
I20260925 16:43:45.307965  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.215430 11688 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.315424  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:45.297539 11722 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.011s	sys 0.019s
I20260925 16:43:45.320432  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:45.321009  9697 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:45.321970  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:45.322738  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.966s (SENT)
I20260925 16:43:45.323305  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:45.325109  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.266013 11659 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:45.330860  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:45.305493 11486 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:45.355445  9697 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
W20260925 16:43:45.368707  9015 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.547s (SENT)
I20260925 16:43:45.367625  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:45.373916  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51203.4us
W20260925 16:43:45.374786  9666 leader_election.cc:334] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.029s (SENT)
I20260925 16:43:45.375052  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:45.376466  9121 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260925 16:43:45.324607 11722 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.011s	sys 0.019s
I20260925 16:43:45.318979 11715 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:45.379194  9119 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:45.382951  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.666s (SENT)
W20260925 16:43:45.333797 11730 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.014s	sys 0.007s
W20260925 16:43:45.388729  9015 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.730s (SENT)
I20260925 16:43:45.390552  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:45.391220  9042 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:45.343389 11733 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260925 16:43:45.376888 11688 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:45.394137 11734 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20260925 16:43:45.397907 11734 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:45.398227 11734 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:45.398954 11734 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:45.386888 11730 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.016s	sys 0.007s
I20260925 16:43:45.390115 11715 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.401443 11734 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:45.405272  9089 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.726s (SENT)
I20260925 16:43:45.405823  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.405987 11706 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:45.408196  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.802s (SENT)
I20260925 16:43:45.406719 11620 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260925 16:43:45.386283 11726 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:43:45.417550  9666 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.177s (SENT)
I20260925 16:43:45.417994  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:45.399462  9693 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:45.419986 11659 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.420001 11706 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.421064  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.422736  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:45.393692 11722 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:43:45.423496 11722 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:45.418407  9119 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:45.424506 11722 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.425769 11722 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:43:45.427186  9042 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:45.428198  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:45.430007 11453 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:43:45.435781  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 78584us
I20260925 16:43:45.436877  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:45.439003  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.889s (SENT)
I20260925 16:43:45.439507  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.368403 11763 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.028s
I20260925 16:43:45.449219  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.455307  9119 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: [3.2-3.2]
I20260925 16:43:45.456054  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:45.441946 11645 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:45.366554 11745 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.474306  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:45.475526  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57981.6us
I20260925 16:43:45.475636  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.440287 11726 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:45.479092  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.383976 11486 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.480149  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.481745  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:45.484586  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45619.7us
I20260925 16:43:45.506562  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:45.473577 11774 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:45.510169  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.473562 11620 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:45.410185 11618 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.094s
W20260925 16:43:45.527760  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.012s	sys 0.031s
W20260925 16:43:45.529732  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.526s	user 0.012s	sys 0.031s
W20260925 16:43:45.530145  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 527834us
I20260925 16:43:45.531236  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.532083  9120 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:45.451135 11731 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260925 16:43:45.475440 11757 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:45.502617 11680 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:45.541262  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.546167  8968 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:45.504186 11726 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:45.509047 11687 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.027s	sys 0.033s
I20260925 16:43:45.561169  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:45.578917  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.039s (SENT)
I20260925 16:43:45.579552  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:45.580700  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.581712  8966 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
I20260925 16:43:45.584721  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.592028  9042 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:45.592232  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.593192  8970 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:45.595533  8968 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260925 16:43:45.509054 11564 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.025s
I20260925 16:43:45.596653  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.602185  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.598335  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.512892 11774 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:45.577363 11687 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.027s	sys 0.033s
I20260925 16:43:45.599814  8967 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:45.601481  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.603035  8974 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:45.604002  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.605347  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.617224  8966 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:45.618090  9698 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:45.629132  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.545387 11659 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:45.562439 11490 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:45.593915 11680 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:45.602460 11564 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.625s	user 0.007s	sys 0.025s
I20260925 16:43:45.647154  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1492) took 1294 ms. Trace:
W20260925 16:43:45.651912  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 283254us
I20260925 16:43:45.652801  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.650550  9045 rpcz_store.cc:276] 0925 16:43:44.352848 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:44.352969 (+   121us) service_pool.cc:227] Handling call
0925 16:43:44.353233 (+   264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:44.353434 (+   201us) raft_consensus.cc:1520] Early marking committed up to index 2
0925 16:43:45.264604 (+911170us) log.cc:842] Serialized 14 byte log entry
0925 16:43:45.646182 (+381578us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:45.646475 (+   293us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:45.646881 (+   406us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:45.646962 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:45.647091 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1188740,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"thread_start_us":1268148,"threads_started":2}
I20260925 16:43:45.652365  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.656231  9042 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:45.657135  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.606482 11722 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:43:45.660385  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81502.2us
I20260925 16:43:45.665395  9045 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260925 16:43:45.631193 11774 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:43:45.654151 11771 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260925 16:43:45.677168  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 170694us
I20260925 16:43:45.678387  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:45.649574  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.678632  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.683444  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.689821  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.651029 11539 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:45.686381  9045 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260925 16:43:45.685307  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 247502us
I20260925 16:43:45.635272 11620 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
W20260925 16:43:45.712845  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 323093us
W20260925 16:43:45.716514  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.938s (SENT)
I20260925 16:43:45.728809  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:45.694267  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 163377us
I20260925 16:43:45.653757 11659 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.681802 11715 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.736876  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.658188 11490 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:45.658371 11680 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:45.745893  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 93296.8us
W20260925 16:43:45.746327  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68037.1us
I20260925 16:43:45.753803  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:45.755524  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:45.756395  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.699715 11539 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:45.758005  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:45.701329 11786 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:45.683612 11722 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.057s
I20260925 16:43:45.767064  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:45.772948  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:45.774334  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:45.776131 11618 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:45.776561 11618 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:45.777484  8968 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:45.778299  8971 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:45.782480  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.792817 11763 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:43:45.794731 11763 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:45.795727 11763 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:45.771416  8969 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260925 16:43:45.832342  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55389.5us
I20260925 16:43:45.766067 11539 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:45.834129  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 128405us
W20260925 16:43:45.835400  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 52962us
I20260925 16:43:45.776973 11618 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:45.691601 11783 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.125s
I20260925 16:43:45.692320 11778 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.093s
W20260925 16:43:45.842374  9123 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.000s	sys 0.011s
W20260925 16:43:45.849584  9123 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.000s	sys 0.012s
W20260925 16:43:45.852105  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 74672.6us
I20260925 16:43:45.762632 11620 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.077s
I20260925 16:43:45.821597 11486 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:45.841997 11788 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:45.808842 11784 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:45.880879  8970 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:45.882586  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:45.861541  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90462.5us
W20260925 16:43:45.866830 11780 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260925 16:43:45.867357  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:45.870301  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 150707us
I20260925 16:43:45.857183 11477 tablet_copy_client.cc:531] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:43:45.876574 11620 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:45.877454 11486 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:43:45.839444 11777 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
W20260925 16:43:45.883766  9701 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.014s	sys 0.002s
I20260925 16:43:45.887887  8970 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:45.885910  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:45.918684  9701 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.014s	sys 0.002s
I20260925 16:43:45.853780 11757 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:43:45.933259 11757 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:45.933652 11757 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:45.934513 11726 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:45.907864  9015 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.363s (SENT)
I20260925 16:43:45.936107  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:45.936141  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.918104 11803 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:45.937044  8966 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
I20260925 16:43:45.937095 11803 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:45.937273  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.075s (SENT)
I20260925 16:43:45.937543 11803 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:45.937718  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:45.937862  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.938637  8966 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:45.938759  9015 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.794s (SENT)
I20260925 16:43:45.939321  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.859642 11490 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.864146 11788 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:45.914346 11779 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.136s	user 0.000s	sys 0.001s
W20260925 16:43:45.923171 11776 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.222s	user 0.000s	sys 0.000s
W20260925 16:43:45.923317 11797 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.100s	user 0.000s	sys 0.001s
W20260925 16:43:45.923951 11789 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.115s	user 0.001s	sys 0.000s
W20260925 16:43:45.924957 11772 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260925 16:43:45.925755  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.925937 11486 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:45.927093  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.055979  8968 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:45.928584  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.929804 11645 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:45.930202  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.065712  8969 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:45.930495  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:45.932331 11659 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:45.912302  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55181.4us
I20260925 16:43:45.896543  8974 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:45.964932  9697 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:46.067628  9116 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:43:45.894743 11774 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:45.968874  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:45.973260  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.074608  8970 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
I20260925 16:43:45.968196 11788 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:45.980568  9700 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:45.936374 11680 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:45.945554 11687 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:46.046784  8971 raft_consensus.cc:2362] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:43:46.064260  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:46.064754  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:46.068177  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:46.068903  9117 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:43:45.979434 11816 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:46.066741  8967 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:46.078454  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:46.079226 11763 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:46.079826  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.078471  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:46.111078  9702 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 6.
I20260925 16:43:46.080286  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.080879 11757 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:46.082970 11774 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:46.069123 11486 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:46.083403 11825 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:46.083851  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:46.084410  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:46.128933  9701 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:43:46.129014  9115 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:46.084574 11734 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:46.083581  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:46.057053  8975 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:43:46.130306  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 267975us
I20260925 16:43:46.102226 11675 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:46.107161  9122 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
I20260925 16:43:46.110335  8969 raft_consensus.cc:2362] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:43:46.117992  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:46.144876  9044 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:46.145176  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.147145  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:46.148468  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 305388us
I20260925 16:43:46.148950  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:46.151101  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:46.114605  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 228755us
I20260925 16:43:46.126453  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.170715  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.083030 11477 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:43:46.065464 11645 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:43:46.092634 11473 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.005s	sys 0.006s
I20260925 16:43:46.128307  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.183197  8971 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:46.133729  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.092424 11798 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:46.139846  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:46.094955  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.187300  8970 raft_consensus.cc:2362] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4. Re-sending same reply.
I20260925 16:43:46.188707  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.189476  8970 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:46.190438  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.191104  8970 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:46.123067  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 279921us
W20260925 16:43:46.138893 11731 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.001s	sys 0.029s
I20260925 16:43:46.163947  9048 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 6. Ops: []
I20260925 16:43:46.163323  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2116) took 1889 ms. Trace:
I20260925 16:43:46.108101 11815 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.053s
I20260925 16:43:46.171445  8969 raft_consensus.cc:2362] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6. Re-sending same reply.
I20260925 16:43:46.144203 11675 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:46.223197  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.173192  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.174563  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:46.159768 11688 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.741s	user 0.010s	sys 0.000s
I20260925 16:43:46.136626 11734 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:46.152421  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:46.220206  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 82233.3us
I20260925 16:43:46.194367  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:46.221475  9049 rpcz_store.cc:276] 0925 16:43:44.273845 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:44.274001 (+   156us) service_pool.cc:227] Handling call
0925 16:43:44.328910 (+ 54909us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:44.329131 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:44.329154 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:44.329599 (+   445us) log.cc:842] Serialized 26 byte log entry
0925 16:43:45.172002 (+842403us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:45.172035 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:45.172090 (+    55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:46.163067 (+990977us) raft_consensus.cc:1671] finished
0925 16:43:46.163092 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:46.163259 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":842036,"threads_started":1,"wal-append.queue_time_us":1182962}
I20260925 16:43:46.231463  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:46.161290 11715 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:46.237463  9046 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
W20260925 16:43:46.144018 11706 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.000s	sys 0.015s
I20260925 16:43:46.250051 11726 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:46.206353  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:46.251283  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:46.182665 11473 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.007s	sys 0.006s
I20260925 16:43:46.252794  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.263940  8966 raft_consensus.cc:2362] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4. Re-sending same reply.
I20260925 16:43:46.147352 11774 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260925 16:43:46.259028  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.259326  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.261327  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.272035  8967 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:46.264940  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:46.266103  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44693us
I20260925 16:43:46.266326  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:46.221047 11731 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.001s	sys 0.029s
I20260925 16:43:46.114333 11816 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:46.242859  8970 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:46.287896  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:46.314467  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.297797  9044 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:46.298966  8971 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:46.300377  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.243243 11802 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
W20260925 16:43:46.301564  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50360.6us
I20260925 16:43:46.306195 11687 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:46.307303  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.308429  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.315218  8970 raft_consensus.cc:2362] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
W20260925 16:43:46.262483 11706 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.000s	sys 0.017s
W20260925 16:43:46.321170  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 463550us
I20260925 16:43:46.326054  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:46.340139  8967 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:46.371493  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.372414  8975 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:43:46.373428  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.183593 11827 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.159s
I20260925 16:43:46.269805 11814 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.092s
I20260925 16:43:46.222146 11804 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.157s
I20260925 16:43:46.299391 11731 consensus_queue.cc:1225] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 4.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260925 16:43:46.317708 11836 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.065s
I20260925 16:43:46.328154 11837 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:46.343221  8969 raft_consensus.cc:2362] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6. Re-sending same reply.
I20260925 16:43:46.375819  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:46.353152  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:46.380483  8966 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:46.382711  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.365374  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2125) took 1050 ms. Trace:
I20260925 16:43:46.317562  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1498) took 1009 ms. Trace:
I20260925 16:43:46.391006 11814 consensus_queue.cc:1225] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 4.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:43:46.270489 11453 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.077s
I20260925 16:43:46.343911  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:46.350383 11794 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260925 16:43:46.425374  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:46.675976  8974 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:46.676690  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1866) took 1085 ms. Trace:
I20260925 16:43:46.677006  8974 rpcz_store.cc:276] 0925 16:43:45.591443 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.335895 (+744452us) service_pool.cc:227] Handling call
0925 16:43:46.676617 (+340722us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:46.425187  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:46.422910  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.000s	sys 0.011s
W20260925 16:43:46.359051 11812 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.493s	user 0.004s	sys 0.000s
I20260925 16:43:46.506500  8975 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 7. Ops: [4.4-5.5]
W20260925 16:43:46.505239  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 155795us
I20260925 16:43:46.509068  9049 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260925 16:43:46.362226 11800 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.504s	user 0.000s	sys 0.001s
I20260925 16:43:46.521622  8969 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:46.391824 11680 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:46.521831  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 851) took 1560 ms. Trace:
I20260925 16:43:46.336784 11726 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:46.717928  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1862) took 1106 ms. Trace:
I20260925 16:43:46.717939  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:46.718353  8975 rpcz_store.cc:276] 0925 16:43:45.590059 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.505296 (+915237us) service_pool.cc:227] Handling call
0925 16:43:46.505989 (+   693us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:46.696540 (+190551us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.696807 (+   267us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:46.411067 11787 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.050s	sys 0.137s
I20260925 16:43:46.522773 11809 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.104s
W20260925 16:43:46.527820 11790 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.466s	user 0.001s	sys 0.001s
I20260925 16:43:46.471334 11802 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:46.707625  9698 rpcz_store.cc:276] 0925 16:43:44.961163 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:44.961400 (+   237us) service_pool.cc:227] Handling call
0925 16:43:44.961661 (+   261us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:45.646256 (+684595us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.521514 (+875258us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54006eda54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:46.521760 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1509139200}
I20260925 16:43:46.353394 11734 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:46.678089  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.003s	sys 0.015s
I20260925 16:43:46.669512 11817 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:46.349682 11645 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:46.581359 11763 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:46.718039  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.030s	sys 0.062s
I20260925 16:43:46.721395  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1864) took 1106 ms. Trace:
W20260925 16:43:46.911996  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.031s	sys 0.062s
W20260925 16:43:46.912515  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 750223us
I20260925 16:43:46.912148  8969 rpcz_store.cc:276] 0925 16:43:45.590776 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.520886 (+930110us) service_pool.cc:227] Handling call
0925 16:43:46.521239 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:46.697355 (+176116us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.697592 (+   237us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:46.342003 11841 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:43:46.634253 11757 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:46.820325  8975 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 2. (term mismatch)
I20260925 16:43:46.931715  8975 pending_rounds.cc:76] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 1
I20260925 16:43:46.932027  8975 pending_rounds.cc:97] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 3.2
I20260925 16:43:46.932301  8975 raft_consensus.cc:2866] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:46.358834 11675 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:46.846261  8974 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260925 16:43:46.846519  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 138675us
I20260925 16:43:46.902740  9121 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:43:46.902529  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:46.706550 11486 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:46.941223  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1876) took 1297 ms. Trace:
I20260925 16:43:46.949087  8974 rpcz_store.cc:276] 0925 16:43:45.643787 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.696906 (+1053119us) service_pool.cc:227] Handling call
0925 16:43:46.845845 (+148939us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:46.940901 (+ 95056us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.941146 (+   245us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:46.951411  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1885) took 1275 ms. Trace:
I20260925 16:43:46.952045  8975 rpcz_store.cc:276] 0925 16:43:45.676326 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.719303 (+1042977us) service_pool.cc:227] Handling call
0925 16:43:46.719601 (+   298us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:46.951018 (+231417us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.951351 (+   333us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:46.904408  8968 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.848s	user 0.006s	sys 0.005s
W20260925 16:43:46.730839 11787 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.050s	sys 0.137s
I20260925 16:43:46.502388  9123 rpcz_store.cc:276] 0925 16:43:45.315132 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.315287 (+   155us) service_pool.cc:227] Handling call
0925 16:43:45.315529 (+   242us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:45.315729 (+   200us) raft_consensus.cc:1520] Early marking committed up to index 2
0925 16:43:45.328043 (+ 12314us) log.cc:842] Serialized 14 byte log entry
0925 16:43:46.364918 (+1036875us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003c6a00. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:43:46.365026 (+   108us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:46.365081 (+    55us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:46.365135 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.365223 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:46.365323 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1904,"prepare.queue_time_us":28448,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":274063,"raft.run_cpu_time_us":159,"raft.run_wall_time_us":21491,"spinlock_wait_cycles":24025344,"thread_start_us":820648,"threads_started":2,"wal-append.queue_time_us":891879}
I20260925 16:43:46.706207 11819 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260925 16:43:46.938463  9701 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.800s	user 0.010s	sys 0.000s
I20260925 16:43:46.983522  9701 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:46.914122 11827 raft_consensus.cc:2741] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260925 16:43:46.907593 11722 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:46.821491 11833 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:46.956861  8968 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:46.867199 11680 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:46.991170  8975 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:46.673974  8970 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:46.997187  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1895) took 1307 ms. Trace:
I20260925 16:43:46.997292  8974 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:43:46.634051 11830 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.426s
W20260925 16:43:46.991966  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.003s	sys 0.007s
W20260925 16:43:47.006673  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.004s	sys 0.008s
W20260925 16:43:47.007059  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 832514us
I20260925 16:43:46.684275  8971 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:43:47.008242  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1873) took 1365 ms. Trace:
I20260925 16:43:47.008733  8971 rpcz_store.cc:276] 0925 16:43:45.642892 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.529963 (+887071us) service_pool.cc:227] Handling call
0925 16:43:46.658166 (+128203us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:47.007903 (+349737us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.008178 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:46.974262 11803 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.022s	user 0.011s	sys 0.000s
I20260925 16:43:46.923990 11841 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:46.997623  8970 rpcz_store.cc:276] 0925 16:43:45.689454 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.343562 (+654108us) service_pool.cc:227] Handling call
0925 16:43:46.997124 (+653562us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:46.998908  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56853.7us
W20260925 16:43:46.959558 11794 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:43:47.000121  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1894) took 1311 ms. Trace:
I20260925 16:43:47.039075  8975 rpcz_store.cc:276] 0925 16:43:45.689167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.953002 (+1263835us) service_pool.cc:227] Handling call
0925 16:43:46.953383 (+   381us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:46.996813 (+ 43430us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.000040 (+  3227us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:47.021883  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:46.999580  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1868) took 1372 ms (client timeout 1671 ms). Trace:
I20260925 16:43:46.997954  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1893) took 1309 ms. Trace:
I20260925 16:43:47.046540  8974 rpcz_store.cc:276] 0925 16:43:45.688891 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.949991 (+1261100us) service_pool.cc:227] Handling call
0925 16:43:46.996869 (+ 46878us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:46.997702 (+   833us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.997903 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":843520}
W20260925 16:43:47.048004  8968 rpcz_store.cc:269] 0925 16:43:45.626877 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.926890 (+300013us) service_pool.cc:227] Handling call
0925 16:43:46.999526 (+1072636us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:46.931403 11726 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:46.971787 11848 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:46.987325 11688 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:47.066243 11688 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.068893 11688 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.054167  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1839) took 1480 ms. Trace:
I20260925 16:43:47.069505  8972 rpcz_store.cc:276] 0925 16:43:45.538337 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.540896 (+  2559us) service_pool.cc:227] Handling call
0925 16:43:45.593162 (+ 52266us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:45.600554 (+  7392us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:45.600593 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:45.601098 (+   505us) log.cc:842] Serialized 26 byte log entry
0925 16:43:45.766750 (+165652us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:45.856740 (+ 89990us) log.cc:842] Serialized 14 byte log entry
0925 16:43:46.237511 (+380771us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.237578 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:46.358347 (+120769us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:47.006775 (+648428us) raft_consensus.cc:1671] finished
0925 16:43:47.018259 (+ 11484us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.018441 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":101492,"prepare.queue_time_us":318672,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":26,"raft.queue_time_us":215488,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":5388,"spinlock_wait_cycles":108924672,"thread_start_us":469025,"threads_started":3,"wal-append.queue_time_us":192369}
I20260925 16:43:46.996640 11675 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:47.072860 11680 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.063737 11848 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:47.080618 11564 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:47.081714 11853 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:47.081753 11836 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:43:47.082223 11853 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.027925 11803 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.084352 11853 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:47.085121 11803 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:47.085668  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63881.4us
I20260925 16:43:47.086895  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:46.993584 11722 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:47.061170 11763 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:47.080982 11848 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:46.983330 11819 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:47.108246  9115 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.975s	user 0.007s	sys 0.003s
I20260925 16:43:47.058411  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:47.027642 11734 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 4
W20260925 16:43:47.088169 11618 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.233s	user 0.011s	sys 0.000s
I20260925 16:43:47.052093 11807 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:47.041674 11841 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 1 FOLLOWER]: Advancing to term 2
W20260925 16:43:47.106199 11539 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.254s	user 0.011s	sys 0.001s
I20260925 16:43:47.107044 11853 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:47.060837 11486 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:47.094264 11816 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:47.114805  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 514) took 1841 ms. Trace:
I20260925 16:43:47.231068  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:47.133625  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.635s (SENT)
W20260925 16:43:47.304184  9050 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.068s	sys 0.142s
W20260925 16:43:47.124189  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.568s	user 0.032s	sys 0.061s
I20260925 16:43:47.238140  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:47.142246  9115 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:43:47.021116 11825 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.233s
I20260925 16:43:47.081099 11564 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:47.370018  9122 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.020s	sys 0.032s
I20260925 16:43:47.016520 11833 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.354326  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1887) took 1671 ms. Trace:
W20260925 16:43:47.385924  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.993s	user 0.104s	sys 0.177s
I20260925 16:43:47.029165 11827 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:47.040345 11802 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:47.404999  9050 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.926s	user 0.068s	sys 0.143s
I20260925 16:43:47.132434 11763 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:47.596813  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.032s	sys 0.083s
I20260925 16:43:47.401937  9047 rpcz_store.cc:276] 0925 16:43:45.273586 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.273688 (+   102us) service_pool.cc:227] Handling call
0925 16:43:45.282032 (+  8344us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:45.282386 (+   354us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:45.282412 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:45.282862 (+   450us) log.cc:842] Serialized 26 byte log entry
0925 16:43:45.642321 (+359459us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:43:45.661498 (+ 19177us) log.cc:842] Serialized 14 byte log entry
0925 16:43:45.671713 (+ 10215us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:45.671804 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:47.114575 (+1442771us) raft_consensus.cc:1671] finished
0925 16:43:47.114601 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.114738 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20760,"prepare.queue_time_us":34834,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":2299,"raft.queue_time_us":116563,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":20605,"thread_start_us":359120,"threads_started":1,"wal-append.queue_time_us":868491}
W20260925 16:43:47.598133  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.111s	sys 0.187s
W20260925 16:43:47.598439  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 511588us
W20260925 16:43:47.598526  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.21628e+06us
I20260925 16:43:47.599725  9044 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:47.569882  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:47.600181  9122 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.028s	sys 0.034s
I20260925 16:43:47.404894  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:47.559358  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49818.7us
W20260925 16:43:47.601250  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 486918us
I20260925 16:43:46.473354  9041 rpcz_store.cc:276] 0925 16:43:45.307912 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.308047 (+   135us) service_pool.cc:227] Handling call
0925 16:43:45.308398 (+   351us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:45.308656 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:43:45.737047 (+428391us) log.cc:842] Serialized 14 byte log entry
0925 16:43:46.229121 (+492074us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:46.250914 (+ 21793us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:46.258968 (+  8054us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.277928 (+ 18960us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:46.307360 (+ 29432us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26114,"prepare.queue_time_us":326684,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":5027,"raft.queue_time_us":33796,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":23214,"thread_start_us":799489,"threads_started":2}
I20260925 16:43:47.604847  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:47.609330  9044 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:43:47.594383  9667 thread.cc:636] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.763s	user 0.009s	sys 0.001s
I20260925 16:43:47.230072 11688 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:47.611192  9667 thread.cc:602] server-negotiator [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.010s	sys 0.001s
W20260925 16:43:47.594218  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.764s	user 0.001s	sys 0.009s
W20260925 16:43:47.111768 11786 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.000s	sys 0.005s
W20260925 16:43:47.627168 11786 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.149s	user 0.006s	sys 0.014s
I20260925 16:43:47.627635 11786 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:47.628104 11786 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.333541 11819 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:47.488036 11486 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:47.631924 11849 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.002s	sys 0.021s
W20260925 16:43:47.632454 11849 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.002s	sys 0.021s
I20260925 16:43:47.633123 11849 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:47.633690 11486 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:47.378371 11807 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:47.615119  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 493) took 1516 ms (client timeout 1878 ms). Trace:
I20260925 16:43:47.598953  8969 rpcz_store.cc:276] 0925 16:43:45.682765 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.930268 (+1247503us) service_pool.cc:227] Handling call
0925 16:43:46.930812 (+   544us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:47.352438 (+421626us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:47.352466 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:47.352509 (+    43us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:47.352535 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.354122 (+  1587us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.354267 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":134003,"raft.run_cpu_time_us":312,"raft.run_wall_time_us":63179,"thread_start_us":421171,"threads_started":1}
W20260925 16:43:47.637214  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 503578us
W20260925 16:43:47.637024  9115 rpcz_store.cc:269] 0925 16:43:46.084017 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.084153 (+   136us) service_pool.cc:227] Handling call
0925 16:43:47.600717 (+1516564us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:47.638249  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.920s (SENT)
I20260925 16:43:47.619863  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:47.638782  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:47.352705 11837 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.017s	sys 0.025s
W20260925 16:43:47.622251  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.396s	user 0.002s	sys 0.009s
I20260925 16:43:47.354383 11845 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:47.495502 11687 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:47.656023 11687 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.656988 11831 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:47.658149 11687 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.579052 11722 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.659313 11783 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:47.659518  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1495) took 3284 ms. Trace:
I20260925 16:43:47.659957 11783 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.229878 11618 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.659945  9043 rpcz_store.cc:276] 0925 16:43:44.375165 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:44.375945 (+   780us) service_pool.cc:227] Handling call
0925 16:43:44.392313 (+ 16368us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:44.408717 (+ 16404us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:44.408754 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:44.949255 (+540501us) log.cc:842] Serialized 52 byte log entry
0925 16:43:45.275341 (+326086us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:43:45.878871 (+603530us) spinlock_profiling.cc:243] Waited 990 us on lock 0x7b1800182380. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f
0925 16:43:45.879029 (+   158us) log.cc:842] Serialized 14 byte log entry
0925 16:43:45.879399 (+   370us) log.cc:842] Serialized 14 byte log entry
0925 16:43:47.659136 (+1779737us) spinlock_profiling.cc:243] Waited 22.1 ms on lock 0x7b540027aea0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bebdfb3 00007f719bf2af0f 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c
0925 16:43:47.659191 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.659277 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:47.659321 (+    44us) raft_consensus.cc:1671] finished
0925 16:43:47.659331 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.659462 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59432,"prepare.queue_time_us":361164,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":83,"raft.queue_time_us":208375,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":69056,"spinlock_wait_cycles":53147648,"thread_start_us":1064330,"threads_started":3,"wal-append.queue_time_us":741901,"wal-append.run_cpu_time_us":4699,"wal-append.run_wall_time_us":1671719}
I20260925 16:43:47.662302 11618 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:47.625392  9047 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:47.663718  9116 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:47.625684  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1511) took 1853 ms. Trace:
I20260925 16:43:47.664470  9045 rpcz_store.cc:276] 0925 16:43:45.771973 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.772095 (+   122us) service_pool.cc:227] Handling call
0925 16:43:45.772374 (+   279us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:45.833396 (+ 61022us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:45.833604 (+   208us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:45.848324 (+ 14720us) log.cc:842] Serialized 26 byte log entry
0925 16:43:46.086447 (+238123us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:46.086484 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.086649 (+   165us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:47.625499 (+1538850us) raft_consensus.cc:1671] finished
0925 16:43:47.625518 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.625630 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31608,"raft.queue_time_us":100455,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":29359,"thread_start_us":179555,"threads_started":1,"wal-append.queue_time_us":1763785}
I20260925 16:43:47.373693 11840 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:47.626380  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:47.408269 11853 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.672174  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:47.672730 11777 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:47.672793  9694 raft_consensus.cc:2362] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6. Re-sending same reply.
I20260925 16:43:47.673188 11777 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:47.673398 11853 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:47.595372 11796 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.291s	user 0.000s	sys 0.000s
I20260925 16:43:47.600495 11848 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:47.643751 11688 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:47.649760  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.47452e+06us
I20260925 16:43:47.650473 11838 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:47.623131 11726 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.625625 11564 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:47.595515 11843 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:47.674084  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47775.7us
I20260925 16:43:47.408613 11539 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.640201  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:47.642387 11837 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.022s	sys 0.029s
W20260925 16:43:47.682390  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 332095us
I20260925 16:43:47.707893  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:47.644543 11835 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:47.611057 11827 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.704804 11830 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:43:47.735344  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 97130.2us
I20260925 16:43:47.673434  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 736) took 1480 ms. Trace:
W20260925 16:43:47.740713  9666 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.040s (SENT)
W20260925 16:43:47.745383  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.671s (SENT)
I20260925 16:43:47.751833 11854 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:47.752133 11846 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:47.752324 11807 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:47.752786 11855 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:47.752610 11863 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:47.753314 11855 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.754079 11863 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260925 16:43:47.754782 11715 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.490s	user 0.009s	sys 0.001s
W20260925 16:43:47.755754 11842 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.477s	user 0.000s	sys 0.001s
I20260925 16:43:47.756798 11852 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:47.757333 11852 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.734652 11837 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:47.760881 11837 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.763533  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2129) took 1916 ms. Trace:
W20260925 16:43:47.764358 11847 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260925 16:43:47.764083  9050 rpcz_store.cc:276] 0925 16:43:45.850977 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.276944 (+425967us) service_pool.cc:227] Handling call
0925 16:43:46.277340 (+   396us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:46.300848 (+ 23508us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:46.300890 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:46.339359 (+ 38469us) log.cc:842] Serialized 26 byte log entry
0925 16:43:47.596529 (+1257170us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:47.596564 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.596630 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:47.763292 (+166662us) raft_consensus.cc:1671] finished
0925 16:43:47.763316 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.763464 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23064,"raft.queue_time_us":32789,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":18259,"thread_start_us":1117817,"threads_started":1,"wal-append.queue_time_us":1388482}
I20260925 16:43:47.766541 11614 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:47.766570  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2134) took 1049 ms. Trace:
I20260925 16:43:47.755419 11715 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:47.674103 11829 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.034s	sys 0.040s
W20260925 16:43:47.768538 11829 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.676s	user 0.034s	sys 0.043s
I20260925 16:43:47.747977 11835 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.770681 11835 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.752632 11846 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:47.749405  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 109335us
I20260925 16:43:47.711194 11786 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.716761 11757 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:47.776336 11833 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.776079 11757 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.779248  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:47.759488 11852 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:47.709071 11777 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.728138 11763 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.778621 11786 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:47.681270 11840 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:48.039157  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1490) took 3699 ms. Trace:
I20260925 16:43:47.767481  9117 rpcz_store.cc:276] 0925 16:43:46.717731 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.718058 (+   327us) service_pool.cc:227] Handling call
0925 16:43:46.718658 (+   600us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:46.719205 (+   547us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:46.719255 (+    50us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:46.919314 (+200059us) log.cc:842] Serialized 532 byte log entry
0925 16:43:47.400708 (+481394us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:47.400779 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.400872 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:47.766288 (+365416us) raft_consensus.cc:1671] finished
0925 16:43:47.766312 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.766508 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":523030,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":44808,"thread_start_us":385817,"threads_started":1,"wal-append.queue_time_us":773273}
W20260925 16:43:48.389652  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1499) took 3079 ms (client timeout 2054 ms). Trace:
I20260925 16:43:47.854209  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:48.518317  9050 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:48.519109  9047 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:48.517261 11680 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:48.520030  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:48.175750  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.520789 11490 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:48.521272 11490 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.523895 11816 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:48.525127 11787 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:48.525646 11787 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:47.811084 11709 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:48.526432 11787 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:47.818902  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 206638us
W20260925 16:43:48.107288 11811 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.241s	user 0.003s	sys 0.005s
I20260925 16:43:47.887459 11715 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:48.527529 11787 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:48.532011  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1841) took 2993 ms. Trace:
W20260925 16:43:48.203891  8966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1889) took 2520 ms (client timeout 2363 ms). Trace:
W20260925 16:43:48.533602  8966 rpcz_store.cc:269] 0925 16:43:45.683384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.264671 (+581287us) service_pool.cc:227] Handling call
0925 16:43:48.203640 (+1938969us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003557d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:48.203804 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":246722304}
I20260925 16:43:48.532471  8973 rpcz_store.cc:276] 0925 16:43:45.538809 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.540985 (+  2176us) service_pool.cc:227] Handling call
0925 16:43:45.597678 (+ 56693us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:45.607421 (+  9743us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:45.607452 (+    31us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:45.650546 (+ 43094us) log.cc:842] Serialized 52 byte log entry
0925 16:43:45.734023 (+ 83477us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:45.860637 (+126614us) log.cc:842] Serialized 14 byte log entry
0925 16:43:46.233791 (+373154us) log.cc:842] Serialized 14 byte log entry
0925 16:43:46.233978 (+   187us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:46.234064 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:48.106748 (+1872684us) spinlock_profiling.cc:243] Waited 45.9 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:48.531743 (+424995us) raft_consensus.cc:1671] finished
0925 16:43:48.531774 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:48.531922 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":49152,"prepare.queue_time_us":351611,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":7206,"raft.queue_time_us":616890,"raft.run_cpu_time_us":1120,"raft.run_wall_time_us":85038,"spinlock_wait_cycles":105500928,"thread_start_us":428598,"threads_started":3,"wal-append.queue_time_us":145449}
I20260925 16:43:48.515141  9048 rpcz_store.cc:276] 0925 16:43:44.339398 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:44.339555 (+   157us) service_pool.cc:227] Handling call
0925 16:43:46.163740 (+1824185us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:46.221163 (+ 57423us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:48.002112 (+1780949us) spinlock_profiling.cc:243] Waited 1.8 s on lock 0x7b54002c0450. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:48.039080 (+ 36968us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4150330624}
I20260925 16:43:47.997340  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:48.162340  9697 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:48.558766  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:48.519796 11680 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:47.863360 11810 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:47.790340 11845 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:48.523509 11490 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:48.527181 11709 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.176234  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:48.517568  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 776807us
W20260925 16:43:47.793125  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43975.4us
I20260925 16:43:47.891360 11859 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260925 16:43:48.517131  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 771699us
I20260925 16:43:48.089236  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2133) took 1403 ms. Trace:
W20260925 16:43:48.513769  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 738688us
I20260925 16:43:48.310173 11804 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:48.587524  9116 rpcz_store.cc:276] 0925 16:43:46.685406 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.685516 (+   110us) service_pool.cc:227] Handling call
0925 16:43:46.936496 (+250980us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:47.664076 (+727580us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:48.088965 (+424889us) spinlock_profiling.cc:243] Waited 727 ms on lock 0x7b54003bf1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:48.089165 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1671965056}
I20260925 16:43:47.735863 11838 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:48.070708 11841 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260925 16:43:48.539934 11715 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.324390  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2140) took 1260 ms. Trace:
I20260925 16:43:48.540894  9701 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:48.046478  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.594717  9702 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:47.735118 11843 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.601109 11843 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.001758 11539 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:48.184314 11820 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:48.601795 11680 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.602200 11820 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:47.824975  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:48.573781 11745 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:48.603880  8967 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
W20260925 16:43:48.604322  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1896) took 2914 ms (client timeout 3297 ms). Trace:
W20260925 16:43:48.604645  8967 rpcz_store.cc:269] 0925 16:43:45.689788 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.372417 (+682629us) service_pool.cc:227] Handling call
0925 16:43:47.824814 (+1452397us) spinlock_profiling.cc:243] Waited 7.49 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:43:48.604270 (+779456us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":17221376}
I20260925 16:43:48.542977 11777 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:47.751236  9694 rpcz_store.cc:276] 0925 16:43:46.192747 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.669525 (+1476778us) service_pool.cc:227] Handling call
0925 16:43:47.673378 (+  3853us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:48.607591 11848 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.898s	user 0.007s	sys 0.003s
I20260925 16:43:48.542948 11840 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.320708  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2139) took 1263 ms. Trace:
I20260925 16:43:48.541740  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:48.608242  9120 rpcz_store.cc:276] 0925 16:43:47.056918 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.057066 (+   148us) service_pool.cc:227] Handling call
0925 16:43:47.076403 (+ 19337us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:47.811807 (+735404us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:47.811852 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:47.811907 (+    55us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:47.811952 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:48.320398 (+508446us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b5400041fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:48.320459 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:48.320639 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1690609536}
I20260925 16:43:48.609526 11820 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:47.999347  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1512) took 2191 ms. Trace:
I20260925 16:43:48.609889 11715 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.610332 11838 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.610140  9042 rpcz_store.cc:276] 0925 16:43:45.808406 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.809297 (+   891us) service_pool.cc:227] Handling call
0925 16:43:45.809668 (+   371us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:45.908593 (+ 98925us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:45.908636 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:45.909031 (+   395us) log.cc:842] Serialized 26 byte log entry
0925 16:43:46.251995 (+342964us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:46.318496 (+ 66501us) log.cc:842] Serialized 14 byte log entry
0925 16:43:46.318711 (+   215us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.997635 (+1678924us) spinlock_profiling.cc:243] Waited 9.16 ms on lock 0x7b180036f820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9
0925 16:43:47.998968 (+  1333us) spinlock_profiling.cc:243] Waited 98.5 ms on lock 0x7b540008e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:47.999028 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:47.999085 (+    57us) raft_consensus.cc:1671] finished
0925 16:43:47.999103 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:47.999278 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":66226,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":203493,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":34732,"spinlock_wait_cycles":247730944,"thread_start_us":311929,"threads_started":1,"wal-append.queue_time_us":1642885}
I20260925 16:43:48.612357  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:48.612926  9042 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:48.578433 11810 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.613695  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:48.614616 11810 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.614660  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:47.794610 11830 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:48.550258 11620 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:48.616050 11620 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.616290 11830 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.618074 11620 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:47.842319  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 230465us
I20260925 16:43:48.549157 11857 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:48.583377 11855 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:48.619334 11857 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.590782 11726 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:48.621625 11845 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:43:48.622180 11857 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:48.622462 11845 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:48.622934 11845 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.623849 11634 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:48.624218 11634 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:48.625051 11841 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.626102  9696 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 1. Current term is 2. Ops: []
I20260925 16:43:48.627239  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 637) took 2670 ms. Trace:
I20260925 16:43:48.627336 11845 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:48.555401  9046 rpcz_store.cc:269] 0925 16:43:45.309740 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.309867 (+   127us) service_pool.cc:227] Handling call
0925 16:43:48.389344 (+3079477us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54000df554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:48.389531 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2096610176}
I20260925 16:43:48.514441 11645 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:43:48.627589  9696 rpcz_store.cc:276] 0925 16:43:45.956740 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:45.964489 (+  7749us) service_pool.cc:227] Handling call
0925 16:43:46.360662 (+396173us) spinlock_profiling.cc:243] Waited 62.5 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:43:46.360940 (+   278us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:48.626465 (+2265525us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:48.627018 (+   553us) spinlock_profiling.cc:243] Waited 2.26 s on lock 0x7b54004f06d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:48.627168 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5352587264}
I20260925 16:43:48.414844  9045 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260925 16:43:48.444300 11858 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.074s	user 0.003s	sys 0.000s
W20260925 16:43:48.001343 11799 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 2.135s	user 0.001s	sys 0.002s
I20260925 16:43:48.569100  9699 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:48.579598  9697 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:48.630570 11841 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.560905  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:48.582858  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:48.631004  9046 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260925 16:43:48.588217  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:48.587535  9049 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260925 16:43:48.587649  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.689s (SENT)
I20260925 16:43:48.632429  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:48.633425  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45801us
W20260925 16:43:48.634114  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.727s (SENT)
I20260925 16:43:48.447813  8872 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 4, leader changed from <none> to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:48.634553  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:43:48.590118  9089 connection.cc:232] RPC call timeout handler was delayed by -2.3293954899997971s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2054s for a response
I20260925 16:43:48.553362 11722 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:48.637245 11820 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:48.638186  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50045.5us
I20260925 16:43:48.639086  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:48.639823 11840 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:48.640269 11841 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:48.640769 11841 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:48.640823 11859 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:48.091897 11827 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:48.594381  9121 rpcz_store.cc:276] 0925 16:43:47.064479 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.064695 (+   216us) service_pool.cc:227] Handling call
0925 16:43:47.066186 (+  1491us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:47.083307 (+ 17121us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:47.083336 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:47.083373 (+    37us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:47.083403 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:48.324124 (+1240721us) spinlock_profiling.cc:243] Waited 16.9 ms on lock 0x7b540009ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:48.324179 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:48.324327 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":38981888}
I20260925 16:43:48.596194  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:48.596717 11784 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
W20260925 16:43:48.642354  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48447.1us
I20260925 16:43:48.598016  9693 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260925 16:43:48.641592 11841 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.647586  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.647972  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.648272  9693 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:48.649228  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.649940  9693 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:48.650651  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.651376  9693 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:48.654258  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:48.603768 11846 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:48.605093 11688 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:48.609485  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.612450 11838 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:47.978365  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:48.620121  9700 raft_consensus.cc:2396] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:48.619860 11490 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:43:48.601832  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:48.717536  9702 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:48.624951 11634 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.628818  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:47.751533 11783 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:48.144099 11734 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.891s	user 0.011s	sys 0.000s
W20260925 16:43:48.179905 11675 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.108s	user 0.011s	sys 0.000s
W20260925 16:43:48.580695  8871 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 217) took 17457 ms (client timeout 15000 ms). Trace:
I20260925 16:43:48.316051 11753 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
W20260925 16:43:48.632465  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71632.9us
W20260925 16:43:48.635560  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9768195639999249s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
I20260925 16:43:48.590572 11709 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:48.107582 11788 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.998s	user 0.013s	sys 0.000s
I20260925 16:43:48.631307  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.636539 11763 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260925 16:43:48.636771  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.760s (SENT)
W20260925 16:43:48.801009  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 164248us
I20260925 16:43:48.636919  9044 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:43:48.642364  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:48.805282  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 162980us
I20260925 16:43:48.806147  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:48.643074  9701 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:48.644196  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.807981  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.645989  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.603015 11757 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:48.647858 11897 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.096s	user 0.002s	sys 0.000s
I20260925 16:43:48.635151  8872 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 6 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:48.669764  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.811383  9116 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:48.591779 11804 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:48.813781 11804 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.814917 11804 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:48.689079  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.046847 11819 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.715641  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.675585 11849 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:48.716382  9698 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:48.677196 11680 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.056s
I20260925 16:43:48.733923  9696 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:43:48.713783 11857 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:48.736297  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2131) took 2059 ms. Trace:
I20260925 16:43:48.831524  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.833388  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.831395  9122 rpcz_store.cc:276] 0925 16:43:46.677344 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.677477 (+   133us) service_pool.cc:227] Handling call
0925 16:43:46.685529 (+  8052us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:47.604114 (+918585us) raft_consensus.cc:1520] Early marking committed up to index 2
0925 16:43:47.988937 (+384823us) log.cc:842] Serialized 14 byte log entry
0925 16:43:48.571052 (+582115us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:48.571775 (+   723us) log.cc:842] Serialized 52 byte log entry
0925 16:43:48.571931 (+   156us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:48.572174 (+   243us) log.cc:842] Serialized 14 byte log entry
0925 16:43:48.572392 (+   218us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:48.572480 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:48.736069 (+163589us) raft_consensus.cc:1671] finished
0925 16:43:48.736090 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:48.736238 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18015,"prepare.queue_time_us":937754,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":75,"raft.queue_time_us":441694,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":15636,"thread_start_us":1687944,"threads_started":3,"wal-append.queue_time_us":575298}
I20260925 16:43:48.834401  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.834695  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:48.744534 11886 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
W20260925 16:43:48.747004 11884 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.199s	user 0.000s	sys 0.001s
I20260925 16:43:48.807680 11734 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:48.748189 11887 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
W20260925 16:43:48.749668 11898 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.206s	user 0.002s	sys 0.000s
I20260925 16:43:48.733652  9702 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260925 16:43:48.760082 11490 consensus_queue.cc:1225] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260925 16:43:48.778564 11837 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:48.780885 11753 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:48.796147  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8760195639999893s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1648s for a response
W20260925 16:43:48.897059  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8355195639999238s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1693s for a response
W20260925 16:43:48.897441  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7941195639998568s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17390000000000003s for a response
I20260925 16:43:48.783624  9699 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:48.817262  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.816622  8872 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:43:48.900523  8872 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:48.903378  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:48.830600  9696 raft_consensus.cc:595] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:48.904505  9696 raft_consensus.cc:603] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:48.897106  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:48.777882  8871 rpcz_store.cc:269] 0925 16:43:31.117298 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:31.117950 (+   652us) service_pool.cc:227] Handling call
0925 16:43:48.574698 (+17456748us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:40.970391 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:41.104189 (+133798us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:41.104238 (+    49us) write_op.cc:435] Acquired schema lock
0925 16:43:41.104256 (+    18us) tablet.cc:660] Decoding operations
0925 16:43:41.171185 (+ 66929us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:41.185073 (+ 13888us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:41.193261 (+  8188us) tablet.cc:683] Acquiring locks for 11 operations
0925 16:43:41.439050 (+245789us) tablet.cc:699] Row locks acquired
0925 16:43:41.447090 (+  8040us) write_op.cc:260] PREPARE: finished
0925 16:43:41.460034 (+ 12944us) write_op.cc:270] Start()
0925 16:43:41.460242 (+   208us) write_op.cc:276] Timestamp: P: 1790354621459950 usec, L: 0
0925 16:43:41.460285 (+    43us) op_driver.cc:331] REPLICATION: starting
0925 16:43:41.461010 (+   725us) log.cc:842] Serialized 4367 byte log entry
0925 16:43:42.660459 (+1199449us) op_driver.cc:444] REPLICATION: finished
0925 16:43:43.419756 (+759297us) write_op.cc:301] APPLY: starting
0925 16:43:43.428047 (+  8291us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:43.444363 (+ 16316us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:43.491907 (+ 47544us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:44.059146 (+567239us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:44.289059 (+229913us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0925 16:43:44.338200 (+ 49141us) write_op.cc:312] APPLY: finished
0925 16:43:44.403408 (+ 65208us) log.cc:842] Serialized 83 byte log entry
0925 16:43:45.400071 (+996663us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:45.400277 (+   206us) write_op.cc:454] Released schema lock
0925 16:43:45.400365 (+    88us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:45.400687 (+   322us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:45.400716 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3563401,"reported_tablets":26,"child_traces":[["op",{"apply.queue_time_us":716258,"apply.run_cpu_time_us":30104,"apply.run_wall_time_us":2013799,"num_ops":11,"prepare.queue_time_us":347629,"prepare.run_cpu_time_us":16587,"prepare.run_wall_time_us":659568,"raft.queue_time_us":290829,"raft.run_cpu_time_us":18296,"raft.run_wall_time_us":323007,"replication_time_us":1200078,"thread_start_us":1870898,"threads_started":5,"wal-append.queue_time_us":1440808,"wal-append.run_cpu_time_us":68862,"wal-append.run_wall_time_us":3367196}]]}
W20260925 16:43:48.742273 11892 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260925 16:43:48.835650  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:48.733173  8941 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 2.012s (SENT)
I20260925 16:43:48.902900  8872 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 8, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 8 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:43:48.908066  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 174926us
I20260925 16:43:48.856855  9117 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:48.857282  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.816180 11634 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:48.859066  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:48.865650  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:48.816431 11787 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:48.871726  9697 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
W20260925 16:43:48.910034  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 103979us
I20260925 16:43:48.855907 11817 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:48.898991  9701 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:48.810071 11788 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.863456  9694 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:48.909112  8872 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:48.938727  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:48.940140  8872 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:48.916978  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7689195639998161s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260925 16:43:48.934355  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:48.941656  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6437368790000164s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260925 16:43:48.942319  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6302368789999946s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18930000000000002s for a response
W20260925 16:43:48.942843  9089 connection.cc:232] RPC call timeout handler was delayed by -1.5870368789999247s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260925 16:43:48.932914  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67338.6us
I20260925 16:43:48.935809  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.838284 11857 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.936520  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:48.934371  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:48.944581  9702 raft_consensus.cc:2362] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6. Re-sending same reply.
I20260925 16:43:48.945461  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:48.945652  9089 connection.cc:232] RPC call timeout handler was delayed by -1.371119563999855s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2209s for a response
W20260925 16:43:48.946375  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1856368789999578s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23870000000000002s for a response
W20260925 16:43:48.946827  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0767368790000091s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2508s for a response
I20260925 16:43:48.947054  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:48.948691  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:48.837218 11849 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.944012  9699 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:48.954366 11787 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:48.949858 11817 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:48.954934 11816 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:48.954948 11763 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260925 16:43:48.959053 11881 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:43:48.967990  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:49.013162  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 497833us
I20260925 16:43:48.968839  9117 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:43:48.978685  9015 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.763s (SENT)
I20260925 16:43:48.931015 11675 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:49.005457  9119 raft_consensus.cc:2396] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:48.974735  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2145) took 1767 ms. Trace:
I20260925 16:43:48.934954 11875 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:48.911181 11840 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.087s
I20260925 16:43:48.873525 11734 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.930797 11786 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260925 16:43:48.943729 11859 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.074s
I20260925 16:43:48.911047 11837 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:48.974747  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:48.975659 11680 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:49.006448 11751 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.021s	sys 0.032s
I20260925 16:43:49.019596  9123 rpcz_store.cc:276] 0925 16:43:47.207753 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.333770 (+126017us) service_pool.cc:227] Handling call
0925 16:43:47.334223 (+   453us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:47.371007 (+ 36784us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:47.371056 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:47.401638 (+ 30582us) log.cc:842] Serialized 52 byte log entry
0925 16:43:47.985653 (+584015us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:47.985704 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:47.985790 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:48.974542 (+988752us) raft_consensus.cc:1671] finished
0925 16:43:48.974563 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:48.974680 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":257541,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":37846,"thread_start_us":385765,"threads_started":1,"wal-append.queue_time_us":1271916}
I20260925 16:43:49.034006  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:49.077992  9122 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:48.973358  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:49.080154  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:49.081830  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:49.068234  8872 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:49.006129 11816 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:49.020429 11688 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:49.078872  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2132) took 2401 ms. Trace:
I20260925 16:43:49.096429  9119 rpcz_store.cc:276] 0925 16:43:46.677655 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:46.677815 (+   160us) service_pool.cc:227] Handling call
0925 16:43:49.078643 (+2400828us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54001a04d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:49.078797 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5257841024}
I20260925 16:43:49.014137 11787 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:49.088284  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:49.090436  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 117161us
I20260925 16:43:49.081009  9123 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:49.052970 11880 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:49.085628 11751 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.026s	user 0.021s	sys 0.032s
I20260925 16:43:49.099980 11883 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:49.103838  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:49.105611  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:49.118110  9122 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260925 16:43:49.113287  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:49.120174  9119 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:49.106921  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 498) took 1238 ms. Trace:
W20260925 16:43:49.099596  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43720.6us
I20260925 16:43:49.104938  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:49.124465  9123 rpcz_store.cc:276] 0925 16:43:47.868299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.105672 (+1237373us) service_pool.cc:227] Handling call
0925 16:43:49.105979 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.106364 (+   385us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.106400 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:49.106450 (+    50us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:49.106679 (+   229us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.106749 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.106863 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:49.125583  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.094s (SENT)
I20260925 16:43:49.139627  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 501) took 1238 ms. Trace:
W20260925 16:43:49.140092  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.106s (SENT)
I20260925 16:43:49.141363  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2146) took 1232 ms. Trace:
I20260925 16:43:49.147734  9122 rpcz_store.cc:276] 0925 16:43:47.908977 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.089900 (+1180923us) service_pool.cc:227] Handling call
0925 16:43:49.141298 (+ 51398us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:49.101354 11787 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:49.144634  9120 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:49.093848 11819 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.150228  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 500) took 1261 ms. Trace:
I20260925 16:43:49.114084  8872 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:43:49.152659  9695 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.007s	sys 0.021s
I20260925 16:43:49.030376 11675 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:49.153283  8872 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:43:49.159155  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.124s (SENT)
I20260925 16:43:49.150905  9119 rpcz_store.cc:276] 0925 16:43:47.888356 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.121532 (+1233176us) service_pool.cc:227] Handling call
0925 16:43:49.149686 (+ 28154us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.149885 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.149912 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:49.149961 (+    49us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:49.150005 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.150052 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.150172 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:49.152676  9124 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.974s	user 0.008s	sys 0.023s
I20260925 16:43:49.008523 11753 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.114733 11883 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:49.115521 11880 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:49.099910 11827 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.073s
I20260925 16:43:49.103030 11688 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.472741  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2152) took 1415 ms. Trace:
I20260925 16:43:49.100032 11854 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:49.247958  9696 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:54192
W20260925 16:43:49.201041  9666 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.032s	sys 0.079s
I20260925 16:43:49.480014  9122 rpcz_store.cc:276] 0925 16:43:48.057593 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.149143 (+1091550us) service_pool.cc:227] Handling call
0925 16:43:49.180940 (+ 31797us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.283156 (+102216us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.283199 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:49.283251 (+    52us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:49.283293 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.472505 (+189212us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:49.472560 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.472685 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":234483584}
I20260925 16:43:49.377192  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:49.163738  8872 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 4 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:49.252986  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2148) took 1325 ms. Trace:
I20260925 16:43:49.309405  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:49.355820  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.755s	user 0.017s	sys 0.020s
W20260925 16:43:49.227200  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 90157.1us
W20260925 16:43:49.483717  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.017s	sys 0.026s
W20260925 16:43:49.479671  9116 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.000s
W20260925 16:43:49.230756  9117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 499) took 1343 ms (client timeout 1594 ms). Trace:
I20260925 16:43:49.484661  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 2.
W20260925 16:43:49.484787  9117 rpcz_store.cc:269] 0925 16:43:47.887381 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.541502 (+654121us) service_pool.cc:227] Handling call
0925 16:43:49.230581 (+689079us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:49.230696 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":571144576}
I20260925 16:43:49.226795  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2153) took 1166 ms. Trace:
W20260925 16:43:49.486492  9124 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.346s	user 0.019s	sys 0.026s
I20260925 16:43:49.482777  9120 rpcz_store.cc:276] 0925 16:43:47.927755 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.714197 (+786442us) service_pool.cc:227] Handling call
0925 16:43:49.252767 (+538570us) spinlock_profiling.cc:243] Waited 328 ms on lock 0x7b54001c8c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:49.252914 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":755083008}
I20260925 16:43:49.144313 11875 raft_consensus.cc:2741] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260925 16:43:49.481495  9666 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.040s	sys 0.107s
W20260925 16:43:49.365311  9045 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.028s	sys 0.125s
I20260925 16:43:49.250701  9698 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:49.488123  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:49.200651  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50890us
I20260925 16:43:49.481230  9696 raft_consensus.cc:595] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:43:49.147017 11882 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:49.163636  9123 rpcz_store.cc:276] 0925 16:43:47.901081 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.138704 (+1237623us) service_pool.cc:227] Handling call
0925 16:43:49.139049 (+   345us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.139244 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.139292 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:49.139343 (+    51us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:49.139383 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.139445 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.139568 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:43:49.508956  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.778s (SENT) [suppressed 42 similar messages]
W20260925 16:43:49.239903 11900 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
W20260925 16:43:49.481904  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.021s	sys 0.039s
W20260925 16:43:49.547188  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.021s	sys 0.039s
W20260925 16:43:49.547886  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 599234us
I20260925 16:43:49.258548 11763 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:43:49.517933  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 934101us
I20260925 16:43:49.524863  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:49.518091  9045 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.039s	sys 0.176s
I20260925 16:43:49.520076  9700 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260925 16:43:49.520216  9698 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 854) took 1542 ms (client timeout 1637 ms). Trace:
I20260925 16:43:49.458777  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:49.237468 11675 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:49.516994  9116 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:43:49.571388  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2155) took 1021 ms. Trace:
I20260925 16:43:49.571851  9116 rpcz_store.cc:276] 0925 16:43:48.549934 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.516266 (+966332us) service_pool.cc:227] Handling call
0925 16:43:49.516670 (+   404us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.571070 (+ 54400us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.571325 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:49.464753 11726 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:43100 (request call id 13) took 17457 ms. Trace:
W20260925 16:43:49.238253 11899 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260925 16:43:49.264274 11645 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.636s	user 0.004s	sys 0.005s
W20260925 16:43:49.260879 11477 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260925 16:43:49.149240 11787 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:49.567963 11763 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:49.535100  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:49.107803 11853 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.864s	user 0.010s	sys 0.008s
I20260925 16:43:49.537302  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:49.601257  9122 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:49.528890 11826 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260925 16:43:49.237545 11857 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.541489  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:49.541908  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:49.544024  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:49.634246  9043 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
W20260925 16:43:49.545194  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.518s (SENT)
I20260925 16:43:49.234767 11816 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:49.548699  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:49.608239 11853 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.365s	user 0.023s	sys 0.015s
I20260925 16:43:49.265461 11680 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:49.262985 11849 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.508234 11854 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:49.262341 11734 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.563745  9044 raft_consensus.cc:2354] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:49.260387 11788 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:49.564249  9666 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.119s (SENT)
I20260925 16:43:49.525537  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:43:49.661757  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 136346us
I20260925 16:43:49.203754  9701 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
W20260925 16:43:49.553047  9698 rpcz_store.cc:269] 0925 16:43:47.977950 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.978075 (+   125us) service_pool.cc:227] Handling call
0925 16:43:49.520142 (+1542067us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:49.529198  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2154) took 1468 ms. Trace:
I20260925 16:43:49.663758  9117 rpcz_store.cc:276] 0925 16:43:48.061192 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.528132 (+1466940us) service_pool.cc:227] Handling call
0925 16:43:49.528584 (+   452us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.528791 (+   207us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.528827 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:49.528880 (+    53us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:49.528921 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.528986 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.529105 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:49.637168 11840 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:49.516408 11874 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:49.536427 11882 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:49.503563 11883 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:49.539264 11805 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260925 16:43:49.531921  9089 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.536s (SENT)
W20260925 16:43:49.677325  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 145434us
I20260925 16:43:49.486661  9119 rpcz_store.cc:276] 0925 16:43:48.060876 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.163355 (+1102479us) service_pool.cc:227] Handling call
0925 16:43:49.226228 (+ 62873us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.226444 (+   216us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.226481 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:49.226533 (+    52us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:49.226574 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.226636 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.226744 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:49.600971  9115 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:43:49.608486  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73484.3us
I20260925 16:43:49.537551 11827 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.050s
W20260925 16:43:49.632997  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.003s	sys 0.027s
W20260925 16:43:49.694357  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.003s	sys 0.027s
I20260925 16:43:49.661175 11854 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:49.694739  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 638255us
I20260925 16:43:49.354884 11634 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:49.697155  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.004s	sys 0.030s
W20260925 16:43:49.697497  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.004s	sys 0.030s
W20260925 16:43:49.697714  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 785102us
I20260925 16:43:49.698876  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:49.639724  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91097.8us
I20260925 16:43:49.701332  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:49.267261  9121 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:49.630847  9694 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:49.647895  9122 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:49.600943  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:49.576375  9116 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:49.634573 11838 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:49.720708  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:49.722883  9121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2150) took 1734 ms (client timeout 2163 ms). Trace:
W20260925 16:43:49.723349  9121 rpcz_store.cc:269] 0925 16:43:47.988687 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.643799 (+655112us) service_pool.cc:227] Handling call
0925 16:43:49.722693 (+1078894us) spinlock_profiling.cc:243] Waited 619 ms on lock 0x7b5400165154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:49.722822 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1422718208}
I20260925 16:43:49.637866 11837 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:49.674031  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 109804us
W20260925 16:43:49.726370  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.229s (SENT)
I20260925 16:43:49.726856  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:49.649327 11786 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:49.675729  9117 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260925 16:43:49.676621 11871 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.026s	sys 0.019s
I20260925 16:43:49.679149 11863 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:49.650255  9041 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:49.693275  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:49.635597  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90449.5us
W20260925 16:43:49.675526 11804 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.000s
I20260925 16:43:49.717312  9119 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:49.719326  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2159) took 1027 ms. Trace:
I20260925 16:43:49.669859 11788 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:49.737061  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:49.679237 11882 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:49.655783 11680 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:49.789024  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:49.790457  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:49.700507 11477 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260925 16:43:49.738215 11816 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:49.692379 11805 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:49.763665  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:49.765444  9115 rpcz_store.cc:276] 0925 16:43:48.691658 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.818511 (+126853us) service_pool.cc:227] Handling call
0925 16:43:49.719111 (+900600us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400143f54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:49.719264 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1568880384}
W20260925 16:43:49.753675 11783 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.020s	sys 0.060s
I20260925 16:43:49.721148 11838 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:49.791951  9695 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.014s	sys 0.029s
W20260925 16:43:49.753985 11871 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.027s	sys 0.019s
I20260925 16:43:49.675271 11840 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:49.794783 11913 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260925 16:43:49.804550 11855 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:49.804754 11871 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:43:49.584297 11726 rpcz_store.cc:276] 0925 16:43:32.007104 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:32.357570 (+350466us) service_pool.cc:227] Handling call
0925 16:43:32.502214 (+144644us) log.cc:842] Serialized 506 byte log entry
0925 16:43:33.012437 (+510223us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b5400401b20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bec3416 00007f719bebcdaa 00007f719bebc014 00007f719bea4545 00007f719bea9771 00007f719bea96f9 00007f719bea9689 00007f719bea9651 00007f719bea881d 00007f71a2266204
0925 16:43:33.070484 (+ 58047us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b180040a5c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f719fdd2bcf 00007f71990027b6 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d
0925 16:43:33.261522 (+191038us) spinlock_profiling.cc:243] Waited 5.65 ms on lock 0x7b180040a5c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:43:33.271259 (+  9737us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b180040a5c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:43:49.464429 (+16193170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":243924,"raft.queue_time_us":29235,"raft.run_cpu_time_us":15377,"raft.run_wall_time_us":338396,"spinlock_wait_cycles":52093184,"thread_start_us":217559,"threads_started":1,"wal-append.queue_time_us":295544,"wal-append.run_cpu_time_us":1575,"wal-append.run_wall_time_us":1001631}
I20260925 16:43:49.794407  9693 raft_consensus.cc:2354] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:49.762475 11880 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:49.709059 11634 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:49.784129 11784 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.012s	sys 0.030s
I20260925 16:43:49.770973 11777 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:49.783859 11846 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:49.840504 11751 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.004s	sys 0.021s
W20260925 16:43:49.906559 11751 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.004s	sys 0.022s
I20260925 16:43:49.906663 11846 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:43:49.906991 11905 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.166s	user 0.000s	sys 0.000s
I20260925 16:43:49.907236 11846 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:49.907718 11846 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:49.908816 11904 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.277s	user 0.000s	sys 0.001s
I20260925 16:43:49.785742 11788 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:49.910060 11788 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:49.910395 11477 tablet_bootstrap.cc:492] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:43:49.911320 11477 ts_tablet_manager.cc:1397] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 3.828s	user 0.037s	sys 0.023s
W20260925 16:43:49.801282 11783 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.020s	sys 0.061s
I20260925 16:43:49.805069 11709 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:49.827097  9115 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
W20260925 16:43:49.801548  9695 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.014s	sys 0.030s
I20260925 16:43:49.919384  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 742) took 1650 ms. Trace:
I20260925 16:43:49.919749  9695 rpcz_store.cc:276] 0925 16:43:48.268649 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.617391 (+348742us) service_pool.cc:227] Handling call
0925 16:43:48.617667 (+   276us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:48.618019 (+   352us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:48.618045 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:48.618445 (+   400us) log.cc:842] Serialized 26 byte log entry
0925 16:43:49.163556 (+545111us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:49.918948 (+755392us) log.cc:842] Serialized 14 byte log entry
0925 16:43:49.919130 (+   182us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.919191 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:49.919227 (+    36us) raft_consensus.cc:1671] finished
0925 16:43:49.919238 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.919339 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1660,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":1171258,"threads_started":2,"wal-append.queue_time_us":851361}
I20260925 16:43:49.801100 11805 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:49.922981 11874 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:49.923410 11874 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
W20260925 16:43:49.924031 11910 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.320s	user 0.000s	sys 0.000s
I20260925 16:43:49.924821 11753 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:49.802508 11688 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.772691 11786 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.049s
I20260925 16:43:49.805917 11838 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:49.772038 11863 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:49.822901 11907 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.241s	user 0.000s	sys 0.001s
I20260925 16:43:49.913188  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 743) took 1054 ms. Trace:
I20260925 16:43:49.935971  9701 rpcz_store.cc:276] 0925 16:43:48.859165 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.941271 (+ 82106us) service_pool.cc:227] Handling call
0925 16:43:48.941599 (+   328us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.663005 (+721406us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.912904 (+249899us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b5400436054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:49.913124 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":602229120}
I20260925 16:43:49.913550  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 496) took 2055 ms. Trace:
I20260925 16:43:49.824839 11871 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:49.914407  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2143) took 1334 ms. Trace:
I20260925 16:43:49.882755 11680 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.868117 11855 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:43:49.944593  9048 rpcz_store.cc:276] 0925 16:43:48.580458 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.581056 (+   598us) service_pool.cc:227] Handling call
0925 16:43:48.599144 (+ 18088us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:48.599524 (+   380us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:48.599559 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:48.600117 (+   558us) log.cc:842] Serialized 26 byte log entry
0925 16:43:49.484244 (+884127us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:49.484295 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.484391 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:49.914181 (+429790us) raft_consensus.cc:1671] finished
0925 16:43:49.914205 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.914343 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8733,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":60,"thread_start_us":883713,"threads_started":1,"wal-append.queue_time_us":951415}
I20260925 16:43:49.917424 11783 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:49.884820 11849 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:49.958112 11634 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.930608  9120 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
W20260925 16:43:49.876504 11784 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.012s	sys 0.030s
I20260925 16:43:49.928292 11777 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.937286  9118 rpcz_store.cc:276] 0925 16:43:47.858637 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.858760 (+   123us) service_pool.cc:227] Handling call
0925 16:43:47.873402 (+ 14642us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:48.514643 (+641241us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:48.514671 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:48.583278 (+ 68607us) log.cc:842] Serialized 26 byte log entry
0925 16:43:49.056382 (+473104us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:49.056417 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.056485 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:49.913305 (+856820us) raft_consensus.cc:1671] finished
0925 16:43:49.913332 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.913486 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":669667,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":450371,"threads_started":1,"wal-append.queue_time_us":1050552}
I20260925 16:43:49.960742 11783 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:49.961057 11777 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.961601 11783 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:49.961923 11477 raft_consensus.cc:348] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:49.962597 11783 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:49.963236 11477 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:43:49.952180 11871 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:49.965636 11853 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:43:49.965996 11853 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:49.957473 11680 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:49.967056 11477 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:49.970261 11853 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.971398 11853 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:49.928521 11918 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:49.960379 11787 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:49.977468 11787 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:49.971558 11840 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:49.957888 11855 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:49.978583 11855 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.972870 11788 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:49.975550 11477 ts_tablet_manager.cc:1428] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.064s	user 0.009s	sys 0.000s
I20260925 16:43:49.987360 11788 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:49.980450 11906 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:43:50.009553 11874 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:50.010630 11909 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.371s	user 0.000s	sys 0.001s
W20260925 16:43:50.039031 11921 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
W20260925 16:43:50.072134  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.000s	sys 0.033s
W20260925 16:43:50.073135  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.522s	user 0.000s	sys 0.034s
W20260925 16:43:50.073590  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 522771us
W20260925 16:43:50.078967  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 358139us
I20260925 16:43:50.079329  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:50.082048  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:49.941100  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 150500us
W20260925 16:43:50.083451  9045 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.009s	sys 0.011s
W20260925 16:43:50.092274  9045 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.010s	sys 0.011s
I20260925 16:43:50.093729  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1519) took 1481 ms. Trace:
I20260925 16:43:49.927979  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1517) took 1316 ms. Trace:
I20260925 16:43:50.094187  9045 rpcz_store.cc:276] 0925 16:43:48.612099 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.630143 (+ 18044us) service_pool.cc:227] Handling call
0925 16:43:48.630413 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:48.630590 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 3
0925 16:43:48.644247 (+ 13657us) log.cc:842] Serialized 14 byte log entry
0925 16:43:48.745906 (+101659us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b180036f4c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b 00007f719bf3488a
0925 16:43:50.093000 (+1347094us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:50.093140 (+   140us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:50.093279 (+   139us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:50.093415 (+   136us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:50.093667 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":268,"prepare.queue_time_us":13458,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":36,"raft.queue_time_us":39576,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":30492,"spinlock_wait_cycles":23759232,"thread_start_us":1331205,"threads_started":2,"wal-append.queue_time_us":935503}
I20260925 16:43:50.096421  9042 rpcz_store.cc:276] 0925 16:43:48.611500 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.615515 (+  4015us) service_pool.cc:227] Handling call
0925 16:43:48.642787 (+ 27272us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:48.643234 (+   447us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:48.643280 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:48.666544 (+ 23264us) log.cc:842] Serialized 52 byte log entry
0925 16:43:49.201062 (+534518us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:49.201208 (+   146us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.201415 (+   207us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:49.927764 (+726349us) raft_consensus.cc:1671] finished
0925 16:43:49.927783 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:49.927923 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":81,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":3365,"thread_start_us":467951,"threads_started":1,"wal-append.queue_time_us":798959}
W20260925 16:43:49.944952  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 266822us
W20260925 16:43:50.100287  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 406949us
W20260925 16:43:50.100859  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.693s (SENT)
I20260925 16:43:50.085541  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2146) took 1133 ms. Trace:
I20260925 16:43:50.104091  9050 rpcz_store.cc:276] 0925 16:43:48.952164 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:48.952389 (+   225us) service_pool.cc:227] Handling call
0925 16:43:48.952773 (+   384us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:48.970911 (+ 18138us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:48.970953 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:48.996043 (+ 25090us) log.cc:842] Serialized 26 byte log entry
0925 16:43:49.561161 (+565118us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:49.561217 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.561315 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:50.084954 (+523639us) raft_consensus.cc:1671] finished
0925 16:43:50.084994 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:50.085322 (+   328us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17682,"raft.queue_time_us":43188,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":9635,"thread_start_us":498381,"threads_started":1,"wal-append.queue_time_us":1019192}
I20260925 16:43:50.085656  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 506) took 1507 ms. Trace:
I20260925 16:43:50.106482  9123 rpcz_store.cc:276] 0925 16:43:48.579560 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.551646 (+972086us) service_pool.cc:227] Handling call
0925 16:43:49.564068 (+ 12422us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:49.564485 (+   417us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:49.564524 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:49.565023 (+   499us) log.cc:842] Serialized 26 byte log entry
0925 16:43:49.600271 (+ 35248us) spinlock_profiling.cc:243] Waited 20.9 ms on lock 0x7b1800409e40. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:43:49.995326 (+395055us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:49.995375 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:49.995527 (+   152us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:50.084841 (+ 89314us) raft_consensus.cc:1671] finished
0925 16:43:50.084885 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:50.085376 (+   491us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":403,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13021,"spinlock_wait_cycles":48091392,"thread_start_us":394775,"threads_started":1,"wal-append.queue_time_us":480846}
I20260925 16:43:50.107591  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.111737  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.113271  9695 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260925 16:43:50.114622  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.115489  9693 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:50.116938  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:50.088559  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 362079us
W20260925 16:43:50.121323  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.767s (SENT)
I20260925 16:43:50.132190  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.125186  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.125953  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.137260  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.155717 11751 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:50.156611 11751 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:50.158257 11709 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:50.158764 11751 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.160174 11726 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:50.151283 11688 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260925 16:43:50.160905 11726 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:50.161723 11726 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:50.168045 11804 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:50.169248 11804 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.174350 11804 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:50.170349 11841 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.005s
W20260925 16:43:50.129460  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 428036us
W20260925 16:43:50.215662  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 105260us
W20260925 16:43:50.224215  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88686.6us
I20260925 16:43:50.185130 11709 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260925 16:43:50.226174  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 105118us
I20260925 16:43:50.232970 11688 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:50.233920 11871 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.240700  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.246749  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2141) took 3152 ms. Trace:
I20260925 16:43:50.247182  9124 rpcz_store.cc:276] 0925 16:43:47.094616 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:47.613374 (+518758us) service_pool.cc:227] Handling call
0925 16:43:47.614437 (+  1063us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:48.038146 (+423709us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:48.038192 (+    46us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:48.068589 (+ 30397us) log.cc:842] Serialized 52 byte log entry
0925 16:43:49.487049 (+1418460us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:50.001937 (+514888us) log.cc:842] Serialized 14 byte log entry
0925 16:43:50.246116 (+244179us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:50.246307 (+   191us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:50.246370 (+    63us) raft_consensus.cc:1671] finished
0925 16:43:50.246378 (+     8us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:50.246571 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":227159,"prepare.queue_time_us":542140,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":341212,"raft.run_cpu_time_us":285,"raft.run_wall_time_us":23840,"thread_start_us":2166172,"threads_started":3,"wal-append.queue_time_us":1338712}
I20260925 16:43:50.251039  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2166) took 1006 ms. Trace:
I20260925 16:43:50.251482  9122 rpcz_store.cc:276] 0925 16:43:49.244163 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.720963 (+476800us) service_pool.cc:227] Handling call
0925 16:43:49.721303 (+   340us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.721526 (+   223us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:43:49.987902 (+266376us) log.cc:842] Serialized 14 byte log entry
0925 16:43:50.250345 (+262443us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:50.250470 (+   125us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:50.250544 (+    74us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:50.250677 (+   133us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:50.250861 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17528,"prepare.queue_time_us":321890,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"thread_start_us":510174,"threads_started":2}
I20260925 16:43:50.282322  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.287328 11927 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:43:50.287969  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.289273 11927 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:50.289752 11927 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:50.290213 11927 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:50.292358 11871 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:50.295869 11763 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.651s	user 0.008s	sys 0.013s
I20260925 16:43:50.296442 11763 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.297863  9043 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:50.301028  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 197390us
W20260925 16:43:50.302541  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.893s (SENT)
I20260925 16:43:50.302938  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:50.303251 11883 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.586s	user 0.006s	sys 0.005s
I20260925 16:43:50.233963 11688 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.304863 11634 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:50.305078 11675 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:43:50.305671  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.941s (SENT)
I20260925 16:43:50.306278  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.307312  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2162) took 1585 ms. Trace:
I20260925 16:43:50.307788  9116 rpcz_store.cc:276] 0925 16:43:48.722153 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.575681 (+853528us) service_pool.cc:227] Handling call
0925 16:43:49.576024 (+   343us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:49.576240 (+   216us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:43:49.836854 (+260614us) log.cc:842] Serialized 14 byte log entry
0925 16:43:50.304085 (+467231us) log.cc:842] Serialized 14 byte log entry
0925 16:43:50.306061 (+  1976us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:50.306128 (+    67us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:50.306215 (+    87us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:50.306328 (+   113us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:50.307113 (+   785us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1600,"prepare.queue_time_us":13132,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":3576,"raft.run_cpu_time_us":202,"raft.run_wall_time_us":199,"thread_start_us":407741,"threads_started":1}
I20260925 16:43:50.310030 11866 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:50.310849 11866 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:50.310515  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72287us
I20260925 16:43:50.317404  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:50.312784  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 72435.8us
I20260925 16:43:50.320294  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.320443 11816 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:43:50.320930 11816 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:50.322048 11949 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.323556 11859 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:50.289283  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.322136 11816 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.327425 11874 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.330941 11820 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:50.313932 11931 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:50.296880  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 181905us
W20260925 16:43:50.333245  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.949s (SENT)
I20260925 16:43:50.335807  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.339637 11931 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:50.322952 11949 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.342352 11726 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.336611 11863 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:50.337581 11688 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:50.338245 11882 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.541s	user 0.006s	sys 0.007s
I20260925 16:43:50.338675 11940 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.325935  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 505) took 1755 ms. Trace:
I20260925 16:43:50.344815  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.349012  9120 rpcz_store.cc:276] 0925 16:43:48.569990 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:49.545417 (+975427us) service_pool.cc:227] Handling call
0925 16:43:49.545739 (+   322us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:49.958824 (+413085us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:50.325463 (+366639us) spinlock_profiling.cc:243] Waited 385 ms on lock 0x7b54003bf6d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:50.325763 (+   300us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":884447104}
I20260925 16:43:50.353284  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.354673  9697 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260925 16:43:50.355738  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.356206  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.356566 11871 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.356333 11948 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:43:50.363822 11948 consensus_queue.cc:1225] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 8.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260925 16:43:50.363898  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.364241  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.364840 11726 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.365033  9700 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
W20260925 16:43:50.365219  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73188.6us
I20260925 16:43:50.365753 11939 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:50.366526  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.367100  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:50.367755  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62151.2us
I20260925 16:43:50.367924  9702 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
W20260925 16:43:50.368479  9089 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.007s (SENT)
I20260925 16:43:50.369006  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.369045  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:50.369777  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 80643.6us
I20260925 16:43:50.372598 11830 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:43:50.372731 11950 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:50.373088 11830 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:50.373344 11950 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:50.374116 11830 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.374369 11950 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.366528  9696 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
W20260925 16:43:50.385370  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52239.3us
I20260925 16:43:50.343268 11949 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:50.375602 11830 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:50.341035 11838 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.380636 11882 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:50.403110  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62027.5us
I20260925 16:43:50.404412 11882 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.405490  9701 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:50.405664  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.405889  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.406406  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.406992  8966 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:50.407177  8967 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:50.357208 11871 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:50.383188 11854 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.600s	user 0.006s	sys 0.010s
I20260925 16:43:50.344797 11883 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.419991  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:43:50.422814  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54354us
W20260925 16:43:50.423164 11805 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.502s	user 0.009s	sys 0.010s
I20260925 16:43:50.423605 11805 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:50.424175  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.387s (SENT)
I20260925 16:43:50.424679  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.424189  9693 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 LEARNER]: Advancing to term 4
I20260925 16:43:50.425809 11805 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.386138 11874 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:50.426445 11675 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:50.426891 11874 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:50.411654 11948 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:43:50.428715  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.429513  8969 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:50.431054 11866 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:50.389319 11763 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.432538  9702 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:50.434923 11948 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:50.435894 11948 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:50.436203 11948 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:50.437157 11948 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.438400 11948 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.439822 11882 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:43:50.442327 11883 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.448004  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.451386  9695 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:50.453274  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.453933  9120 raft_consensus.cc:2362] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6. Re-sending same reply.
I20260925 16:43:50.471789  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.472803  9694 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:50.456837 11854 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.492580 11871 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.493309  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.467407 11949 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
W20260925 16:43:50.484491  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.184s (SENT)
I20260925 16:43:50.480141 11763 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
W20260925 16:43:50.508517  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 426782us
I20260925 16:43:50.509073 11763 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:50.509472 11763 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:50.510653 11688 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:43:50.510499 11763 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.503329  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.511737  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.529191  8967 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:50.537695 11854 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:50.539336  9666 connection.cc:232] RPC call timeout handler was delayed by -2.7740544630000841s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2972s for a response
W20260925 16:43:50.539840  9666 connection.cc:232] RPC call timeout handler was delayed by -2.3534577410000566s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30720000000000003s for a response
I20260925 16:43:50.532734  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.547824 11952 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:50.548295 11946 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:43:50.548514 11952 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.550232 11838 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.550596 11952 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.551222  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.551553  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.481326 11940 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:50.609262  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 134447us
W20260925 16:43:50.611408  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 101408us
W20260925 16:43:50.580054  9666 connection.cc:232] RPC call timeout handler was delayed by -2.0231518299999607s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16100000000000003s for a response
W20260925 16:43:50.612948  9666 connection.cc:232] RPC call timeout handler was delayed by -2.00425182999993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260925 16:43:50.613284  9666 connection.cc:232] RPC call timeout handler was delayed by -1.9286518300000353s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1715s for a response
W20260925 16:43:50.613669  9666 connection.cc:232] RPC call timeout handler was delayed by -1.7990518300000531s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260925 16:43:50.614007  9666 connection.cc:232] RPC call timeout handler was delayed by -1.7819518300000254s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1878s for a response
W20260925 16:43:50.614523  9666 connection.cc:232] RPC call timeout handler was delayed by -1.7693518300000051s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260925 16:43:50.552165  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.552011  8975 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:50.568413  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.551931  9090 leader_election.cc:398] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:50.599610  8969 raft_consensus.cc:2362] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10. Re-sending same reply.
I20260925 16:43:50.620393  9090 leader_election.cc:401] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260925 16:43:50.617437  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:50.556625 11846 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.648s	user 0.008s	sys 0.007s
I20260925 16:43:50.580669 11882 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.627576  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.615383 11863 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:50.627278  8972 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:50.634704  9123 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:50.634856  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.636723 11882 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:50.638738 11955 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
W20260925 16:43:50.643987  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 211768us
I20260925 16:43:50.644632  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.645617  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.645809  8974 raft_consensus.cc:2354] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:43:50.646916  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.580943 11924 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.647956 11874 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:50.648676 11854 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:50.648109 11924 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.648864  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.649120 11854 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:50.649501 11854 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.650873 11924 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:50.652891 11866 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:50.653312 11866 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:50.580458  9693 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEARNER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:43:50.653647 11866 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.660097  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.661227  9120 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.658300 11931 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:50.664520 11866 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.667985  8973 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:50.669239  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.669842  9702 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:50.675278  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.666s (SENT)
I20260925 16:43:50.677130  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.677968  9048 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:50.678090 11934 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:50.678180  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 67242.9us
I20260925 16:43:50.678625 11934 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.681025 11934 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:50.681514 11940 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.682017  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:50.682185  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.682693  9123 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:50.682804  8969 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.683974  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.684154  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:50.687983  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.688735  8968 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:50.689525  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.690229  8968 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:50.690907  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.691442  8968 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:50.635847 11846 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.692631 11763 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:50.692998  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.696151  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.696507 11934 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:50.697634  8966 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:50.697738  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.698035  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.708436  9696 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:50.639303 11882 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:50.668025 11866 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.701690  9120 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:50.705361  8974 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:50.700120  9702 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:50.710446  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.713883  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.718474  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.719588  8969 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:50.719595  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.720870  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:50.721657  8975 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:50.721565  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.725932  9043 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:50.709669 11934 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:50.724436  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.727228  8970 raft_consensus.cc:2396] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 4 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:50.723289  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.719077 11830 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:50.626489 11927 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:50.728252  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.610s (SENT)
I20260925 16:43:50.728746  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.728225  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.729075  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.721163 11948 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:50.739787  8975 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:50.727861  9047 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:50.732743  9118 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:50.732570  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.725294 11866 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:50.746397 11866 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:50.747224 11927 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:50.748231  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.631s (SENT)
I20260925 16:43:50.727975 11726 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:50.748761 11726 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:50.749260 11726 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:50.730160  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.750435  8974 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:50.723889 11882 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:50.751125 11882 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:50.752041  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.752682  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.753664  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.754249  8974 raft_consensus.cc:2362] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6. Re-sending same reply.
I20260925 16:43:50.747517 11866 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.709311 11854 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.764402  9047 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:50.764525  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.765116 11854 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.765518  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:50.752682  8970 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:50.766124  9044 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:43:50.766641 11846 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.728111 11934 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:50.767068  8970 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:50.736258 11830 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:50.767661 11830 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.768563  8970 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260925 16:43:50.769740  8970 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260925 16:43:50.770862  8970 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:43:50.756501 11883 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:50.758782  9696 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:50.771857 11883 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:50.765633  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.756014 11948 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.776721  8970 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:50.777007  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.775056  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:50.771955  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.758594 11931 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:50.736893  8972 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:50.788225  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.787985 11838 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260925 16:43:50.791069  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.791169  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:50.791785  9694 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.792325 11816 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:50.796025 11931 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.793563 11883 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.807830  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:50.842983 11931 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.843645  8973 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 6
I20260925 16:43:50.807993 11859 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:50.809389 11948 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.791548 11838 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:43:50.797217 11932 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260925 16:43:50.844272 11859 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:50.844421 11838 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:50.844655 11859 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:50.813299  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.845809  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:50.845476 11838 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.845609 11859 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.846685  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:50.846773 11838 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:43:50.846915 11859 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:50.813143  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.848033 11927 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.814276  9696 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:43:50.848573 11927 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.816083  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.814213  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:50.850378 11927 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.850857 11927 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:50.822723  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c694676902c54ad8bfe8e7fd5a725e33 received from {username='slave'} at 127.0.0.1:43114
I20260925 16:43:50.824330  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:50.851464  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.851933  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c694676902c54ad8bfe8e7fd5a725e33 on tablet c694676902c54ad8bfe8e7fd5a725e33 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.852629  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:50.853273  9049 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:50.825878  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.856112  8969 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:50.856393 11854 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.856987  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.857506 11827 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.857659  8969 raft_consensus.cc:2362] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7. Re-sending same reply.
I20260925 16:43:50.858414  9089 leader_election.cc:398] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:43:50.858062 11827 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.858536  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.859239  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.823480  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.860100  9046 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:50.860246 11827 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:50.860741  9046 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:50.861410  9046 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:50.826862  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.862895  8968 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:43:50.826949  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:50.853289  9015 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.837s (SENT)
I20260925 16:43:50.859232  8969 raft_consensus.cc:2354] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3.
I20260925 16:43:50.862144 11883 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:50.827778  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.828012  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.790532  9044 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:50.828637  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.829627  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.794440 11882 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.867017  9694 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:50.835594  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:50.840116  9041 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:50.840432 11863 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:50.838868  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 88400.5us
I20260925 16:43:50.843945  8973 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260925 16:43:50.869900  8973 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:43:50.870786  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.892s (SENT)
I20260925 16:43:50.811544 11830 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:50.827214  9702 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:50.865147  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.869289  9045 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260925 16:43:50.843483  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.868257  8971 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:43:50.874670  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.872499  8975 raft_consensus.cc:2362] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7. Re-sending same reply.
I20260925 16:43:50.877390  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:50.878021  8972 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:50.879040  8968 raft_consensus.cc:2354] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3.
I20260925 16:43:50.879750  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.877622  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:50.868827  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.877388  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.887018  9124 raft_consensus.cc:2354] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
I20260925 16:43:50.890199  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.895048  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.897157  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:50.909950  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.857004 11854 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:50.912384  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59158.9us
I20260925 16:43:50.914690  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.916298  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.883460 11827 raft_consensus.cc:2741] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260925 16:43:50.924811  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.918155  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.919037  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:50.926739  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67558.4us
I20260925 16:43:50.929154  9694 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:50.932497  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:50.933297  9700 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 8 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:43:50.908047 11874 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election won for term 5
W20260925 16:43:50.935894  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67128.9us
I20260925 16:43:50.936296 11753 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:50.936915  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:50.930020 11932 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:50.948632  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.922575 11927 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260925 16:43:50.927977 11763 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:50.875417 11863 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.937106  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:50.943602  8972 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:50.963399 11932 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:50.981086  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110331us
I20260925 16:43:50.981474 11688 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:50.982004 11763 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:50.985180 11726 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:50.980010  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:50.987735  9121 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:50.988036  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51243.2us
I20260925 16:43:50.995620  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:50.995901  9048 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:50.999481  9049 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:50.999431  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.001703  8968 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:43:51.005733  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.007632  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:50.989954 11675 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:51.014833  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.011300  8972 raft_consensus.cc:2362] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4. Re-sending same reply.
I20260925 16:43:51.020226  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.021029  8972 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:51.022015  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.022959  8972 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.017285  8968 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.025090  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.032496  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.038116  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.038888  9048 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:51.040782  8970 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:43:51.042734  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.043061  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.043779  8968 raft_consensus.cc:2362] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:43:51.059747  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.060339  8972 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:51.061316  9049 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:51.061290  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.062892  8972 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:51.063838  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.019037 11675 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:51.060322  8968 raft_consensus.cc:2362] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:43:51.087662  8975 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:51.090029  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:51.096319  9049 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:51.096974  9046 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:51.098507  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.099376  8975 raft_consensus.cc:2354] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 5.
I20260925 16:43:51.101025  9694 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:43:51.093587  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 157929us
I20260925 16:43:51.105875  8969 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:51.097628  9046 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:51.108685  9045 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260925 16:43:51.106662  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 174252us
I20260925 16:43:51.100096  9043 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:51.068126 11830 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:51.072371 11874 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:51.112375  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.311725  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:51.239342  8971 raft_consensus.cc:2396] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:51.326035  9118 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260925 16:43:51.108623  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.327198  8968 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:51.077673 11675 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:51.324604  8967 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
W20260925 16:43:51.339008 11977 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260925 16:43:51.222183  9666 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.102s (SENT)
I20260925 16:43:51.248624  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:51.118000  8969 pending_rounds.cc:76] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 5
I20260925 16:43:51.173869  8972 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:43:51.089967 11948 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:51.344903  8969 pending_rounds.cc:97] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260925 16:43:51.392278  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.359068  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.423841  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.429821  8972 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:51.395922  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:51.428525  8969 raft_consensus.cc:2866] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:51.303733  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260925 16:43:51.320693 11973 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260925 16:43:51.108768 11931 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:51.431789  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:51.194263 11970 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260925 16:43:51.458074  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:51.193161  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 8dc3391062084f45a6ba62d28d340722 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:43:51.250799 11952 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:51.347028 11863 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:51.347366 11932 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:51.228111 11854 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:51.469318  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.347810 11726 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:51.121135 11934 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.472431  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.459209 11882 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:51.478379  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:51.480393 11883 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260925 16:43:51.121428 11871 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.338s
I20260925 16:43:51.441854  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 886) took 1044 ms. Trace:
I20260925 16:43:51.495391  9123 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 3.
I20260925 16:43:51.473264  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260925 16:43:51.462852  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 279898us
I20260925 16:43:51.490394 11952 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.502825  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:51.515530  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 319422us
I20260925 16:43:51.215302 11763 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.509745 11871 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:51.464102 11948 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.520401  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.520774  8968 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:51.523171  9115 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:43:51.525298  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.528719  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:51.527997  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:51.531853  9122 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260925 16:43:51.534004  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:51.534557  9116 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:51.533085  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
W20260925 16:43:51.523298 11972 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260925 16:43:51.496737 11931 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:51.538511  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.778s (SENT)
I20260925 16:43:51.539103  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:51.541062  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.543241  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.545044  8972 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:43:51.545341  8967 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.545568  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:51.520192 11871 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:51.540467  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.548609  8970 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.552433  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.554520  8968 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:51.555950  8972 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260925 16:43:51.556700  8973 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:51.557008  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1482) took 1006 ms. Trace:
I20260925 16:43:51.536285 11944 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:51.563086  8971 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:51.557485  8966 rpcz_store.cc:276] 0925 16:43:50.550433 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:50.755109 (+204676us) service_pool.cc:227] Handling call
0925 16:43:50.755501 (+   392us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:50.756061 (+   560us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:50.756099 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:50.756761 (+   662us) log.cc:842] Serialized 52 byte log entry
0925 16:43:50.916017 (+159256us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:50.916053 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:50.916112 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:51.556786 (+640674us) raft_consensus.cc:1671] finished
0925 16:43:51.556812 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:51.556949 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1227,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":81,"thread_start_us":158843,"threads_started":1,"wal-append.queue_time_us":267057}
I20260925 16:43:51.571528  9014 leader_election.cc:398] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
I20260925 16:43:51.571879  9014 leader_election.cc:401] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:51.572886  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.572880  8968 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:43:51.556138 11927 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:51.575465 11688 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6.
I20260925 16:43:51.577018 11688 raft_consensus.cc:979] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:51.577461 11688 raft_consensus.cc:979] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:51.577809 11688 raft_consensus.cc:1067] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:51.578568 11688 raft_consensus.cc:1067] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:51.581851 11985 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:51.582235  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:51.584491  9121 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.582s	user 0.009s	sys 0.000s
I20260925 16:43:51.584784  9121 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:51.582265 11985 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:51.589521 11985 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:51.591907 11986 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:51.594360  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.595150  8970 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.564894 11979 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:51.597658  9116 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:51.600203  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:51.600234  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61776.5us
I20260925 16:43:51.612229  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:51.600180  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:51.622661  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 77989.7us
I20260925 16:43:51.596179 11863 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:51.530628 11874 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.626137  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:51.646153  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.547361  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:43:51.621567  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.630502  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1483) took 1079 ms. Trace:
I20260925 16:43:51.630437  9115 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:43:51.636181 11952 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:51.636937  9119 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:51.637404 11863 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.637894  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:43:51.655668  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:51.656167  9121 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:51.656613  9121 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:51.639031 11931 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:51.639407 11985 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.642886 11934 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:51.616747 11925 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:51.643975 11948 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:51.669193  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:51.644629  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:51.655112  9119 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:51.668068  9699 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:51.668805  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.671439  9119 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:43:51.642899 11987 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.065s	user 0.002s	sys 0.000s
I20260925 16:43:51.673703  9046 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:51.676017  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:51.680441  9696 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:51.645496 11688 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:51.611111 11726 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260925 16:43:51.690747  9123 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:51.648470  8974 rpcz_store.cc:276] 0925 16:43:50.550700 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:50.763221 (+212521us) service_pool.cc:227] Handling call
0925 16:43:50.805721 (+ 42500us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:50.808758 (+  3037us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:50.808783 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:50.809195 (+   412us) log.cc:842] Serialized 26 byte log entry
0925 16:43:51.000434 (+191239us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:43:51.000486 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:51.000576 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:51.630307 (+629731us) raft_consensus.cc:1671] finished
0925 16:43:51.630325 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:51.630449 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":111,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":190804,"threads_started":1,"wal-append.queue_time_us":302293}
I20260925 16:43:51.655596 11846 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:51.504501  9693 rpcz_store.cc:276] 0925 16:43:50.384158 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:50.389279 (+  5121us) service_pool.cc:227] Handling call
0925 16:43:50.423925 (+ 34646us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:50.580251 (+156326us) raft_consensus.cc:1520] Early marking committed up to index 3
0925 16:43:50.862001 (+281750us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.000145 (+138144us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:51.058293 (+ 58148us) log.cc:842] Serialized 26 byte log entry
0925 16:43:51.058449 (+   156us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:51.058742 (+   293us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.058923 (+   181us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:51.059005 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:51.340960 (+281955us) raft_consensus.cc:1671] finished
0925 16:43:51.346525 (+  5565us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:51.395898 (+ 49373us) inbound_call.cc:173] Queueing success response
0925 16:43:51.492074 (+ 96176us) spinlock_profiling.cc:243] Waited 4 ms on lock 0x7b18001ac380. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
Metrics: {"mutex_wait_us":49518,"prepare.queue_time_us":6572,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":64410,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":10466,"spinlock_wait_cycles":9209600,"thread_start_us":76229,"threads_started":1,"wal-append.queue_time_us":432028}
I20260925 16:43:51.690164 11980 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:51.598749 11871 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.703589 11688 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:51.704641 11688 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:51.708688  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 119629us
I20260925 16:43:51.690702  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:51.709376  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:51.673645 11866 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:51.654531 11854 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.045s
I20260925 16:43:51.715263  9115 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:51.725459  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.722740  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.726651  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:51.697131 11925 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:51.730197  8970 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.699872 11927 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Leader election won for term 3
W20260925 16:43:51.735256  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.013s (SENT)
I20260925 16:43:51.732327  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.746050  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:51.714671 11939 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:51.747648  8970 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260925 16:43:51.715863 11846 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:51.620635 11979 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:43:51.779393  8967 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:51.776819  9121 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.783530  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.748157 11871 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:51.817431  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 145561us
I20260925 16:43:51.819865  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:51.817844  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91292.2us
W20260925 16:43:51.825992  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 114144us
I20260925 16:43:51.783286 11709 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:51.835021 11709 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:51.835533 11709 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:51.828740 11944 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:43:51.818007 11838 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.971s	user 0.012s	sys 0.000s
I20260925 16:43:51.838289 11978 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:43:51.838763 11978 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:51.841243  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.722746 11866 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.845408  8974 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:51.845489  9700 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:51.842289  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:51.835054 11981 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.281s	user 0.000s	sys 0.002s
I20260925 16:43:51.848502  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:51.843430 11854 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:51.851938  9119 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.855659  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:51.829061 11932 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:51.865104  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47682.9us
I20260925 16:43:51.866448  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.867084  8966 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:51.865610  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.863336 11927 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:51.895169  9115 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:51.896116  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 124167us
I20260925 16:43:51.891624  8974 raft_consensus.cc:2362] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
I20260925 16:43:51.897416  9119 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:51.854306 11854 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:51.901268  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:51.902034  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:51.902575  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:51.903294  8975 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:43:51.832391 11924 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260925 16:43:51.860819 11980 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:51.839653 11978 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.057693  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2173) took 1193 ms. Trace:
W20260925 16:43:52.064225 11993 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.207s	user 0.001s	sys 0.000s
I20260925 16:43:51.975427 11927 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.065130 11866 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.066408 11709 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:51.905503  9693 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:51.905386 11985 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:52.075212 11675 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.002s
I20260925 16:43:51.935880 11998 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:43:52.061601  9120 rpcz_store.cc:276] 0925 16:43:50.863785 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:50.863886 (+   101us) service_pool.cc:227] Handling call
0925 16:43:50.874834 (+ 10948us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:50.941483 (+ 66649us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:50.955849 (+ 14366us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.106363 (+150514us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:51.187087 (+ 80724us) log.cc:842] Serialized 26 byte log entry
0925 16:43:51.187217 (+   130us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:51.187258 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:51.631762 (+444504us) spinlock_profiling.cc:243] Waited 59.5 ms on lock 0x7b5400144454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:51.631821 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:51.784096 (+152275us) spinlock_profiling.cc:243] Waited 44.2 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:52.057439 (+273343us) raft_consensus.cc:1671] finished
0925 16:43:52.057466 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:52.057608 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":10776,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":481,"raft.queue_time_us":91549,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":35320,"spinlock_wait_cycles":238620416,"thread_start_us":95356,"threads_started":1,"wal-append.queue_time_us":516490}
I20260925 16:43:52.073663  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1913) took 1094 ms. Trace:
I20260925 16:43:52.082790  9124 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:52.080112  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:52.080626  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 253964us
W20260925 16:43:51.942082 11988 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.301s	user 0.001s	sys 0.000s
I20260925 16:43:52.085395  9701 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:52.014510 11979 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:51.961850 11863 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.081864  8973 rpcz_store.cc:276] 0925 16:43:50.979576 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.565783 (+586207us) service_pool.cc:227] Handling call
0925 16:43:51.579893 (+ 14110us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:51.580115 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:51.580141 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:51.580579 (+   438us) log.cc:842] Serialized 26 byte log entry
0925 16:43:51.656916 (+ 76337us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:51.691717 (+ 34801us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.700380 (+  8663us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:51.700467 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:52.067775 (+367308us) raft_consensus.cc:1671] finished
0925 16:43:52.067794 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:52.073601 (+  5807us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":34768,"prepare.queue_time_us":31058,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":8839,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6788,"thread_start_us":76009,"threads_started":1,"wal-append.queue_time_us":197779}
I20260925 16:43:52.161043  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:51.902120 11932 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:52.174638  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 230900us
I20260925 16:43:51.943486 11874 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.198s
W20260925 16:43:52.177884  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 89853.1us
I20260925 16:43:52.075577 11675 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:52.183554  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50256.4us
I20260925 16:43:51.896842 11925 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:52.188956  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 102460us
I20260925 16:43:51.896900 11846 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.203353 11978 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
W20260925 16:43:52.204301 12011 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.126s	user 0.000s	sys 0.000s
I20260925 16:43:52.221568  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1912) took 1242 ms. Trace:
I20260925 16:43:52.221973  8972 rpcz_store.cc:276] 0925 16:43:50.979301 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.561108 (+581807us) service_pool.cc:227] Handling call
0925 16:43:51.561434 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:51.565338 (+  3904us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:43:51.601068 (+ 35730us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.815761 (+214693us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:51.816411 (+   650us) log.cc:842] Serialized 26 byte log entry
0925 16:43:51.816562 (+   151us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:52.154843 (+338281us) log.cc:842] Serialized 14 byte log entry
0925 16:43:52.177334 (+ 22491us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:52.177413 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:52.221381 (+ 43968us) raft_consensus.cc:1671] finished
0925 16:43:52.221401 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:52.221518 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":47318,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":58,"raft.queue_time_us":3718,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":11709,"thread_start_us":472532,"threads_started":2,"wal-append.queue_time_us":331510}
W20260925 16:43:52.224160 11996 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.319s	user 0.001s	sys 0.000s
I20260925 16:43:52.225521 12013 raft_consensus.cc:1050] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:43:52.227007 11709 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:52.230408 12013 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 3, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.232563  8967 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:52.234287  8970 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:52.247618  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 553) took 1373 ms. Trace:
W20260925 16:43:52.255566  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 171535us
I20260925 16:43:52.257054  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:43:52.254824  8969 rpcz_store.cc:276] 0925 16:43:50.859473 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.117372 (+257899us) service_pool.cc:227] Handling call
0925 16:43:51.117773 (+   401us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:51.496771 (+378998us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:51.496805 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:51.501109 (+  4304us) log.cc:842] Serialized 52 byte log entry
0925 16:43:51.772760 (+271651us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:51.782856 (+ 10096us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.786425 (+  3569us) log.cc:842] Serialized 14 byte log entry
0925 16:43:51.813149 (+ 26724us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:51.813234 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:52.232280 (+419046us) raft_consensus.cc:1671] finished
0925 16:43:52.232298 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:52.232411 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":50763,"prepare.queue_time_us":107323,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":74,"raft.queue_time_us":54158,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":12785,"spinlock_wait_cycles":22833536,"thread_start_us":241865,"threads_started":1,"wal-append.queue_time_us":569861}
I20260925 16:43:52.189657 11838 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260925 16:43:52.275952  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:52.277305  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.277225  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:52.277665  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.277992  9045 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:52.286568  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:52.287410  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:52.287966  9041 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:43:52.288093  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:52.288259  9041 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:52.289386  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:52.291455  9042 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:52.295928  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:52.296476  9045 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:43:52.296736  9045 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:52.283941 11883 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:52.298449  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:52.303723  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:52.301798  9701 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
W20260925 16:43:52.304401  9015 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.226s (SENT)
I20260925 16:43:52.305004  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:52.296254  9041 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.290552 11854 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.305796  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:52.306749  9116 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:52.234607 11980 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.308211  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:52.312196  9120 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:52.309264  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:52.316687  9123 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:52.298920 11924 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:52.307193  9045 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.399118  9045 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:52.400131  9041 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:52.298226 11939 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.090s
I20260925 16:43:52.406708  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:52.370496 11874 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:43:52.385215 11924 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:52.407787  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 116667us
I20260925 16:43:52.410925  9048 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:43:52.412292 12016 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:52.412957 11932 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.414352  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:52.440702  9701 raft_consensus.cc:2396] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260925 16:43:52.414727  9121 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:52.415781 11874 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:43:52.428052  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 133899us
I20260925 16:43:52.393703 11998 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:52.396426 11854 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:52.440022 11924 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:52.446265 11874 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:52.518098  9116 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:43:52.522308  9701 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:52.523846  9120 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:52.525426  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:52.517990 11932 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:52.536513  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.280s (SENT)
I20260925 16:43:52.535600 11675 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.543973  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:52.529559 11925 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:43:52.550035 12015 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260925 16:43:52.514509 11854 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.502184 11998 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.541636 12024 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:52.582175 12024 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.584193 12024 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:52.559643 12014 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.001s
W20260925 16:43:52.560057 12026 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260925 16:43:52.561046 12023 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260925 16:43:52.546854 11726 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:43:52.532122 12022 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.045s
I20260925 16:43:52.557574  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:52.588501  9045 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:52.602056  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:52.604100  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:52.578284 12030 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:52.585039 11944 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:52.545892 11932 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.615006  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:52.585335 11925 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:52.603206 11675 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:52.616078 12007 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:52.674348 11978 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:52.623797 11883 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:52.674860 12012 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:52.689702 11883 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.688799 11978 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:52.689870 12012 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.707886 11978 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.716709 12012 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.717855  9121 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260925 16:43:52.703859 12002 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:52.723718  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:52.724097 12027 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260925 16:43:52.724289  9117 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:52.724797 11854 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:52.718895  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:52.706524  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2193) took 1150 ms. Trace:
I20260925 16:43:52.726344  9122 rpcz_store.cc:276] 0925 16:43:51.556454 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.562931 (+  6477us) service_pool.cc:227] Handling call
0925 16:43:51.563241 (+   310us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:51.777760 (+214519us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:51.777803 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:51.777860 (+    57us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:51.777910 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:52.706255 (+928345us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b54001efad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:52.706315 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:52.706458 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":470324608}
I20260925 16:43:52.715564  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1919) took 1599 ms. Trace:
I20260925 16:43:52.619678 11944 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.616444 12030 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.727882  8971 rpcz_store.cc:276] 0925 16:43:51.115869 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.650184 (+534315us) service_pool.cc:227] Handling call
0925 16:43:51.674537 (+ 24353us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:51.730037 (+ 55500us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:51.730068 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:51.780996 (+ 50928us) log.cc:842] Serialized 26 byte log entry
0925 16:43:51.968369 (+187373us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:52.020368 (+ 51999us) log.cc:842] Serialized 14 byte log entry
0925 16:43:52.024227 (+  3859us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:52.024392 (+   165us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:52.715301 (+690909us) raft_consensus.cc:1671] finished
0925 16:43:52.715334 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:52.715497 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5137,"prepare.queue_time_us":51633,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"raft.queue_time_us":22290,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":16418,"spinlock_wait_cycles":2304,"thread_start_us":135493,"threads_started":1,"wal-append.queue_time_us":479146}
I20260925 16:43:52.740899  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:52.748838 11709 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:52.740365 11925 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:52.750494  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1537) took 1021 ms. Trace:
I20260925 16:43:52.751013  9046 rpcz_store.cc:276] 0925 16:43:51.728713 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.729471 (+   758us) service_pool.cc:227] Handling call
0925 16:43:52.750231 (+1020760us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b54000a78d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:52.750398 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1256477056}
W20260925 16:43:52.752144  9089 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.648s (SENT)
I20260925 16:43:52.752687  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:52.749218 11709 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:52.754235 11709 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:52.755505 12007 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:52.738794 12005 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
W20260925 16:43:52.758108 12034 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260925 16:43:52.752240 11998 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:52.768770  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 665) took 1167 ms. Trace:
I20260925 16:43:52.769243  9700 rpcz_store.cc:276] 0925 16:43:51.597033 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.597166 (+   133us) service_pool.cc:227] Handling call
0925 16:43:51.610712 (+ 13546us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:51.849996 (+239284us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:52.764205 (+914209us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54006bce54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:52.764364 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":531306368}
I20260925 16:43:52.781498  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:52.790678  9041 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:52.792860  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:52.805603  9042 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.510s	user 0.005s	sys 0.005s
I20260925 16:43:52.806270  9042 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:52.812376  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:52.811169 11830 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:52.846036  9089 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.739s (SENT)
I20260925 16:43:52.818902 11944 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:52.820114 11854 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:52.867756  9120 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:43:52.837661 12004 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
W20260925 16:43:52.870646  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 365650us
W20260925 16:43:52.873461 11827 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.044s	user 0.023s	sys 0.083s
I20260925 16:43:52.868300 11932 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:52.903294  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57287.7us
W20260925 16:43:52.914721  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.878s (SENT)
I20260925 16:43:52.915215  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:52.888810 11827 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.062s	user 0.023s	sys 0.083s
I20260925 16:43:52.917586  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:52.917937  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:52.918220  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:43:52.918485  9700 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:43:52.882804 11854 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:52.927917  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:52.928530  9701 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:52.894096 11944 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:52.871009 11830 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:52.936782  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:52.939392  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:52.892763 11763 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.043s
I20260925 16:43:52.889576 11675 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260925 16:43:52.941393  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:52.942080  9701 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:52.942643  9117 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
W20260925 16:43:52.982646  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67949.5us
W20260925 16:43:52.993609  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.209s (SENT)
W20260925 16:43:52.993966  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 194283us
I20260925 16:43:52.994124  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:52.990994  9694 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:52.997298  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:52.976150  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:53.002075  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.112s (SENT)
I20260925 16:43:52.935518 12030 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:53.016261  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:53.017294  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:52.931914 11980 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:43:53.010941  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:52.970945  8873 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:53.051226 11675 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:53.051638 11675 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:53.052013 11675 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:53.054565  9696 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260925 16:43:53.061429 11830 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.015755 11854 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.062415 11830 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:53.062500  9119 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:43:53.062925  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.063105  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.063997  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.064766  9121 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:43:53.065685  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72109us
I20260925 16:43:53.062222  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.064673  9700 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:53.073658  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71617.7us
I20260925 16:43:53.007925 12032 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:53.081589  9117 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:53.078577  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:53.084787  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.040032 11827 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:53.045770 12030 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:53.100904  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.080761  8873 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:53.087831  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:52.968641 11944 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.015517 12013 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.068s
I20260925 16:43:53.047212 12008 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:53.112030  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:53.082468 11874 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.542s	user 0.004s	sys 0.005s
I20260925 16:43:53.086210 12004 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:53.025157 11846 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.072s
I20260925 16:43:53.116498 11709 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.119113 12039 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:53.119994  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:53.120473 12016 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.674s	user 0.008s	sys 0.002s
I20260925 16:43:53.120757 12019 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260925 16:43:53.124333 12047 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260925 16:43:53.125012  8872 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 340) took 10615 ms. Trace:
I20260925 16:43:53.125991 11944 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.127563 12003 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.062952 11830 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.147543  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.192395  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:53.156523  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 78012.1us
I20260925 16:43:53.164896  9695 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260925 16:43:53.081693 12032 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:53.167943  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:53.196556  9121 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 3: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:53.148550  9701 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:53.176544  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.179716  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:53.181906  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52448.9us
I20260925 16:43:53.111208 12030 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:53.186656  9045 raft_consensus.cc:2354] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
W20260925 16:43:53.175724 11924 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.650s	user 0.007s	sys 0.004s
I20260925 16:43:53.088251 12005 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
I20260925 16:43:53.111627  8873 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 1 to 4, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:53.108111 11952 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.079s
I20260925 16:43:53.198400  9120 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:53.178201 11978 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:53.175001 11932 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.179241 11948 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:53.188519 12016 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:53.204108 12032 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:53.204101 12030 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:53.210140 12002 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:53.238430  8873 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 6 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:53.242604 11948 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:53.244653  9089 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.508s (SENT)
I20260925 16:43:53.249009  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:53.241320  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:53.245636 12050 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260925 16:43:53.172508 11874 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.243598  9042 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
W20260925 16:43:53.268185  9015 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.501s (SENT)
I20260925 16:43:53.252511 11978 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:53.207340 11924 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.279217  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:53.285624  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.288026  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.290511  8873 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:53.240207 11932 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.298069  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.304385  9121 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 4 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:43:53.298838  8873 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:53.284814 12002 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:53.313411  8873 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:43:53.329725  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88446.5us
I20260925 16:43:53.183000  8872 rpcz_store.cc:276] 0925 16:43:42.511328 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:42.532228 (+ 20900us) service_pool.cc:227] Handling call
0925 16:43:53.043976 (+10511748us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:50.039822 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:50.040388 (+   566us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:50.040428 (+    40us) write_op.cc:435] Acquired schema lock
0925 16:43:50.040444 (+    16us) tablet.cc:660] Decoding operations
0925 16:43:50.041211 (+   767us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:50.041251 (+    40us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:50.041267 (+    16us) tablet.cc:683] Acquiring locks for 11 operations
0925 16:43:50.046365 (+  5098us) tablet.cc:699] Row locks acquired
0925 16:43:50.046392 (+    27us) write_op.cc:260] PREPARE: finished
0925 16:43:50.046562 (+   170us) write_op.cc:270] Start()
0925 16:43:50.046654 (+    92us) write_op.cc:276] Timestamp: P: 1790354630046520 usec, L: 0
0925 16:43:50.046684 (+    30us) op_driver.cc:331] REPLICATION: starting
0925 16:43:50.047309 (+   625us) log.cc:842] Serialized 4470 byte log entry
0925 16:43:50.828717 (+781408us) op_driver.cc:444] REPLICATION: finished
0925 16:43:51.339468 (+510751us) write_op.cc:301] APPLY: starting
0925 16:43:51.339578 (+   110us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:51.339983 (+   405us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:51.340142 (+   159us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:51.425864 (+ 85722us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:51.426203 (+   339us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=11
0925 16:43:51.426253 (+    50us) write_op.cc:312] APPLY: finished
0925 16:43:51.426717 (+   464us) log.cc:842] Serialized 83 byte log entry
0925 16:43:51.426902 (+   185us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:51.427135 (+   233us) write_op.cc:454] Released schema lock
0925 16:43:51.427200 (+    65us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:51.427515 (+   315us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:51.427544 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8242,"reported_tablets":32,"child_traces":[["op",{"apply.queue_time_us":485476,"apply.run_cpu_time_us":4807,"apply.run_wall_time_us":144767,"num_ops":11,"prepare.queue_time_us":264035,"prepare.run_cpu_time_us":26376,"prepare.run_wall_time_us":500315,"raft.queue_time_us":189001,"raft.run_cpu_time_us":27178,"raft.run_wall_time_us":225964,"replication_time_us":781873,"thread_start_us":1029470,"threads_started":4,"wal-append.queue_time_us":487916,"wal-append.run_cpu_time_us":15200,"wal-append.run_wall_time_us":1904792}]]}
I20260925 16:43:53.337090  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:53.338346  9041 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:43:53.343849 11688 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.344475 11688 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.346391 11830 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.346789 11688 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.346941 11830 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.347461 11830 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.347942 11709 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.344482 12078 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:53.349283 11830 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.349659 12078 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:53.349838 11830 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.350113 12078 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:53.350456 11830 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:53.352349 12064 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260925 16:43:53.352555 11874 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.353854 11924 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:53.354794 11874 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:53.356806  9122 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
W20260925 16:43:53.358265  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74077.5us
I20260925 16:43:53.360301  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:53.362157  9046 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:43:53.343183  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73848.6us
I20260925 16:43:53.363646  9041 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260925 16:43:53.379541  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.290385 11883 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260925 16:43:53.395865  9121 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:53.404623  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 966) took 1115 ms. Trace:
I20260925 16:43:53.405138  9049 rpcz_store.cc:276] 0925 16:43:52.289363 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:52.289521 (+   158us) service_pool.cc:227] Handling call
0925 16:43:53.403531 (+1114010us) spinlock_profiling.cc:243] Waited 648 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:53.404524 (+   993us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1490927488}
W20260925 16:43:53.408551  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 121285us
I20260925 16:43:53.409744  8873 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 5, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:43:53.414150  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.414945  9043 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:53.414971  8873 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:43:53.416697  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:53.423642  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:53.422325  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.019s (SENT)
I20260925 16:43:53.425625  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:53.425782  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.181825 12004 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:53.431677 12065 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260925 16:43:53.432088  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.432850 12067 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:53.433362 12067 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.434715 12001 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:53.435298 12001 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:53.435400 12069 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.435906 12001 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:53.265184 12061 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.163s
I20260925 16:43:53.436105 12069 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.395375 12013 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.028s
I20260925 16:43:53.438158 12069 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.438632 12069 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.439177 12075 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:53.439011 12069 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.439621 12075 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.441747 12075 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.431636 12022 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:53.435518  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:53.445715  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.445936  9694 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:53.436161 11830 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:53.449653  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c756d218cfc0470183a9fe1cc08a22ab, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:53.452685  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c756d218cfc0470183a9fe1cc08a22ab, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.455514  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.455540  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.198928 12003 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.442546 11948 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.472061  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.435308 12067 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.478716 12083 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.479220 12083 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.480010 11932 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.480404  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.421052 12057 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260925 16:43:53.481202 12003 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.481312 12083 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.413661 11978 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.475835  9694 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:43:53.488292  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:43:53.488608  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71316.5us
I20260925 16:43:53.487764  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:53.495899  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.496706  9698 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:53.498579  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:53.498931  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:53.499606  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:53.502594  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.189s (SENT)
I20260925 16:43:53.503285  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.503643  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.504272  8971 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:53.509582  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.510119  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:53.505236  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:53.499521  9122 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:43:53.490466 12067 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.516980  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.517678  8975 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.528137  8967 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:53.510252  8970 raft_consensus.cc:2362] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6. Re-sending same reply.
I20260925 16:43:53.530464  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.531127  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.531910  8969 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:53.496140 12000 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:43:53.537287  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.539364  8970 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 2.
I20260925 16:43:53.514065  8873 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:53.542349  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:53.547649  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.548658  8970 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:53.556428  9089 leader_election.cc:398] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
W20260925 16:43:53.558476  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55900.9us
I20260925 16:43:53.514741 11688 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:53.514045 12008 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:53.558314  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.571086  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.551225 11948 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:53.572202  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:53.572487  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.297s (SENT)
I20260925 16:43:53.587337  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:53.572768  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.572954  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.573454  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.588176  8972 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:53.515210 11931 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:53.556398  8873 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 5, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:53.588057  8974 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:53.571561  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.579170  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.532990 12086 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.533282 11830 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:53.552698 12000 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:53.588215  8966 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:53.573534  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.592666  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:43:53.591109  8971 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.598389  8970 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260925 16:43:53.586889  8969 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:53.625136  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.625856  8969 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:53.626760  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.609166  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.628556  8973 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:53.610356  9119 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:43:53.614645  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.627411  8969 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:53.641252  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.617450  8968 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.647294  8970 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:43:53.584054 12008 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:53.650507  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.641866  8974 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.651867  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.538489 12067 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.654489  9696 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:43:53.609184 11948 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.659372  8969 raft_consensus.cc:2362] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5. Re-sending same reply.
I20260925 16:43:53.549376 11675 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.657393  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.666829  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.675748  8968 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:53.670221  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.677148  8973 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:53.591312 12019 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.076s
I20260925 16:43:53.657608 12008 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:53.679575  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.687176  8975 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:53.674733  8971 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.675168  8873 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:43:53.613773 11952 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:53.683663  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:53.689168  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 116707us
I20260925 16:43:53.690249  8969 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:53.696712  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.698547  9123 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:53.702566  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:53.709583  9124 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260925 16:43:53.711475  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.712484  8968 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:53.671270 12036 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260925 16:43:53.657346 11931 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.678457 11948 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.724490 12000 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.702083 12004 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260925 16:43:53.727074 12004 consensus_queue.cc:1225] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 5.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260925 16:43:53.614295 12086 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.736554  9042 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:43:53.737427  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.685164 12069 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.737993  8975 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.739338  9046 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:43:53.750787  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:53.728197 12088 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.115s	user 0.000s	sys 0.001s
I20260925 16:43:53.751425  8971 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:53.756773 11931 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.758677  8967 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:53.767452  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.773262  8966 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
W20260925 16:43:53.774959 12030 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.519s	user 0.007s	sys 0.000s
I20260925 16:43:53.759465 12086 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.711463 12083 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:53.779495  9693 pending_rounds.cc:76] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 6
I20260925 16:43:53.764002  8972 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:53.779898  9693 pending_rounds.cc:97] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260925 16:43:53.780181  9693 raft_consensus.cc:2866] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:43:53.780342  8969 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:53.777145  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.781198  8966 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:53.782676  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:43:53.784762  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.542s (SENT)
I20260925 16:43:53.785243  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:53.785857  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.789568  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.792035  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:53.778656 12082 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.273s	user 0.001s	sys 0.000s
I20260925 16:43:53.792261 11675 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.792615  8966 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:53.792291  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.741532 11925 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.052s
I20260925 16:43:53.793463  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.794042  8966 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:53.794159  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.794762  8975 raft_consensus.cc:2362] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5. Re-sending same reply.
I20260925 16:43:53.794806  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.795835 12067 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.795965  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.796306  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.796526  8966 raft_consensus.cc:2362] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5. Re-sending same reply.
I20260925 16:43:53.796967  8974 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:53.798519  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.799347  8970 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260925 16:43:53.799449  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:53.800195  9695 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:43:53.796012  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:53.801424  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:53.795838  8975 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:53.804348 12004 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:53.804487  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:53.805207  8972 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:53.805781 12090 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260925 16:43:53.811640  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:53.777781 12032 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.520s	user 0.007s	sys 0.000s
I20260925 16:43:53.814220  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:53.821101  8968 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:53.823012  8975 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:43:53.819628  9046 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:43:53.823506  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:53.775381 12030 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.826781  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:53.826676 12067 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:53.836227  9043 raft_consensus.cc:2354] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:43:53.845178 11830 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:53.845700 11830 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:53.847630 11830 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.776908 11978 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.050s
I20260925 16:43:53.851614  8973 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:43:53.855819  8971 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260925 16:43:53.827543 12083 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:43:53.857126  9089 leader_election.cc:398] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:43:53.861750  9089 leader_election.cc:401] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260925 16:43:53.870549  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.879367  9046 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:53.904851 12091 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260925 16:43:53.875566 12007 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:43:53.907434  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:53.908602  9048 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:43:53.910650 12095 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:43:53.914592 12001 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.864315 12083 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:53.827631 12032 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:53.856920 11948 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:53.916556 12053 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:43:53.933885  9702 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:43:53.937784  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:53.926519 12083 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:53.941562  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.942574  9043 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:53.948496 12001 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:53.950032 12032 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.952793  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2213) took 1254 ms. Trace:
I20260925 16:43:53.953209  9116 rpcz_store.cc:276] 0925 16:43:52.698195 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:52.704093 (+  5898us) service_pool.cc:227] Handling call
0925 16:43:52.704422 (+   329us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:52.704800 (+   378us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:52.704836 (+    36us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:52.731600 (+ 26764us) log.cc:842] Serialized 52 byte log entry
0925 16:43:52.916861 (+185261us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:43:53.004604 (+ 87743us) log.cc:842] Serialized 14 byte log entry
0925 16:43:53.018803 (+ 14199us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:53.018907 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:53.727477 (+708570us) spinlock_profiling.cc:243] Waited 6.51 ms on lock 0x7b1800305c20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:43:53.952494 (+225017us) raft_consensus.cc:1671] finished
0925 16:43:53.952602 (+   108us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:53.952736 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7127,"prepare.queue_time_us":161193,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":43064,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":12420,"spinlock_wait_cycles":14965632,"thread_start_us":216939,"threads_started":2,"wal-append.queue_time_us":371155}
I20260925 16:43:53.961799  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:53.976817  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:53.980198 12030 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:53.982246  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:53.982976  9116 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:53.995899  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:53.999100  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:54.002372  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:54.015801  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:54.016439  9043 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:43:54.018461  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91927.8us
W20260925 16:43:54.018153  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 84825.2us
I20260925 16:43:54.012531 12032 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:54.030999  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:54.033490  9049 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
W20260925 16:43:54.036788 12078 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.686s	user 0.008s	sys 0.005s
I20260925 16:43:54.047134  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:43:54.053817  9015 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.930s (SENT)
I20260925 16:43:54.054677 11883 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260925 16:43:54.055822  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.200s (SENT)
I20260925 16:43:54.056219  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.056510  9115 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:43:54.057320  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.058048  8970 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:54.057891  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.058223  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.058419  8969 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5. Re-sending same reply.
I20260925 16:43:54.058837  8972 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 3.
I20260925 16:43:54.059798  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.060331  8974 raft_consensus.cc:2362] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8. Re-sending same reply.
I20260925 16:43:54.060761  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:54.066942  9015 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.227s (SENT)
I20260925 16:43:54.067790  8966 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:43:54.067927  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:54.073575  9045 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:54.069187  8972 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260925 16:43:54.076325 12104 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:43:54.084362  8969 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260925 16:43:54.085354  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.086031  8969 raft_consensus.cc:2354] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3.
I20260925 16:43:54.086738  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.087278  8969 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:54.088014  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.044386 12032 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:54.088855  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.089536  8973 raft_consensus.cc:2354] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3.
I20260925 16:43:54.089447 12032 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.090293  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.091053  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.091987  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.092965  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.093456  8968 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 3.
I20260925 16:43:54.094117  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.094686  8968 raft_consensus.cc:2354] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
I20260925 16:43:54.052172 12078 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.097647 12078 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:54.098542 11925 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:54.091576  8975 raft_consensus.cc:2362] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8. Re-sending same reply.
I20260925 16:43:54.105896  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.106422  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:54.107116  9041 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:54.107424  8973 raft_consensus.cc:2354] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
I20260925 16:43:54.106575  8974 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:54.109648  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:54.110782  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49034.6us
I20260925 16:43:54.112452  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.114735  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:54.115334  9694 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:54.114311  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:54.119843  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.872s (SENT)
I20260925 16:43:54.119906 11883 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:43:54.120481  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.120971 11883 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:54.151337  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.153472  8969 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:54.121444 12057 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:54.141765  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.152118  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.155172  9702 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:54.155634 11948 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:54.159489  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.715s (SENT)
I20260925 16:43:54.168964 12028 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:54.200039  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.200003 11948 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:54.201779 11939 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:43:54.202664 12000 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:54.138911 12008 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.175486  8975 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:43:54.220055 12114 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.078s	user 0.000s	sys 0.001s
I20260925 16:43:54.132434  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.224193  8966 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:54.122133 11882 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:54.143116 11883 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:54.245621 11883 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.248653 11883 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:54.252218 12113 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
W20260925 16:43:54.256812  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 142794us
I20260925 16:43:54.257165  9695 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:43:54.259456  9042 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260925 16:43:54.259765  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.890s (SENT)
I20260925 16:43:54.260576  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.098557 12111 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Committing config change with OpId 4.5: config changed from index 3 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:54.364363  9048 raft_consensus.cc:595] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
W20260925 16:43:54.359165  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 246807us
I20260925 16:43:54.367009  9048 raft_consensus.cc:603] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:43:54.280216  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:43:54.332232  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.859s (SENT)
W20260925 16:43:54.363724  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.052s (SENT)
I20260925 16:43:54.367735  8973 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:54.368685  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.369259  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:54.371290  9089 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.055s (SENT)
I20260925 16:43:54.362079  9050 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260925 16:43:54.300203  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.350788  9694 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:54.372316  8969 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:54.370898 12063 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:54.371747  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.378351  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:54.384948  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:54.385206  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 337366us
I20260925 16:43:54.390367  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:54.390972  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58795.9us
W20260925 16:43:54.392030  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.878s (SENT)
I20260925 16:43:54.401453  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.422219  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.423240  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.423185  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.392757  9041 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:54.379858 12041 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:54.425379  8973 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:43:54.437296  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.438174  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:54.438803  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44845.6us
W20260925 16:43:54.441109  9089 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.507s (SENT)
I20260925 16:43:54.338024 12008 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:54.444568  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.389004 12078 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:54.451089  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:54.452971  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.522s (SENT)
W20260925 16:43:54.454306  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.657s (SENT)
I20260925 16:43:54.448366  9116 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:43:54.456821  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66407.2us
I20260925 16:43:54.459473  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:54.460232  9695 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:54.470152  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.265535 12071 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.180s
I20260925 16:43:54.470340  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:54.485268  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 93258.7us
I20260925 16:43:54.486929  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:54.487257  9089 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.707s (SENT)
I20260925 16:43:54.487679  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.379761 12003 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.062s
I20260925 16:43:54.468793  8969 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:43:54.445091 11948 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:54.504911  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:54.426960 11978 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.054s
I20260925 16:43:54.510500  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.475500 12078 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:54.386474 12110 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.127s
I20260925 16:43:54.528457  9050 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:54.532994  9050 raft_consensus.cc:595] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:54.533272  9050 raft_consensus.cc:603] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:43:54.508081 12083 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.538s	user 0.016s	sys 0.006s
I20260925 16:43:54.504856 12067 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:54.535879  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:54.537585  9118 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:54.531461 12109 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:54.507011 12008 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260925 16:43:54.507766 12007 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.031s
I20260925 16:43:54.507793 11927 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260925 16:43:54.547603  9666 leader_election.cc:398] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 2 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3.
I20260925 16:43:54.541463 11846 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:54.547621  9694 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:43:54.562021  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.562578  8973 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260925 16:43:54.564920 12119 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260925 16:43:54.538401 12083 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.568917 12083 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:54.569726  9043 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.553s	user 0.014s	sys 0.002s
I20260925 16:43:54.570030  9043 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:43:54.570685  8970 raft_consensus.cc:2354] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10.
I20260925 16:43:54.574427  9695 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:54.575344  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:54.575984  9693 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:43:54.577365 12125 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:43:54.581044  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:54.582165  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.582717  8973 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:54.585450  8967 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260925 16:43:54.586588  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.587221  8967 raft_consensus.cc:2362] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5. Re-sending same reply.
I20260925 16:43:54.590823  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.590984  9118 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:43:54.592906  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.596604  8969 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:54.597468  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:54.598481  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:54.599061  8969 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:43:54.599359  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 112125us
W20260925 16:43:54.599998  9089 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.791s (SENT)
I20260925 16:43:54.537407 12067 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.602281  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.603307 11846 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:54.603683 12067 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:54.604209 11846 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.605059  8971 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:43:54.607450  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.607834  8972 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260925 16:43:54.608258  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45987.6us
I20260925 16:43:54.609067  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:54.609344  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:54.609922  9043 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:54.610088  8969 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260925 16:43:54.611079  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:54.616477  8967 raft_consensus.cc:2362] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:43:54.617985  9693 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:43:54.626791  8973 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:54.548126 11934 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260925 16:43:54.635869  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:54.571223 12078 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.642315  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:54.648437 12115 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
W20260925 16:43:54.673354  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125807us
I20260925 16:43:54.628369 12003 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:54.638305 11827 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
W20260925 16:43:54.685374  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83141.7us
I20260925 16:43:54.686365  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.692919  9666 leader_election.cc:398] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
I20260925 16:43:54.693248  9666 leader_election.cc:401] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:43:54.673044 12133 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:43:54.697670 11925 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.001s
I20260925 16:43:54.698068 11925 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:43:54.698530  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:54.699404 12003 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:54.698565  9049 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:43:54.700278 12003 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:54.649350 12083 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:54.691596 12067 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:43:54.705678  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 124284us
I20260925 16:43:54.707159  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.708559  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.709484  9049 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:43:54.709721  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:54.714596  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:54.715433  9693 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:43:54.717207  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.720714  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:54.631045 12041 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260925 16:43:54.639180 11854 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:54.689694 12069 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:54.735575  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.715837 12036 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
I20260925 16:43:54.739130  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.762627  9043 raft_consensus.cc:595] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:54.723523 11944 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:54.729241 12083 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:54.769544  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 76443.7us
W20260925 16:43:54.773319  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 87040.8us
I20260925 16:43:54.728402 12067 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:43:54.777279 11986 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:54.777845 11986 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:54.736472 11883 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:54.739543 12069 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:54.739089 12030 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:54.793613  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.794507  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.764581 12076 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:54.799871  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:54.800895  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61851.7us
I20260925 16:43:54.772071 11978 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260925 16:43:54.791939 12115 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:43:54.801759  9666 leader_election.cc:398] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
I20260925 16:43:54.795452 12032 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:54.770620 11944 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:54.802554 12007 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:54.778893 11986 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:54.808149  9666 leader_election.cc:401] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260925 16:43:54.816708  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.796121 12069 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:54.843825  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.808018 11978 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:54.808957 12083 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:54.812868 12032 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:54.872180  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.836948 12041 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:54.831221 11944 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:54.841557  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.219s (SENT) [suppressed 57 similar messages]
I20260925 16:43:54.812338 12117 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:54.851022  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51245.8us
I20260925 16:43:54.878950  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:54.820242 12007 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:54.837684 12067 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:54.841450 11883 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5.
I20260925 16:43:54.853577 12137 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:43:54.896512  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.909901  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.910548  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.870298 11978 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:54.885160 12007 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:54.911517  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 70002.6us
I20260925 16:43:54.873849 12032 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:54.914642  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.882040 11939 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:54.881605 12041 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:54.893447 12063 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:54.922433  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:54.902230 12138 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:54.920504 12041 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:54.882237 12117 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:54.914377 12061 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:43:54.917328 12057 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:54.926257 12078 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:54.926386 12063 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:54.949437  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:54.953255  9043 raft_consensus.cc:595] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:54.938700 12136 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:54.936556 12061 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:54.947013 12145 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:54.956743 12063 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:54.984033  9118 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:54.963073 12061 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:43:54.949433 12067 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.014534  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.019310  9694 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:43:55.020387  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.020533  9694 raft_consensus.cc:595] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:55.021821  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.022754  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.025823  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.026942  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.028308  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.029238  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.023643 12136 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260925 16:43:55.035224 12130 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260925 16:43:55.035346 12139 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.155s	user 0.001s	sys 0.000s
I20260925 16:43:55.035511 11948 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:55.026513 12078 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:55.028782 12137 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:55.032579 12083 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:55.034090 12138 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:55.066576  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.044174 12132 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:43:55.075196 12148 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260925 16:43:55.076409 12147 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260925 16:43:55.080837  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 110565us
W20260925 16:43:55.075592 12142 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.149s	user 0.001s	sys 0.001s
W20260925 16:43:55.074060 12149 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260925 16:43:55.102972  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:55.104457  9046 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6030f186a664452b127609fadec766b"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:43:55.088481 12137 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:55.108036  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:55.084071 12136 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:43:55.108269 12157 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:43:55.106002  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:55.123473 12140 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.164s	user 0.001s	sys 0.000s
I20260925 16:43:55.106830 12117 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:55.152606  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46674.6us
W20260925 16:43:55.151060  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 231155us
I20260925 16:43:55.137924 12137 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:55.160815  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 131611us
I20260925 16:43:55.167670  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.169433 12133 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:55.169570  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.171844 12155 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:55.172072 12133 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:55.173261  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.176132 12133 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:55.178699 12160 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.028s
I20260925 16:43:55.152596 12156 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:43:55.180620 12141 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260925 16:43:55.181766  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.184849 12133 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:55.188301  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:55.189270  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.697s (SENT)
I20260925 16:43:55.189797  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.191056  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.194795  9116 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:55.196803  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.197844  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.198992  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.205148  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.215018  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.217765 12081 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:55.218470 12153 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:43:55.220189 12138 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:43:55.222941 12063 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.224089  9043 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:55.225419 12063 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.225626 12083 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:43:55.226863 11944 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.228088 12159 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:43:55.228848 11944 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:55.228994 12003 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:55.229861 12159 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:43:55.230254 11854 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:55.230340 12041 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.231607  9117 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:55.232076 12061 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:55.233101  9120 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:43:55.233309 12116 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:55.231271  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.234822 11827 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:43:55.235203 11827 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:55.235558 11827 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:55.235751  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.166481 12069 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.237277 12057 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:43:55.238039 12069 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.238814 12057 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:43:55.239253 12057 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:55.239675 12057 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:55.240880  9702 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:55.241487 12145 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:55.241938 12145 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.242446  9700 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:55.243541 12153 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:43:55.243846 12145 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.233927 12061 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:55.251056 12158 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:55.252360 11925 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:43:55.255424  8975 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:55.257117  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.257759  8975 raft_consensus.cc:2362] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8. Re-sending same reply.
I20260925 16:43:55.259585  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:55.261418  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:55.262044  9043 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:55.263967  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.219533 12007 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.272028  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.273451 12007 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.271586  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:55.274823 12041 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.193825 12155 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:55.189251 12076 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:55.279748 11925 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:43:55.285827  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:55.285485  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:55.291568  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.235451 12032 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.293222  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:55.276768  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:55.294646  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 138283us
I20260925 16:43:55.294776  8969 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:43:55.334203  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.312885  9043 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:43:55.321906  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.336167  8971 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:55.277340 12019 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260925 16:43:55.322990  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 214318us
I20260925 16:43:55.324922  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.337179  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:55.337735  8970 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 4: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:43:55.282573 12133 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:55.327977  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:55.202441 11830 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:55.330075  9049 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:43:55.332983  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.373031  8969 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:55.370350 12081 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:43:55.371201  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.340163 12083 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:55.344358  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:55.393784  9694 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:55.345027  9696 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:55.345309  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:55.365916  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.395890  8973 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:55.396083  9701 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:55.392591  9693 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:55.347476  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:55.384498  8969 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:55.292405 12111 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.073s
I20260925 16:43:55.383416  8974 raft_consensus.cc:2362] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6. Re-sending same reply.
I20260925 16:43:55.348119  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:55.344960  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:55.328506 12141 raft_consensus.cc:465] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Not starting pre-election -- already a leader
I20260925 16:43:55.341564  8967 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:43:55.420770  8973 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:55.442126  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:55.356171 11944 raft_consensus.cc:979] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:55.437693  9694 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
W20260925 16:43:55.381906 12148 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:43:55.464299  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.363037 11986 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:43:55.469249  8966 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:55.357440 12001 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:43:55.392815 12081 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:43:55.478300  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:43:55.480352  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 132008us
I20260925 16:43:55.484203  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:55.462973 12160 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:55.353703 12030 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
I20260925 16:43:55.473155 11883 raft_consensus.cc:1067] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:55.392279 12097 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.098s
I20260925 16:43:55.481824 12061 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:55.511768 12112 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.220s
I20260925 16:43:55.514259  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:55.516064 12141 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:43:55.517495 12071 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:43:55.472677 11854 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.051s
I20260925 16:43:55.446374 12083 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260925 16:43:55.470322 12155 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.522826 12032 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:55.518285 12163 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260925 16:43:55.547616  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:43572
I20260925 16:43:55.562213  9121 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:43:55.508747 12160 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:55.562613  9121 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:55.571107  9117 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
W20260925 16:43:55.586306  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 300551us
I20260925 16:43:55.559657 12144 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:55.509687 12076 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.068s
I20260925 16:43:55.607620  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:55.541971 12175 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:55.636188 12171 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.039s
I20260925 16:43:55.584637 12081 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.531710 12137 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.608350 12144 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:43:55.663919  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 165104us
I20260925 16:43:55.607177 11846 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260925 16:43:55.668465  9121 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.616771 12175 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:55.677691 12175 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:55.687312  8971 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:55.692201  8970 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:55.693409 12137 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.694252  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:43:55.695079  9117 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:43:55.698153  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:55.698342  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:55.698896  8971 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:55.687781 12160 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:55.689149 11978 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.769s	user 0.010s	sys 0.000s
I20260925 16:43:55.606365 12057 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.733034 12057 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.690889 11827 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:55.616310 11925 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.053s
I20260925 16:43:55.711236  9121 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:55.700052  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:55.746235  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46308.1us
I20260925 16:43:55.716775  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:55.718758  8971 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:55.747767  9700 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:55.748059  9700 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:55.749446  8968 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:55.751778  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:55.748929 12138 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:43:55.757799  9121 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:43:55.700562  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:55.664768 12019 raft_consensus.cc:2741] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260925 16:43:55.749642  9700 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.769323  9700 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:55.744985 12132 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:55.770263 12071 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:55.793579 12071 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:55.770059 12173 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
W20260925 16:43:55.805155  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53506us
I20260925 16:43:55.809340  9121 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:55.810686  9117 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:55.821848 12178 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
W20260925 16:43:55.824291  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 216550us
I20260925 16:43:55.836934  9700 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:55.738490 11978 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:55.840166  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54518.1us
I20260925 16:43:55.837684 12032 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:55.849731  9115 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:55.906018  9046 raft_consensus.cc:595] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:43:55.906643  9046 raft_consensus.cc:603] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:43:55.920490  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59578.4us
I20260925 16:43:55.858526 12032 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:55.804783 12132 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.848430 12076 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260925 16:43:55.961763 11763 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:43:55.962340 11763 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:55.789885 12144 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:55.966001  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 109391us
I20260925 16:43:55.964052 11827 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:55.976984 12183 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260925 16:43:55.978192 12165 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260925 16:43:55.979485 12165 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:55.979875 12165 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:55.980799 12165 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:55.984257 12144 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:43:56.052634  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60688.7us
W20260925 16:43:56.045678 12139 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260925 16:43:55.963320 11763 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:56.082685  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:43:56.092260  9121 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
W20260925 16:43:56.105271 12198 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260925 16:43:56.106648 12186 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
W20260925 16:43:56.107726 12182 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.191s	user 0.001s	sys 0.000s
I20260925 16:43:56.107846  9124 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:43:56.109405 12121 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.023s
W20260925 16:43:56.111124  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 109840us
I20260925 16:43:56.116591  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:56.117369  8969 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:56.114740  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:56.131363  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:43:56.133912  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 216851us
I20260925 16:43:56.136940  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:43:56.139168  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56551.6us
W20260925 16:43:56.224062  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92783.9us
I20260925 16:43:56.225386  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:56.226020  8972 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:56.227944  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95160.5us
I20260925 16:43:56.229442 12214 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:43:56.230789  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:56.231361  8968 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:43:56.235059 12188 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.378s	user 0.000s	sys 0.001s
I20260925 16:43:56.227839 11925 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:43:56.236119 12061 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:43:56.236665 12061 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:56.236735  8972 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:56.107873 12192 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.070s	user 0.008s	sys 0.014s
I20260925 16:43:56.237605  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:43:56.245128  8972 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:43:56.247447  8969 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:43:56.249912  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:56.253304  9121 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260925 16:43:56.253397  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 115803us
I20260925 16:43:56.224179 11978 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:56.248878 11763 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:56.248055 12019 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:56.237605 12061 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.228094 11986 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260925 16:43:56.087528 12032 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.255625 12171 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:56.385459  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 139165us
I20260925 16:43:56.388887  9090 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:56.282550 11846 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.111s
I20260925 16:43:56.409183  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 595) took 1073 ms. Trace:
I20260925 16:43:56.420043  8972 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:43:56.394841  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1562) took 1091 ms. Trace:
W20260925 16:43:56.421267  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 168255us
I20260925 16:43:56.421811  8973 rpcz_store.cc:276] 0925 16:43:55.302982 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.444321 (+141339us) service_pool.cc:227] Handling call
0925 16:43:55.444564 (+   243us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:55.462186 (+ 17622us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:55.462215 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:55.466048 (+  3833us) log.cc:842] Serialized 26 byte log entry
0925 16:43:55.657267 (+191219us) spinlock_profiling.cc:243] Waited 5.33 ms on lock 0x7b18000dd080. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:43:55.791282 (+134015us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:56.133637 (+342355us) log.cc:842] Serialized 14 byte log entry
0925 16:43:56.389347 (+255710us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:56.389421 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:56.389468 (+    47us) raft_consensus.cc:1671] finished
0925 16:43:56.394069 (+  4601us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:56.394784 (+   715us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36317,"prepare.queue_time_us":142249,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":3018,"raft.queue_time_us":116375,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":4058,"spinlock_wait_cycles":12253440,"thread_start_us":728860,"threads_started":3,"wal-append.queue_time_us":523017}
I20260925 16:43:56.409698  8966 rpcz_store.cc:276] 0925 16:43:55.341421 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.510423 (+169002us) service_pool.cc:227] Handling call
0925 16:43:55.510734 (+   311us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:55.525206 (+ 14472us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:55.525254 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:55.528514 (+  3260us) log.cc:842] Serialized 26 byte log entry
0925 16:43:55.741730 (+213216us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:43:55.801886 (+ 60156us) log.cc:842] Serialized 14 byte log entry
0925 16:43:55.903975 (+102089us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:55.904052 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:56.234448 (+330396us) spinlock_profiling.cc:243] Waited 1.71 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:43:56.396215 (+161767us) raft_consensus.cc:1671] finished
0925 16:43:56.408930 (+ 12715us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:56.409113 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":188127,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":59815,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":30099,"spinlock_wait_cycles":3929472,"thread_start_us":320549,"threads_started":3,"wal-append.queue_time_us":310269}
I20260925 16:43:56.406019 11934 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:56.430696 12195 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:56.412283 12153 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
W20260925 16:43:56.468603  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 188136us
W20260925 16:43:56.470968  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133821us
I20260925 16:43:56.472337  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:56.473167  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:56.431897 12132 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:56.389631 12019 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.437321 12137 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:56.421445 11986 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:56.482810  8973 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:43:56.485693  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
W20260925 16:43:56.486382 12202 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
W20260925 16:43:56.487846 12208 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260925 16:43:56.488523 12000 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:43:56.488904 12111 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:56.498571  9041 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:56.499742  8973 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260925 16:43:56.504853  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:56.505424  8968 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260925 16:43:56.469379 12222 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:56.393216 12171 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:56.498288 12175 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.814s	user 0.005s	sys 0.006s
I20260925 16:43:56.479755 12172 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:56.496271 12153 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:56.475126 12216 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:56.493098 11986 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:56.498278 12155 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:56.567984 12222 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.473670 11934 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.586434  8973 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:43:56.594792 12171 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:56.594849  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1579) took 1347 ms. Trace:
I20260925 16:43:56.563921 12111 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.595415  9048 rpcz_store.cc:276] 0925 16:43:55.247833 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.248055 (+   222us) service_pool.cc:227] Handling call
0925 16:43:55.248357 (+   302us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:55.248708 (+   351us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:55.248737 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:55.857474 (+608737us) spinlock_profiling.cc:243] Waited 9.47 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:43:55.858038 (+   564us) log.cc:842] Serialized 52 byte log entry
0925 16:43:55.993860 (+135822us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:43:56.384874 (+391014us) log.cc:842] Serialized 14 byte log entry
0925 16:43:56.385083 (+   209us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:56.385181 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:56.591907 (+206726us) raft_consensus.cc:1671] finished
0925 16:43:56.594584 (+  2677us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:56.594777 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":370,"prepare.queue_time_us":95515,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":4976,"raft.queue_time_us":23298,"raft.run_cpu_time_us":197,"raft.run_wall_time_us":6378,"spinlock_wait_cycles":21779840,"thread_start_us":433536,"threads_started":2,"wal-append.queue_time_us":394604}
I20260925 16:43:56.506937 12137 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:56.591380 12155 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.606644 12155 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:56.607896  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:56.609536 12111 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:56.610816 12210 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
W20260925 16:43:56.612622 12213 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260925 16:43:56.590080 12172 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:56.615222 12172 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:56.616132 12153 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.583528 12000 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:56.619758 12000 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:56.620615 11986 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.626538 12013 raft_consensus.cc:979] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:56.476966 12195 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:56.628530 12222 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:56.628791 12195 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:56.585809 12216 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.631054 12019 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:56.628233 11882 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:43:56.569636 12175 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:56.632109 12216 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:56.944021 12229 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:57.257081 12229 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:57.258409 12144 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.274s	user 0.011s	sys 0.000s
I20260925 16:43:57.258980 12144 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:56.869467 12205 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:57.261343 12179 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.588s	user 0.028s	sys 0.044s
I20260925 16:43:57.261377 12205 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:57.261931 12179 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.028s	sys 0.045s
I20260925 16:43:57.263396 12205 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:56.944242 11830 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:57.303668 11830 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.305163 12145 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.305752 11830 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:57.305650 12145 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.306356 11830 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:57.306850 11830 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.264074 12179 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.312093 12179 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:56.735726  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 252142us
I20260925 16:43:56.931980 12132 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:56.655061  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 376063us
I20260925 16:43:56.958086 12083 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:56.723316 12222 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.259672 12144 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.274937  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:57.275995 11882 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:56.932041  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:56.946293  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:56.632756  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 941) took 1743 ms. Trace:
I20260925 16:43:57.330685  9693 rpcz_store.cc:276] 0925 16:43:54.888868 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:54.889021 (+   153us) service_pool.cc:227] Handling call
0925 16:43:54.889351 (+   330us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:55.406581 (+517230us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:56.632475 (+1225894us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54004731d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:43:56.632690 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1156911360}
I20260925 16:43:57.332897 11830 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:57.323251 12205 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.333842 12205 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.334466 11675 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:57.334942 11675 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.335724 12205 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:56.632287 12152 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:56.869928  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:56.791735  9700 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:57.290493  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:57.259167 12229 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:57.303114 12216 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:57.344540 11675 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:57.345093 11675 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.344623 12216 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.345515 11675 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.347054 12216 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:57.265196 12175 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:57.347396 11675 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:57.341306 11882 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.328536 12222 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.328660 12083 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.355422 12083 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:57.326887 12132 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.301561  9699 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:57.283596  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:43:57.358057  9697 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:57.187839 12137 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:57.670397  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.000s	sys 0.025s
W20260925 16:43:57.544641  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.006s	sys 0.014s
W20260925 16:43:57.577908  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 251384us
W20260925 16:43:57.689251  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.717s	user 0.011s	sys 0.014s
I20260925 16:43:57.427152  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:57.459872  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.947s	user 0.016s	sys 0.019s
W20260925 16:43:57.690155  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.178s	user 0.016s	sys 0.027s
I20260925 16:43:57.609622  8973 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260925 16:43:57.608847  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.008s	sys 0.015s
I20260925 16:43:57.607386  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:57.691043  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.010s	sys 0.016s
W20260925 16:43:57.688036  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 241683us
I20260925 16:43:57.693131  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:57.694213  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.000s	sys 0.026s
I20260925 16:43:57.695238  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:57.358175 12132 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:57.725960 12205 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.726374 12256 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.726459 12132 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:57.726996 12256 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.728739 12175 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.729174 12233 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:57.729673 12233 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.729969 12256 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:57.730046 12238 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:57.730558 12256 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.730616 12238 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.731107 12256 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:57.631091  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.002s	sys 0.013s
W20260925 16:43:57.656270  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.007s	sys 0.017s
I20260925 16:43:57.734360  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:57.733178  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:57.734918  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.673s	user 0.008s	sys 0.018s
W20260925 16:43:57.735739  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.002s	sys 0.015s
I20260925 16:43:57.696993  8968 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:43:57.691315  8971 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:57.735276  9694 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:57.697597  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:57.662845 12061 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.704s	user 0.008s	sys 0.008s
W20260925 16:43:57.536427 12172 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.918s	user 0.007s	sys 0.013s
I20260925 16:43:57.727598 12132 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:57.701817 12222 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:57.775224  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:43:57.656838 12234 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:43:57.426143 12212 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.684401 12245 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:57.591475 12032 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.235s
I20260925 16:43:57.911544  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2279) took 2655 ms. Trace:
I20260925 16:43:57.802641  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:57.797199  8968 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:43:57.921365  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40140 (request call id 28) took 2817 ms. Trace:
I20260925 16:43:57.784020  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:57.982251  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2217) took 1506 ms. Trace:
I20260925 16:43:57.775981  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:58.004317  9046 rpcz_store.cc:276] 0925 16:43:55.104114 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.104282 (+   168us) service_pool.cc:227] Handling call
0925 16:43:57.921165 (+2816883us) spinlock_profiling.cc:243] Waited 800 ms on lock 0x7b54000dfa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:57.921293 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1840307072}
I20260925 16:43:58.004674  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:58.007886  9121 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:57.731592 12233 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.005131  9050 rpcz_store.cc:276] 0925 16:43:56.476015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:56.481193 (+  5178us) service_pool.cc:227] Handling call
0925 16:43:56.481442 (+   249us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:56.481624 (+   182us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:56.509494 (+ 27870us) log.cc:842] Serialized 14 byte log entry
0925 16:43:57.981681 (+1472187us) spinlock_profiling.cc:243] Waited 1.09 ms on lock 0x7b18002c2360. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:43:57.981844 (+   163us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:57.981903 (+    59us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:57.981957 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:57.982038 (+    81us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:57.982186 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2890,"prepare.queue_time_us":27897,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":46,"spinlock_wait_cycles":2513792}
I20260925 16:43:58.009094  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:57.784384  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:57.599418 12229 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:57.359612 12145 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:57.802265  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 1974) took 2444 ms (client timeout 2219 ms). Trace:
I20260925 16:43:57.511713 12083 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.412233 12076 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.001735  9118 rpcz_store.cc:276] 0925 16:43:55.256126 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.257299 (+  1173us) service_pool.cc:227] Handling call
0925 16:43:55.291128 (+ 33829us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:55.326909 (+ 35781us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:55.326935 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:55.327273 (+   338us) log.cc:842] Serialized 26 byte log entry
0925 16:43:57.314666 (+1987393us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b18001b08e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:43:57.605471 (+290805us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:57.605505 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:57.605636 (+   131us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:57.911198 (+305562us) raft_consensus.cc:1671] finished
0925 16:43:57.911223 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:57.911479 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38009,"raft.queue_time_us":40035,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":30308,"spinlock_wait_cycles":4748160,"thread_start_us":290651,"threads_started":1,"wal-append.queue_time_us":2577126}
I20260925 16:43:57.724291 12137 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:58.005981  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 230054us
I20260925 16:43:57.976410 12252 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.938380 12153 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:43:58.003602 12172 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.386s	user 0.019s	sys 0.024s
I20260925 16:43:58.130918  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:57.791409 12250 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.920364 11675 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:58.001107 12061 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.014s	sys 0.018s
I20260925 16:43:57.921808 12110 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:57.975069 12028 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:43:58.068492  9697 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:43:58.069203  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:58.069501  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:57.729207 12175 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:57.916272 11854 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:58.056996  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:58.152053  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:58.152761  9043 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:57.957976 12248 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.914954 12230 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:57.911936 12244 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.160226 12244 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.160202 12230 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.163206 12244 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:58.059434  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50452.3us
I20260925 16:43:57.726583 12205 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.166819 12230 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:58.168013  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:58.071122 12159 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.167050 12205 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:58.170176  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 96971.5us
I20260925 16:43:57.918584 11934 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:58.171104 11934 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:58.171418  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:58.051869 12253 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:58.058703 12032 consensus_queue.cc:1225] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 6.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
W20260925 16:43:58.061900  8974 rpcz_store.cc:269] 0925 16:43:55.296854 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.370993 (+ 74139us) service_pool.cc:227] Handling call
0925 16:43:57.740916 (+2369923us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b540020e254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:57.741026 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10362112}
I20260925 16:43:58.177865  9043 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:43:58.192348  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:43:57.407123 12152 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.062824 12233 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.064231 12195 raft_consensus.cc:1067] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:43:58.142844  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:43:57.916895 12238 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:58.143630  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:58.068050 12013 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:58.146037  9041 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:43:58.140196  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 125930us
I20260925 16:43:58.067340 12136 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:43:58.064574 12078 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.150127  9701 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:43:58.151165  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 707) took 1142 ms. Trace:
I20260925 16:43:58.012230 12067 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:43:58.156829  9123 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260925 16:43:58.170349 12205 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:58.068812 12145 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:57.983194 11925 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.217394  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:58.217866 11925 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.192520  9043 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:58.141227 12110 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:57.908599 12247 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.145042 12157 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:58.047499 12212 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.191668 12256 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.145485 12172 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.070310 12083 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.129885 12137 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.036397 12245 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.072981 12076 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.211614  9701 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:43:58.226351 12061 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:58.145054 11675 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.215730  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:58.156359 12001 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:58.151091 12003 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:58.275954  9699 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:43:58.141404 12028 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:43:58.214439  9697 rpcz_store.cc:276] 0925 16:43:57.001893 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.002038 (+   145us) service_pool.cc:227] Handling call
0925 16:43:58.144223 (+1142185us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:43:58.176050  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:58.221822  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1977) took 1738 ms. Trace:
I20260925 16:43:58.065734 12229 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.224555  9043 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.203931 12111 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:58.226963  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:58.143392 12250 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.237464  9050 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:43:58.262115  9698 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260925 16:43:58.171561 11934 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.207608 12171 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:58.212000 12136 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.139349 12252 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.169504 11854 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.139137 12153 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.225744 11709 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:58.298080 12262 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.102s
I20260925 16:43:58.301054 11709 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.302825 11709 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.234987 12178 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:58.282500 12260 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.267234 12232 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:43:58.267985 12259 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:58.271158  9701 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.216259 12078 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.282503  8966 rpcz_store.cc:276] 0925 16:43:56.483201 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:56.483333 (+   132us) service_pool.cc:227] Handling call
0925 16:43:56.483612 (+   279us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:56.483925 (+   313us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:56.483951 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:56.484339 (+   388us) log.cc:842] Serialized 26 byte log entry
0925 16:43:56.670603 (+186264us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:57.256046 (+585443us) log.cc:842] Serialized 14 byte log entry
0925 16:43:57.626885 (+370839us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:57.626978 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:58.221636 (+594658us) raft_consensus.cc:1671] finished
0925 16:43:58.221659 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:58.221771 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":613641,"prepare.queue_time_us":585832,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":82875,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":151,"thread_start_us":527597,"threads_started":2,"wal-append.queue_time_us":1060281}
I20260925 16:43:58.174901 12159 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.278918 12272 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.282231 12001 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.282395 12003 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.255960 12157 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.288285  9043 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:58.219520 12013 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.264950 12172 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.274601 12246 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.223212 12067 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.054s
I20260925 16:43:58.219359 12233 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.297863 11854 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:58.219038 12205 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.274807 12061 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:58.234475 12247 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.194329 12253 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.172641 12248 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.281106 12110 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.303385 12262 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:43:58.285432 12132 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:58.303941 12178 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.304106 12260 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.219485 12145 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.706421  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:58.375344  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:58.640440  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:43:58.312007  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:58.711920  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.006s	sys 0.005s
I20260925 16:43:58.711755  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:43:58.721169  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.007s	sys 0.006s
W20260925 16:43:58.733057  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.007s	sys 0.006s
W20260925 16:43:58.733520  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.007s	sys 0.006s
I20260925 16:43:58.718943  9695 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:58.293553 12136 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:58.749914  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:43:58.839223  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:58.726238 11827 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:58.700793 12000 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.003s	sys 0.008s
W20260925 16:43:58.867441  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 117626us
I20260925 16:43:58.298516 12252 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:58.364754 12268 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260925 16:43:58.897332 12000 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.750s	user 0.003s	sys 0.008s
I20260925 16:43:58.888384  9118 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:43:58.313892 12083 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.287825 12111 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.368271 11925 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.900576  9119 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:43:58.762303 11854 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.729394 12262 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:58.373982 12258 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260925 16:43:58.906536  9120 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:43:58.923134 12013 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:58.897214 11827 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.924067 12003 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:58.914069 12000 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.925284 11827 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:58.924981 12000 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.925923 11827 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.728010 12061 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:58.898366  9048 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:43:58.639488 12019 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.312094 12261 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.293641 12171 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.726411 11675 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.650255 12076 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:58.914961  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.771s	user 0.009s	sys 0.018s
W20260925 16:43:59.014696  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.009s	sys 0.018s
I20260925 16:43:58.648655 12195 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.374472 12152 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:58.647470 12250 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.923171 12001 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.312526 12175 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:58.910058  9015 connection.cc:232] RPC call timeout handler was delayed by -1.8743216230000144s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260925 16:43:58.841493 12110 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:58.388226 12269 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.842376 12229 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:58.898914 12132 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:43:58.990989  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.779s	user 0.003s	sys 0.031s
W20260925 16:43:58.990728  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.012s	sys 0.023s
W20260925 16:43:58.990885  9694 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.012s	sys 0.023s
I20260925 16:43:58.913120 11882 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.016959 11934 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:58.997155 11763 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.005s	sys 0.000s
I20260925 16:43:58.926519 11827 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:59.021926  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.083s	user 0.008s	sys 0.024s
W20260925 16:43:59.118556  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.180s	user 0.008s	sys 0.024s
I20260925 16:43:58.388218 12271 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:43:58.353444 12232 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.012617 12019 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:58.352155 12028 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.048699 12081 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:58.983189 12287 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.982244 12277 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.042212  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:43:59.026343 12153 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:58.929770 12262 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:43:59.043951  8969 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.847s	user 0.009s	sys 0.041s
I20260925 16:43:58.984294 12290 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:58.368026 12270 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.767s
I20260925 16:43:58.905869 12212 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.020757 12067 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:59.174722  8969 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.978s	user 0.009s	sys 0.041s
W20260925 16:43:59.182951  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.989s	user 0.073s	sys 0.104s
W20260925 16:43:59.186769  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.993s	user 0.074s	sys 0.105s
W20260925 16:43:59.174541  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.952s	user 0.018s	sys 0.037s
W20260925 16:43:59.187371  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.968s	user 0.018s	sys 0.037s
W20260925 16:43:59.187259  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 993781us
W20260925 16:43:59.046713  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.877s	user 0.012s	sys 0.023s
I20260925 16:43:59.195914  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:58.940099 11854 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.125717  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:43:59.030184 12083 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:43:59.132844  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 276932us
I20260925 16:43:59.043504 12133 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:59.199397  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:58.888936 12272 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:58.754971 12246 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.114581 12001 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:59.206826 12233 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.045403 12132 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:43:58.920343 12245 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:59.158349  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.022s	sys 0.038s
W20260925 16:43:59.215948  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.047s	user 0.022s	sys 0.038s
I20260925 16:43:59.174714 12229 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:43:58.755086 12259 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.044376 12278 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:59.172335  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 130222us
I20260925 16:43:58.984854 12289 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:43:59.115123 11763 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.006s	sys 0.000s
I20260925 16:43:59.117334 12003 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:59.115332 12250 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:59.218134 12172 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.029207 12283 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.118186 11675 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:59.182335 12277 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:59.046875  9694 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.832s	user 0.012s	sys 0.023s
I20260925 16:43:59.195827  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.158334 11882 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.115828 12252 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.060s
W20260925 16:43:59.046517  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.003s	sys 0.031s
I20260925 16:43:59.197118  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.159801 12000 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.200619  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:43:59.350495  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.13857e+06us
W20260925 16:43:59.162132 12255 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.012s	sys 0.031s
I20260925 16:43:59.044664 12195 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.205776  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.192133 12296 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:59.208868  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.159030 12274 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:43:59.212481 12226 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.903s	user 0.024s	sys 0.044s
I20260925 16:43:59.213023 12260 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.213488 12178 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:59.213799  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.798s	user 0.006s	sys 0.025s
I20260925 16:43:59.214617 12171 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:59.018606 12121 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.004s	sys 0.004s
I20260925 16:43:59.211246 12078 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.218482 12132 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:43:59.192916 12287 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.022128 12261 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:59.311179  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 173298us
I20260925 16:43:59.180665 12271 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.207015 12001 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.180017 12081 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.229506 12145 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.200875 12067 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.205036 12083 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.355019  9090 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:59.356747 12204 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.115442 12269 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.305032 12152 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.304973 12076 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.345621 12247 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:43:59.424266  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 192708us
I20260925 16:43:59.255318 11925 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.094s
I20260925 16:43:59.331828 12248 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.201361 12290 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:59.357931 12160 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 3.101s	user 0.030s	sys 0.087s
I20260925 16:43:59.336207 12289 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.337352 12278 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.343786 12250 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.205209 12133 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:59.358506 12255 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.124s	user 0.013s	sys 0.032s
I20260925 16:43:59.445973 12137 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.720146  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 591) took 4384 ms. Trace:
W20260925 16:43:59.720834  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.497s	user 0.013s	sys 0.036s
W20260925 16:43:59.722297 12121 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.013s	sys 0.014s
I20260925 16:43:59.742369  8968 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:43:59.357796 11882 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.744668  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:59.748598 12272 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:43:59.751992  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 397181us
I20260925 16:43:59.753073  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:59.753901  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 110435us
W20260925 16:43:59.734827 12160 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 3.496s	user 0.030s	sys 0.094s
I20260925 16:43:59.755143  8970 rpcz_store.cc:276] 0925 16:43:55.335206 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.463258 (+128052us) service_pool.cc:227] Handling call
0925 16:43:55.692023 (+228765us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:55.692594 (+   571us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:59.719906 (+4027312us) spinlock_profiling.cc:243] Waited 228 ms on lock 0x7b540038d450. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:43:59.720070 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":525371264}
I20260925 16:43:59.778527  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.778842 12261 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.779886  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.780651  8970 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:43:59.573369  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 309036us
I20260925 16:43:59.783623 12133 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.784262  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.339677 12253 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.346267 12245 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:59.340161 12003 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.765365  8966 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:43:59.744016 12152 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.816627 12246 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.767088 12278 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.758196  8971 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:59.772459  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.772950  9121 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:59.356156 12111 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.781085 12287 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:59.600432 11827 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.775609  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 799) took 1561 ms. Trace:
I20260925 16:43:59.785668  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:59.767189 12304 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:59.507844 12296 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.349712 11675 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.686856 12019 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:43:59.754760 12226 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.025s	sys 0.055s
I20260925 16:43:59.799031  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.518195 12232 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.750015 11854 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:59.757858 12247 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:43:59.814724 11882 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.815847 12003 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.818343  8968 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:43:59.820657  9016 connection.cc:232] RPC call timeout handler was delayed by -1.5717262759999358s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1751s for a response
I20260925 16:43:59.507431 12205 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.824194  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:43:59.838443  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 504977us
I20260925 16:43:59.347934 12283 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.827186  9694 rpcz_store.cc:276] 0925 16:43:58.213839 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.213977 (+   138us) service_pool.cc:227] Handling call
0925 16:43:58.214243 (+   266us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:58.214416 (+   173us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:59.346083 (+1131667us) log.cc:842] Serialized 14 byte log entry
0925 16:43:59.774852 (+428769us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:59.774905 (+    53us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:59.774942 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:59.775006 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:43:59.775549 (+   543us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17019,"prepare.queue_time_us":766698,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":52,"thread_start_us":1539278,"threads_started":2}
I20260925 16:43:59.828706  9048 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:43:59.871383  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:59.848013  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.872591  8970 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:43:59.873718  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.481750 12274 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:43:59.851022  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.791s (SENT) [suppressed 8 similar messages]
I20260925 16:43:59.786679 12271 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.865417  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:43:59.868948 12278 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:43:59.749462 12076 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:59.885516  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0402552930002003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1652s for a response
I20260925 16:43:59.822824 12259 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:43:59.881457  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:59.883162  8970 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260925 16:43:59.868873 12293 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.524s	user 0.000s	sys 0.001s
I20260925 16:43:59.886170  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:43:59.889421 12003 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:59.878134 12081 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.772202 12204 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.888413  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:43:59.896529 12003 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:43:59.834619 12306 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:59.882011 12160 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:43:59.817936 12245 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:43:59.897790  8970 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: [2.3-4.5]
I20260925 16:43:59.899379  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:59.876245 12232 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:43:59.875708 12247 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:43:59.916100  9048 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:43:59.917953 12306 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:43:59.921471  9088 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45954 dropped due to backpressure. The service queue is full; it has 50 items.
I20260925 16:43:59.786204 12280 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.639s
I20260925 16:43:59.922297 12152 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.866670 12277 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.917080 12178 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:43:59.922435 12144 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.926556  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:43:59.899957 12259 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:43:59.904671 12110 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.859s	user 0.008s	sys 0.004s
I20260925 16:43:59.904361 12003 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:43:59.947587  9694 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:43:59.902661 12083 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.893491 12278 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.854816 12304 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.948165  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:43:59.947467  9088 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45954 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2306)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 650)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 644)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2311)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45954 (request call id 2312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2314)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2316)
I20260925 16:44:00.086632  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.363305  9696 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
W20260925 16:44:00.135644  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 239717us
I20260925 16:44:00.363951  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.364457  9048 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:00.362257  9088 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45954 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2306)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 650)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 644)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2311)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45954 (request call id 2312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2314)
I20260925 16:44:00.366170  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.367569  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.369550  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.370383 12245 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.004418 12001 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.945863 12178 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:00.372053 12178 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:00.371748  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.372841  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.373585  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:43:59.987500 12235 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260925 16:44:00.364420  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1990) took 1161 ms. Trace:
I20260925 16:44:00.004269 12067 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.376261  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1978) took 3892 ms. Trace:
I20260925 16:44:00.377879  9049 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
W20260925 16:44:00.161800  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 190328us
I20260925 16:44:00.376896  8972 rpcz_store.cc:276] 0925 16:43:56.483488 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:56.483626 (+   138us) service_pool.cc:227] Handling call
0925 16:43:56.483940 (+   314us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:56.484272 (+   332us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:56.484300 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:56.484647 (+   347us) log.cc:842] Serialized 26 byte log entry
0925 16:43:56.698742 (+214095us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:57.256411 (+557669us) log.cc:842] Serialized 14 byte log entry
0925 16:43:57.960730 (+704319us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b1800480100. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:43:57.960890 (+   160us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:57.960984 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:43:59.918777 (+1957793us) spinlock_profiling.cc:243] Waited 24.2 ms on lock 0x7b1800480100. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11
0925 16:43:59.920419 (+  1642us) spinlock_profiling.cc:243] Waited 5.34 ms on lock 0x7b1800480100. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:00.375966 (+455547us) raft_consensus.cc:1671] finished
0925 16:44:00.375999 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.376161 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":585935,"prepare.queue_time_us":557713,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":25,"raft.queue_time_us":82551,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":34740,"spinlock_wait_cycles":75924992,"thread_start_us":506879,"threads_started":2,"wal-append.queue_time_us":1062539}
I20260925 16:44:00.381135  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1991) took 1178 ms. Trace:
I20260925 16:44:00.381619  8972 rpcz_store.cc:276] 0925 16:43:59.203121 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.380085 (+1176964us) service_pool.cc:227] Handling call
0925 16:44:00.380498 (+   413us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:00.380731 (+   233us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:00.380767 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:00.380823 (+    56us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:00.380867 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.380933 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.381059 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:00.240340  9697 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.004s	sys 0.013s
W20260925 16:44:00.053097  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.827s	user 0.008s	sys 0.030s
W20260925 16:44:00.385563  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.160s	user 0.014s	sys 0.035s
I20260925 16:44:00.375402  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.387504  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.388170  9048 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:00.389570  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:00.390268  9699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 963) took 2693 ms (client timeout 1751 ms). Trace:
I20260925 16:44:00.390970  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:00.390678  9699 rpcz_store.cc:269] 0925 16:43:57.697055 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.697310 (+   255us) service_pool.cc:227] Handling call
0925 16:44:00.390078 (+2692768us) spinlock_profiling.cc:243] Waited 529 ms on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:00.390183 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1217833728}
I20260925 16:44:00.375895  8970 rpcz_store.cc:276] 0925 16:43:59.202867 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.930290 (+727423us) service_pool.cc:227] Handling call
0925 16:43:59.966055 (+ 35765us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:59.966303 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:59.966339 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:59.966394 (+    55us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:43:59.966435 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.364271 (+397836us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.364373 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.386265  9694 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:00.390880 12306 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:43:59.946178 12289 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:00.101970 12274 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.393394 11675 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.395565 12283 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:43:59.995232 12250 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.004076 11952 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.394s
I20260925 16:44:00.397665 12159 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:00.399077  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2194) took 2231 ms (client timeout 2117 ms). Trace:
W20260925 16:44:00.399478  9118 rpcz_store.cc:269] 0925 16:43:58.167598 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.167745 (+   147us) service_pool.cc:227] Handling call
0925 16:44:00.398914 (+2231169us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:00.398987 (+    73us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1655172352}
I20260925 16:44:00.401232  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 611) took 1204 ms. Trace:
I20260925 16:44:00.401587  8966 rpcz_store.cc:276] 0925 16:43:59.196817 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.196918 (+   101us) service_pool.cc:227] Handling call
0925 16:44:00.401050 (+1204132us) spinlock_profiling.cc:243] Waited 415 ms on lock 0x7b5400355cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:00.401156 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":953671552}
I20260925 16:44:00.403620  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.399077  9120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2187) took 2615 ms (client timeout 2172 ms). Trace:
W20260925 16:44:00.404549  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2304) took 1223 ms (client timeout 1554 ms). Trace:
I20260925 16:44:00.405460  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.406157  9116 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
W20260925 16:44:00.405061  9118 rpcz_store.cc:269] 0925 16:43:59.181233 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.400395 (+1219162us) service_pool.cc:227] Handling call
0925 16:44:00.404461 (+  4066us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:00.406787 12211 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 3.965s	user 0.010s	sys 0.000s
I20260925 16:44:00.408429  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1556) took 5149 ms. Trace:
I20260925 16:44:00.408993  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.404439  9120 rpcz_store.cc:269] 0925 16:43:57.783668 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.783806 (+   138us) service_pool.cc:227] Handling call
0925 16:44:00.398891 (+2615085us) spinlock_profiling.cc:243] Waited 899 ms on lock 0x7b5400041fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:00.398987 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2066629888}
I20260925 16:44:00.408757  8975 rpcz_store.cc:276] 0925 16:43:55.258914 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.259682 (+   768us) service_pool.cc:227] Handling call
0925 16:43:55.259968 (+   286us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:55.272329 (+ 12361us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:55.272358 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:43:55.272748 (+   390us) log.cc:842] Serialized 26 byte log entry
0925 16:43:55.928288 (+655540us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b1800192400. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:43:56.058514 (+130226us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:56.238713 (+180199us) log.cc:842] Serialized 14 byte log entry
0925 16:43:56.243396 (+  4683us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:43:56.243466 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:00.406229 (+4162763us) spinlock_profiling.cc:243] Waited 20 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:00.408234 (+  2005us) raft_consensus.cc:1671] finished
0925 16:44:00.408256 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.408378 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":166453,"prepare.queue_time_us":81119,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5322,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":6011,"spinlock_wait_cycles":51327744,"thread_start_us":130005,"threads_started":1,"wal-append.queue_time_us":1109287}
W20260925 16:44:00.406713  9116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2190) took 2540 ms (client timeout 2043 ms). Trace:
W20260925 16:44:00.410547  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2306) took 1212 ms (client timeout 1538 ms). Trace:
I20260925 16:44:00.410674  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.411880  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.411211  9116 rpcz_store.cc:269] 0925 16:43:57.866917 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.867035 (+   118us) service_pool.cc:227] Handling call
0925 16:44:00.405315 (+2538280us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:00.406646 (+  1331us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":232958208}
W20260925 16:44:00.413532 12215 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 4.026s	user 0.008s	sys 0.018s
I20260925 16:44:00.412465  9122 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
W20260925 16:44:00.414575  9122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2192) took 2468 ms (client timeout 2855 ms). Trace:
I20260925 16:44:00.411262  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.415104  9122 rpcz_store.cc:269] 0925 16:43:57.945913 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.946038 (+   125us) service_pool.cc:227] Handling call
0925 16:44:00.411757 (+2465719us) spinlock_profiling.cc:243] Waited 46 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:00.414497 (+  2740us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":105870080}
W20260925 16:44:00.415580  9124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2186) took 2641 ms (client timeout 2715 ms). Trace:
W20260925 16:44:00.415970  9124 rpcz_store.cc:269] 0925 16:43:57.774408 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.774615 (+   207us) service_pool.cc:227] Handling call
0925 16:44:00.411137 (+2636522us) spinlock_profiling.cc:243] Waited 4.02 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:00.415510 (+  4373us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9246976}
I20260925 16:44:00.416934  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.418380  9116 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:00.417186  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.418974  9116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 648) took 1289 ms (client timeout 1647 ms). Trace:
I20260925 16:44:00.416138  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.419363  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2197) took 1165 ms. Trace:
I20260925 16:44:00.420006  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 650) took 1290 ms. Trace:
I20260925 16:44:00.419835  9124 rpcz_store.cc:276] 0925 16:43:59.254530 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.416925 (+1162395us) service_pool.cc:227] Handling call
0925 16:44:00.419303 (+  2378us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.420382  9122 rpcz_store.cc:276] 0925 16:43:59.129906 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.415900 (+1285994us) service_pool.cc:227] Handling call
0925 16:44:00.419957 (+  4057us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.421298  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.421468  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.421921  9124 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:00.422245  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2196) took 1215 ms. Trace:
I20260925 16:44:00.422448  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 647) took 1300 ms. Trace:
I20260925 16:44:00.422640  9122 rpcz_store.cc:276] 0925 16:43:59.206370 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.421236 (+1214866us) service_pool.cc:227] Handling call
0925 16:44:00.422200 (+   964us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.422892  9124 rpcz_store.cc:276] 0925 16:43:59.121945 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.421039 (+1299094us) service_pool.cc:227] Handling call
0925 16:44:00.422399 (+  1360us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:00.419389  9116 rpcz_store.cc:269] 0925 16:43:59.129203 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.413568 (+1284365us) service_pool.cc:227] Handling call
0925 16:44:00.418863 (+  5295us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.423941  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.424808  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.425151  9124 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:00.425554  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2315) took 1064 ms. Trace:
I20260925 16:44:00.425671  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2309) took 1198 ms. Trace:
I20260925 16:44:00.425923  9116 rpcz_store.cc:276] 0925 16:43:59.361430 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.424585 (+1063155us) service_pool.cc:227] Handling call
0925 16:44:00.425507 (+   922us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.426101  9124 rpcz_store.cc:276] 0925 16:43:59.227606 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.423663 (+1196057us) service_pool.cc:227] Handling call
0925 16:44:00.425606 (+  1943us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.426944  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.427289  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.428721  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.411500  9118 rpcz_store.cc:269] 0925 16:43:59.197849 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.408377 (+1210528us) service_pool.cc:227] Handling call
0925 16:44:00.410422 (+  2045us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.430119  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.430768  9118 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:00.431646  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.432708  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.433224  9118 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:00.433969  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.423583  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.441646  9122 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:00.442113  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2198) took 1105 ms. Trace:
I20260925 16:44:00.429047  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.435954  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 130209us
W20260925 16:44:00.437067  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71774.1us
I20260925 16:43:59.923552 12232 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:00.438887  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74092.7us
W20260925 16:44:00.029274 12291 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.558s	user 0.001s	sys 0.000s
I20260925 16:44:00.440917  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
W20260925 16:44:00.073699 12305 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260925 16:43:59.950809  9087 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45954 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2304)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2306)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2308)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 648)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 650)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2197)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 647)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2196)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2198)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2309)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2315)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2199)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2320)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2318)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2195)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2203)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2323)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2206)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2324)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2325)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2209)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2204)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2207)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2208)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2200)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2326)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2201)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2319)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2322)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2321)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2202)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 651)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 646)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2210)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2205)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 641)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 643)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 644)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 645)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2300)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2301)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2302)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2303)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2305)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2311)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45954 (request call id 2312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2313)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2314)
I20260925 16:44:00.058589 12247 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:43:59.927359 12160 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:00.436755 12280 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:00.388592 12157 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.359671 12076 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.438103 12296 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:00.461704 12262 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.277s	user 0.008s	sys 0.003s
I20260925 16:44:00.506724  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.099920 12204 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:00.623409 12132 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.872s	user 0.010s	sys 0.001s
I20260925 16:44:00.456744 12232 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:00.362581 12195 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:00.570436 12136 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.669s	user 0.009s	sys 0.005s
I20260925 16:44:00.668381 12136 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:00.515192 12061 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.494s	user 0.008s	sys 0.004s
W20260925 16:44:00.671332  9695 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.933s	user 0.073s	sys 0.173s
W20260925 16:44:00.671741  9695 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.960s	user 0.074s	sys 0.173s
I20260925 16:44:00.660394  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.664896 11986 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:43:59.986364 12152 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.658s
I20260925 16:44:00.656468  9696 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:00.502025 12304 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:00.644083 12280 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:00.606801 12311 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.233s
I20260925 16:44:00.676394 12278 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.681762 12144 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260925 16:44:00.673110 12061 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:00.686213 12225 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:44:00.688890 12179 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.690513 12225 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:00.691461 12225 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:00.672047 12132 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:00.649605 12262 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:00.691473 12290 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:00.692411 12269 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:00.694164 12225 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:44:00.699383 12132 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.700151 12262 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.741416 12280 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.789491  8968 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:00.807085  8974 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:00.439841  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:00.833254  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 393349us
I20260925 16:44:00.631913  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2195) took 1433 ms. Trace:
I20260925 16:44:00.524389  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.837517  9116 rpcz_store.cc:276] 0925 16:43:59.198805 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.428478 (+1229673us) service_pool.cc:227] Handling call
0925 16:44:00.631849 (+203371us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.838136  9120 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:00.606290  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1592) took 2534 ms. Trace:
I20260925 16:44:00.461650  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.839635  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.840502  9118 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:00.842103  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.839571  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.442397  9122 rpcz_store.cc:276] 0925 16:43:59.337128 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.423355 (+1086227us) service_pool.cc:227] Handling call
0925 16:44:00.442053 (+ 18698us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.844327  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.845274  9116 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:00.845206  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.845942  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2201) took 1090 ms. Trace:
I20260925 16:44:00.846235  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2319) took 1302 ms. Trace:
I20260925 16:44:00.846302  9116 rpcz_store.cc:276] 0925 16:43:59.755263 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.843875 (+1088612us) service_pool.cc:227] Handling call
0925 16:44:00.845877 (+  2002us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.846736  9122 rpcz_store.cc:276] 0925 16:43:59.543958 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.844516 (+1300558us) service_pool.cc:227] Handling call
0925 16:44:00.846181 (+  1665us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:00.488127  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 119541us
I20260925 16:44:00.875895  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.876662  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:00.877139  9696 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:00.878409  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:00.858222  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 224309us
I20260925 16:44:00.860711 11948 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:00.864692  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.869186 12061 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:00.869601  9700 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:00.858270 12136 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.870380  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.871671  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2271) took 5805 ms. Trace:
I20260925 16:44:00.873203 12057 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:00.878427 12144 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:00.842188  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.858314  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 561) took 2155 ms. Trace:
I20260925 16:44:00.881876  9115 rpcz_store.cc:276] 0925 16:43:55.065714 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:55.065856 (+   142us) service_pool.cc:227] Handling call
0925 16:43:55.069069 (+  3213us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:55.853684 (+784615us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.866883 (+5013199us) spinlock_profiling.cc:243] Waited 779 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:00.871396 (+  4513us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1790625536}
I20260925 16:44:00.884757  9042 rpcz_store.cc:276] 0925 16:43:58.703161 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.703307 (+   146us) service_pool.cc:227] Handling call
0925 16:43:58.703655 (+   348us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:59.196652 (+492997us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:59.196681 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:59.196717 (+    36us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:43:59.196744 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.857507 (+1660763us) spinlock_profiling.cc:243] Waited 493 ms on lock 0x7b54000df554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:00.857626 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.857997 (+   371us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1133344128}
I20260925 16:44:00.886472  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.887463  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2202) took 1076 ms. Trace:
I20260925 16:44:00.889433  9115 rpcz_store.cc:276] 0925 16:43:59.811521 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.886023 (+1074502us) service_pool.cc:227] Handling call
0925 16:44:00.887397 (+  1374us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.891139  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 806) took 1957 ms. Trace:
W20260925 16:44:00.871793  9702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 712) took 3178 ms (client timeout 1953 ms). Trace:
I20260925 16:44:00.883874  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.839254  9046 rpcz_store.cc:276] 0925 16:43:58.068060 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.068265 (+   205us) service_pool.cc:227] Handling call
0925 16:43:58.068653 (+   388us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:58.887143 (+818490us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:58.887173 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:58.887214 (+    41us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:43:58.887248 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.602583 (+1715335us) spinlock_profiling.cc:243] Waited 818 ms on lock 0x7b54002611d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:00.602655 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.602820 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1881862528}
I20260925 16:44:00.887301  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:00.894336  9119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2191) took 2956 ms (client timeout 2214 ms). Trace:
W20260925 16:44:00.894884  9119 rpcz_store.cc:269] 0925 16:43:57.936807 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.936952 (+   145us) service_pool.cc:227] Handling call
0925 16:43:58.375147 (+438195us) spinlock_profiling.cc:243] Waited 67.5 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:00.867567 (+2492420us) spinlock_profiling.cc:243] Waited 183 ms on lock 0x7b54001c8754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:00.893064 (+ 25497us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":576230016}
I20260925 16:44:00.869969  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.907609  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.908237  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.908674  9119 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
W20260925 16:44:00.892361  9702 rpcz_store.cc:269] 0925 16:43:57.693602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.871283 (+3177681us) service_pool.cc:214] Skipping call since client already timed out
0925 16:44:00.871516 (+   233us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260925 16:44:00.909842  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.910833  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.896914  9118 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:00.913760  9702 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:00.914183  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.914939  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.894361 11948 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:00.916260  9122 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:00.917001  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2321) took 1195 ms. Trace:
I20260925 16:44:00.899412 12232 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:00.917354  9122 rpcz_store.cc:276] 0925 16:43:59.721231 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.847503 (+1126272us) service_pool.cc:227] Handling call
0925 16:44:00.916909 (+ 69406us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.919036  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.918681  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.891722  9695 rpcz_store.cc:276] 0925 16:43:58.925463 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.925652 (+   189us) service_pool.cc:227] Handling call
0925 16:43:58.926055 (+   403us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:43:58.926476 (+   421us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:43:59.304856 (+378380us) log.cc:842] Serialized 14 byte log entry
0925 16:44:00.672039 (+1367183us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:00.672498 (+   459us) log.cc:842] Serialized 26 byte log entry
0925 16:44:00.672645 (+   147us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:00.672679 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.672741 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:00.864336 (+191595us) raft_consensus.cc:1671] finished
0925 16:44:00.864371 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.882554 (+ 18183us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39585,"prepare.queue_time_us":54905,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":285941,"raft.run_cpu_time_us":250,"raft.run_wall_time_us":25485,"thread_start_us":1606145,"threads_started":3,"wal-append.queue_time_us":565574}
I20260925 16:44:00.920212  9122 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:44:00.920526  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.901000  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2200) took 1293 ms. Trace:
I20260925 16:44:00.920792  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2205) took 1023 ms. Trace:
I20260925 16:44:00.921231  9124 rpcz_store.cc:276] 0925 16:43:59.607886 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.841724 (+1233838us) service_pool.cc:227] Handling call
0925 16:44:00.900916 (+ 59192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.921375  9122 rpcz_store.cc:276] 0925 16:43:59.897048 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.918330 (+1021282us) service_pool.cc:227] Handling call
0925 16:44:00.920739 (+  2409us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.900383  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:00.921957 11948 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:00.922600 12232 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:00.901343 12160 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:00.905007  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.923810  9702 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
W20260925 16:44:00.915215  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 80266.3us
I20260925 16:44:00.920691  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.923273  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:00.912765  8966 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:00.917917 12178 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:00.924865  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:00.984535  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49037.7us
W20260925 16:44:01.253182  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 125568us
W20260925 16:44:00.927932  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49798.8us
I20260925 16:44:00.909291  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 646) took 1787 ms. Trace:
I20260925 16:44:01.280939  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:00.923378  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 643) took 1802 ms. Trace:
I20260925 16:44:00.915680  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:00.917483  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1600) took 2740 ms (client timeout 2206 ms). Trace:
I20260925 16:44:00.941138  9116 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:01.291923  9119 rpcz_store.cc:276] 0925 16:43:59.121663 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.907093 (+1785430us) service_pool.cc:227] Handling call
0925 16:44:00.909228 (+  2135us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.292542  9122 rpcz_store.cc:276] 0925 16:43:59.120838 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.922267 (+1801429us) service_pool.cc:227] Handling call
0925 16:44:00.922677 (+   410us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:00.923022 (+   345us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:00.923046 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:00.923096 (+    50us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:00.923132 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.923200 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:00.923304 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.935298  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:00.936563  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.293553  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2322) took 1408 ms. Trace:
I20260925 16:44:01.299220  9116 rpcz_store.cc:276] 0925 16:43:59.885210 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.847272 (+962062us) service_pool.cc:227] Handling call
0925 16:44:01.293484 (+446212us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:00.937129 12083 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:01.281183 12061 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:00.888188 12144 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:00.993731  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.111814 12236 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.303790 12061 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.304383 12236 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.306182 12061 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:01.306744 12236 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:01.293192  9050 rpcz_store.cc:269] 0925 16:43:58.143169 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.143324 (+   155us) service_pool.cc:227] Handling call
0925 16:44:00.865646 (+2722322us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b54000a7dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:00.883288 (+ 17642us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":51307776}
I20260925 16:44:00.938056  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:01.308004  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.111377  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:00.936650 12311 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:01.315830  8966 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 4.
I20260925 16:44:01.232280 12214 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:01.315977  9702 raft_consensus.cc:2396] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
W20260925 16:44:01.054085 12003 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.609s	user 0.003s	sys 0.010s
I20260925 16:44:01.312419  9046 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:01.310448 12144 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:00.936071 12121 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.319414  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260925 16:44:01.323881  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 386067us
I20260925 16:44:01.036777 12008 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.318133 12311 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:01.329522  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.325898  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.332579 11934 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:01.333067 11934 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.333498 11934 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:01.336233 12232 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:01.337546 12232 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:01.338040 12232 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:01.322180 12214 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.341030  9042 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:01.340636  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 803) took 3034 ms. Trace:
I20260925 16:44:01.331982  9115 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:01.350152 12121 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.352891 12121 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:01.352917  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1017) took 4887 ms. Trace:
I20260925 16:44:01.353955  9045 rpcz_store.cc:276] 0925 16:43:56.465640 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:56.465886 (+   246us) service_pool.cc:227] Handling call
0925 16:44:01.346885 (+4880999us) spinlock_profiling.cc:243] Waited 4.76 s on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.352661 (+  5776us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10958855040}
I20260925 16:44:00.938846 12228 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.403s
I20260925 16:44:01.327852 12311 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:01.348379  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 651) took 1626 ms (client timeout 2152 ms). Trace:
I20260925 16:44:01.358296  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:01.358702  9115 rpcz_store.cc:269] 0925 16:43:59.722447 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.893500 (+1171053us) service_pool.cc:227] Handling call
0925 16:44:01.348309 (+454809us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.357636  8975 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:01.328156 12003 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.358978  9046 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:01.361096  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.360217  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 644) took 2235 ms. Trace:
I20260925 16:44:01.312834 12083 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.363343  9122 rpcz_store.cc:276] 0925 16:43:59.121077 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.312820 (+2191743us) service_pool.cc:227] Handling call
0925 16:44:01.325209 (+ 12389us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.356567 (+ 31358us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.356585 (+    18us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.356613 (+    28us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:01.356629 (+    16us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.356697 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.356796 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.364723 12008 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.367348 12008 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.368149  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.368602  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.369117  9042 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:01.369871  8966 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:01.370364  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.371423  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 573) took 1607 ms. Trace:
I20260925 16:44:01.372694  9042 rpcz_store.cc:276] 0925 16:43:59.763659 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.370001 (+1606342us) service_pool.cc:227] Handling call
0925 16:44:01.371365 (+  1364us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.373255  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 564) took 2668 ms. Trace:
I20260925 16:44:01.365049  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.345850  9697 rpcz_store.cc:276] 0925 16:43:58.305595 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.305708 (+   113us) service_pool.cc:227] Handling call
0925 16:43:58.306036 (+   328us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:59.655350 (+1349314us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:59.655393 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:59.656080 (+   687us) log.cc:842] Serialized 52 byte log entry
0925 16:44:00.383724 (+727644us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:00.390162 (+  6438us) log.cc:842] Serialized 14 byte log entry
0925 16:44:00.444581 (+ 54419us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.339902 (+895321us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b540053e8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:01.339997 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:01.340073 (+    76us) raft_consensus.cc:1671] finished
0925 16:44:01.340184 (+   111us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.340418 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":60614,"prepare.queue_time_us":178991,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":11556,"raft.queue_time_us":500201,"raft.run_cpu_time_us":331,"raft.run_wall_time_us":75428,"spinlock_wait_cycles":2373343104,"thread_start_us":996483,"threads_started":3,"wal-append.queue_time_us":906134}
I20260925 16:44:01.378208  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:01.379132 12225 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.684s	user 0.011s	sys 0.010s
I20260925 16:44:01.380266  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.380807  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:01.382057  9120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2308) took 2173 ms (client timeout 1557 ms). Trace:
I20260925 16:44:01.383308  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 637) took 2264 ms. Trace:
I20260925 16:44:01.347223 12232 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.402752  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1580) took 3626 ms. Trace:
I20260925 16:44:01.403231  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2229) took 1592 ms. Trace:
I20260925 16:44:01.403781  9045 rpcz_store.cc:276] 0925 16:43:59.810584 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.379865 (+1569281us) service_pool.cc:227] Handling call
0925 16:44:01.403168 (+ 23303us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.405166  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.406352  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.384477  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.392271 12178 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:01.392776 12083 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:01.412078  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49627.8us
I20260925 16:44:01.413130  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.414052  9041 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:01.414649  9041 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:01.415632  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.407549  9045 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 8 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260925 16:44:01.416409 12178 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:01.416529  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1989) took 2213 ms. Trace:
I20260925 16:44:01.417265 12121 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:01.417816 12121 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.418233 12121 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:01.400447  9120 rpcz_store.cc:269] 0925 16:43:59.209208 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.410427 (+1201219us) service_pool.cc:227] Handling call
0925 16:44:01.381757 (+971330us) spinlock_profiling.cc:243] Waited 425 ms on lock 0x7b540009ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.381949 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":977436416}
I20260925 16:44:01.419723  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.422242  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2305) took 2238 ms. Trace:
I20260925 16:44:01.418241  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 562) took 2714 ms. Trace:
I20260925 16:44:01.422895  9044 rpcz_store.cc:276] 0925 16:43:58.704178 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.704311 (+   133us) service_pool.cc:227] Handling call
0925 16:43:58.711478 (+  7167us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:59.777251 (+1065773us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:59.777295 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:59.777350 (+    55us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:43:59.777394 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.417813 (+1640419us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b5400127354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:01.417871 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.418084 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2450467584}
W20260925 16:44:01.424652  9088 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45954 dropped due to backpressure. The service queue is full; it has 50 items. [suppressed 2 similar messages]
I20260925 16:44:01.396323  9048 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:01.424831  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:01.425160  9088 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2314) took 2074 ms. Trace:
I20260925 16:44:01.425498  9088 rpcz_store.cc:276] 0925 16:43:59.350866 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.425101 (+2074235us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260925 16:44:01.426321  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:01.425820 12282 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:01.371212  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:01.427309 12282 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.427907  8966 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:01.426410  9088 service_pool.cc:140] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:45954 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2307)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2310)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2311)
Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45954 (request call id 2312)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2313)
I20260925 16:44:01.399864  9047 rpcz_store.cc:276] 0925 16:43:58.705178 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.841152 (+135974us) service_pool.cc:227] Handling call
0925 16:44:00.896108 (+2054956us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:00.896585 (+   477us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:00.896614 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:00.896687 (+    73us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:00.896717 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.896795 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.372945 (+476150us) spinlock_profiling.cc:243] Waited 1.97 s on lock 0x7b54000a7dd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.373096 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4521222016}
I20260925 16:44:01.428063 12282 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:01.429693  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.430508  9047 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:44:01.431249  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.433420 12246 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:01.433827 12246 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.434144 12276 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:01.397080 12003 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:01.362623  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.401558  8970 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:01.400930  9123 rpcz_store.cc:276] 0925 16:43:59.118640 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.119815 (+  1175us) service_pool.cc:227] Handling call
0925 16:43:59.161864 (+ 42049us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:59.720655 (+558791us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:59.720686 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:59.720728 (+    42us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:59.720759 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.382855 (+1662096us) spinlock_profiling.cc:243] Waited 559 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:01.382924 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.383120 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1284576640}
I20260925 16:44:01.415859 12225 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:01.417001  8968 rpcz_store.cc:276] 0925 16:43:59.202622 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.903192 (+700570us) service_pool.cc:227] Handling call
0925 16:43:59.904776 (+  1584us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:00.790663 (+885887us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.416264 (+625601us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b54003575d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:01.416454 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2032993024}
I20260925 16:44:01.424507  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.403208  8967 rpcz_store.cc:276] 0925 16:43:57.775908 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.776334 (+   426us) service_pool.cc:227] Handling call
0925 16:43:57.776649 (+   315us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:58.299249 (+522600us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:58.299278 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:43:58.299314 (+    36us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:43:58.299339 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.402315 (+3102976us) spinlock_profiling.cc:243] Waited 522 ms on lock 0x7b54001c4654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:01.402372 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.402554 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1201425152}
I20260925 16:44:01.433799 12178 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:01.396160  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.393584  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:01.438143  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2232) took 1546 ms. Trace:
I20260925 16:44:01.422631  9120 rpcz_store.cc:276] 0925 16:43:59.184278 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.421076 (+2236798us) service_pool.cc:227] Handling call
0925 16:44:01.421527 (+   451us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.421833 (+   306us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.421868 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.421935 (+    67us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:01.421992 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.422066 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.422183 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.422263  9701 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:01.439358  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.439865  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.434237 12246 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:01.444365  9050 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:01.445870  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.446677  9050 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:01.448060  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.449443  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:01.450760  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 559) took 2810 ms (client timeout 1610 ms). Trace:
I20260925 16:44:01.450248  9120 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:01.451756  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.452314  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:01.392310  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74883.6us
I20260925 16:44:01.437534 12276 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:01.453027 12276 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:01.453888  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.454582  8967 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Handling vote request from an unknown peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:01.454927  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:44:01.455951  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.464859  9041 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.466543  9041 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:01.467027  9121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 649) took 2337 ms (client timeout 1557 ms). Trace:
W20260925 16:44:01.467401  9121 rpcz_store.cc:269] 0925 16:43:59.129565 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.200377 (+ 70812us) service_pool.cc:227] Handling call
0925 16:44:01.466720 (+2266343us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b5400165154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.466870 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":970422656}
I20260925 16:44:01.447559  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:01.468567  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.469131  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.456718  8967 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:01.469779  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.472879  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.452999  9123 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:01.476298  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:01.478350  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 614) took 2244 ms (client timeout 1735 ms). Trace:
I20260925 16:44:01.478978  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:01.478925  8971 rpcz_store.cc:269] 0925 16:43:59.197796 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.208657 (+ 10861us) service_pool.cc:227] Handling call
0925 16:44:01.410195 (+2201538us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.442467 (+ 32272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":27969280}
I20260925 16:44:01.480207  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.481135  8971 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:01.482756  8971 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: [2.2-3.3]
I20260925 16:44:01.470566  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.477636  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.480161  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.486457  9045 rpcz_store.cc:276] 0925 16:43:59.892186 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.406063 (+1513877us) service_pool.cc:227] Handling call
0925 16:44:01.438091 (+ 32028us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:01.451179  9049 rpcz_store.cc:269] 0925 16:43:58.639990 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.640119 (+   129us) service_pool.cc:227] Handling call
0925 16:44:01.450331 (+2810212us) spinlock_profiling.cc:243] Waited 1.65 s on lock 0x7b5400261bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.450523 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3800618880}
I20260925 16:44:01.488343  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:01.490300  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49594.6us
I20260925 16:44:01.502789  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.440337 12225 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.486632 12178 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:01.493207  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 645) took 2369 ms. Trace:
I20260925 16:44:01.507318  9116 rpcz_store.cc:276] 0925 16:43:59.121384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.308393 (+2187009us) service_pool.cc:227] Handling call
0925 16:44:01.346667 (+ 38274us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.486956 (+140289us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.486983 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.490933 (+  3950us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:01.490957 (+    24us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.490993 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.491063 (+    70us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.510020  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.512058  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.508561  9050 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:01.513360  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 572) took 1760 ms. Trace:
I20260925 16:44:01.513808  9050 rpcz_store.cc:276] 0925 16:43:59.753328 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.470240 (+1716912us) service_pool.cc:227] Handling call
0925 16:44:01.513289 (+ 43049us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.509188  9045 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:01.516023  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.518595  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.507928 12225 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:01.522722  8975 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:01.519011  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:01.522935  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.524886  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.525763  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.525460  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.529479 11709 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:01.530015 11709 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:01.530490 11709 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:01.531339  9049 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:01.530707  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:01.536888  8967 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:01.522389  9665 connection.cc:232] RPC call timeout handler was delayed by -1.0059078360000058s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260925 16:44:01.537093  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.539160  9049 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:44:01.542586  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.539820  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.540170  9121 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:01.507424 12214 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.531172  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:01.544516  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 80738.7us
I20260925 16:44:01.546169  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2301) took 2359 ms. Trace:
I20260925 16:44:01.543982  9702 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:01.547927  9115 rpcz_store.cc:276] 0925 16:43:59.164978 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.435222 (+2270244us) service_pool.cc:227] Handling call
0925 16:44:01.500050 (+ 64828us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.523895 (+ 23845us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.523924 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.523964 (+    40us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:01.523992 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.524044 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.524139 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.554432  9042 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:01.555140  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 571) took 1802 ms. Trace:
I20260925 16:44:01.555374  9042 rpcz_store.cc:276] 0925 16:43:59.753006 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.486009 (+1733003us) service_pool.cc:227] Handling call
0925 16:44:01.555085 (+ 69076us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.557643  9049 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260925 16:44:01.557085  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.558379  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.562260  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 961) took 4212 ms. Trace:
I20260925 16:44:01.562438  9696 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:01.563182 11934 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.566027  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:01.567754  9120 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:01.562713  9698 rpcz_store.cc:276] 0925 16:43:57.337916 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.338073 (+   157us) service_pool.cc:227] Handling call
0925 16:43:57.686963 (+348890us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:58.286023 (+599060us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.547500 (+3261477us) spinlock_profiling.cc:243] Waited 548 ms on lock 0x7b54006bce54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:01.550250 (+  2750us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1260918144}
I20260925 16:44:01.562808  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2224) took 1805 ms. Trace:
W20260925 16:44:01.569077 12312 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260925 16:44:01.570534  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:01.571540  9701 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:44:01.572518  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.572456  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.573500  8966 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:01.574530  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 569) took 1819 ms. Trace:
I20260925 16:44:01.572625  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:01.556751 12057 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:01.576020  9042 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:01.569487  9048 rpcz_store.cc:276] 0925 16:43:59.757041 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.390753 (+633712us) service_pool.cc:227] Handling call
0925 16:44:01.562578 (+1171825us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54002a3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.562742 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2309877632}
I20260925 16:44:01.574831  9041 rpcz_store.cc:276] 0925 16:43:59.746843 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.746997 (+   154us) service_pool.cc:227] Handling call
0925 16:43:59.747389 (+   392us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.413725 (+1666336us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b54002f2c20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:44:01.566274 (+152549us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.566301 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.566336 (+    35us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:01.566363 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.566434 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.566534 (+   100us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":563465600}
I20260925 16:44:01.577173  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.579027  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:01.579882  9120 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:01.580824 12155 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260925 16:44:01.581269  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.583076  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.583842  9049 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:01.584622  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.579116 12057 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:01.587179 12057 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:01.585465  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:01.588696  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 195290us
I20260925 16:44:01.590382  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 710) took 4466 ms. Trace:
I20260925 16:44:01.590637  9701 rpcz_store.cc:276] 0925 16:43:57.173777 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.204293 (+ 30516us) service_pool.cc:227] Handling call
0925 16:43:57.262427 (+ 58134us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:43:58.150002 (+887575us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b540066ea20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:44:00.623722 (+2473720us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b1800201060. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf65856 00007f719beb7f7e 00007f719bf21367 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:44:01.421164 (+797442us) spinlock_profiling.cc:243] Waited 232 ms on lock 0x7b5800663bb0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:44:01.573691 (+152527us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.590337 (+ 16646us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3698234112}
I20260925 16:44:01.587922  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.593182  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.592170  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:01.596016  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:01.596131  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.597872  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.558024 12276 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.597609  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.591548  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:01.603318  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.605610  8971 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:01.606316  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.607271 12241 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:01.607436  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:01.608107  9123 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:01.576866 12282 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.612582  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.613265  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.615312  9698 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:01.613848  9048 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:44:01.617647  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.618878  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.607838 12241 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.605011 11934 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:01.620575  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2234) took 1648 ms. Trace:
I20260925 16:44:01.620685  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.624573  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.630465  9116 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:01.631560  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:01.632669  9116 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:01.629760  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:01.633646  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2223) took 1877 ms. Trace:
I20260925 16:44:01.634112  9041 rpcz_store.cc:276] 0925 16:43:59.756730 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.582013 (+1825283us) service_pool.cc:227] Handling call
0925 16:44:01.602982 (+ 20969us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.633093 (+ 30111us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.633182 (+    89us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.633243 (+    61us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:01.633288 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.633363 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.633592 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.623152 12241 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:01.637156  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.637406  9694 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:01.623960  9049 rpcz_store.cc:276] 0925 16:43:59.968769 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.584361 (+1615592us) service_pool.cc:227] Handling call
0925 16:44:01.605188 (+ 20827us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.617205 (+ 12017us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.617235 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.617274 (+    39us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:01.617300 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.617354 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.617447 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3394,"raft.run_cpu_time_us":162,"raft.run_wall_time_us":8765}
I20260925 16:44:01.668094  9115 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:44:01.672451  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.675957  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2311) took 2411 ms. Trace:
I20260925 16:44:01.676322  9115 rpcz_store.cc:276] 0925 16:43:59.265110 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.638039 (+2372929us) service_pool.cc:227] Handling call
0925 16:44:01.643333 (+  5294us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.675720 (+ 32387us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.675904 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.676342  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2307) took 2474 ms. Trace:
I20260925 16:44:01.677515  9120 rpcz_store.cc:276] 0925 16:43:59.204283 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.618933 (+2414650us) service_pool.cc:227] Handling call
0925 16:44:01.637087 (+ 18154us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.676123 (+ 39036us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.676143 (+    20us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.676172 (+    29us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:01.676191 (+    19us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.676236 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.676306 (+    70us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.678413  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.679718  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2235) took 1639 ms. Trace:
I20260925 16:44:01.680058  9042 rpcz_store.cc:276] 0925 16:44:00.031265 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.596090 (+1564825us) service_pool.cc:227] Handling call
0925 16:44:01.620479 (+ 24389us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.670157 (+ 49678us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.670200 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.670260 (+    60us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:01.670315 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.670410 (+    95us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.670569 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.675406 12214 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:01.686555  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.689677  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2310) took 2460 ms. Trace:
I20260925 16:44:01.690057  9123 rpcz_store.cc:276] 0925 16:43:59.229062 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.628042 (+2398980us) service_pool.cc:227] Handling call
0925 16:44:01.678227 (+ 50185us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.689305 (+ 11078us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.689342 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.689399 (+    57us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:01.689447 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.689515 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.689625 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.700119  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.700773  9123 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:01.704785 12310 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:01.705435 12310 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:01.708232  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 100893us
I20260925 16:44:01.727061 12282 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.727403  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2313) took 2385 ms. Trace:
I20260925 16:44:01.730860  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.728968  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.732275  9115 rpcz_store.cc:276] 0925 16:43:59.341687 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.693619 (+2351932us) service_pool.cc:227] Handling call
0925 16:44:01.726869 (+ 33250us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.727070 (+   201us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.727091 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.727128 (+    37us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:01.727170 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.727237 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.727342 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.735037  9702 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:01.678531 12246 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.689358 11709 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.708577  9120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
I20260925 16:44:01.738869  9120 raft_consensus.cc:465] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Not starting forced leader election -- already a leader
I20260925 16:44:01.738993  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.739334  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:45954 (request call id 2312) took 2402 ms. Trace:
I20260925 16:44:01.739841  8975 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:01.739893 12310 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:01.741305  8975 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:01.739676  9120 rpcz_store.cc:276] 0925 16:43:59.337299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.682250 (+2344951us) service_pool.cc:227] Handling call
0925 16:44:01.739238 (+ 56988us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.697125 11934 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:01.747022  9045 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:01.748286  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.748972  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.749338  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.746778  8971 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:01.737322 12276 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.754750  8970 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:01.754707  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.753377  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:01.757671  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.757520  8971 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:01.758800  8968 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:01.761190  9115 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:01.763315  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.762558 12013 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:01.760798 12097 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:01.765625 12097 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.766054 12097 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:01.771286  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.757853 11709 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.772455 12057 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.780282  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.781370  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.780099  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.782197 12111 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:01.782588  9121 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:01.782778 12111 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:01.783427 12111 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:01.783687 12121 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.785020 12057 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.786289 12121 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:01.782706  9048 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:01.789744  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.787787 12246 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.755508 11934 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.794675  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.754053 12241 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.796365  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.797493  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:01.799443  9702 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260925 16:44:01.807054  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 58824.6us
I20260925 16:44:01.808075  8967 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:01.814278 12225 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.815774  9047 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 5: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:01.816728  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:01.821993  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 326890us
I20260925 16:44:01.823875  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.823753  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:01.826601  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:01.831290  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.831713  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.832116  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:01.848171  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:01.848948  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.849689  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 641) took 2720 ms. Trace:
I20260925 16:44:01.848949  9116 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:01.852190  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.852880  9123 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:01.853840  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.858506  8968 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:01.860486 11952 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:01.841158 12121 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.015s
I20260925 16:44:01.850391  9124 rpcz_store.cc:276] 0925 16:43:59.120344 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.922164 (+1801820us) service_pool.cc:227] Handling call
0925 16:44:00.922833 (+   669us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:00.923302 (+   469us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:44:00.924756 (+  1454us) log.cc:842] Serialized 14 byte log entry
0925 16:44:01.839957 (+915201us) log.cc:842] Serialized 14 byte log entry
0925 16:44:01.840277 (+   320us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.840336 (+    59us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:01.840397 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.840481 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.840621 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":739,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":6507,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":3541,"thread_start_us":536040,"threads_started":2,"wal-append.queue_time_us":680949}
I20260925 16:44:01.864830  9041 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:01.866667 11934 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:01.870805  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.872151  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2302) took 2706 ms. Trace:
I20260925 16:44:01.872560  9119 rpcz_store.cc:276] 0925 16:43:59.165412 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.831269 (+2665857us) service_pool.cc:227] Handling call
0925 16:44:01.857467 (+ 26198us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.868648 (+ 11181us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.868682 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.871885 (+  3203us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:01.871928 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.871992 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.872109 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:01.872587  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:01.863734  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 609) took 2668 ms (client timeout 1751 ms). Trace:
W20260925 16:44:01.873788  8974 rpcz_store.cc:269] 0925 16:43:59.195312 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.195504 (+   192us) service_pool.cc:227] Handling call
0925 16:44:01.857788 (+2662284us) spinlock_profiling.cc:243] Waited 1.46 s on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.863640 (+  5852us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3365412736}
I20260925 16:44:01.861908 11952 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:01.877071  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.879041  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.880179  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:01.882306  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2300) took 2726 ms. Trace:
I20260925 16:44:01.882325  8972 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:01.882695  9118 rpcz_store.cc:276] 0925 16:43:59.156124 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.314013 (+2157889us) service_pool.cc:227] Handling call
0925 16:44:01.468322 (+154309us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.468733 (+   411us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.468756 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.468794 (+    38us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:01.468838 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.468888 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.882151 (+413263us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400165150. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.882256 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":247475072}
I20260925 16:44:01.872411 12225 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:01.887758  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 65106.5us
I20260925 16:44:01.878913 11709 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:01.877398 11952 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:01.880752 12236 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:01.894295  8968 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:01.896137  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:01.900323  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.908023 12236 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:01.909070 12236 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.910418 12246 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:01.911001 12246 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:01.895147 12225 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:01.895915 12241 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:01.926031  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.913391 11709 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:01.925480  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:01.948066  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.948333 11709 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:01.949759  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.950510  9042 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:01.950928  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 568) took 3037 ms. Trace:
I20260925 16:44:01.951622  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.928922 12225 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:01.967454  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.951331  9043 rpcz_store.cc:276] 0925 16:43:58.898444 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:58.951250 (+ 52806us) service_pool.cc:227] Handling call
0925 16:44:01.450567 (+2499317us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.491452 (+ 40885us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:01.491505 (+    53us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:01.491598 (+    93us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:01.491648 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:01.494965 (+  3317us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.929459 (+434494us) spinlock_profiling.cc:243] Waited 2.5 s on lock 0x7b5400261bd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.935760 (+  6301us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37688,"raft.queue_time_us":42016,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"spinlock_wait_cycles":5746774144}
I20260925 16:44:01.977438  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:01.952808 11934 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:01.952526 12165 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:01.989051  9694 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:44:01.993983  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 638) took 2816 ms. Trace:
I20260925 16:44:01.972853 12232 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:01.995846  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:01.994410  9117 rpcz_store.cc:276] 0925 16:43:59.119010 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.119893 (+   883us) service_pool.cc:227] Handling call
0925 16:44:00.885569 (+1765676us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:00.886015 (+   446us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:00.886049 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:00.886127 (+    78us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:00.886160 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:00.886247 (+    87us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:01.930474 (+1044227us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54001c8750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:01.935497 (+  5023us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4046721792}
W20260925 16:44:02.007624  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 325289us
I20260925 16:44:02.010053  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:01.956547 12097 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.011750  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.013296  9042 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:02.013316  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:01.981859 11934 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:02.013732  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:02.006865 12144 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.679s	user 0.009s	sys 0.003s
I20260925 16:44:02.021027  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.023044  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2251) took 1195 ms. Trace:
W20260925 16:44:02.025105  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 126126us
I20260925 16:44:02.023393  9047 rpcz_store.cc:276] 0925 16:44:00.822482 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.439507 (+617025us) service_pool.cc:227] Handling call
0925 16:44:02.017290 (+577783us) spinlock_profiling.cc:243] Waited 367 ms on lock 0x7b54000a73d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:02.017458 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":844300032}
W20260925 16:44:02.026155  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 114567us
I20260925 16:44:02.023566  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.030757  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.015156 12282 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.019239 11934 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:02.036278  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.036931  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:02.040126  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.043560  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.006457 12111 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.056937  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.057710  8974 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:02.054678  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.059756  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2244) took 1233 ms. Trace:
I20260925 16:44:02.060123  9045 rpcz_store.cc:276] 0925 16:44:00.819866 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.599934 (+780068us) service_pool.cc:227] Handling call
0925 16:44:01.608176 (+  8242us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.747418 (+139242us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:02.052614 (+305196us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b54002265d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:02.052778 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":316011776}
I20260925 16:44:02.060657  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.042641 12246 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:02.027671 12144 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.081538  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.082157  9702 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.084609  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.085291  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:02.085856  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66839.2us
W20260925 16:44:02.084764  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 170693us
I20260925 16:44:02.086455  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.088678  9115 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:02.042459 11952 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.090420  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:02.100536 12205 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.101102 12205 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.103809 12196 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.104368 12279 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.105794 12242 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:02.106295 12242 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:02.106750 12242 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:02.109392 12178 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.589s	user 0.011s	sys 0.000s
I20260925 16:44:02.109915 12178 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.111322  9050 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:02.111804  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:02.120456  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1582) took 2916 ms. Trace:
I20260925 16:44:02.120888  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.121541  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.122466  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.122650  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.123239  8967 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.067924 12225 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.124079  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.124719  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.128091  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.128890  9700 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:02.129813  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.082904 12097 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.130357  9699 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:02.132539 12311 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.646s	user 0.013s	sys 0.000s
I20260925 16:44:02.132936 12311 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.134018  9701 raft_consensus.cc:2354] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:02.135578 12311 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.136549  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.137058  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.138247  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.139985 12310 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:44:02.140256  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 66747.1us
I20260925 16:44:02.140455 12310 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:02.141084 12310 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:02.142483  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:02.143957  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70403.9us
I20260925 16:44:02.144398 12003 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:02.144649  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:02.145699  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.146528 12246 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:02.146883 12246 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:02.147212 12246 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:02.144811 12003 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:02.148756  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.149508  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.148765  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.123598  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:01.337355  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:02.163990  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.120923  8972 rpcz_store.cc:276] 0925 16:43:59.203639 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:00.382852 (+1179213us) service_pool.cc:227] Handling call
0925 16:44:01.878663 (+1495811us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.892909 (+ 14246us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:02.120260 (+227351us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b540038d450. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:02.120401 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3395172608}
I20260925 16:44:02.167464  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.171715  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.172935  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.166880  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.156631 12003 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:02.175746  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.176748  8968 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 4.
I20260925 16:44:02.177845  8968 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:02.153301 12111 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:02.180205 12144 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.180867 12013 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:02.181146 12083 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:02.181763 12083 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:02.182176 12083 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:02.182412  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 1983) took 5682 ms. Trace:
I20260925 16:44:02.183852  9693 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:02.184569 12257 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:02.184999 12257 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.189865 11934 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.181268 12013 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:02.191877  9695 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:02.192957 12013 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.191784  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 606) took 4443 ms. Trace:
I20260925 16:44:02.180279 12178 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.196030  9047 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:02.187521  8974 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:02.099032 12028 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:02.202260  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:02.204380  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 299349us
I20260925 16:44:02.164458 12311 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:02.157094 12205 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:02.214484  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47935.9us
I20260925 16:44:02.213820  9699 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:02.174026 12276 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:44:02.219058  8972 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:44:02.221160  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.227286  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.195236  8973 rpcz_store.cc:276] 0925 16:43:57.619347 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:57.691374 (+ 72027us) service_pool.cc:227] Handling call
0925 16:44:01.408828 (+3717454us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:44:01.474429 (+ 65601us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:01.474815 (+   386us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:44:01.832644 (+357829us) log.cc:842] Serialized 14 byte log entry
0925 16:44:02.048000 (+215356us) log.cc:842] Serialized 14 byte log entry
0925 16:44:02.062475 (+ 14475us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:02.062529 (+    54us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:02.062569 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:02.062628 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:02.062733 (+   105us) inbound_call.cc:173] Queueing success response
0925 16:44:02.128399 (+ 65666us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b18002bab60. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
Metrics: {"mutex_wait_us":42765,"prepare.queue_time_us":285638,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":3743,"raft.queue_time_us":22101,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":8048,"spinlock_wait_cycles":25171328,"thread_start_us":533723,"threads_started":2,"wal-append.queue_time_us":269388}
W20260925 16:44:02.241732  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 99330.1us
W20260925 16:44:02.243791  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 120271us
I20260925 16:44:02.213891 12144 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:02.209007 12311 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:02.243984  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.218943 12013 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.254534  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.182775  8969 rpcz_store.cc:276] 0925 16:43:56.500384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:56.500878 (+   494us) service_pool.cc:227] Handling call
0925 16:43:57.742488 (+1241610us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:43:58.143880 (+401392us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:43:58.143899 (+    19us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:43:58.155778 (+ 11879us) log.cc:842] Serialized 52 byte log entry
0925 16:44:01.407630 (+3251852us) spinlock_profiling.cc:243] Waited 874 us on lock 0x7b1800433240. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411
0925 16:44:01.463975 (+ 56345us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:01.789593 (+325618us) log.cc:842] Serialized 14 byte log entry
0925 16:44:02.061401 (+271808us) log.cc:842] Serialized 14 byte log entry
0925 16:44:02.061583 (+   182us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:02.072706 (+ 11123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:02.098412 (+ 25706us) raft_consensus.cc:1671] finished
0925 16:44:02.098436 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:02.140998 (+ 42562us) spinlock_profiling.cc:243] Waited 12.8 ms on lock 0x7b480024c258. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:02.176532 (+ 35534us) spinlock_profiling.cc:243] Waited 4.39 ms on lock 0x7b1800433240. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:02.182157 (+  5625us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540020e250. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:02.182269 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59622,"prepare.queue_time_us":282131,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":108,"raft.queue_time_us":171487,"raft.run_cpu_time_us":3058,"raft.run_wall_time_us":101939,"spinlock_wait_cycles":2896021888,"thread_start_us":1909903,"threads_started":4,"wal-append.queue_time_us":1026766,"wal-append.run_cpu_time_us":28789,"wal-append.run_wall_time_us":2482375}
I20260925 16:44:02.217429 11934 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:02.255178  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.223115 12276 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:02.259125  9693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 808) took 2747 ms (client timeout 1575 ms). Trace:
W20260925 16:44:02.271401  9693 rpcz_store.cc:269] 0925 16:43:59.509390 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:59.509582 (+   192us) service_pool.cc:227] Handling call
0925 16:44:02.255174 (+2745592us) spinlock_profiling.cc:243] Waited 2.37 s on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:02.257152 (+  1978us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5461252480}
I20260925 16:44:02.270967  8871 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 7 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 10 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.251664 12144 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:02.273748 12144 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.273572  8871 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:02.269788 12003 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.276885 12257 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.275219  8871 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.279280  8871 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 7, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:02.281366 12144 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.277860 12003 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:02.280157  9042 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:02.281620  8871 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 7, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 7 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.284164 12342 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:02.260797  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 221879us
W20260925 16:44:02.285439 12340 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260925 16:44:02.287144  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:02.288070 12205 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:02.288470 12205 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.288834 12205 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:02.260633  8967 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:02.292886  8975 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:02.283490 12144 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.294186 12246 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.297842  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.298668 12003 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:44:02.304447 12337 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:44:02.305279  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:02.286506  8871 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 6 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.310505 12282 raft_consensus.cc:2741] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260925 16:44:02.324558 12282 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:02.325028 12282 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.325433 12282 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:02.328279  9046 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
W20260925 16:44:02.330688  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2256) took 1506 ms (client timeout 1860 ms). Trace:
W20260925 16:44:02.331100  9046 rpcz_store.cc:269] 0925 16:44:00.824382 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.384218 (+559836us) service_pool.cc:227] Handling call
0925 16:44:02.330534 (+946316us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b54000d43d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:02.330635 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2105197952}
W20260925 16:44:02.349049  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 106303us
I20260925 16:44:02.349818  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.332562 12242 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.333480 11952 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:02.336035 12282 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.304558 12205 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.338997  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.358544 12282 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.358549 12205 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.360037  8871 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 3 to 6, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:02.362294  8871 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 6, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 6 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:02.340184  9045 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:02.338419  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.340924 12003 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:02.341512 12310 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.342018  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.342276 11934 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:02.345362  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.264120 12276 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:44:02.374779  9042 raft_consensus.cc:2354] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:02.256009 12311 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:02.346799  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 92382.7us
I20260925 16:44:02.348096  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2245) took 1527 ms. Trace:
I20260925 16:44:02.375792  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:02.354130  9702 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
W20260925 16:44:02.355090  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 128375us
I20260925 16:44:02.340032  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.364358  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2303) took 3192 ms. Trace:
I20260925 16:44:02.374917 11934 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.376097  9049 rpcz_store.cc:276] 0925 16:44:00.820351 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.642860 (+822509us) service_pool.cc:227] Handling call
0925 16:44:01.683687 (+ 40827us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:01.696340 (+ 12653us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:01.925562 (+229222us) log.cc:842] Serialized 14 byte log entry
0925 16:44:02.204939 (+279377us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:02.252128 (+ 47189us) log.cc:842] Serialized 26 byte log entry
0925 16:44:02.252248 (+   120us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:02.252286 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:02.252377 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:02.347818 (+ 95441us) raft_consensus.cc:1671] finished
0925 16:44:02.347839 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:02.348002 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1932,"prepare.queue_time_us":453332,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":6840,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":19469,"thread_start_us":418246,"threads_started":2,"wal-append.queue_time_us":385782}
I20260925 16:44:02.380937 11934 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.382541 12310 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:02.384034  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:02.384333  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46030.9us
I20260925 16:44:02.385128  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.385447 11952 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.386658  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:02.387461 12350 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:02.373437  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.385923 12282 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:44:02.387917 12205 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:02.378893  9122 rpcz_store.cc:276] 0925 16:43:59.172091 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:02.052629 (+2880538us) service_pool.cc:227] Handling call
0925 16:44:02.098806 (+ 46177us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:02.173014 (+ 74208us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:02.173043 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:02.201987 (+ 28944us) log.cc:842] Serialized 26 byte log entry
0925 16:44:02.255027 (+ 53040us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:02.255063 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:02.255119 (+    56us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:02.364142 (+109023us) raft_consensus.cc:1671] finished
0925 16:44:02.364162 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:02.364305 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8150,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":8240,"thread_start_us":27914,"threads_started":1,"wal-append.queue_time_us":150114}
I20260925 16:44:02.388763 12205 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.389209 12205 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.366392  9047 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:02.384079  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.391661  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.392693 12155 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:02.397382 12155 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.397902 12155 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.396147  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:02.383402 12083 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.406250 11952 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:02.406847 12003 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:02.408270  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.409221 12083 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.415987 12246 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:02.415498  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.419131  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.396520  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.409544 12349 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:02.421792 12349 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:02.396355 12205 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.422030  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.410663  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.421103  9702 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:02.426487  9042 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260925 16:44:02.422230 12349 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:02.427068 12347 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.423136 11952 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:02.423473  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:02.411181  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55211.3us
I20260925 16:44:02.424047 12246 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.424638  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.425833  9047 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:02.437567  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:02.438258 12242 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.439836  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.440611 12246 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.441653  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.442965  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:02.443995  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:02.444383  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:02.444660 12246 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:02.445281 12246 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:02.445319  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:02.445591  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:02.446183  9042 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.446358 12246 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:02.447737  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 302079us
I20260925 16:44:02.449173  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.449846  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.450989  8940 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:02.451293  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:02.451875  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8127947319999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260925 16:44:02.452082 12282 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:44:02.452335  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8127947319999294s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1759s for a response
I20260925 16:44:02.452042  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:02.453289  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:02.453320  9047 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:44:02.469087  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.454592 11934 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.455310  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.459978  9042 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:02.460855  9044 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:02.475287  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2255) took 1651 ms (client timeout 1960 ms). Trace:
W20260925 16:44:02.475653  9044 rpcz_store.cc:269] 0925 16:44:00.824009 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:01.424233 (+600224us) service_pool.cc:227] Handling call
0925 16:44:02.475151 (+1050918us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:02.475240 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2338104576}
I20260925 16:44:02.431634  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.461805  9695 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:02.463452 12311 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.464574  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.465867  9117 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:02.466652  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.467664  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.472555  8871 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:02.399211 12276 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.493304  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.493656  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:02.482126 11709 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.013s	sys 0.017s
W20260925 16:44:02.498715  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55288.2us
I20260925 16:44:02.499119  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.502300  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.483402 12178 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:02.512533  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.514546  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.488817 12083 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.508742  8871 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:02.514554  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:02.514781  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.490916 12282 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:44:02.519517  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87951us
I20260925 16:44:02.454193 12155 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:02.504753 11709 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.014s	sys 0.018s
I20260925 16:44:02.527380  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.528185  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.529947  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.459992 12205 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.532063  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.533030  8966 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:02.533327  9694 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260925 16:44:02.498625 12057 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:02.506587 12347 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:02.538901  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.539955  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:02.541620  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.544196  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.544505  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.546936 12236 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:44:02.547125  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.547926  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.549144  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.536129 12057 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.550395 12057 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.552070  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.552867  9118 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.555939  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.556835  8970 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:02.561262 12276 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.564064  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.568791 12348 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:02.569361 12348 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:02.569787 12348 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.573324 12144 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:02.574826 12144 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
W20260925 16:44:02.576103  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55885.7us
I20260925 16:44:02.575328 12144 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:02.588255  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48355.8us
I20260925 16:44:02.523110 12282 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:02.592404  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:02.604542  8971 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:02.603637  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59235.4us
I20260925 16:44:02.602881  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.604640  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.609371  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:02.610797  9090 leader_election.cc:334] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.953s (SENT)
I20260925 16:44:02.611739  9702 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
W20260925 16:44:02.608541  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60893.9us
I20260925 16:44:02.612677  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:02.613323  8966 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:02.538802 12347 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.611166  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:02.619354  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 106930us
I20260925 16:44:02.619437  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.602589 12214 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:02.611759 12236 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:02.532271 12178 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.607084 12097 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:02.607275 12282 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.633905  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.616428  8871 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 3, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.625329  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.604323 12349 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.623350 12111 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:02.639092 12349 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:02.639833 12176 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.641654  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.643118  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.645603 12349 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.645732 12111 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:02.620730 12205 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:02.646970 12205 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.646739 12111 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.2, Last appended by leader: 2, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.648262  9117 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:02.648604  9117 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:02.648051 12144 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.649041 12236 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.649263  9117 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.649588 12144 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:02.650213  9117 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:02.605862 11934 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.608646 12276 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:02.652833 12276 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:02.653383 12276 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:02.655988  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.624759  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:02.657415  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44840.8us
I20260925 16:44:02.621212 12347 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:02.660419  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51140.5us
I20260925 16:44:02.661064  8967 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:02.661760 12178 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.662842 12155 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.655990 11709 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260925 16:44:02.664022 12176 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:02.664434 12176 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:02.664525 11709 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:02.634078  9118 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:02.633045 12097 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:02.652460 12013 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.681226  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.676641  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.680200  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.684377  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.690024  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.691883  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:02.668128  8873 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 337) took 19655 ms (client timeout 15000 ms). Trace:
I20260925 16:44:02.670354  8970 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:02.686563  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.685583  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.693235  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.693982  9120 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.659144 12348 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.664811 12176 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:02.688192  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:02.698773  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.710327  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.710974  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.714082  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:02.664888 11952 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.704088  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:02.719501  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 94232.1us
I20260925 16:44:02.715420  8871 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:02.697793  8971 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:02.685127 12097 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.720382  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.666090 12311 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:02.720786  8871 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:44:02.722182  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45481.9us
I20260925 16:44:02.725054  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:02.679872 11709 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:02.699420 12205 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.734277  9121 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:02.702550 12178 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:02.732971  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.709263 12350 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:02.733253  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
W20260925 16:44:02.737015  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55874.9us
I20260925 16:44:02.734663  9121 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:02.737069  9693 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:02.740482  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.721706 12232 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.746053  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.746275  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.750073  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.750392  9701 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:02.753011  8967 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:02.723991 12003 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:02.724442 12155 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:02.755731  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.755955  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.751103  8871 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 4, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 4 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.764482  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.765455  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.765817  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:02.768080  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.764540  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.768635  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.769071  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.770814  9696 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:02.770633  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:02.772486  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:02.773213  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 162425us
I20260925 16:44:02.774560  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:02.764743  9121 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.776669  9121 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:02.777506  9700 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:02.773274  9694 raft_consensus.cc:2362] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8. Re-sending same reply.
I20260925 16:44:02.773468  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:02.721568 12312 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260925 16:44:02.781862 12057 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.783952 12222 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:02.772178 12349 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:02.695717  8873 rpcz_store.cc:269] 0925 16:43:42.968810 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:42.969157 (+   347us) service_pool.cc:227] Handling call
0925 16:43:43.537250 (+568093us) spinlock_profiling.cc:243] Waited 10.2 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:44:02.617597 (+19080347us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:43:53.900156 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:43:53.900964 (+   808us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:43:53.901032 (+    68us) write_op.cc:435] Acquired schema lock
0925 16:43:53.901060 (+    28us) tablet.cc:660] Decoding operations
0925 16:43:53.902655 (+  1595us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:43:53.902786 (+   131us) write_op.cc:641] Partition lock acquired for write op
0925 16:43:53.902829 (+    43us) tablet.cc:683] Acquiring locks for 12 operations
0925 16:43:53.971556 (+ 68727us) tablet.cc:699] Row locks acquired
0925 16:43:53.971593 (+    37us) write_op.cc:260] PREPARE: finished
0925 16:43:53.971768 (+   175us) write_op.cc:270] Start()
0925 16:43:53.971937 (+   169us) write_op.cc:276] Timestamp: P: 1790354633971685 usec, L: 0
0925 16:43:53.971968 (+    31us) op_driver.cc:331] REPLICATION: starting
0925 16:43:54.014602 (+ 42634us) log.cc:842] Serialized 4761 byte log entry
0925 16:43:54.704420 (+689818us) op_driver.cc:444] REPLICATION: finished
0925 16:43:54.987323 (+282903us) write_op.cc:301] APPLY: starting
0925 16:43:54.989928 (+  2605us) tablet.cc:1365] starting BulkCheckPresence
0925 16:43:55.025912 (+ 35984us) tablet.cc:1368] finished BulkCheckPresence
0925 16:43:55.044532 (+ 18620us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:43:55.176873 (+132341us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:43:55.177108 (+   235us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=12
0925 16:43:55.177153 (+    45us) write_op.cc:312] APPLY: finished
0925 16:43:55.177454 (+   301us) log.cc:842] Serialized 89 byte log entry
0925 16:43:55.177613 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:55.177744 (+   131us) write_op.cc:454] Released schema lock
0925 16:43:55.177802 (+    58us) write_op.cc:341] FINISH: Updating metrics
0925 16:43:55.178076 (+   274us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:43:55.178103 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":57389,"reported_tablets":39,"spinlock_wait_cycles":23434496,"child_traces":[["op",{"apply.queue_time_us":261740,"apply.run_cpu_time_us":4819,"apply.run_wall_time_us":199811,"num_ops":12,"prepare.queue_time_us":141567,"prepare.run_cpu_time_us":22535,"prepare.run_wall_time_us":367898,"raft.queue_time_us":104799,"raft.run_cpu_time_us":85208,"raft.run_wall_time_us":201743,"replication_time_us":719746,"thread_start_us":510004,"threads_started":4,"wal-append.queue_time_us":407981,"wal-append.run_cpu_time_us":6696,"wal-append.run_wall_time_us":1789051}]]}
I20260925 16:44:02.788889 12347 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.790616 12057 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:02.791369 12057 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:02.791807 12057 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:02.792327 12057 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.792415 12003 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:02.793578 12003 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:02.730882 12196 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260925 16:44:02.797497 12196 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:02.797842 12196 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:02.798642 12196 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:02.756531 12155 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:02.804979 12155 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:02.829629  8971 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:02.839579  9120 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:02.768028 12242 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:02.874168  9123 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260925 16:44:02.874727  8871 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:02.877187  8967 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
W20260925 16:44:02.851677  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 142041us
W20260925 16:44:02.879616  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49205us
W20260925 16:44:02.935894  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 198229us
I20260925 16:44:02.938627  8871 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 3, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:02.845208 12347 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:02.963887  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 181986us
I20260925 16:44:02.974640  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:02.977052  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.976145  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:02.978691  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:02.984532  8967 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:02.988220  9117 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260925 16:44:02.998598 12362 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260925 16:44:02.999007 12176 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.000134 12097 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.001138 12176 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:03.001919  9115 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:03.003104 12097 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:03.004159  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:03.004936  9701 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:02.953917 12196 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:03.009326 12282 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.010862  8969 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:03.013144 12276 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:03.015674  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 261185us
I20260925 16:44:02.779016 12232 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.203s
I20260925 16:44:03.019172  8871 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 1 to 2, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:44:03.022504  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45628.5us
W20260925 16:44:03.023262  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48722us
I20260925 16:44:03.023343  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.024963  9121 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:03.026535  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:02.994647 12347 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:02.994405 12222 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.030793  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.035794  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:03.036473  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:03.024560 12349 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:03.021633 12350 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:03.053596  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.042670  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:03.052783  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.036497 12176 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260925 16:44:03.055824  8871 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 2 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:03.059489  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:03.060454  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 176219us
I20260925 16:44:03.032578 12257 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:03.069332  8871 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 3 to 4, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:03.062472 12276 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:03.052968 12371 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260925 16:44:03.024461 12083 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.041s
I20260925 16:44:03.104467 11934 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:03.105350 12178 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:03.107321 12257 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:03.057837 12349 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:03.065793 12246 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:03.113507 12241 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:03.100857 12348 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:03.120504 11709 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.032945 12366 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.135419  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.178264  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.103549 12347 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:03.142231  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89556.4us
W20260925 16:44:03.148800  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 316767us
I20260925 16:44:03.182729  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.149834  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:03.146238 12097 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260925 16:44:03.150760  9693 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:03.151487 11934 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:03.065425 12282 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:03.153045  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.193755  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.194300  9700 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:03.156515  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.157920  8971 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:03.157106  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:03.160086  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.161453  9116 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:03.137451 12350 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:03.164031 12241 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.172402  8968 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260925 16:44:03.199472  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.173828 12155 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.152149 12178 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.152360 12236 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260925 16:44:03.168694 12257 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.179327  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.179450  9119 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.180449  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.181186  9701 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260925 16:44:03.121773 12364 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.138s
I20260925 16:44:03.190629  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:03.211488  8970 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 4. Ops: []
I20260925 16:44:03.212037 12155 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:03.193866 12083 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:03.156472 12349 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:03.213323  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:03.214051  8972 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.213935  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:03.214512  8975 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:03.196764  8967 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:03.176107 12111 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:03.200076  8971 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:03.196535  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:03.220320  8973 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:03.169179 12222 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:03.203963  8968 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:44:03.205130  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.152997 12057 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.207221  8969 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:03.208215 12366 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:03.190618 11934 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:03.219203 12348 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.256500  8972 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:03.219805  8974 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
W20260925 16:44:03.253571  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54198.2us
I20260925 16:44:03.193593 12246 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:03.231282  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 69217.5us
I20260925 16:44:03.262914  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.264207 12144 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.264662  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.265484 12144 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:03.213388 12370 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:03.268429  8966 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:03.268553 12246 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.270313  9121 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:03.232615  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.227876 12222 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:03.273936  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.273891 12222 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.234310 12364 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:03.214424 12376 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260925 16:44:03.248442  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.276279 12364 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:03.276723 12364 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:03.277503  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.218927 12368 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260925 16:44:03.279168 12097 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:03.279395 12176 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:03.279819 12176 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:03.280817 12176 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.281347 12097 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:44:03.281888 12176 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:03.282464 12013 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:03.282820 12013 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.283756 12376 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:03.283569 12013 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.284178 12376 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.284437 11934 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.285072 12013 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.286550 11934 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:03.285094 12376 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.288532 12376 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:03.290174 12222 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:03.292711 12370 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:03.293303 12370 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:03.293722  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.294435 12013 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.294819 12373 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:44:03.295259  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.295935 12013 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:03.296048 12282 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:03.296371 12013 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.296510 12282 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:03.296967 12282 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:03.299206  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:03.232628  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49928.2us
I20260925 16:44:03.250600 12057 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:03.251418 12241 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.252285 12178 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.253393 12341 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.254125 12083 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.254335 12366 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:03.325165  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:03.215780 11709 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:03.255852  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:03.255652 12350 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.297947  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.305444  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:03.298447  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:03.307149  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 254026us
I20260925 16:44:03.317459  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.318950  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:03.329100  8974 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Handling vote request from an unknown peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.329612  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.331239  8974 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:03.329758  8969 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:03.333602  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.332773  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:03.341886  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 311172us
I20260925 16:44:03.342813  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.344327  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.345584  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.347637  9123 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:44:03.349643  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.349782  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.350113  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.350354  9048 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:03.348093  9123 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:03.352252  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.352698  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:03.350008  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.355384  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.356419 12349 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.357934 12342 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:03.358798 12349 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:03.358983 12028 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:03.360261 12003 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:44:03.360967  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:03.361526 12028 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:44:03.362612  9044 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:03.364333  9045 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260925 16:44:03.362021 12028 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.322593 12366 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:03.341660 12341 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:03.334863 12257 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.369153  9122 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:03.343528  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:03.370340  8966 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 2. Preceding OpId from leader: term: 6 index: 3. (index mismatch)
I20260925 16:44:03.346570 12178 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.372730  9122 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:03.341506 12057 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.047s
I20260925 16:44:03.369406 12246 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:03.385015  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:03.420461  9701 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.420814  8972 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260925 16:44:03.384280  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.410305  8969 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:44:03.367151 12241 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:03.362569 12276 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260925 16:44:03.432022  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 116056us
I20260925 16:44:03.364377 12347 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:03.318289 12368 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260925 16:44:03.297372 12013 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.383497  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.440518  9049 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:03.346873 12236 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:03.416268  9123 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.437433  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.442164  9047 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:03.344395 12294 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.068s
W20260925 16:44:03.446676  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 113138us
I20260925 16:44:03.411538 12341 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.448025  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.447472  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.452606  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.458191  9123 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:03.452319  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.452966  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.357968 12374 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260925 16:44:03.454705  9044 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260925 16:44:03.382351 12312 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.058s
I20260925 16:44:03.461143  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.464280  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:03.465289  9047 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:03.466661  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111347us
I20260925 16:44:03.468576  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.445746 12236 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:03.475826  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:03.445497 12246 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.477777  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:03.478192  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 126569us
I20260925 16:44:03.454741 12232 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:03.479297  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:03.523587  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45873us
I20260925 16:44:03.530615  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.465889 12347 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:03.527872  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:03.536904  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57701.4us
I20260925 16:44:03.541436  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.542328  9701 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:03.543998  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:03.472659 12368 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:03.519536 12242 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:03.519745 12236 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:03.528607 12257 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:03.562444  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:03.535543 12276 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260925 16:44:03.564388  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44315.2us
I20260925 16:44:03.534423 11883 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.547158 12310 raft_consensus.cc:2741] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260925 16:44:03.588553  9119 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:44:03.469070 12028 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.587024 12144 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.599751 12391 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260925 16:44:03.600276 12382 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.168s	user 0.001s	sys 0.000s
I20260925 16:44:03.600678 12391 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:03.601308 12391 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:03.603967 12392 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:03.454722 12366 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:03.329662 12225 consensus_queue.cc:1159] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 6 status { last_received { term: 3 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: [5.7-5.7]" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:44:03.603273 12391 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.568761 12057 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.606148  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.536334 12232 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.558950 12368 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:03.607103 12390 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260925 16:44:03.549705 12303 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.041s
I20260925 16:44:03.616158  9050 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:03.603545  9043 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:03.617728  9049 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
W20260925 16:44:03.621088  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90589.2us
I20260925 16:44:03.620313  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.625705  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.626595 12144 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.534405 12378 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.284s
I20260925 16:44:03.629469  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:03.635785 12385 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:44:03.636268 12388 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.004s
I20260925 16:44:03.638427 12232 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:03.640090 12368 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.655470 12312 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
W20260925 16:44:03.656567  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46728.2us
I20260925 16:44:03.660254 12399 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:03.660537  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.592495 12381 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.252s
I20260925 16:44:03.661494 12390 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.661999 12398 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:03.629535 12348 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:03.663650 12388 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:03.664532 12380 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260925 16:44:03.665578 12384 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260925 16:44:03.665934 12389 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:03.662937 12386 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260925 16:44:03.728502 12372 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.729846 12398 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.686465 12399 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:03.737282 12399 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.738731 12399 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:03.742879 12394 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.083s	user 0.000s	sys 0.002s
I20260925 16:44:03.672219  9041 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:03.684479  9123 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260925 16:44:03.703156  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74187.9us
I20260925 16:44:03.575533 12341 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.669744 12368 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:03.737848 12176 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:03.668536 12379 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260925 16:44:03.746325  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.696461 12232 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:44:03.757200  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 212796us
W20260925 16:44:03.754652  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 300951us
I20260925 16:44:03.768675  9701 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:03.704131 12388 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:03.775554  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 234231us
I20260925 16:44:03.776533  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:03.784427  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 96570.8us
I20260925 16:44:03.667663 12364 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.784562  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.786885  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.787068 12407 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:03.791899  9701 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:03.793110  8972 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:03.754724 12144 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.800171  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:03.801011  9693 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:03.801209  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:03.802795  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:03.805138 12406 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:03.801864  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:03.806954  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:03.813630  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 153131us
I20260925 16:44:03.785813 12393 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:44:03.815266  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:03.820686  8969 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:03.732405 12398 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:03.822768  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.791981 12222 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260925 16:44:03.828059 12144 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:03.801823 12242 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.828637 12144 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:03.829839 12397 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.076s
I20260925 16:44:03.800271 12232 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:03.829672 12144 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:03.833570  9048 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:03.784049 12392 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
W20260925 16:44:03.892743  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 70045.1us
I20260925 16:44:03.784636 12312 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260925 16:44:03.785487 12371 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260925 16:44:03.898911  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.826452 12376 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:03.802047 12378 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.037s
I20260925 16:44:03.905576 12376 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:03.910615 12404 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260925 16:44:03.913316  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 128901us
I20260925 16:44:03.913412  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:03.892747 12393 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:03.910984 12416 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260925 16:44:03.914369  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.907742 12412 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:44:03.910735 12411 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260925 16:44:03.915623 12376 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:03.827451 12390 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.082s
I20260925 16:44:03.960877  9701 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
W20260925 16:44:03.925004 11709 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.590s	user 0.009s	sys 0.001s
I20260925 16:44:03.965893  9116 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:03.824105 12408 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.110s
I20260925 16:44:03.968798  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:03.971189  9120 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260925 16:44:03.971825  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57550.2us
I20260925 16:44:03.973157  9702 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:03.974050  9694 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:44:03.927356 12404 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:03.979485  9696 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260925 16:44:03.957746 12393 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:03.980424  9120 pending_rounds.cc:76] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:44:03.996403  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:03.987138  9693 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:03.999661  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:03.997843  9120 pending_rounds.cc:97] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260925 16:44:04.006510  9120 raft_consensus.cc:2866] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:04.016644  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.018639  9043 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:03.970927 12372 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:03.959473 12392 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.040s
I20260925 16:44:04.021835  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:04.022159  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:04.022821  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:04.023892 12396 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.215s	user 0.001s	sys 0.000s
I20260925 16:44:04.023933  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:04.006654 11709 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:04.026310  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:03.892109 12388 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.008386 12420 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:04.005282 12407 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:04.029420  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:04.064599  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:04.062407  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:04.008162 12408 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
W20260925 16:44:04.044808  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 241139us
I20260925 16:44:04.015007 12232 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:04.004647 12347 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.058s
I20260925 16:44:04.104914  9699 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:44:04.106055  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:04.111263  9048 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:04.078717  9043 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:04.107282  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:04.114437  8971 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:04.122151  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58995.9us
I20260925 16:44:04.125835  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:04.122381 12257 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:04.130461  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:04.130519 12257 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:04.132048 12241 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.708s	user 0.002s	sys 0.009s
I20260925 16:44:04.132736 12257 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:04.127514 12407 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
W20260925 16:44:04.140420 12282 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.841s	user 0.012s	sys 0.000s
I20260925 16:44:04.141000 12282 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:04.062845 11709 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:04.146320  9045 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:04.148316  8974 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:04.132895 12414 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260925 16:44:04.155143 12178 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.740s	user 0.004s	sys 0.005s
I20260925 16:44:04.108207 12225 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:04.166666 12225 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.168236 12155 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:04.168735 12155 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.169080 12225 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:04.159232 12403 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.348s	user 0.000s	sys 0.000s
I20260925 16:44:04.170873 12155 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:04.160269 12176 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Stepping down as leader of term 5
W20260925 16:44:04.163980 12236 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.008s
I20260925 16:44:04.078316 12410 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:04.173942  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:04.217108  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:04.217455  9120 raft_consensus.cc:2354] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10.
I20260925 16:44:04.065567 12364 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:04.226431  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.227171  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:04.107985 12408 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:04.179847  9050 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:04.178252 12176 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:04.149852 12282 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:04.189302  9043 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:04.147625 11709 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:04.216140  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0438680430002023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260925 16:44:04.245360  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0168680430001587s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1549s for a response
I20260925 16:44:04.246166  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:04.225226  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 142916us
I20260925 16:44:04.091740 12425 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:04.036724 12393 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.143s
W20260925 16:44:04.320143  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74077.8us
I20260925 16:44:04.324229  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:04.314558 12422 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:04.036686 12372 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.270390  9043 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:04.265938  8939 leader_election.cc:398] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10.
I20260925 16:44:04.239385 12165 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:04.191953 12155 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.129s
I20260925 16:44:04.325096  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:04.334089  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.327889  8974 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
W20260925 16:44:04.353937  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 229719us
I20260925 16:44:04.331827  8939 leader_election.cc:401] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260925 16:44:04.252020 11709 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:04.356058  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.211840 12236 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:04.068042 12420 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:04.380421  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55419.4us
I20260925 16:44:04.381327  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:04.381611  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:04.384703  9047 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:04.386793  9049 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:04.388046  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63978.5us
I20260925 16:44:04.362398 12165 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:04.396377  9698 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:04.373153 12392 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:04.448868  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67607.3us
I20260925 16:44:04.457301  9698 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:04.512715  9693 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:04.515990  9699 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
W20260925 16:44:04.515519 12376 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260925 16:44:04.525674 12376 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.526301 12420 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:04.527005 12405 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:44:04.452641 12368 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.000s
I20260925 16:44:04.527465 12405 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:04.451092 12348 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:04.604143  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 220078us
I20260925 16:44:04.399727 12311 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:04.451359 12410 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:04.367575 12176 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.379410 11709 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.614861  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.335755 12425 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:04.646286  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 257292us
I20260925 16:44:04.599409 12407 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:04.647300  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:04.647390  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:04.604447 12405 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:04.603742 12348 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:04.365747 12422 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.653631  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:04.660347 12348 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:04.669286 12404 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.655s	user 0.006s	sys 0.004s
I20260925 16:44:04.680511  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:04.680884  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:04.681981  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:04.641075 12311 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.683228  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:04.665853 12312 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:04.687685  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 237808us
I20260925 16:44:04.675853 12364 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:04.674669 12376 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:04.700278 12449 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:44:04.701279 12441 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260925 16:44:04.700940 12449 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:04.703349 12440 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:44:04.704077 12432 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:04.673190 12165 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.704499 12432 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:04.676079 12371 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260925 16:44:04.686199 12404 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:04.704959 12432 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:04.652163 12424 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.367s
I20260925 16:44:04.703302 12449 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:04.725797  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:04.726809  9115 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:04.744069  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44142.3us
I20260925 16:44:04.778524  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:04.781143  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:04.779662  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 97266.6us
I20260925 16:44:04.694629 12236 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:04.782094  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2372) took 1449 ms. Trace:
I20260925 16:44:04.786507  9118 rpcz_store.cc:276] 0925 16:44:03.301616 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.301770 (+   154us) service_pool.cc:227] Handling call
0925 16:44:03.302129 (+   359us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:03.317435 (+ 15306us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:03.317464 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:03.331641 (+ 14177us) log.cc:842] Serialized 26 byte log entry
0925 16:44:04.171846 (+840205us) spinlock_profiling.cc:243] Waited 3.97 ms on lock 0x7b1800321100. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:44:04.388004 (+216158us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:04.388047 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:04.388121 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:04.707455 (+319334us) raft_consensus.cc:1671] finished
0925 16:44:04.707481 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:04.750870 (+ 43389us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8447,"raft.queue_time_us":41684,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":2536,"spinlock_wait_cycles":9131392,"thread_start_us":215977,"threads_started":1,"wal-append.queue_time_us":1305032}
I20260925 16:44:04.697875 12372 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:04.707376 12364 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:04.707713  9120 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:04.796483  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:04.798116  8972 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.012s	sys 0.008s
W20260925 16:44:04.798856  8972 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.013s	sys 0.008s
I20260925 16:44:04.781219 12420 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:04.800535  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.785626 12404 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:04.813678  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 122557us
I20260925 16:44:04.817651  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:04.697963 12312 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.824676  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:04.814841 12420 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:04.825886 12434 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
I20260925 16:44:04.828191 12377 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:04.698232 12407 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:04.707274 12410 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:04.810062 12364 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.100s
I20260925 16:44:04.827435 12420 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:04.802038 12372 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260925 16:44:04.828330 12422 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:05.273944 12405 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.601s	user 0.011s	sys 0.000s
I20260925 16:44:04.947733 12458 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:05.288089 12458 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260925 16:44:05.242846 12392 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.788s	user 0.010s	sys 0.001s
I20260925 16:44:05.289237 12392 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:05.289954 12392 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:05.290364 12392 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:04.830189 11709 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:04.830307 12455 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:05.291862 12392 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.293541 12392 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:04.832768 12348 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.295997 12348 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:04.996136  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 195480us
W20260925 16:44:05.227672  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.012s	sys 0.010s
W20260925 16:44:05.297933  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.014s	sys 0.010s
W20260925 16:44:04.924427  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53878.6us
I20260925 16:44:05.084522 12312 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.148900  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:05.287868 12405 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:04.828600 12438 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.428s	user 0.001s	sys 0.000s
I20260925 16:44:05.573575 12482 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.272293 12404 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:05.574489 12482 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.575224 12404 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:05.576545 12404 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:05.576917 12482 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:05.573702  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2380) took 1737 ms. Trace:
I20260925 16:44:05.577145 12404 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.987521 12232 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.461539 12310 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:04.871228 12432 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.577678  9119 rpcz_store.cc:276] 0925 16:44:03.836586 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.900200 (+ 63614us) service_pool.cc:227] Handling call
0925 16:44:03.900653 (+   453us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:03.906942 (+  6289us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:03.906971 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:03.911373 (+  4402us) log.cc:842] Serialized 26 byte log entry
0925 16:44:04.224688 (+313315us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:04.224752 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:04.224853 (+   101us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:05.573457 (+1348604us) raft_consensus.cc:1671] finished
0925 16:44:05.573486 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:05.573641 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5839,"raft.queue_time_us":7083,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":120,"thread_start_us":268653,"threads_started":1,"wal-append.queue_time_us":400761}
W20260925 16:44:05.312469  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 492427us
I20260925 16:44:05.223256 12448 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:05.299274  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.576s (SENT) [suppressed 64 similar messages]
I20260925 16:44:05.296530 12348 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.580485 12405 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:05.357767  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54092.7us
I20260925 16:44:05.384008 12468 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.581658  9116 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:04.959810 12097 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Stepping down as leader of term 3
I20260925 16:44:04.828732 12459 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.383105 12342 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:05.085995 12466 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:44:04.819741 12368 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:05.428395 12411 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
W20260925 16:44:05.583001  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.007s	sys 0.007s
W20260925 16:44:05.651856  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.848s	user 0.008s	sys 0.007s
I20260925 16:44:04.828922 12451 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:05.384334 12457 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.429749 12435 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Stepping down as leader of term 5
W20260925 16:44:05.518227  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 168652us
I20260925 16:44:05.428397 12473 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:04.830703 12439 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260925 16:44:05.384173  9117 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:05.043326 12465 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.558s
I20260925 16:44:05.377940  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:05.663769  9124 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:05.658668 12435 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:05.640435 12459 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.836907 12425 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.667840 12479 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.668015 12425 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.667400 12435 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.668457 12425 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:05.669304 12435 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:05.669430 12459 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.640019 12342 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.635658 12348 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.670535 12425 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:05.588825 12111 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.671905  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1616) took 1650 ms. Trace:
I20260925 16:44:05.672022 12348 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:05.672356 12111 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.674208 12111 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.479943 12155 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:05.589118 12421 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:05.686508 12421 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.687045  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2384) took 1073 ms. Trace:
W20260925 16:44:05.411106  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 602) took 1958 ms (client timeout 1576 ms). Trace:
W20260925 16:44:05.687891  9041 rpcz_store.cc:269] 0925 16:44:03.452602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.452724 (+   122us) service_pool.cc:227] Handling call
0925 16:44:05.410805 (+1958081us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540011e754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:05.411009 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":468979584}
I20260925 16:44:05.689052 12404 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.687592  9123 rpcz_store.cc:276] 0925 16:44:04.613999 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.614134 (+   135us) service_pool.cc:227] Handling call
0925 16:44:04.614423 (+   289us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:04.614605 (+   182us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:44:04.685429 (+ 70824us) log.cc:842] Serialized 14 byte log entry
0925 16:44:05.686518 (+1001089us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b18003fc580. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:44:05.686628 (+   110us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:05.686690 (+    62us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:05.686741 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:05.686825 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:05.686980 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11731,"prepare.queue_time_us":187464,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":108061,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":6973,"spinlock_wait_cycles":3688192,"thread_start_us":164562,"threads_started":2}
I20260925 16:44:05.689450  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:05.587214 12392 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:05.690179  9041 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:05.612763 12310 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:04.830034 12311 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:05.589426 12378 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:05.620508  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 316510us
W20260925 16:44:05.619293 12462 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.020s	sys 0.000s
I20260925 16:44:05.589871 12232 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:05.627175  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 162492us
W20260925 16:44:05.688292 12484 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260925 16:44:05.400629 12364 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.227s
I20260925 16:44:05.628364  9089 leader_election.cc:398] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:05.627169 12312 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.628625 12480 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:05.637769 12097 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:05.654544  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:05.659624  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 360354us
I20260925 16:44:05.659857  9117 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:05.671625 12342 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.672273  8974 rpcz_store.cc:276] 0925 16:44:04.021487 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.021615 (+   128us) service_pool.cc:227] Handling call
0925 16:44:05.671720 (+1650105us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b54003e7e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:05.671834 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":262865664}
W20260925 16:44:05.774283  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.53309e+06us
I20260925 16:44:05.774255  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:05.685442 12155 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.651666 12411 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:05.591209 12422 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.782032  9123 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260925 16:44:05.701205  9089 leader_election.cc:401] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:05.774616  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2056) took 1655 ms. Trace:
I20260925 16:44:05.783106  9117 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:05.773823  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:05.709590  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:05.773553  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1619) took 1745 ms. Trace:
I20260925 16:44:05.784116  9117 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:05.784830  8969 rpcz_store.cc:276] 0925 16:44:04.027809 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.027948 (+   139us) service_pool.cc:227] Handling call
0925 16:44:04.106040 (+ 78092us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:04.106248 (+   208us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:04.106532 (+   284us) log.cc:842] Serialized 14 byte log entry
0925 16:44:05.773051 (+1666519us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:05.773098 (+    47us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:05.773138 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:05.773215 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:05.773426 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1442199,"prepare.queue_time_us":1269,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":39,"raft.queue_time_us":1444496,"raft.run_cpu_time_us":52,"raft.run_wall_time_us":52,"thread_start_us":219792,"threads_started":1,"wal-append.queue_time_us":409562}
I20260925 16:44:05.766532  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2048) took 1969 ms. Trace:
I20260925 16:44:05.774523  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:05.786507  9693 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:05.709930  9699 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:05.710523  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:05.786969  9696 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:05.773891  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:05.780491  9694 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:05.790086  9702 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:44:05.787375  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 161617us
I20260925 16:44:05.786779  8970 rpcz_store.cc:276] 0925 16:44:03.796889 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.797831 (+   942us) service_pool.cc:227] Handling call
0925 16:44:03.816359 (+ 18528us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:03.978722 (+162363us) raft_consensus.cc:1520] Early marking committed up to index 2
0925 16:44:04.037526 (+ 58804us) log.cc:842] Serialized 14 byte log entry
0925 16:44:04.240641 (+203115us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:04.246077 (+  5436us) log.cc:842] Serialized 52 byte log entry
0925 16:44:04.246277 (+   200us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:04.246552 (+   275us) log.cc:842] Serialized 14 byte log entry
0925 16:44:05.765956 (+1519404us) spinlock_profiling.cc:243] Waited 3.06 ms on lock 0x7b1800367060. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:44:05.766129 (+   173us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:05.766206 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:05.766329 (+   123us) raft_consensus.cc:1671] finished
0925 16:44:05.766345 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:05.766476 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1513241,"prepare.queue_time_us":57707,"prepare.run_cpu_time_us":118,"prepare.run_wall_time_us":9429,"raft.queue_time_us":1681433,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":14013,"spinlock_wait_cycles":7045376,"thread_start_us":310862,"threads_started":2,"wal-append.queue_time_us":613851}
I20260925 16:44:05.728904  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:05.680553  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:05.793170  9041 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:05.783516  8971 rpcz_store.cc:276] 0925 16:44:04.119417 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.121100 (+  1683us) service_pool.cc:227] Handling call
0925 16:44:04.148273 (+ 27173us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:04.231006 (+ 82733us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:04.231055 (+    49us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:04.231806 (+   751us) log.cc:842] Serialized 52 byte log entry
0925 16:44:04.358055 (+126249us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:04.373166 (+ 15111us) log.cc:842] Serialized 14 byte log entry
0925 16:44:05.774325 (+1401159us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:05.774399 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:05.774438 (+    39us) raft_consensus.cc:1671] finished
0925 16:44:05.774450 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:05.774566 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2910824,"prepare.queue_time_us":14757,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":3535,"raft.queue_time_us":101863,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":70170,"thread_start_us":140434,"threads_started":2,"wal-append.queue_time_us":458620}
I20260925 16:44:05.792343  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:05.768639 12395 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 2.102s	user 0.006s	sys 0.017s
I20260925 16:44:05.640702 12468 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.764921 12310 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:05.766485 12482 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:05.775035 12443 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.775327 12430 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:05.779109 12480 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:05.800365  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 145898us
I20260925 16:44:05.790745 12465 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.809186  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:05.809257  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:05.788024 12451 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.810454  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:05.810570  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:05.800383 12381 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.048s	user 0.026s	sys 0.030s
I20260925 16:44:05.668354 12479 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.711298 12311 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:05.676152 12457 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.699502 12392 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.789021 12422 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.709707 12481 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:05.709556 12312 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:05.676002 12473 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.698318 12378 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:05.814702  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:06.543987  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.006s	sys 0.010s
I20260925 16:44:05.852139  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:06.322824  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2386) took 1600 ms. Trace:
I20260925 16:44:06.570781  9695 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:06.572731  9121 rpcz_store.cc:276] 0925 16:44:04.722168 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.722302 (+   134us) service_pool.cc:227] Handling call
0925 16:44:04.722649 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:04.798824 (+ 76175us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:04.798877 (+    53us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:04.798922 (+    45us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:04.798956 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:06.322489 (+1523533us) spinlock_profiling.cc:243] Waited 75.9 ms on lock 0x7b5400143f54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:06.322551 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:06.322732 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":174548352}
I20260925 16:44:05.853431 12410 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.721s
W20260925 16:44:05.900554  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 126821us
I20260925 16:44:06.574388  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:06.574129  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:06.575461 12410 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:06.575764  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:05.900110  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.44854e+06us
I20260925 16:44:06.577198 12486 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:06.514729  9696 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.001s
I20260925 16:44:06.577839  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:06.578186 12495 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:06.576891 12311 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:06.400348 12491 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260925 16:44:06.578997 12495 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:06.576576  9695 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:06.579464 12495 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.578004 12486 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.579968 12465 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.581678 12495 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.582146 12495 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:05.980475  9117 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:06.584949  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2392) took 1436 ms. Trace:
I20260925 16:44:06.585525  9117 rpcz_store.cc:276] 0925 16:44:05.148390 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:05.312413 (+164023us) service_pool.cc:227] Handling call
0925 16:44:05.384012 (+ 71599us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:06.584633 (+1200621us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:06.584882 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:06.542289  8972 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.009s	sys 0.007s
I20260925 16:44:06.316115  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2282) took 2989 ms. Trace:
W20260925 16:44:06.587980  8972 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.011s	sys 0.007s
I20260925 16:44:06.589033  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1618) took 2565 ms. Trace:
I20260925 16:44:05.822762  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:06.592371  9041 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
W20260925 16:44:06.592928  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 611) took 1806 ms (client timeout 2227 ms). Trace:
W20260925 16:44:06.593340  9041 rpcz_store.cc:269] 0925 16:44:04.786750 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:05.802938 (+1016188us) service_pool.cc:227] Handling call
0925 16:44:06.592868 (+789930us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:06.534601  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.001s	sys 0.009s
W20260925 16:44:06.594661  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.001s	sys 0.009s
W20260925 16:44:06.571579  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.007s	sys 0.010s
W20260925 16:44:06.603494  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 683211us
I20260925 16:44:06.025810 12246 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.631006 12312 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.631434 12392 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.588164  9046 rpcz_store.cc:276] 0925 16:44:03.326825 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.326940 (+   115us) service_pool.cc:227] Handling call
0925 16:44:03.327471 (+   531us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:03.327819 (+   348us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:03.327860 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:03.352740 (+ 24880us) log.cc:842] Serialized 26 byte log entry
0925 16:44:03.521159 (+168419us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:03.646767 (+125608us) log.cc:842] Serialized 14 byte log entry
0925 16:44:03.655747 (+  8980us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:03.655807 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:05.767682 (+2111875us) spinlock_profiling.cc:243] Waited 36 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:06.270692 (+503010us) raft_consensus.cc:1671] finished
0925 16:44:06.315810 (+ 45118us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:06.316032 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8763,"prepare.queue_time_us":206615,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":13736,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"spinlock_wait_cycles":82754944,"thread_start_us":219259,"threads_started":2,"wal-append.queue_time_us":254334}
I20260925 16:44:06.605279  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:06.143313 12444 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:06.321666 12155 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.629089 12282 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:06.629254 12473 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.630448 12311 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:05.805893 12425 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:06.672384  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:06.673288  9698 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:06.636269  9117 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:06.640920  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 830493us
W20260925 16:44:06.570199 12381 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.867s	user 0.026s	sys 0.048s
I20260925 16:44:06.631026 12246 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:05.973904 12446 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.589517  8972 rpcz_store.cc:276] 0925 16:44:04.023583 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.024633 (+  1050us) service_pool.cc:227] Handling call
0925 16:44:04.025093 (+   460us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:44:04.028575 (+  3482us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:04.028621 (+    46us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:44:04.106935 (+ 78314us) log.cc:842] Serialized 78 byte log entry
0925 16:44:04.799451 (+692516us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:44:04.813352 (+ 13901us) log.cc:842] Serialized 14 byte log entry
0925 16:44:06.588615 (+1775263us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:06.588721 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:06.588782 (+    61us) raft_consensus.cc:1671] finished
0925 16:44:06.588802 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:06.588969 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":985459,"prepare.queue_time_us":13476,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":47,"raft.queue_time_us":1004092,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":66373,"thread_start_us":1437520,"threads_started":2,"wal-append.queue_time_us":1122039,"wal-append.run_cpu_time_us":3016,"wal-append.run_wall_time_us":1014929}
I20260925 16:44:05.856396 12430 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.672298  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:06.677217 12486 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.681757  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:06.067018 12453 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10.
I20260925 16:44:05.951594 12222 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.814005 12432 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:05.809795 12276 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:05.810030 12407 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.678153  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:06.739002  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 60925.2us
I20260925 16:44:06.740694  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:06.024384 12447 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:06.051640 12452 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.051316 12349 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:06.548180 12435 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.878s	user 0.007s	sys 0.004s
I20260925 16:44:06.675308  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:05.806958 12364 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:05.899618 12421 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.637434 12501 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:06.023581 12424 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:05.963347 12083 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:06.701993  9046 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:06.641662 12481 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.748694 12453 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.582595 12495 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.676908 12312 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.672423 12425 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:06.708227  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:05.814373 12482 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.685415 12473 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:05.963037 12411 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.786819 12364 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:06.749939 12349 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.749763 12452 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:06.750914  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75710.2us
I20260925 16:44:06.816849  9041 raft_consensus.cc:2362] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8. Re-sending same reply.
W20260925 16:44:06.816169  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 124688us
I20260925 16:44:05.851413 12097 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.817943  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 640) took 3511 ms. Trace:
I20260925 16:44:05.815362 12443 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.747493 12432 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.682299 12282 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.825968  8969 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:06.640424 12451 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.795883 12421 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:06.812515 12311 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.812184 12486 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:06.793638 12083 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.651294 12444 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.795252 12481 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:06.793520 12479 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:06.884254  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 142032us
I20260925 16:44:06.816526 12435 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:06.834841  9701 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:06.837522  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:06.853575 12421 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:06.838001  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:06.821040 12196 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:44:06.789608 12222 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.743458 12276 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.819478 12425 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:06.852907  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:06.833783  8968 rpcz_store.cc:276] 0925 16:44:03.306134 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.314073 (+  7939us) service_pool.cc:227] Handling call
0925 16:44:03.314449 (+   376us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:03.314694 (+   245us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:03.385591 (+ 70897us) log.cc:842] Serialized 14 byte log entry
0925 16:44:03.742260 (+356669us) spinlock_profiling.cc:243] Waited 62.2 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:06.678310 (+2936050us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b1800366b20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b
0925 16:44:06.817159 (+138849us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:06.817341 (+   182us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:06.817436 (+    95us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:06.817617 (+   181us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:06.817836 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":207360,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"spinlock_wait_cycles":166884480,"thread_start_us":355295,"threads_started":3,"wal-append.queue_time_us":237600,"wal-append.run_cpu_time_us":10374,"wal-append.run_wall_time_us":1154427}
I20260925 16:44:06.821209 12503 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.836407 12411 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:06.886976  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:06.868947 12496 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.869309 12452 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.879930 12509 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:06.880375 12497 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:06.880754 12493 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:06.881227 12508 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.693975 12446 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.793320 12424 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.837822  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:06.959584  8967 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:06.922627 12196 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:06.822754 12312 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.967293 12312 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.968067 12510 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.967936 12509 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.827867 12473 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.968623 12451 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.969822 12482 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:06.970055 12473 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.796312 12501 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.970733 12446 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.795629 12453 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.971752 12457 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:06.972091  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:06.972870 12453 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.886888  8974 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:06.973323  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:06.974308  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:06.975180  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:06.748546 12407 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.844816 12432 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.976506  8967 raft_consensus.cc:2396] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:44:06.931267  8966 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:06.904359 12498 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.905802 12512 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.752435 12447 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.880790 12349 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:06.906569 12448 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.270s	user 0.010s	sys 0.001s
W20260925 16:44:06.945240  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 111518us
I20260925 16:44:06.954762  9046 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:06.864207 12505 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260925 16:44:06.885809 12481 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.928761 12421 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:06.904143 12504 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.922945 12246 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:06.905987 12490 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:44:06.885600 12506 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:06.881762 12083 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:06.960152  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.007s	sys 0.003s
I20260925 16:44:06.869727 12311 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.891279 12364 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.962790 12508 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.961504 12497 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.965134 12493 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.938699 12503 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:06.976353 12495 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:06.884099  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.000s	sys 0.024s
I20260925 16:44:06.929661  9041 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
W20260925 16:44:06.885185  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.085s	user 0.004s	sys 0.004s
I20260925 16:44:06.740190 12480 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:06.977285  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.153268 12515 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.153614  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.154237  8967 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:07.153918 12515 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.155064  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:07.157094  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 270181us
W20260925 16:44:07.157231  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 319976us
W20260925 16:44:07.158066  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 614) took 1859 ms (client timeout 2143 ms). Trace:
W20260925 16:44:07.158159  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.000s	sys 0.038s
I20260925 16:44:07.157967  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 617) took 1227 ms. Trace:
W20260925 16:44:07.159677  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.368s	user 0.008s	sys 0.007s
I20260925 16:44:07.158104  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:07.160063  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.36804e+06us
W20260925 16:44:07.158172  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.003s	user 0.007s	sys 0.010s
W20260925 16:44:07.159969  9046 rpcz_store.cc:269] 0925 16:44:05.299051 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.671879 (+1372828us) service_pool.cc:227] Handling call
0925 16:44:07.158016 (+486137us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.029255  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:07.162828  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.161398  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:07.012749  8974 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:07.164358  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:06.947968 12452 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:06.906476 12494 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:06.977246 12430 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:07.168118  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 138990us
I20260925 16:44:07.159761  9041 rpcz_store.cc:276] 0925 16:44:05.930503 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.828640 (+898137us) service_pool.cc:227] Handling call
0925 16:44:07.157912 (+329272us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.200491  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.202874  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.204020  8967 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:44:07.141150 12407 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.207506 12282 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.210052 12493 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.212193  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.219573  9046 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:07.164826 12453 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.220245  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 615) took 1301 ms. Trace:
I20260925 16:44:07.226102  9046 rpcz_store.cc:276] 0925 16:44:05.918875 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.174687 (+1255812us) service_pool.cc:227] Handling call
0925 16:44:07.220194 (+ 45507us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.166956 12374 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:07.164500 12276 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.165416 12490 raft_consensus.cc:2741] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260925 16:44:07.225087  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:07.167047 12246 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.197686 12448 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:07.235980 12521 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:07.069001 12520 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:07.218979 12455 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:07.224587 12480 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:07.167335 12495 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:07.167868 12473 consensus_queue.cc:1159] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8dc3391062084f45a6ba62d28d340722" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 8 last_received_current_leader { term: 7 index: 8 } }
I20260925 16:44:07.232710 12374 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.254782  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.239017  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:06.973356 12507 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.216233 12364 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:07.244648  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.231845 12432 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:07.198079 12494 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:07.216241 12482 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.186302 12349 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:07.171607 12444 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.244144 12490 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.068881 12196 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.167217 12481 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.211057 12513 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.040s
I20260925 16:44:06.961696 12496 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.202111 12452 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.262562 12507 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.015280 12435 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 4.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.203s
I20260925 16:44:07.166244 12498 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.274416 12490 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.275198 12508 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.274672 12526 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:07.276232  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.237228 12453 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.260717 12374 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:07.244307 12246 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.212345 12506 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.282876 12518 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.263379 12495 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.263126 12494 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:07.271997 12432 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.177736 12504 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.270931 12515 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.273181  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.272332 12521 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:07.272020 12349 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.327665 11952 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:07.198254 12512 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.325459 12435 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.364650  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.270361 12482 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.279665 12427 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:07.347409 12522 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.342831  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:06.968653 12510 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.356571  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.377266  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.347321 12444 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:07.357827  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 137831us
I20260925 16:44:07.362485  9117 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260925 16:44:07.337976 12490 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.366856  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.337931 12498 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.367875  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.367628  9116 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:07.367964  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.381825  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:07.361232 12447 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.384507  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.369432  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.286912 12519 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.386627  9046 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:07.389434  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.390219  9116 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:07.381655  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.382750  9123 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:07.380846  9117 pending_rounds.cc:76] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:44:07.383271  9124 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:07.392866  9117 pending_rounds.cc:97] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260925 16:44:07.373733  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.368487 12526 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:07.393147  9117 raft_consensus.cc:2866] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:07.379760 12435 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.394492  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:07.397095  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.399185  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.357852 12432 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.364975 12513 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.024s
I20260925 16:44:07.402611  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.404803  8967 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:07.382638 12427 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:07.370642 11952 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.388365 12498 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:07.408416 12503 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.376292 12518 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.408666 12349 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.410946  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.388227 12490 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:07.406808  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.394438 12214 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:07.416061  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.433749  9117 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:07.412557 11952 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.408427  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.408329 12311 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.422569 12452 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.384411 12444 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.408635 12083 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.424367  9124 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.426060 12425 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.427301 12490 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.428351  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.429013 12435 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:07.429308  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.429733 12523 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.429930  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.430540  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.429014  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.431523  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.408178 12447 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:07.447016  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.451171  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.434273 12176 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.402624 12522 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.401490 12398 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260925 16:44:07.449366 12427 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.483752  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 609) took 2681 ms. Trace:
I20260925 16:44:07.449401 12311 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:07.484303  9041 rpcz_store.cc:276] 0925 16:44:04.786133 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.466939 (+2680806us) service_pool.cc:227] Handling call
0925 16:44:07.467302 (+   363us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.467495 (+   193us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.467523 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:07.467570 (+    47us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:07.467610 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.467674 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:07.467831 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.455366  9118 raft_consensus.cc:2396] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260925 16:44:07.433495 12214 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:07.486794 12214 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:07.487361  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.454236 12431 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.488741  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.489151 12431 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.490044  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.490960  9118 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:07.464918  9117 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:07.492228 12431 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.461109  9116 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:07.453015  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.466073 12526 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.493564  9046 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 5.
I20260925 16:44:07.450913 12481 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.405725 12519 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.435915 12282 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.029s
I20260925 16:44:07.457126 12490 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.495394  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2291) took 1718 ms. Trace:
W20260925 16:44:07.524191  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73099.7us
I20260925 16:44:07.517616  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:07.510593  9041 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260925 16:44:07.542794  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.542007  9046 rpcz_store.cc:276] 0925 16:44:05.777433 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.494292 (+1716859us) service_pool.cc:227] Handling call
0925 16:44:07.494623 (+   331us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.494981 (+   358us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.495018 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:07.495104 (+    86us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:07.495146 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.495214 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:07.495339 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":925,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":89}
I20260925 16:44:07.478268  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.450850 12506 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.432858 12521 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.576131 12482 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.552783  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2292) took 1775 ms. Trace:
I20260925 16:44:07.580078  9123 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:07.580039  9046 rpcz_store.cc:276] 0925 16:44:05.777778 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.552011 (+1774233us) service_pool.cc:227] Handling call
0925 16:44:07.552328 (+   317us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.552481 (+   153us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.552506 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:07.552544 (+    38us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:07.552574 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.552644 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:07.552735 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.556314  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.540160  9124 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260925 16:44:07.557260  8967 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:07.464389 12447 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:07.463960 12425 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.481178 12522 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.478019 12512 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.415777 12531 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:07.551664  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 612) took 2253 ms. Trace:
I20260925 16:44:07.588452 12510 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.593045 12404 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.592978 12494 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.616153 12176 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.482760 12083 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:07.643908  9041 rpcz_store.cc:276] 0925 16:44:05.297966 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.509910 (+2211944us) service_pool.cc:227] Handling call
0925 16:44:07.510322 (+   412us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:07.551356 (+ 41034us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.551602 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.519595 12427 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.646272  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.511485 12495 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:07.649061 12455 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:07.583904 12481 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.524603 12311 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:07.663846 12083 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.509268 12246 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.628854 12349 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:07.668133 12083 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:07.672742 12349 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.673281 12349 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:07.672654 12481 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.665894 12176 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.640506 12447 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:07.616709 12214 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.660010  8967 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:07.594030 12444 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.556699 12504 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.691489  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.666540  9041 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:07.524089 12523 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:07.594071  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51398.6us
I20260925 16:44:07.670535  9695 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:44:07.553138 12518 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.567811 12421 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.616398 12432 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.674892  9702 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:07.508538 12453 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.655166 12404 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.668107 12311 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.694247  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 620) took 1015 ms. Trace:
I20260925 16:44:07.694279  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.696812  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.693217 12494 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:07.710117  9041 rpcz_store.cc:276] 0925 16:44:06.678861 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.666061 (+987200us) service_pool.cc:227] Handling call
0925 16:44:07.666371 (+   310us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.693980 (+ 27609us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.694187 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.716487  9041 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260925 16:44:07.717150  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 621) took 1038 ms. Trace:
I20260925 16:44:07.710527  9695 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:07.719345  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.720695  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.721902  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:07.677062 12496 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.712611 12214 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.711426  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.701644  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.723680  8967 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:07.724118  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.724493  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.725071  8967 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:07.717955  9041 rpcz_store.cc:276] 0925 16:44:06.679231 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.715171 (+1035940us) service_pool.cc:227] Handling call
0925 16:44:07.716086 (+   915us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.716883 (+   797us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.717092 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:07.727798  9041 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:07.727955  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:07.729835  8967 raft_consensus.cc:2362] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:44:07.728672  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.730723 12523 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.734292 12443 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.735049 12443 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:07.692022 12519 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:07.736519  8969 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.026s	sys 0.062s
W20260925 16:44:07.736850  8969 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.026s	sys 0.062s
W20260925 16:44:07.737098  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1636) took 3715 ms (client timeout 2334 ms). Trace:
I20260925 16:44:07.737448  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.730757  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:07.737464  9047 rpcz_store.cc:269] 0925 16:44:04.021665 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.021871 (+   206us) service_pool.cc:227] Handling call
0925 16:44:07.736927 (+3715056us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:07.737040 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":805893888}
I20260925 16:44:07.672147 12531 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.739614  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.744225  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.739862 12453 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:07.741752 12246 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:07.747646  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.747725 12246 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.749029 12246 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:07.749066  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.750583  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.709230 12518 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260925 16:44:07.752264  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.751847  9119 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:07.710146 12444 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260925 16:44:07.755085 12504 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:07.755031 12517 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.756238  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1634) took 3736 ms. Trace:
I20260925 16:44:07.768966  9049 rpcz_store.cc:276] 0925 16:44:04.019984 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.020609 (+   625us) service_pool.cc:227] Handling call
0925 16:44:04.020941 (+   332us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:04.392492 (+371551us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.756039 (+3363547us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54001af754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:07.756185 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":840782592}
I20260925 16:44:07.755752  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.742161 12481 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:07.753450 12411 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.814s	user 0.015s	sys 0.000s
I20260925 16:44:07.746995 12510 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:07.751490 12522 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.765683  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.778823  9115 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:44:07.766542  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.779999  9116 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:07.767824 12504 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.773178  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.782618  9124 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:07.781319  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:07.784157  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:07.785678  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:07.784483 12370 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:07.789777 12370 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.790120 12370 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:07.747434 12443 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260925 16:44:07.774593  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.770872  9118 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:07.759714  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.778071 12176 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.811303  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.777868 12529 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
I20260925 16:44:07.781634  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.759486 12493 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260925 16:44:07.781987 12431 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:07.778507 12510 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.788060 12504 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:07.798164 12503 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:07.791817 12452 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:07.777068 12349 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.827757  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 596) took 4390 ms. Trace:
I20260925 16:44:07.829442 12349 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.828218  9042 rpcz_store.cc:276] 0925 16:44:03.436562 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.445892 (+  9330us) service_pool.cc:227] Handling call
0925 16:44:03.467371 (+ 21479us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:03.629442 (+162071us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:03.790803 (+161361us) log.cc:842] Serialized 14 byte log entry
0925 16:44:03.928592 (+137789us) log.cc:842] Serialized 14 byte log entry
0925 16:44:04.011919 (+ 83327us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:04.012067 (+   148us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:04.012219 (+   152us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:05.403152 (+1390933us) spinlock_profiling.cc:243] Waited 13.7 ms on lock 0x7b1800341080. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002799 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:05.414283 (+ 11131us) spinlock_profiling.cc:243] Waited 4.08 ms on lock 0x7b1800341080. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:05.464164 (+ 49881us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b1800341080. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:07.826292 (+2362128us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:07.826332 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:07.826436 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":176785,"prepare.queue_time_us":99944,"prepare.run_cpu_time_us":103,"prepare.run_wall_time_us":104,"raft.queue_time_us":195935,"raft.run_cpu_time_us":241,"raft.run_wall_time_us":31802,"spinlock_wait_cycles":438974336,"thread_start_us":284562,"threads_started":3,"wal-append.queue_time_us":136834,"wal-append.run_cpu_time_us":1855,"wal-append.run_wall_time_us":1069288}
I20260925 16:44:07.810218  8969 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:07.807934 12057 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:07.830729  9699 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:07.815990 12443 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:07.829958 12452 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.834451 12443 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.834722 12057 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:07.834824 12452 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.834933 12443 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:07.822091 12497 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.835836  9041 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:07.824266  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 762) took 2122 ms. Trace:
I20260925 16:44:07.832356  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:07.843959  9115 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:07.834525  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.846185  8969 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:07.847162  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.841679  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.842597  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:07.848395  9049 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:07.833559  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.850023  9047 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:07.850981  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.840502  9698 rpcz_store.cc:276] 0925 16:44:05.701596 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:05.701993 (+   397us) service_pool.cc:227] Handling call
0925 16:44:05.772700 (+ 70707us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:06.677883 (+905183us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:07.824038 (+1146155us) spinlock_profiling.cc:243] Waited 900 ms on lock 0x7b5400426154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:07.824213 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2070637824}
I20260925 16:44:07.827803 12503 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.826905 12510 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:07.814006 12531 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.853350  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.853925  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.860244  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.849705  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:07.856238  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.826737 12421 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.857604  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:07.863031  8969 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:07.863636  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.865216 12205 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:07.865983 12205 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.866130 12232 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.866402 12205 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:07.866919 12378 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.857172 12503 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.839825 12422 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:07.864560  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:07.868557  9701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1011) took 2165 ms (client timeout 2219 ms). Trace:
W20260925 16:44:07.882496  9701 rpcz_store.cc:269] 0925 16:44:05.702779 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:05.702925 (+   146us) service_pool.cc:227] Handling call
0925 16:44:07.868379 (+2165454us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b5400333454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:07.868492 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2390805248}
I20260925 16:44:07.882987  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.859715 12349 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260925 16:44:07.866004 12013 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:07.872228  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.886538  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.887425  9049 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:07.875238 12517 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:07.876332  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.869989  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.891530  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:07.884997  9115 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:07.895251  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.827024 12431 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.888967  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.901487 12349 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:07.901996 12349 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:07.905813 12349 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:07.894588 12374 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.546s	user 0.010s	sys 0.003s
I20260925 16:44:07.908015  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:07.907195  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.914084  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.918632  9115 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:07.914927  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:07.885499 12497 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:44:07.916903  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.922067  9698 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:07.923628  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:07.919812  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:07.835656 12057 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:07.918180  9701 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:07.930687  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:07.940253 12510 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:07.944253  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:07.946878  9115 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:07.953222 12510 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.960245  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.961681  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.907140 12276 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:07.965195  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.966019  9701 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:07.968324  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.898360 12507 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:07.973595  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:07.974166  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:07.974628  9695 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:07.963079 12493 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:07.964577 12444 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:07.960040 12517 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:07.987936  9043 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.022s	sys 0.029s
I20260925 16:44:07.966215 12057 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:07.990471  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.027s	sys 0.023s
I20260925 16:44:07.964505 12276 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:08.001873  9043 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.022s	sys 0.029s
W20260925 16:44:08.004070  8966 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.016s	sys 0.055s
W20260925 16:44:08.011677  8966 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.016s	sys 0.055s
W20260925 16:44:08.004911  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.027s	sys 0.023s
I20260925 16:44:07.892771 12408 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:08.012696  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 853006us
I20260925 16:44:07.988051 12497 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:08.002997 12444 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:07.996250 12493 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:08.028709  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:08.012024 12276 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:07.978513 12083 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.003274 12517 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:07.928925 12374 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.011909 12488 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:08.027333 12444 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:08.030766 12493 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:08.039491 12517 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:08.043572 12246 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.032258 12531 raft_consensus.cc:2741] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260925 16:44:08.047088 12408 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:08.061422 12246 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.065359  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2063) took 1227 ms. Trace:
I20260925 16:44:08.065842 12431 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:08.065886  8973 rpcz_store.cc:276] 0925 16:44:06.838544 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.838669 (+   125us) service_pool.cc:227] Handling call
0925 16:44:06.839006 (+   337us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:06.856941 (+ 17935us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:07.165638 (+308697us) log.cc:842] Serialized 14 byte log entry
0925 16:44:07.245869 (+ 80231us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:07.245939 (+    70us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:07.245997 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.065092 (+819095us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54002cbfd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:08.065152 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:08.065298 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":396062,"raft.queue_time_us":8698,"raft.run_wall_time_us":8925,"spinlock_wait_cycles":91848448,"thread_start_us":356384,"threads_started":2,"wal-append.queue_time_us":237734}
I20260925 16:44:08.044934 12488 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.089558  9117 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:08.090592  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.091130  9117 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:08.092988 12520 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.833s	user 0.005s	sys 0.008s
I20260925 16:44:08.105031 12393 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260925 16:44:08.092633 12366 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:08.109048 12144 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:08.117748 12409 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:08.118309 12409 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:08.116768  9115 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:08.126709  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:08.087927 12205 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.132028  9117 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:08.137585  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:08.128577 12393 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:08.139072 12419 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:08.121177 12520 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:08.142804  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1637) took 4119 ms (client timeout 1698 ms). Trace:
W20260925 16:44:08.144264  9050 rpcz_store.cc:269] 0925 16:44:04.023019 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.023628 (+   609us) service_pool.cc:227] Handling call
0925 16:44:08.142648 (+4119020us) spinlock_profiling.cc:243] Waited 124 ms on lock 0x7b54000d48d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:08.142743 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":286237952}
I20260925 16:44:08.145606  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:08.146322  9050 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
W20260925 16:44:08.140894  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.014s	sys 0.035s
W20260925 16:44:08.149591  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.014s	sys 0.035s
W20260925 16:44:08.152201  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 770419us
I20260925 16:44:08.157658  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:08.130013 12374 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.178905  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:08.140154 12393 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:08.143386 12083 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.140146 12522 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:08.189354  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.014s	sys 0.022s
W20260925 16:44:08.191633  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.796s	user 0.014s	sys 0.022s
I20260925 16:44:08.197351  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.198211  9123 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:08.183806 12534 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
W20260925 16:44:08.148869 12412 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 8 is higher.
I20260925 16:44:08.169363 12419 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:08.119299 12409 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:08.195154  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 799518us
I20260925 16:44:08.180609 12431 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:08.178182 12460 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:08.207794  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:08.180863 12531 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:08.209733  9120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2383) took 3882 ms (client timeout 1750 ms). Trace:
W20260925 16:44:08.175241  9089 connection.cc:232] RPC call timeout handler was delayed by -2.8506568929999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260925 16:44:08.211110  9120 rpcz_store.cc:269] 0925 16:44:04.326856 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.326998 (+   142us) service_pool.cc:227] Handling call
0925 16:44:08.209557 (+3882559us) spinlock_profiling.cc:243] Waited 344 ms on lock 0x7b540009e554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:08.209667 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":790601600}
W20260925 16:44:08.211428  9089 connection.cc:232] RPC call timeout handler was delayed by -2.519756961999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260925 16:44:08.169544 12447 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.183142 12370 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.308532  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:08.290751  9123 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:08.170100  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:08.294421  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.010s	sys 0.022s
W20260925 16:44:08.313690  9090 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.013s	sys 0.033s
I20260925 16:44:08.248193  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:08.313697  9089 connection.cc:232] RPC call timeout handler was delayed by -2.519756961999974s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260925 16:44:08.315668  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.010s	sys 0.023s
W20260925 16:44:08.252323  9046 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.011s	sys 0.019s
W20260925 16:44:08.254894  8971 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.056s	user 0.008s	sys 0.020s
W20260925 16:44:08.316143  9090 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.013s	sys 0.033s
W20260925 16:44:08.357260  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 871544us
W20260925 16:44:08.356827  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 186806us
I20260925 16:44:08.358453  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:08.317543  9089 connection.cc:232] RPC call timeout handler was delayed by -2.4963569619999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260925 16:44:08.360141  9089 connection.cc:232] RPC call timeout handler was delayed by -2.4963569619999362s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
W20260925 16:44:08.360526  9089 connection.cc:232] RPC call timeout handler was delayed by -2.3451569619999191s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
W20260925 16:44:08.360809  9089 connection.cc:232] RPC call timeout handler was delayed by -1.947356961999958s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23340000000000002s for a response
I20260925 16:44:08.362237  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:08.317953  9046 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.011s	sys 0.025s
W20260925 16:44:08.319610  8971 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.121s	user 0.010s	sys 0.022s
W20260925 16:44:08.320418  9116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.004s	sys 0.021s
I20260925 16:44:08.182426 12393 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:08.386747  9116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.588s	user 0.005s	sys 0.022s
I20260925 16:44:08.375062  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:08.309916 12222 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.314529 12097 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:44:08.379196  8973 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 5. Ops: []
I20260925 16:44:08.310294 12196 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:08.394037  8967 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:08.306138 12501 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.372685  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:08.407377  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:08.206599 12509 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.394642  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:08.417613 12406 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:08.418668 12406 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:08.420359 12165 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:08.420830 12165 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:08.421902 12165 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.423866 12205 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.426437 12276 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.373061 12512 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:08.321234 12521 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.010s	sys 0.016s
W20260925 16:44:08.341084 12391 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 4.671s	user 0.010s	sys 0.056s
W20260925 16:44:08.323114 12311 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.005s	sys 0.017s
W20260925 16:44:08.341171 12371 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.175s	user 0.018s	sys 0.033s
W20260925 16:44:08.315868 12526 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.814s	user 0.011s	sys 0.022s
I20260925 16:44:08.397609  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:08.398085  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:08.392946  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:08.456856  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:08.391759  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:08.458070  9693 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:08.397553 12538 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:08.413630  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:08.461493  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47971.1us
I20260925 16:44:08.430464  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:08.463140  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:08.419298  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 599) took 4981 ms (client timeout 1858 ms). Trace:
I20260925 16:44:08.386386 12257 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:44:08.401655 12452 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.006s
W20260925 16:44:08.406352 12504 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.566s	user 0.011s	sys 0.000s
I20260925 16:44:08.390725 12533 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:08.390858 12536 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:08.423516 12165 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:08.457639  9698 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
W20260925 16:44:08.459086  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 485240us
I20260925 16:44:08.428092 12222 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:08.444247 12521 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.010s	sys 0.017s
I20260925 16:44:08.519634 12370 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.521106  9699 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:08.521310 12276 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.521870 12536 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:08.522838 12536 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.471818 12509 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:08.523538 12370 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:08.523962 12509 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.524055 12370 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.525848 12509 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.526130 12370 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.474677 12539 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:08.476507 12392 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:08.527581 12392 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:08.472941 12452 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.527946 12392 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:08.529374 12452 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:08.529968  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:08.531152 12452 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:08.531526 12452 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:08.474854 12504 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.531967 12452 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:08.532624 12013 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.636s	user 0.011s	sys 0.000s
I20260925 16:44:08.533389 12504 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:08.294548 12508 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.912s	user 0.002s	sys 0.027s
W20260925 16:44:08.538329 12508 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.158s	user 0.002s	sys 0.029s
I20260925 16:44:08.427896 12419 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:08.463737  9045 rpcz_store.cc:269] 0925 16:44:03.437590 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.447787 (+ 10197us) service_pool.cc:227] Handling call
0925 16:44:08.419025 (+4971238us) spinlock_profiling.cc:243] Waited 676 ms on lock 0x7b54002a3d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:08.419175 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1555161984}
I20260925 16:44:08.464547  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.539958 12493 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.540750  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:08.541126  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:08.541850 12493 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.541800  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:08.542280  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:08.542568  9045 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:08.448606 12391 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 4.778s	user 0.011s	sys 0.058s
I20260925 16:44:08.466053  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:08.544598  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78645.6us
I20260925 16:44:08.545279  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.545333  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:08.545945  9124 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 5
I20260925 16:44:08.546327 12404 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:08.547464 12374 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:08.535089 12444 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.440011 12111 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:08.440419 12501 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:08.452252 12311 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.009s	sys 0.021s
W20260925 16:44:08.458379 12526 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.961s	user 0.012s	sys 0.024s
W20260925 16:44:08.458447 12371 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 3.292s	user 0.020s	sys 0.038s
W20260925 16:44:08.453263 12443 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.005s
I20260925 16:44:08.496608  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:08.562264  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.010s	sys 0.020s
W20260925 16:44:08.563074  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.010s	sys 0.020s
W20260925 16:44:08.531174 12503 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.642s	user 0.009s	sys 0.000s
I20260925 16:44:08.479960  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:08.471485 12205 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:08.465903 12257 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:08.465094 12538 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:08.210186 12460 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:08.513428  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2289) took 4391 ms. Trace:
W20260925 16:44:08.516254 12540 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:44:08.543864  9694 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:08.555289 12422 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:08.543421  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.628172  9123 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:08.629128  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:08.470140  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 78808.3us
W20260925 16:44:08.550072  9695 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.011s	sys 0.002s
I20260925 16:44:08.556005 12501 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:08.552627  9044 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:08.556013  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:08.632716  9120 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:08.557099  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:08.634099  9698 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:08.635038  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:08.635316  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:08.509388 12222 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:08.230342 12431 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.562076  9041 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:08.562191  9045 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:08.641924  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:08.642601  9045 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:08.230849 12531 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.577399 12257 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:08.570744  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:08.552186 12374 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:08.548398  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.640441 12236 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:08.583014 12205 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:08.552214  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.066s	sys 0.095s
W20260925 16:44:08.817863  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.067s	sys 0.095s
I20260925 16:44:08.563196 12462 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:08.637751  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:08.582888 11883 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:08.581037 12383 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 4.913s	user 0.017s	sys 0.030s
I20260925 16:44:08.653434 12504 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:08.653643  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:08.653725  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:08.643517  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:08.655398  9119 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:08.523643 12517 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.578306  9043 rpcz_store.cc:276] 0925 16:44:04.122053 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.354675 (+232622us) service_pool.cc:227] Handling call
0925 16:44:04.355058 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:04.356219 (+  1161us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:04.356368 (+   149us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:07.243793 (+2887425us) spinlock_profiling.cc:243] Waited 1.25 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:07.244137 (+   344us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.011758 (+767621us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:08.011797 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.012556 (+   759us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:08.513161 (+500605us) raft_consensus.cc:1671] finished
0925 16:44:08.513183 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:08.513373 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":14262,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":5314,"spinlock_wait_cycles":2876672,"thread_start_us":743782,"threads_started":1,"wal-append.queue_time_us":1216229}
I20260925 16:44:08.580374 12538 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:08.672163  9116 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:08.631873  9695 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.011s	sys 0.003s
I20260925 16:44:08.627372 12422 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:08.816562  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:08.818562  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:08.656124 12222 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:08.641764 12501 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:08.839092  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
W20260925 16:44:08.854269  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 216549us
I20260925 16:44:08.688550 12374 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:08.578554 12503 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:08.637529 12460 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:08.577988 12443 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.689330 12447 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:09.106045  9015 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.169s (SENT)
I20260925 16:44:08.957937  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.236464  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:09.236867  9045 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:08.951973  9693 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:09.238976  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:08.990091  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.241281  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.242027  9698 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
W20260925 16:44:09.154930  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.765s	user 0.021s	sys 0.021s
W20260925 16:44:09.244148  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.024s	sys 0.021s
I20260925 16:44:09.246389  9090 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:09.237479  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1654) took 1070 ms. Trace:
I20260925 16:44:09.252998  9045 rpcz_store.cc:276] 0925 16:44:08.166970 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.957610 (+790640us) service_pool.cc:227] Handling call
0925 16:44:09.237427 (+279817us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.255360  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.237439  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:09.266345  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2067) took 2423 ms (client timeout 1812 ms). Trace:
W20260925 16:44:09.266921  8968 rpcz_store.cc:269] 0925 16:44:06.843230 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.922963 (+ 79733us) service_pool.cc:227] Handling call
0925 16:44:09.237284 (+2314321us) spinlock_profiling.cc:243] Waited 7.33 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:09.266266 (+ 28982us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":16854272}
I20260925 16:44:09.244994  9050 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:09.274067  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1656) took 1086 ms. Trace:
I20260925 16:44:09.274434  9050 rpcz_store.cc:276] 0925 16:44:08.187844 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.662106 (+474262us) service_pool.cc:227] Handling call
0925 16:44:09.274013 (+611907us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.275457  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.277565  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2288) took 1373 ms. Trace:
I20260925 16:44:09.277575 12531 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.334005 12531 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:09.272181 12556 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
W20260925 16:44:09.347888  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62361.1us
I20260925 16:44:09.353636  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 616) took 3434 ms. Trace:
I20260925 16:44:09.345705  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2068) took 2502 ms. Trace:
I20260925 16:44:09.354122  9046 rpcz_store.cc:276] 0925 16:44:05.919197 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.581106 (+1661909us) service_pool.cc:227] Handling call
0925 16:44:07.581864 (+   758us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:07.582411 (+   547us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.582436 (+    25us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:07.582920 (+   484us) log.cc:842] Serialized 52 byte log entry
0925 16:44:08.365598 (+782678us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:08.365652 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.365740 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.353421 (+987681us) raft_consensus.cc:1671] finished
0925 16:44:09.353443 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.353576 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":77,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":63,"thread_start_us":782275,"threads_started":1,"wal-append.queue_time_us":991293}
I20260925 16:44:09.354978  8974 rpcz_store.cc:276] 0925 16:44:06.843883 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.172320 (+328437us) service_pool.cc:227] Handling call
0925 16:44:07.174452 (+  2132us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.337815 (+163363us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.337844 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:07.337886 (+    42us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:07.337916 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.345420 (+2007504us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54003c50d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:09.345476 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.345640 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":375259520}
I20260925 16:44:09.356164  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.356848  9046 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:09.360203  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:09.283529 12539 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.005s
I20260925 16:44:09.365355  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.366290  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1638) took 1263 ms. Trace:
I20260925 16:44:09.366663  8974 rpcz_store.cc:276] 0925 16:44:08.103989 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.365040 (+1261051us) service_pool.cc:227] Handling call
0925 16:44:09.366226 (+  1186us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:09.368438 12547 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.544s	user 0.000s	sys 0.001s
W20260925 16:44:09.369156 12257 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.714s	user 0.007s	sys 0.000s
I20260925 16:44:09.369596 12257 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.370332 12443 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:09.371299 12557 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260925 16:44:09.270545 12371 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:44:09.281814  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.383642  9045 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:09.384095  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1648) took 1279 ms. Trace:
I20260925 16:44:09.384477  9045 rpcz_store.cc:276] 0925 16:44:08.105103 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.281580 (+1176477us) service_pool.cc:227] Handling call
0925 16:44:09.384040 (+102460us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:08.819753 12380 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:09.281991  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.281217  9118 rpcz_store.cc:276] 0925 16:44:07.904060 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.904230 (+   170us) service_pool.cc:227] Handling call
0925 16:44:07.904634 (+   404us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:07.905052 (+   418us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.905091 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:07.959688 (+ 54597us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.472059 (+512371us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:08.472095 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.473117 (+  1022us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.277307 (+804190us) raft_consensus.cc:1671] finished
0925 16:44:09.277333 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.277500 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":106,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":483725,"threads_started":1,"wal-append.queue_time_us":1218382}
I20260925 16:44:08.820252 12236 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:09.388015  9043 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:09.367623  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.353686  9116 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:09.388592  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1652) took 1280 ms. Trace:
I20260925 16:44:09.284721  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.388928  8974 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:09.389040  9043 rpcz_store.cc:276] 0925 16:44:08.108269 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.281597 (+1173328us) service_pool.cc:227] Handling call
0925 16:44:09.388537 (+106940us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.389655  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1630) took 1288 ms. Trace:
I20260925 16:44:09.375348  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:08.707991 12467 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 3.540s	user 0.049s	sys 0.062s
I20260925 16:44:09.390117  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.390372  8974 rpcz_store.cc:276] 0925 16:44:08.101117 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.367362 (+1266245us) service_pool.cc:227] Handling call
0925 16:44:09.389606 (+ 22244us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:08.950616 12383 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 5.283s	user 0.018s	sys 0.031s
I20260925 16:44:09.385340  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.289135  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.371578 12257 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:09.110359 12452 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.002s
I20260925 16:44:09.389297  9698 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:09.276363  9050 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:09.391599  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:09.382143  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.009s	sys 0.034s
W20260925 16:44:09.421425  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.011s	user 0.010s	sys 0.034s
I20260925 16:44:09.421618  8974 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:09.421725  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.01151e+06us
I20260925 16:44:09.421983  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:09.397993  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 859) took 1647 ms. Trace:
I20260925 16:44:09.407536  9045 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:09.423255  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1655) took 1254 ms. Trace:
I20260925 16:44:09.408226  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.423659  9045 rpcz_store.cc:276] 0925 16:44:08.168811 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.385096 (+1216285us) service_pool.cc:227] Handling call
0925 16:44:09.423181 (+ 38085us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.424366  9043 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:09.305083 12536 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.002s	sys 0.008s
I20260925 16:44:08.990103 12477 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:08.950637 12468 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.273471 12422 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:09.422008  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1636) took 1319 ms. Trace:
I20260925 16:44:09.438308  8974 rpcz_store.cc:276] 0925 16:44:08.102736 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.391336 (+1288600us) service_pool.cc:227] Handling call
0925 16:44:09.421955 (+ 30619us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.422930  9701 rpcz_store.cc:276] 0925 16:44:07.751078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.977630 (+226552us) service_pool.cc:227] Handling call
0925 16:44:07.977996 (+   366us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:07.978246 (+   250us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.978281 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:07.978758 (+   477us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.460570 (+481812us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:08.460633 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.460750 (+   117us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.397744 (+936994us) raft_consensus.cc:1671] finished
0925 16:44:09.397770 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.397935 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":449993,"threads_started":1,"wal-append.queue_time_us":968961}
I20260925 16:44:09.439544  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:09.423816  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:09.429494 12536 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.904s	user 0.004s	sys 0.010s
W20260925 16:44:09.019462 12097 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.613s	user 0.008s	sys 0.000s
I20260925 16:44:09.358808 12408 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:09.424767  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:09.428975  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1634) took 1326 ms (client timeout 1718 ms). Trace:
W20260925 16:44:09.462018  8968 rpcz_store.cc:269] 0925 16:44:08.102190 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.280432 (+1178242us) service_pool.cc:227] Handling call
0925 16:44:09.428919 (+148487us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.463176  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:08.952368 12462 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:08.950562 11883 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.364780 12531 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:09.431540  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1657) took 1243 ms. Trace:
I20260925 16:44:09.474573  9043 rpcz_store.cc:276] 0925 16:44:08.188326 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.407988 (+1219662us) service_pool.cc:227] Handling call
0925 16:44:09.431474 (+ 23486us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.475639  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:09.476593  9043 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:09.477032  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1653) took 1360 ms. Trace:
I20260925 16:44:09.477398  9043 rpcz_store.cc:276] 0925 16:44:08.116845 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.475325 (+1358480us) service_pool.cc:227] Handling call
0925 16:44:09.476976 (+  1651us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.432789  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.432348 12452 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.387199 12493 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.383846 12444 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.384207 12539 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:09.426596 12467 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 4.259s	user 0.050s	sys 0.063s
I20260925 16:44:09.442082  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.440201  9701 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:09.419320  9046 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:09.445787  9050 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
W20260925 16:44:09.386945 12508 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.018s	sys 0.058s
I20260925 16:44:09.451205  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2291) took 1384 ms. Trace:
I20260925 16:44:09.474264 12408 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.358567 12205 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:09.465165  9045 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:09.481272 12282 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:08.950809 12504 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:09.468593  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.464166  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1633) took 1362 ms. Trace:
W20260925 16:44:09.473417  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.599s	user 0.005s	sys 0.064s
W20260925 16:44:09.558781  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.326s	user 0.005s	sys 0.064s
I20260925 16:44:09.558544  8968 rpcz_store.cc:276] 0925 16:44:08.101931 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.462891 (+1360960us) service_pool.cc:227] Handling call
0925 16:44:09.464098 (+  1207us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.559934  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.560000  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:09.561237  9124 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:09.479045  9698 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:09.562242  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.284654 12447 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.478407  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.569456  9043 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:09.478932  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2059) took 2653 ms. Trace:
W20260925 16:44:09.481976  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.004s	sys 0.032s
I20260925 16:44:09.437774 12477 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.578850  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.579491  9116 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:09.579588 12517 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:09.557802 12503 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:09.580405  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.580737 12503 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:09.581111  9116 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:09.581248 12503 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:09.581630 12452 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.581723 12503 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:09.582006  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.582590  9116 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:09.558508 12282 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:09.479341 12564 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260925 16:44:09.490926  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.583177 12282 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:09.547299 12508 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.954s	user 0.018s	sys 0.059s
I20260925 16:44:09.584123  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.585299  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.491173  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.586695 12222 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.562103 12408 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:09.479496 12393 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.964s	user 0.011s	sys 0.024s
I20260925 16:44:09.589588 12408 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:09.589687 12393 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.074s	user 0.012s	sys 0.024s
I20260925 16:44:09.491328  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:09.591106  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 99860.6us
W20260925 16:44:09.562414 12366 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.447s	user 0.006s	sys 0.004s
I20260925 16:44:09.591930  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:09.592389 12366 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:09.592904 12366 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:09.593657 12366 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.492762  9115 rpcz_store.cc:276] 0925 16:44:08.067069 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.123191 (+ 56122us) service_pool.cc:227] Handling call
0925 16:44:08.129186 (+  5995us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:08.131309 (+  2123us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:08.131338 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:08.131774 (+   436us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.496709 (+364935us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:08.496747 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.498264 (+  1517us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.450964 (+952700us) raft_consensus.cc:1671] finished
0925 16:44:09.450989 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.451141 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1803,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":8224,"thread_start_us":312914,"threads_started":1,"wal-append.queue_time_us":879257}
I20260925 16:44:09.453222 12431 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.595680  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:09.596575 12499 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.597105 12499 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:09.555236 12392 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.027s	user 0.007s	sys 0.002s
I20260925 16:44:09.601598 12392 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.602989  9124 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260925 16:44:09.603431 12392 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.474169  9049 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:09.563261  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:09.773752  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 210578us
W20260925 16:44:09.570571  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.004s	sys 0.032s
W20260925 16:44:09.776511  9693 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.538s	user 0.010s	sys 0.000s
I20260925 16:44:09.776919  9693 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:09.571913  9118 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:09.570176  8971 rpcz_store.cc:276] 0925 16:44:06.825714 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.825848 (+   134us) service_pool.cc:227] Handling call
0925 16:44:06.835021 (+  9173us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:07.068491 (+233470us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.068527 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:07.146742 (+ 78215us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.366377 (+1219635us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:08.366425 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.463868 (+1097443us) spinlock_profiling.cc:243] Waited 47.7 ms on lock 0x7b54003557d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:09.463941 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.463993 (+    52us) raft_consensus.cc:1671] finished
0925 16:44:09.464012 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.478867 (+ 14855us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":76483,"raft.run_cpu_time_us":172,"raft.run_wall_time_us":46348,"spinlock_wait_cycles":109638912,"thread_start_us":1352597,"threads_started":2,"wal-append.queue_time_us":1298272}
I20260925 16:44:09.572891  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.574016  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.573939 12447 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:09.574884  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2060) took 2740 ms (client timeout 2169 ms). Trace:
I20260925 16:44:09.731921  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:09.785386  8970 rpcz_store.cc:269] 0925 16:44:06.836645 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.836797 (+   152us) service_pool.cc:227] Handling call
0925 16:44:09.468420 (+2631623us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:09.574787 (+106367us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3680000}
I20260925 16:44:09.575574  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.457342 12536 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.483582  9047 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:09.584311  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 860) took 1673 ms. Trace:
W20260925 16:44:09.568462 12419 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.027s	user 0.012s	sys 0.050s
I20260925 16:44:09.609722  9045 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:09.801900  9124 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:09.800930  9695 rpcz_store.cc:276] 0925 16:44:07.911044 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.000379 (+ 89335us) service_pool.cc:227] Handling call
0925 16:44:08.000869 (+   490us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:08.001273 (+   404us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:08.001322 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:08.009561 (+  8239us) log.cc:842] Serialized 26 byte log entry
0925 16:44:09.243450 (+1233889us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:09.243499 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.243581 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.584138 (+340557us) raft_consensus.cc:1671] finished
0925 16:44:09.584156 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.584262 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6036,"raft.queue_time_us":1720,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7026,"thread_start_us":1211581,"threads_started":1,"wal-append.queue_time_us":799559}
I20260925 16:44:09.613672  9043 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:09.803005  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 865) took 1224 ms. Trace:
I20260925 16:44:09.803205  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2327) took 1174 ms. Trace:
I20260925 16:44:09.803500  9693 rpcz_store.cc:276] 0925 16:44:08.552657 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.583803 (+ 31146us) service_pool.cc:227] Handling call
0925 16:44:09.777416 (+1193613us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.803820  9043 rpcz_store.cc:276] 0925 16:44:08.628471 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.478125 (+849654us) service_pool.cc:227] Handling call
0925 16:44:09.803132 (+325007us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.805333  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:09.806291  9043 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:09.624804 12560 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260925 16:44:09.625979 12565 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:09.808965 12565 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:09.809026  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 844) took 2167 ms. Trace:
I20260925 16:44:09.809597 12565 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:09.809706  9696 rpcz_store.cc:276] 0925 16:44:07.641834 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.641951 (+   117us) service_pool.cc:227] Handling call
0925 16:44:07.642437 (+   486us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:07.654518 (+ 12081us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.654562 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:07.658273 (+  3711us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.061534 (+403261us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b18003385c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39
0925 16:44:08.550671 (+489137us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:08.550810 (+   139us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.550969 (+   159us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:09.808683 (+1257714us) raft_consensus.cc:1671] finished
0925 16:44:09.808709 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.808962 (+   253us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":13574,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":6989,"spinlock_wait_cycles":11589248,"thread_start_us":488431,"threads_started":1,"wal-append.queue_time_us":1505368}
I20260925 16:44:09.626497 12431 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.812227  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.553619 12467 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:09.493980  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1632) took 1392 ms (client timeout 1855 ms). Trace:
W20260925 16:44:09.813153  8974 rpcz_store.cc:269] 0925 16:44:08.101679 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.441773 (+1340094us) service_pool.cc:227] Handling call
0925 16:44:09.493914 (+ 52141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.813105 12467 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:09.814421  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.774729  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.779362  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:09.816183 12467 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:09.586910  9046 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260925 16:44:09.816604  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:09.817333  9698 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:09.817456  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2313) took 1985 ms. Trace:
I20260925 16:44:09.818008  9046 rpcz_store.cc:276] 0925 16:44:07.831990 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.586246 (+1754256us) service_pool.cc:227] Handling call
0925 16:44:09.586553 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:09.817111 (+230558us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.817349 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.772182  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2075) took 2865 ms. Trace:
I20260925 16:44:09.819854  8966 rpcz_store.cc:276] 0925 16:44:06.906402 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.218056 (+311654us) service_pool.cc:227] Handling call
0925 16:44:07.218455 (+   399us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.329027 (+110572us) raft_consensus.cc:1520] Early marking committed up to index 3
0925 16:44:08.012147 (+683120us) log.cc:842] Serialized 14 byte log entry
0925 16:44:08.818369 (+806222us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:08.818433 (+    64us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:08.818488 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.771856 (+953368us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b5400136854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:09.771919 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.772109 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":87257,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":107,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":130945,"spinlock_wait_cycles":253741440,"thread_start_us":1473292,"threads_started":2,"wal-append.queue_time_us":1004884}
I20260925 16:44:09.821539 12477 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.821662  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.822266 12477 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:09.822340 12419 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.281s	user 0.012s	sys 0.051s
I20260925 16:44:09.485371 12493 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.823086 12419 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:09.822778 12477 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.823498 12419 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:09.823894 12419 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:09.824631 12493 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.825155 12536 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.827051 12536 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.828557  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.555472 12028 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:09.815583  9115 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:09.830775  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:09.831302  9693 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:09.828972  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 607) took 5765 ms. Trace:
I20260925 16:44:09.821281 12501 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.570421 12504 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:09.824684 12447 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:09.828881  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:10.001796  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 172966us
I20260925 16:44:09.786672  8968 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:44:10.002797  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1631) took 1901 ms (client timeout 1985 ms). Trace:
W20260925 16:44:10.003227  8968 rpcz_store.cc:269] 0925 16:44:08.101413 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.575312 (+1473899us) service_pool.cc:227] Handling call
0925 16:44:10.002694 (+427382us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:09.829198  9118 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:09.481308 12531 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:09.812006 12431 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:09.829720  9696 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:09.631770 12541 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:09.835309  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.830600  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:09.808432  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2321) took 1962 ms. Trace:
I20260925 16:44:09.836036  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:09.773497 12013 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:09.833017  9048 rpcz_store.cc:276] 0925 16:44:04.063930 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.124556 (+ 60626us) service_pool.cc:227] Handling call
0925 16:44:04.124909 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:04.664662 (+539753us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:04.675543 (+ 10881us) log.cc:842] Serialized 14 byte log entry
0925 16:44:08.148841 (+3473298us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b180014a280. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b
0925 16:44:08.149032 (+   191us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:08.149081 (+    49us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:08.149125 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.828755 (+1679630us) spinlock_profiling.cc:243] Waited 539 ms on lock 0x7b54001bfdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:09.828806 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.828925 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2583,"prepare.queue_time_us":12603,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":34,"raft.queue_time_us":1201,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":9283,"spinlock_wait_cycles":1243506432,"thread_start_us":19833,"threads_started":1,"wal-append.queue_time_us":250354,"wal-append.run_cpu_time_us":23779,"wal-append.run_wall_time_us":1720165}
I20260925 16:44:09.706498  9701 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:09.860240  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 666) took 2576 ms. Trace:
I20260925 16:44:09.863461  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:09.832614 12392 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:44:09.912873  9014 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.006s	sys 0.045s
I20260925 16:44:09.929226  9693 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:09.943635  9116 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:09.986927  8974 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:09.773277 12456 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:10.013442  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:10.013870 12536 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:10.015067  9124 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:10.674355  9043 rpcz_store.cc:276] 0925 16:44:07.846540 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.806945 (+1960405us) service_pool.cc:227] Handling call
0925 16:44:09.807285 (+   340us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:09.807506 (+   221us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:09.807541 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:09.807596 (+    55us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:09.807639 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.808224 (+   585us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.808358 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.675531  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 782) took 1220 ms. Trace:
I20260925 16:44:10.675930  9695 rpcz_store.cc:276] 0925 16:44:09.455081 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.830288 (+375207us) service_pool.cc:227] Handling call
0925 16:44:10.675476 (+845188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.676868  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:10.677484  9695 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:10.118153 12566 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:10.674209  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 868) took 1300 ms. Trace:
I20260925 16:44:10.680101 12566 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:10.680792  9701 rpcz_store.cc:276] 0925 16:44:09.373797 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.439290 (+ 65493us) service_pool.cc:227] Handling call
0925 16:44:10.674150 (+1234860us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.681602  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:10.682653 12566 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:10.683725  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1641) took 2177 ms (client timeout 1762 ms). Trace:
I20260925 16:44:10.025856 12447 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:10.016036 12531 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:10.684589  8969 rpcz_store.cc:276] 0925 16:44:07.283364 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.890187 (+606823us) service_pool.cc:227] Handling call
0925 16:44:07.890596 (+   409us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.985781 (+ 95185us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:07.985811 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:07.985854 (+    43us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:07.985888 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:09.859991 (+1874103us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b54002fe754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:09.860039 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:09.860185 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":204546432}
I20260925 16:44:10.685936  8971 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
W20260925 16:44:10.379801  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.097s	user 0.004s	sys 0.015s
W20260925 16:44:10.686441  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1639) took 2501 ms (client timeout 2064 ms). Trace:
I20260925 16:44:10.586599 12501 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:10.686839  8971 rpcz_store.cc:269] 0925 16:44:08.184867 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.800993 (+1616126us) service_pool.cc:227] Handling call
0925 16:44:10.686377 (+885384us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.687280  9120 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
W20260925 16:44:10.312129 12374 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.971s	user 0.007s	sys 0.002s
I20260925 16:44:10.687882  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:10.070353  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.796s	user 0.013s	sys 0.031s
I20260925 16:44:10.689102 12456 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:10.176242 12467 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:10.690222 12467 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:10.691318 12456 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:10.031482  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:10.692101 12467 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:10.692139 12444 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.870s	user 0.000s	sys 0.009s
W20260925 16:44:10.692600  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 661168us
W20260925 16:44:10.285827  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.985s	user 0.009s	sys 0.035s
W20260925 16:44:10.694372  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.393s	user 0.016s	sys 0.048s
W20260925 16:44:10.694448  9665 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.195:32851 timed out after 2.556s (SENT) [suppressed 23 similar messages]
I20260925 16:44:10.695995 12372 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:10.696484 12372 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:10.696825 12372 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:10.698256 12465 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:10.698896 12488 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:10.698807 12465 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:10.687798 12541 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:10.700604 12541 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:10.701790  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:44:10.703794  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.468s	user 0.013s	sys 0.042s
W20260925 16:44:10.704255  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.46848e+06us
I20260925 16:44:10.705900 12372 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:10.706812  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:10.707325 12424 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:10.686653  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.404s	user 0.004s	sys 0.022s
I20260925 16:44:10.708391 12372 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:10.695531 12013 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:10.709656  9014 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.528s	user 0.015s	sys 0.045s
W20260925 16:44:10.754097  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.57266e+06us
W20260925 16:44:10.755867  9014 connection.cc:232] RPC call timeout handler was delayed by -1.6218797129999984s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
W20260925 16:44:10.756394  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.195s	user 0.004s	sys 0.022s
W20260925 16:44:10.756793  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.195s	user 0.004s	sys 0.022s
W20260925 16:44:10.661821  9666 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.222s	user 0.017s	sys 0.005s
W20260925 16:44:10.026639 12422 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.000s
W20260925 16:44:10.761760  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.20044e+06us
I20260925 16:44:10.711028  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:10.712095  9016 connection.cc:232] RPC call timeout handler was delayed by -1.3013764150000497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17110000000000003s for a response
I20260925 16:44:10.762825  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:10.712492 12373 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:10.692970 12444 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.000s	sys 0.009s
I20260925 16:44:10.714241 12431 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:10.714843  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:10.740738 12538 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.409s	user 0.005s	sys 0.015s
W20260925 16:44:10.754804 12366 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.010s	sys 0.014s
W20260925 16:44:10.715420  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.478s	user 0.000s	sys 0.023s
W20260925 16:44:10.715665 12508 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.131s	user 0.006s	sys 0.016s
I20260925 16:44:10.715420 12462 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:10.716686  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:10.675961  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:10.736131 12222 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:10.723989 12377 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:10.724035  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:10.724442 12558 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.000s	sys 0.021s
W20260925 16:44:10.771401 12570 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.516s	user 0.000s	sys 0.001s
W20260925 16:44:10.774183 12508 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.190s	user 0.006s	sys 0.016s
I20260925 16:44:10.726118 12412 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:10.726239 12242 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:10.728360  8968 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:10.688874  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2095) took 2152 ms. Trace:
W20260925 16:44:10.997334  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2092) took 2461 ms (client timeout 2313 ms). Trace:
I20260925 16:44:10.997275  8971 rpcz_store.cc:276] 0925 16:44:08.536885 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.687641 (+2150756us) service_pool.cc:227] Handling call
0925 16:44:10.688813 (+  1172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.730379 12424 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:44:11.000169 12424 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:11.000535 12242 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:11.000988 12242 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:11.001062 12424 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.001857 12242 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.003089 12242 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:10.732154  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1013) took 5026 ms. Trace:
I20260925 16:44:11.003831  9697 rpcz_store.cc:276] 0925 16:44:05.705310 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:05.705456 (+   146us) service_pool.cc:227] Handling call
0925 16:44:05.753286 (+ 47830us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:06.579386 (+826100us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:06.579435 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:06.579495 (+    60us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:06.579543 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:10.731968 (+4152425us) spinlock_profiling.cc:243] Waited 826 ms on lock 0x7b540062f2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:10.732005 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:10.732108 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1899328768}
I20260925 16:44:11.005390  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:11.006291  9697 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10.
I20260925 16:44:11.006750  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1031) took 1185 ms. Trace:
I20260925 16:44:11.007097  9697 rpcz_store.cc:276] 0925 16:44:09.821307 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.005075 (+1183768us) service_pool.cc:227] Handling call
0925 16:44:11.006693 (+  1618us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.732326  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 842) took 3106 ms. Trace:
W20260925 16:44:10.732666  9089 connection.cc:232] RPC call timeout handler was delayed by -1.099865144999967s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1718s for a response
W20260925 16:44:11.008282  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0872651449999466s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260925 16:44:11.008085  9702 rpcz_store.cc:276] 0925 16:44:07.626038 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.626210 (+   172us) service_pool.cc:227] Handling call
0925 16:44:07.650263 (+ 24053us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:07.707543 (+ 57280us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:10.732131 (+3024588us) spinlock_profiling.cc:243] Waited 24.4 ms on lock 0x7b54006badd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:10.732267 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":56152320}
W20260925 16:44:11.009395  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0314651449998564s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
I20260925 16:44:11.009594  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:10.733399  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:10.732206  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 700) took 4107 ms. Trace:
I20260925 16:44:10.737861  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:11.010872 12367 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:11.011097  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1637) took 2908 ms (client timeout 3154 ms). Trace:
W20260925 16:44:11.011713 12282 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.428s	user 0.009s	sys 0.008s
W20260925 16:44:11.011063  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 277715us
I20260925 16:44:11.012240 12467 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.012470 11883 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.012782 12467 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.013604 12380 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:11.014070 12380 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:11.014894 12380 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:10.756908  9014 connection.cc:232] RPC call timeout handler was delayed by -1.5867797129999417s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17500000000000002s for a response
W20260925 16:44:11.015861  9014 connection.cc:232] RPC call timeout handler was delayed by -1.571479712999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
W20260925 16:44:10.751797  9698 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.934s	user 0.009s	sys 0.000s
I20260925 16:44:11.016343  9698 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:10.993194  9122 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.016862  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 786) took 1238 ms. Trace:
W20260925 16:44:10.763043  9016 connection.cc:232] RPC call timeout handler was delayed by -1.1564764150000428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
I20260925 16:44:11.017373  9122 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:11.017344  9698 rpcz_store.cc:276] 0925 16:44:09.778149 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.816330 (+ 38181us) service_pool.cc:227] Handling call
0925 16:44:11.016787 (+1200457us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.017782  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:11.018656  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:11.019447  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 867) took 1648 ms. Trace:
W20260925 16:44:10.684213  8970 rpcz_store.cc:269] 0925 16:44:08.506283 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.786197 (+1279914us) service_pool.cc:227] Handling call
0925 16:44:10.683641 (+897444us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.025019  9698 rpcz_store.cc:276] 0925 16:44:09.371064 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.018414 (+1647350us) service_pool.cc:227] Handling call
0925 16:44:11.019386 (+   972us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.772475  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:10.772502  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.535s	user 0.000s	sys 0.023s
W20260925 16:44:11.027541  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.92135e+06us
W20260925 16:44:10.771021  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.341s	user 0.009s	sys 0.018s
W20260925 16:44:10.760995 12393 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.935s	user 0.003s	sys 0.038s
I20260925 16:44:10.684692 12447 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:10.718854 12388 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:10.776865  9043 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:10.780781  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:10.724630  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.162165  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2341) took 1331 ms. Trace:
I20260925 16:44:11.162374  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1022) took 1386 ms. Trace:
I20260925 16:44:11.162686  9043 rpcz_store.cc:276] 0925 16:44:09.831100 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.675682 (+844582us) service_pool.cc:227] Handling call
0925 16:44:11.162090 (+486408us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.162880  9701 rpcz_store.cc:276] 0925 16:44:09.776360 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.681467 (+905107us) service_pool.cc:227] Handling call
0925 16:44:11.162321 (+480854us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1643008}
W20260925 16:44:10.771689 12460 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.422s	user 0.006s	sys 0.004s
W20260925 16:44:10.784296  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1640) took 2574 ms (client timeout 2113 ms). Trace:
W20260925 16:44:11.166847  8974 rpcz_store.cc:269] 0925 16:44:08.210447 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.814152 (+1603705us) service_pool.cc:227] Handling call
0925 16:44:10.784116 (+969964us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400137254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:10.784237 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":394540288}
W20260925 16:44:10.785229  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2336) took 1410 ms (client timeout 1804 ms). Trace:
W20260925 16:44:11.167914  9045 rpcz_store.cc:269] 0925 16:44:09.374782 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.424516 (+ 49734us) service_pool.cc:227] Handling call
0925 16:44:10.785085 (+1360569us) spinlock_profiling.cc:243] Waited 3.31 ms on lock 0x7b54000a78d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:10.785179 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7602944}
I20260925 16:44:10.781047  9696 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:11.168993  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 787) took 1340 ms. Trace:
I20260925 16:44:11.169377  9696 rpcz_store.cc:276] 0925 16:44:09.828551 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.683143 (+854592us) service_pool.cc:227] Handling call
0925 16:44:11.168928 (+485785us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3456}
W20260925 16:44:10.724825  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2083) took 3281 ms (client timeout 2169 ms). Trace:
W20260925 16:44:11.170290  8967 rpcz_store.cc:269] 0925 16:44:07.443803 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.730478 (+286675us) service_pool.cc:227] Handling call
0925 16:44:10.724649 (+2994171us) spinlock_profiling.cc:243] Waited 652 ms on lock 0x7b54001c3c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:10.724766 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1499622784}
W20260925 16:44:10.775187 12028 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.938s	user 0.007s	sys 0.002s
W20260925 16:44:10.775281 12366 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.157s	user 0.010s	sys 0.014s
I20260925 16:44:10.861068  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:10.784379 12558 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.301s	user 0.000s	sys 0.022s
I20260925 16:44:10.769708 12422 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:10.786856 12377 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:10.769488 12373 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:10.915169 12412 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:10.776436 12446 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:10.783824 12222 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:10.770282 12561 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.139s	user 0.000s	sys 0.027s
W20260925 16:44:10.997761  8968 rpcz_store.cc:269] 0925 16:44:08.536012 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.004042 (+1468030us) service_pool.cc:227] Handling call
0925 16:44:10.997271 (+993229us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.010475  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1023) took 1233 ms. Trace:
W20260925 16:44:11.011580  8969 rpcz_store.cc:269] 0925 16:44:08.103038 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.737567 (+2634529us) service_pool.cc:227] Handling call
0925 16:44:11.011047 (+273480us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.013041  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:11.210234  9702 rpcz_store.cc:276] 0925 16:44:09.776642 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.009273 (+1232631us) service_pool.cc:227] Handling call
0925 16:44:11.010397 (+  1124us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:10.757566  9666 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.318s	user 0.017s	sys 0.005s
W20260925 16:44:11.211021  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.77174e+06us
W20260925 16:44:11.211447  9666 connection.cc:232] RPC call timeout handler was delayed by -2.048169641999948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30110000000000003s for a response
W20260925 16:44:11.212185  9666 connection.cc:232] RPC call timeout handler was delayed by -1.5358870269999443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
W20260925 16:44:11.212553  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4745107879998613s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22610000000000002s for a response
W20260925 16:44:11.212877  9666 connection.cc:232] RPC call timeout handler was delayed by -1.2513107879999552s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2509s for a response
W20260925 16:44:11.213209  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1875695039998391s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1775s for a response
W20260925 16:44:11.213532  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1847107880000749s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.25830000000000003s for a response
W20260925 16:44:11.213804  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0849695039999006s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1889s for a response
I20260925 16:44:11.213763  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:10.776274 12497 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:10.774668 12538 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:10.775564 12205 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.197s	user 0.009s	sys 0.018s
I20260925 16:44:10.774482 12587 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:11.016942  9014 connection.cc:232] RPC call timeout handler was delayed by -1.3878797130000748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260925 16:44:11.225123  9014 connection.cc:232] RPC call timeout handler was delayed by -1.3878797130000748s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260925 16:44:11.225705  9014 connection.cc:232] RPC call timeout handler was delayed by -1.2710420720000002s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18720000000000003s for a response
W20260925 16:44:11.226094  9014 connection.cc:232] RPC call timeout handler was delayed by -1.2465797130000738s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21280000000000002s for a response
W20260925 16:44:11.226441  9014 connection.cc:232] RPC call timeout handler was delayed by -1.201579713000001s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2178s for a response
I20260925 16:44:11.227069  8968 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:10.689538 12392 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:10.712230  9118 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:11.229578  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1623) took 3175 ms. Trace:
I20260925 16:44:10.764251  9124 raft_consensus.cc:2396] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260925 16:44:10.770236  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55484.2us
I20260925 16:44:11.020059 12467 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.020419 12516 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:11.020876 12462 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:11.021600  9695 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:11.236486  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:11.236774  9695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1032) took 1415 ms (client timeout 1872 ms). Trace:
I20260925 16:44:11.237119  9702 raft_consensus.cc:2362] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:44:11.010774  9121 rpcz_store.cc:276] 0925 16:44:06.624453 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.624603 (+   150us) service_pool.cc:227] Handling call
0925 16:44:06.624986 (+   383us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:06.631977 (+  6991us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:06.632016 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:06.632064 (+    48us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:06.632099 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:10.732006 (+4099907us) spinlock_profiling.cc:243] Waited 6.73 ms on lock 0x7b54001c8754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:10.732051 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:10.732159 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":15472384}
I20260925 16:44:11.023586  8971 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:11.238255  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2087) took 3793 ms. Trace:
I20260925 16:44:11.011582 12367 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.010504  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:11.025645  8970 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:11.238584  8971 rpcz_store.cc:276] 0925 16:44:07.444447 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.023142 (+3578695us) service_pool.cc:227] Handling call
0925 16:44:11.023427 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.238046 (+214619us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.238211 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:10.688642 12374 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:11.031886  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.602s	user 0.009s	sys 0.018s
I20260925 16:44:11.034724  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:11.240995  9698 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:11.240945  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:11.040067  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:11.026904  9116 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
W20260925 16:44:11.026116  9016 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 2.219s (SENT)
I20260925 16:44:11.164295  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:11.173321  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:11.232153  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:11.242547  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:11.176569  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.190079  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:11.094354 12565 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.284s	user 0.006s	sys 0.007s
I20260925 16:44:11.194252  8967 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 7. Ops: []
W20260925 16:44:11.227164 12205 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.649s	user 0.010s	sys 0.024s
W20260925 16:44:11.166195 12419 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.342s	user 0.010s	sys 0.002s
I20260925 16:44:11.204074  9042 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:11.175894 12477 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.227030  9048 raft_consensus.cc:2354] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:11.193265 12460 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.267208  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:11.267645  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:11.206609 12473 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.012255 12282 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.254040 12516 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:11.237326  9695 rpcz_store.cc:269] 0925 16:44:09.821597 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.676657 (+855060us) service_pool.cc:227] Handling call
0925 16:44:11.236715 (+560058us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.279199 12516 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.212945 12446 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.279758  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.280746  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:11.281188 12446 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:11.282445  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2319) took 3448 ms (client timeout 2149 ms). Trace:
I20260925 16:44:11.248991 12512 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:11.243857  9701 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:44:11.289229  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 764) took 5482 ms (client timeout 1794 ms). Trace:
I20260925 16:44:11.289464  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1027) took 1511 ms. Trace:
I20260925 16:44:11.289955  9701 rpcz_store.cc:276] 0925 16:44:09.777746 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.189788 (+1412042us) service_pool.cc:227] Handling call
0925 16:44:11.289411 (+ 99623us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.290925  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:11.161096 12393 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.003s	sys 0.038s
W20260925 16:44:11.247146  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 236742us
I20260925 16:44:11.251672  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:11.223423 12348 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.255626  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:11.247871  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 207862us
I20260925 16:44:11.258786 12467 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:44:11.212886 12561 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.583s	user 0.000s	sys 0.037s
I20260925 16:44:11.232120 12342 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.307796  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.308583  9701 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:11.229174 12497 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.231508 12392 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:11.271010  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.312391  9702 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:11.279203 12282 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.273602 12453 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:11.274125 12454 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.274577 12374 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.299665 12577 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:11.275903 12377 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.300637 12368 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:11.245596 12462 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:11.277534 12422 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.015995 12431 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.245611 11709 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:11.266827 11883 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:11.223243 12222 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.325887 11883 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:11.326277 11883 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:11.268132 12580 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260925 16:44:11.327253 12222 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.303815 12348 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.321867 12462 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:11.329048 12348 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.238823 12366 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:11.329734 12366 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:11.330545 12366 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:11.332139 12588 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
I20260925 16:44:11.301326 12509 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:11.274509 12373 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.252607 12565 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.332988 12509 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:11.333484 12509 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:11.333380 12431 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.277156 12412 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.334699 12565 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.268559 12419 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:11.336512 12563 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.924s	user 0.011s	sys 0.088s
I20260925 16:44:11.336794 12419 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.315421 12453 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:11.310822 12467 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:11.318332 12454 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.339001 12467 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.324880 12538 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.332401 12368 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.343999 12577 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:11.354776 12577 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.313674 12512 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:11.293254 12473 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.360167 12499 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.376422 12494 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Stepping down as leader of term 6
W20260925 16:44:11.400586 12503 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.818s	user 0.016s	sys 0.001s
W20260925 16:44:11.222625  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 209639us
I20260925 16:44:11.505096 12503 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.250805  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:11.508845  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 257973us
I20260925 16:44:11.509903 12473 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.510659 12473 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.229947  8968 rpcz_store.cc:276] 0925 16:44:08.053725 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.223680 (+3169955us) service_pool.cc:227] Handling call
0925 16:44:11.223991 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.229355 (+  5364us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.229524 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.512615  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2292) took 3395 ms. Trace:
I20260925 16:44:11.239488  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2089) took 3794 ms. Trace:
I20260925 16:44:11.516028  8970 rpcz_store.cc:276] 0925 16:44:07.444725 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.025183 (+3580458us) service_pool.cc:227] Handling call
0925 16:44:11.025485 (+   302us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.239264 (+213779us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.239439 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:11.516793 12599 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.102s	user 0.003s	sys 0.005s
I20260925 16:44:11.518016  8970 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:11.518121  8971 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:11.518895  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1627) took 3461 ms. Trace:
I20260925 16:44:11.252506  8974 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: [2.3-5.6]
W20260925 16:44:11.248428  9014 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Timed out: RequestConsensusVote RPC to 127.7.158.195:32851 timed out after 1.750s (SENT)
W20260925 16:44:11.524184  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 275626us
W20260925 16:44:11.243850  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 217739us
I20260925 16:44:11.529433 12509 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:11.460216  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 598975us
I20260925 16:44:11.532079 12509 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.533123  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:11.534803  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 649) took 7294 ms (client timeout 1900 ms). Trace:
I20260925 16:44:11.462131  8966 raft_consensus.cc:2354] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8.
W20260925 16:44:11.538108  8966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2090) took 3165 ms (client timeout 2435 ms). Trace:
W20260925 16:44:11.538586  8966 rpcz_store.cc:269] 0925 16:44:08.372300 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.821436 (+1449136us) service_pool.cc:227] Handling call
0925 16:44:11.537822 (+1716386us) spinlock_profiling.cc:243] Waited 1.64 s on lock 0x7b54003e8d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.537995 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3768982400}
I20260925 16:44:11.513093  9117 rpcz_store.cc:276] 0925 16:44:08.116787 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.137582 (+ 20795us) service_pool.cc:227] Handling call
0925 16:44:08.137886 (+   304us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:08.138296 (+   410us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:08.138338 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:08.141707 (+  3369us) log.cc:842] Serialized 26 byte log entry
0925 16:44:08.577206 (+435499us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:08.577242 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:08.577323 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:11.335878 (+2758555us) spinlock_profiling.cc:243] Waited 28.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:11.511820 (+175942us) raft_consensus.cc:1671] finished
0925 16:44:11.511870 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:11.512331 (+   461us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":130,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":80,"spinlock_wait_cycles":65709952,"thread_start_us":398854,"threads_started":1,"wal-append.queue_time_us":1184081}
I20260925 16:44:11.540817  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:11.541982  9117 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:11.246012  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1622) took 3192 ms. Trace:
I20260925 16:44:11.462431  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2322) took 3558 ms. Trace:
W20260925 16:44:11.282835  9047 rpcz_store.cc:269] 0925 16:44:07.833672 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.850691 (+ 17019us) service_pool.cc:227] Handling call
0925 16:44:11.282252 (+3431561us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54000bf4d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.282369 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3753060736}
I20260925 16:44:11.276324  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:11.547590  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1635) took 7526 ms (client timeout 1724 ms). Trace:
I20260925 16:44:11.548398  9043 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:11.549290  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2316) took 3716 ms (client timeout 2907 ms). Trace:
W20260925 16:44:11.549702  9049 rpcz_store.cc:269] 0925 16:44:07.832714 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.897332 (+ 64618us) service_pool.cc:227] Handling call
0925 16:44:11.548964 (+3651632us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400252bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.549107 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3575274880}
I20260925 16:44:11.249508  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:11.552452  9045 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:11.292306  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:11.554183  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 261826us
I20260925 16:44:11.292224  9121 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:11.303331  9122 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 3. (term mismatch)
I20260925 16:44:11.557900  9122 pending_rounds.cc:76] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 2
I20260925 16:44:11.558320  9122 pending_rounds.cc:97] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 5.3
I20260925 16:44:11.558660  9122 raft_consensus.cc:2866] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:11.559988  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2376) took 8222 ms. Trace:
I20260925 16:44:11.560452  9122 rpcz_store.cc:276] 0925 16:44:03.337473 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.337688 (+   215us) service_pool.cc:227] Handling call
0925 16:44:03.363042 (+ 25354us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:10.863273 (+7500231us) spinlock_profiling.cc:243] Waited 3.27 s on lock 0x7b540026c3a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bec0951 00007f719bf21321 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612
0925 16:44:11.559500 (+696227us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.559901 (+   401us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7525289216}
W20260925 16:44:11.561527 12389 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260925 16:44:11.544370  9046 rpcz_store.cc:276] 0925 16:44:07.903547 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.818895 (+1915348us) service_pool.cc:227] Handling call
0925 16:44:09.819275 (+   380us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:09.829461 (+ 10186us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:09.829491 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:10.674443 (+844952us) log.cc:842] Serialized 26 byte log entry
0925 16:44:10.771995 (+ 97552us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:10.772023 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:10.772073 (+    50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:11.461681 (+689608us) raft_consensus.cc:1671] finished
0925 16:44:11.461744 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:11.462168 (+   424us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2481,"raft.run_cpu_time_us":71,"raft.run_wall_time_us":72,"thread_start_us":97200,"threads_started":1,"wal-append.queue_time_us":184868}
W20260925 16:44:11.548082  9044 rpcz_store.cc:269] 0925 16:44:04.020884 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.020979 (+    95us) service_pool.cc:227] Handling call
0925 16:44:11.547184 (+7526205us) spinlock_profiling.cc:243] Waited 4.47 s on lock 0x7b5400126954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.547356 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10274419456}
I20260925 16:44:11.562316  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:11.551544  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2314) took 3719 ms (client timeout 2362 ms). Trace:
I20260925 16:44:11.563035 12389 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:44:11.289611  9694 rpcz_store.cc:269] 0925 16:44:05.788334 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:05.797490 (+  9156us) service_pool.cc:227] Handling call
0925 16:44:11.270670 (+5473180us) spinlock_profiling.cc:243] Waited 1.96 s on lock 0x7b5400436054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.270774 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4513300864}
I20260925 16:44:11.555398  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:11.552790  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2315) took 3720 ms (client timeout 2450 ms). Trace:
W20260925 16:44:11.564179  9042 rpcz_store.cc:269] 0925 16:44:07.832440 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.860392 (+ 27952us) service_pool.cc:227] Handling call
0925 16:44:11.552410 (+3692018us) spinlock_profiling.cc:243] Waited 3.32 s on lock 0x7b54002625d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.552594 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7630568832}
I20260925 16:44:11.565135  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.565507  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2086) took 4087 ms. Trace:
I20260925 16:44:11.300597  9695 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:11.590596  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.267835  9697 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 7
I20260925 16:44:11.257754  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.309811  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1025) took 1532 ms. Trace:
I20260925 16:44:11.315478  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.605150  9698 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:11.605897  9702 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:11.606438  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.607225  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:11.400672 12541 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.700s	user 0.012s	sys 0.005s
I20260925 16:44:11.401430 12494 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:11.485219 12431 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.492944 12367 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:11.399930 12504 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.537s	user 0.011s	sys 0.003s
I20260925 16:44:11.405839 12512 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:11.495116  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 222635us
I20260925 16:44:11.496621 12460 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.496960 12454 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.499325 12497 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.500047 12447 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.501947 12368 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.311945 12342 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.519289  8970 rpcz_store.cc:276] 0925 16:44:08.057668 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.517155 (+3459487us) service_pool.cc:227] Handling call
0925 16:44:11.517689 (+   534us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.518580 (+   891us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.518780 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.544066  8967 rpcz_store.cc:276] 0925 16:44:08.053422 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.193683 (+3140261us) service_pool.cc:227] Handling call
0925 16:44:11.194058 (+   375us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.245777 (+ 51719us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.245960 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:11.559631  9119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2294) took 3416 ms (client timeout 2192 ms). Trace:
I20260925 16:44:11.511521 12473 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.299341  9696 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:11.544080  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:11.561173  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 704) took 2000 ms. Trace:
I20260925 16:44:11.566025  9694 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:11.580108 12405 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.580590  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1621) took 3527 ms. Trace:
I20260925 16:44:11.581403 12577 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:11.563639 12389 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:11.563056  9041 rpcz_store.cc:269] 0925 16:44:07.832209 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:07.860035 (+ 27826us) service_pool.cc:227] Handling call
0925 16:44:11.551147 (+3691112us) spinlock_profiling.cc:243] Waited 701 ms on lock 0x7b54000a87d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.551352 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1612492672}
I20260925 16:44:11.582466 12236 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.584717  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:11.586992  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:11.587978 12393 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election won for term 5
I20260925 16:44:11.588879 12503 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:11.558521  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:11.535320  8975 rpcz_store.cc:269] 0925 16:44:04.239919 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:04.248229 (+  8310us) service_pool.cc:227] Handling call
0925 16:44:11.534353 (+7286124us) spinlock_profiling.cc:243] Waited 5.27 s on lock 0x7b54001b3fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.534542 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12121347840}
I20260925 16:44:11.607623  9698 raft_consensus.cc:2396] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:44:11.592890  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1026) took 1814 ms. Trace:
W20260925 16:44:11.592168  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46428.3us
I20260925 16:44:11.645350  8966 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 8. Ops: []
I20260925 16:44:11.596454  9043 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
W20260925 16:44:11.592262  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 59439.8us
I20260925 16:44:11.651198  8974 rpcz_store.cc:276] 0925 16:44:08.053092 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.194824 (+3141732us) service_pool.cc:227] Handling call
0925 16:44:11.238282 (+ 43458us) raft_consensus.cc:1457] Updating replica for 4 ops
0925 16:44:11.520235 (+281953us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.580378 (+ 60143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.565975  8973 rpcz_store.cc:276] 0925 16:44:07.444295 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.068957 (+624662us) service_pool.cc:227] Handling call
0925 16:44:08.070818 (+  1861us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:08.399390 (+328572us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.531302 (+3131912us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54001b3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:11.531630 (+   328us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":708667264}
I20260925 16:44:11.604815  9701 rpcz_store.cc:276] 0925 16:44:09.777193 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.307532 (+1530339us) service_pool.cc:227] Handling call
0925 16:44:11.309762 (+  2230us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.653680  9117 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:11.653002  9121 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:44:11.633236  9699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 773) took 3269 ms (client timeout 2744 ms). Trace:
I20260925 16:44:11.630726  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1625) took 3574 ms. Trace:
I20260925 16:44:11.632169  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 719) took 1615 ms. Trace:
I20260925 16:44:11.648788  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:11.608021  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 323590us
I20260925 16:44:11.651760  9695 rpcz_store.cc:276] 0925 16:44:09.777473 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.590062 (+1812589us) service_pool.cc:227] Handling call
0925 16:44:11.591625 (+  1563us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.644259  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:11.608125  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 297471us
I20260925 16:44:11.641855  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:11.650437  9123 rpcz_store.cc:276] 0925 16:44:09.560140 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.560267 (+   127us) service_pool.cc:227] Handling call
0925 16:44:11.559423 (+1999156us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.559856 (+   433us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:11.559910 (+    54us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:11.559977 (+    67us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:11.560024 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.560124 (+   100us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:11.560873 (+   749us) spinlock_profiling.cc:243] Waited 2 s on lock 0x7b54001c9b50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.561015 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4596709632}
W20260925 16:44:11.656213  9699 rpcz_store.cc:269] 0925 16:44:08.363388 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.365860 (+  2472us) service_pool.cc:227] Handling call
0925 16:44:11.632793 (+3266933us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54006eda54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.633014 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":144341760}
I20260925 16:44:11.645284  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:11.644218  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:11.612592 12583 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.385s	user 0.000s	sys 0.002s
I20260925 16:44:11.665172  8974 raft_consensus.cc:1203] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Deduplicated request from leader. Original: 4.2->[5.3-5.3]   Dedup: 5.3->[]
I20260925 16:44:11.665840  8974 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260925 16:44:11.666510  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1635) took 3564 ms. Trace:
I20260925 16:44:11.666373 12541 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:11.666904  8974 rpcz_store.cc:276] 0925 16:44:08.102487 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.664451 (+3561964us) service_pool.cc:227] Handling call
0925 16:44:11.665003 (+   552us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:11.666271 (+  1268us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.666437 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.667605 12473 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:11.674711  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2342) took 1843 ms. Trace:
I20260925 16:44:11.668589  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:11.675135  9047 rpcz_store.cc:276] 0925 16:44:09.831386 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.643640 (+1812254us) service_pool.cc:227] Handling call
0925 16:44:11.674632 (+ 30992us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.647522 12409 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:11.622942 12548 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 2.236s	user 0.010s	sys 0.027s
I20260925 16:44:11.665647  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:11.672693  9699 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:11.657220  9118 rpcz_store.cc:276] 0925 16:44:10.016560 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.680052 (+663492us) service_pool.cc:227] Handling call
0925 16:44:10.680314 (+   262us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.232799 (+552485us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.631632 (+398833us) spinlock_profiling.cc:243] Waited 31.7 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:11.631976 (+   344us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":72987904}
I20260925 16:44:11.670537  8973 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260925 16:44:11.669380  9046 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:11.607965 12380 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:12.015342  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2399) took 1285 ms. Trace:
W20260925 16:44:11.995297 12587 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.004s	sys 0.021s
I20260925 16:44:11.781931  9042 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:11.671059  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 866) took 2312 ms. Trace:
I20260925 16:44:11.639232 12013 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:11.668980  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:11.706261  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44942.8us
I20260925 16:44:11.785462  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:11.671100  9702 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:12.052234  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1037) took 1341 ms. Trace:
I20260925 16:44:11.796953  9120 raft_consensus.cc:2396] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260925 16:44:11.957332  8974 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:11.780800  9693 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:12.044658  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2094) took 3508 ms. Trace:
I20260925 16:44:11.849431  9116 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:11.675993  9048 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 8
W20260925 16:44:11.650822  9119 rpcz_store.cc:269] 0925 16:44:08.142692 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:08.308247 (+165555us) service_pool.cc:227] Handling call
0925 16:44:11.559183 (+3250936us) spinlock_profiling.cc:243] Waited 343 ms on lock 0x7b54001c9b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:11.559382 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":788320000}
I20260925 16:44:11.678020  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1628) took 3604 ms. Trace:
I20260925 16:44:12.049216  9124 rpcz_store.cc:276] 0925 16:44:10.729607 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.250388 (+520781us) service_pool.cc:227] Handling call
0925 16:44:12.014890 (+764502us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54001a04d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.015146 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":991466752}
I20260925 16:44:11.967077  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:11.895502  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.052529  9702 rpcz_store.cc:276] 0925 16:44:10.711094 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.606853 (+895759us) service_pool.cc:227] Handling call
0925 16:44:12.052185 (+445332us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.656558  8971 rpcz_store.cc:276] 0925 16:44:08.056395 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.239667 (+3183272us) service_pool.cc:227] Handling call
0925 16:44:11.460198 (+220531us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.518689 (+ 58491us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.630441 (+111752us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b5400135e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:11.630660 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":132219648}
I20260925 16:44:12.050369  9694 rpcz_store.cc:276] 0925 16:44:09.358496 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.669210 (+2310714us) service_pool.cc:227] Handling call
0925 16:44:11.670195 (+   985us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.670646 (+   451us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:11.670670 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:11.670732 (+    62us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:11.670795 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.670868 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:11.670981 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.781613  8970 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 8. Ops: []
I20260925 16:44:11.784964  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2093) took 3248 ms. Trace:
I20260925 16:44:12.054977  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 781) took 2614 ms. Trace:
I20260925 16:44:11.782524  9122 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
W20260925 16:44:11.781471 12388 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.595s	user 0.005s	sys 0.013s
W20260925 16:44:11.995105 12592 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.696s	user 0.004s	sys 0.000s
I20260925 16:44:11.947319  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.059981  9123 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:12.060353  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 407204us
I20260925 16:44:12.060534  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.061501  9047 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:12.062026  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 628) took 1030 ms. Trace:
I20260925 16:44:12.062354  9047 rpcz_store.cc:276] 0925 16:44:11.031422 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.676007 (+644585us) service_pool.cc:227] Handling call
0925 16:44:12.061963 (+385956us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.062867  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:12.063748  9697 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:12.063380  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:12.064350  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1033) took 2242 ms (client timeout 2929 ms). Trace:
I20260925 16:44:12.065068  9047 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.051646  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.065760  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 626) took 1034 ms. Trace:
W20260925 16:44:11.783684  8940 connection.cc:232] RPC call timeout handler was delayed by -1.5573350389997813s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23620000000000002s for a response
I20260925 16:44:11.653862 12389 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:12.064215 12597 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260925 16:44:12.066057  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 625) took 1035 ms. Trace:
I20260925 16:44:12.060504  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2419) took 1045 ms. Trace:
I20260925 16:44:12.054685  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2091) took 3519 ms. Trace:
I20260925 16:44:12.070070  8973 rpcz_store.cc:276] 0925 16:44:08.535651 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.669663 (+3134012us) service_pool.cc:227] Handling call
0925 16:44:11.670160 (+   497us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.051238 (+381078us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.054633 (+  3395us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.050648  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1034) took 2223 ms. Trace:
I20260925 16:44:12.044086  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.081394  9044 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:12.053385  8975 rpcz_store.cc:276] 0925 16:44:08.536604 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.671283 (+3134679us) service_pool.cc:227] Handling call
0925 16:44:11.673133 (+  1850us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.044322 (+371189us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.044354 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.044396 (+    42us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:12.044423 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.044497 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.044607 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":119090,"raft.queue_time_us":372625}
I20260925 16:44:12.082924  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 627) took 1051 ms. Trace:
I20260925 16:44:12.079855  9695 rpcz_store.cc:276] 0925 16:44:09.822095 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.783515 (+1961420us) service_pool.cc:227] Handling call
0925 16:44:11.836145 (+ 52630us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.044913 (+208768us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.044947 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.044994 (+    47us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:12.045022 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.045106 (+    84us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.045232 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":675,"raft.queue_time_us":201116,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":13781}
I20260925 16:44:12.088764 12460 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:11.994684 12342 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:12.089382 12460 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.091073  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.092095 12460 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:12.093503  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2416) took 1079 ms. Trace:
I20260925 16:44:12.096122  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.094856  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.054157  8966 rpcz_store.cc:276] 0925 16:44:08.058002 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.573561 (+3515559us) service_pool.cc:227] Handling call
0925 16:44:11.644915 (+ 71354us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.657271 (+ 12356us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.662045 (+  4774us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.084151  9044 rpcz_store.cc:276] 0925 16:44:11.031139 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.965717 (+934578us) service_pool.cc:227] Handling call
0925 16:44:12.082783 (+117066us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":32128}
I20260925 16:44:12.101680  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.100440  9695 raft_consensus.cc:2362] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10. Re-sending same reply.
I20260925 16:44:12.068040  9049 rpcz_store.cc:276] 0925 16:44:11.030591 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.014139 (+983548us) service_pool.cc:227] Handling call
0925 16:44:12.065977 (+ 51838us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4608}
I20260925 16:44:12.107489  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.055794  8967 rpcz_store.cc:276] 0925 16:44:08.536301 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.677439 (+3141138us) service_pool.cc:227] Handling call
0925 16:44:11.784291 (+106852us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:11.784616 (+   325us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:11.784647 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:11.784703 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:11.784742 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.784801 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:11.784910 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:11.669085 12541 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.058461  9698 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 8. Ops: []
W20260925 16:44:12.058440  9696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1024) took 2281 ms (client timeout 2859 ms). Trace:
W20260925 16:44:12.064777  9697 rpcz_store.cc:269] 0925 16:44:09.821838 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.256799 (+1434961us) service_pool.cc:227] Handling call
0925 16:44:12.064281 (+807482us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.064869 12558 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:11.787199  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.112461  9117 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:12.112977  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 725) took 1082 ms. Trace:
I20260925 16:44:12.108397  9045 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:12.069738  9123 rpcz_store.cc:276] 0925 16:44:11.015107 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.678687 (+663580us) service_pool.cc:227] Handling call
0925 16:44:12.060440 (+381753us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.111382 12558 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:12.066176  9047 rpcz_store.cc:276] 0925 16:44:11.030860 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.063050 (+1032190us) service_pool.cc:227] Handling call
0925 16:44:12.065683 (+  2633us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.076187  9693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1030) took 2255 ms (client timeout 2219 ms). Trace:
I20260925 16:44:12.056275  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2411) took 1273 ms. Trace:
I20260925 16:44:12.055869  9699 rpcz_store.cc:276] 0925 16:44:09.436123 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.671935 (+2235812us) service_pool.cc:227] Handling call
0925 16:44:11.672372 (+   437us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.046737 (+374365us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.050495 (+  3758us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.113898  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 869) took 2554 ms. Trace:
I20260925 16:44:12.113296  9117 rpcz_store.cc:276] 0925 16:44:11.030642 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.676495 (+645853us) service_pool.cc:227] Handling call
0925 16:44:12.112922 (+436427us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.067884 12597 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:12.129465 12597 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:12.125815  9698 rpcz_store.cc:276] 0925 16:44:09.562191 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.792729 (+2230538us) service_pool.cc:227] Handling call
0925 16:44:12.058225 (+265496us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.112032 (+ 53807us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.113709 (+  1677us) spinlock_profiling.cc:243] Waited 265 ms on lock 0x7b540073da50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.113843 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":609580800}
W20260925 16:44:12.129794  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 67088.1us
I20260925 16:44:12.129808  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.131278  9117 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.130781 12597 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.053402  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2096) took 3476 ms. Trace:
I20260925 16:44:12.114897  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.132359 12242 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:12.134658 12597 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.135162  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2318) took 4301 ms. Trace:
I20260925 16:44:12.131718  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 722) took 1101 ms. Trace:
I20260925 16:44:12.136147  9117 rpcz_store.cc:276] 0925 16:44:11.029985 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.129398 (+1099413us) service_pool.cc:227] Handling call
0925 16:44:12.131632 (+  2234us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.133054  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 567502us
I20260925 16:44:12.137072  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.137769  9117 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:12.135560  9050 rpcz_store.cc:276] 0925 16:44:07.833212 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.587660 (+1754448us) service_pool.cc:227] Handling call
0925 16:44:09.587986 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:09.588252 (+   266us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:09.588288 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:11.556231 (+1967943us) spinlock_profiling.cc:243] Waited 99.3 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:11.556828 (+   597us) log.cc:842] Serialized 26 byte log entry
0925 16:44:11.661237 (+104409us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:11.749874 (+ 88637us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:11.787848 (+ 37974us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:12.134750 (+346902us) raft_consensus.cc:1671] finished
0925 16:44:12.134770 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.134989 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":228410240,"thread_start_us":45982,"threads_started":1,"wal-append.queue_time_us":575237}
I20260925 16:44:12.133028  9047 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260925 16:44:11.792069 12392 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.140563  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1642) took 4082 ms. Trace:
I20260925 16:44:12.140972  9047 rpcz_store.cc:276] 0925 16:44:08.058452 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.132170 (+4073718us) service_pool.cc:227] Handling call
0925 16:44:12.132683 (+   513us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.140289 (+  7606us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.140489 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.141487  9115 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.142318 12392 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.115658 12558 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.144331  9046 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:12.144893  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 629) took 1113 ms. Trace:
I20260925 16:44:12.145330  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.145766  9047 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:12.145483  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 178572us
W20260925 16:44:12.146449  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 481068us
I20260925 16:44:12.137785  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.049904  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1665) took 1329 ms. Trace:
I20260925 16:44:12.126263  9122 rpcz_store.cc:276] 0925 16:44:10.782752 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.563378 (+780626us) service_pool.cc:227] Handling call
0925 16:44:12.056226 (+492848us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.109287  9049 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:12.094616  9119 rpcz_store.cc:276] 0925 16:44:11.014304 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.078339 (+1064035us) service_pool.cc:227] Handling call
0925 16:44:12.093279 (+ 14940us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.110942  9696 rpcz_store.cc:269] 0925 16:44:09.776924 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.197102 (+1420178us) service_pool.cc:227] Handling call
0925 16:44:12.054573 (+857471us) spinlock_profiling.cc:243] Waited 84.6 ms on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.058250 (+  3677us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":194556672}
I20260925 16:44:12.139663  9050 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 12. Ops: []
I20260925 16:44:12.145280  9046 rpcz_store.cc:276] 0925 16:44:11.034705 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.648370 (+613665us) service_pool.cc:227] Handling call
0925 16:44:12.144842 (+496472us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.145989  8974 rpcz_store.cc:276] 0925 16:44:08.577747 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.801022 (+3223275us) service_pool.cc:227] Handling call
0925 16:44:11.912375 (+111353us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.053200 (+140825us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.053356 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.114302  9116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2409) took 1343 ms (client timeout 1750 ms). Trace:
I20260925 16:44:12.149600  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2097) took 3471 ms. Trace:
I20260925 16:44:11.629848 11883 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.150014  8971 rpcz_store.cc:276] 0925 16:44:08.654984 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.072257 (+3417273us) service_pool.cc:227] Handling call
0925 16:44:12.106091 (+ 33834us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.113370 (+  7279us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.113709 (+   339us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.114221 (+   512us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:12.114452 (+   231us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.115044 (+   592us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.126363 (+ 11319us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.105141  9044 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:12.147563  9042 rpcz_store.cc:276] 0925 16:44:10.720529 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.644876 (+924347us) service_pool.cc:227] Handling call
0925 16:44:12.049853 (+404977us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.070796  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1629) took 3972 ms. Trace:
W20260925 16:44:12.051232 12587 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.009s	sys 0.025s
I20260925 16:44:11.792220 12393 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:12.152180  8970 rpcz_store.cc:276] 0925 16:44:08.098671 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.676354 (+3577683us) service_pool.cc:227] Handling call
0925 16:44:11.781392 (+105038us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.070076 (+288684us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.070651 (+   575us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.126204  9693 rpcz_store.cc:269] 0925 16:44:09.820983 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:10.712366 (+891383us) service_pool.cc:227] Handling call
0925 16:44:11.641481 (+929115us) spinlock_profiling.cc:243] Waited 26.4 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:12.075965 (+434484us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":60667136}
I20260925 16:44:12.153752  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1641) took 4096 ms. Trace:
I20260925 16:44:12.154510  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:12.116173  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 630) took 1060 ms. Trace:
I20260925 16:44:12.155270  9049 rpcz_store.cc:276] 0925 16:44:08.052700 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.107633 (+4054933us) service_pool.cc:227] Handling call
0925 16:44:12.108779 (+  1146us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.148908 (+ 40129us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.149098 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.124504 12610 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260925 16:44:12.151582  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1649) took 4046 ms. Trace:
I20260925 16:44:12.155917  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1640) took 4100 ms. Trace:
W20260925 16:44:12.149936  9116 rpcz_store.cc:269] 0925 16:44:10.771335 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.255336 (+484001us) service_pool.cc:227] Handling call
0925 16:44:12.112764 (+857428us) spinlock_profiling.cc:243] Waited 375 ms on lock 0x7b540009e554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.113882 (+  1118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":863408896}
I20260925 16:44:12.155529  9045 rpcz_store.cc:276] 0925 16:44:11.055400 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.895082 (+839682us) service_pool.cc:227] Handling call
0925 16:44:12.115413 (+220331us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.159268  9050 rpcz_store.cc:276] 0925 16:44:08.105401 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.139070 (+4033669us) service_pool.cc:227] Handling call
0925 16:44:12.139400 (+   330us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.151325 (+ 11925us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.151515 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.157821  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.162351  9043 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:12.163779  9701 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:12.160315  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.160370  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2400) took 1425 ms. Trace:
I20260925 16:44:12.164973  9124 rpcz_store.cc:276] 0925 16:44:10.729891 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.144985 (+1415094us) service_pool.cc:227] Handling call
0925 16:44:12.155027 (+ 10042us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.166196  9041 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.159667  9044 rpcz_store.cc:276] 0925 16:44:08.051896 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.102755 (+4050859us) service_pool.cc:227] Handling call
0925 16:44:12.104113 (+  1358us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.151877 (+ 47764us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.152058 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.172710  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.156172  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.174072  9123 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:12.160931  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 724) took 1125 ms. Trace:
I20260925 16:44:12.154326 12380 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:12.178843  9117 rpcz_store.cc:276] 0925 16:44:11.030429 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.136765 (+1106336us) service_pool.cc:227] Handling call
0925 16:44:12.155450 (+ 18685us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.164968 12392 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:12.165977 12489 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:12.181826 12541 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:12.181877  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.183279  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2401) took 1447 ms. Trace:
I20260925 16:44:12.183568  9044 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:11.784674 12504 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.185137 12388 raft_consensus.cc:2741] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260925 16:44:12.185120 12389 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.188277 12489 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.195420  9700 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:12.180365  9121 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:12.186136  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:11.799628 12462 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.175619  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.188194  9120 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:12.188560  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.189560  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.190616  9123 rpcz_store.cc:276] 0925 16:44:10.730186 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.114581 (+1384395us) service_pool.cc:227] Handling call
0925 16:44:12.177769 (+ 63188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.190907  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 631) took 1004 ms. Trace:
I20260925 16:44:12.191955  9049 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:11.668949 12405 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:11.790704 12453 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.201228  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.187558 12392 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:12.188462  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.194008  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.185428  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:12.159789 12587 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:12.198297  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.206702  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.207016  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.199659  9044 rpcz_store.cc:276] 0925 16:44:11.186980 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.177353 (+990373us) service_pool.cc:227] Handling call
0925 16:44:12.183297 (+  5944us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.190709 (+  7412us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.190864 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.199875  9049 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:12.192493 12541 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:12.208920  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44459.3us
I20260925 16:44:12.209337  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2413) took 1309 ms. Trace:
I20260925 16:44:12.209568  9119 rpcz_store.cc:276] 0925 16:44:10.899921 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.151850 (+1251929us) service_pool.cc:227] Handling call
0925 16:44:12.209298 (+ 57448us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.210722  8969 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 7. Ops: []
I20260925 16:44:11.670827 12494 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.213387  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2402) took 1480 ms. Trace:
I20260925 16:44:12.206161 12392 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:12.215970  9118 rpcz_store.cc:276] 0925 16:44:10.730500 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.128751 (+1398251us) service_pool.cc:227] Handling call
0925 16:44:12.210877 (+ 82126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.218217  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2328) took 3557 ms. Trace:
I20260925 16:44:12.214306  9050 raft_consensus.cc:1203] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Deduplicated request from leader. Original: 4.2->[5.3-5.3]   Dedup: 5.3->[]
I20260925 16:44:12.214923  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:12.218662  9046 rpcz_store.cc:276] 0925 16:44:08.658464 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.160811 (+3502347us) service_pool.cc:227] Handling call
0925 16:44:12.191847 (+ 31036us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.211605 (+ 19758us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.211640 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.211667 (+    27us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:12.211684 (+    17us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.211787 (+   103us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.215648 (+  3861us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.216312  9117 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.219863  9050 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260925 16:44:12.210963 12541 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.222713  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.210901 12389 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:12.218106 12368 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:12.225049 12368 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:12.225183  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.225400  9695 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:12.225466 12368 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:12.225917  9699 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.215557 12388 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:12.230824  9042 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:12.231505  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.227041  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:12.231334  9042 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:12.224009 12013 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:12.233289  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.235275  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.230827  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.236553  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.237883  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 632) took 1033 ms. Trace:
I20260925 16:44:12.238197  9041 rpcz_store.cc:276] 0925 16:44:11.204757 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.179459 (+974702us) service_pool.cc:227] Handling call
0925 16:44:12.215278 (+ 35819us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.237420 (+ 22142us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.237454 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.237598 (+   144us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:12.237641 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.237710 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.237821 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.239755  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.240166  9048 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:12.239755  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.241766  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.240577  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2403) took 1509 ms. Trace:
I20260925 16:44:12.243408  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.243458  9045 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 8. Ops: []
I20260925 16:44:12.244736  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.245772  9697 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:12.242650  9121 rpcz_store.cc:276] 0925 16:44:10.730783 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.218409 (+1487626us) service_pool.cc:227] Handling call
0925 16:44:12.240500 (+ 22091us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.246541  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67920.3us
I20260925 16:44:12.239404 12013 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:12.243597  9124 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:12.250355  9044 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:12.239241 12494 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.248874  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.255774  9119 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:44:12.252305  9699 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:12.257318  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:12.258155  9046 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.256806  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.259140  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.259407  9121 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 10
W20260925 16:44:12.260027  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49734.5us
I20260925 16:44:12.243185 12467 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:12.214409 12393 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.264756  9048 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.266480 12462 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.266209 12380 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.267176 12389 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:12.267588  9123 raft_consensus.cc:2396] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:44:12.268462  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.269104  9123 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:12.245785 11883 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:12.263455  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:12.270663  9118 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:12.269871  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:12.275882  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90561.4us
I20260925 16:44:12.274616  9043 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:12.276840  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 635) took 1017 ms. Trace:
I20260925 16:44:12.277163  9043 rpcz_store.cc:276] 0925 16:44:11.259499 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.785117 (+525618us) service_pool.cc:227] Handling call
0925 16:44:12.276790 (+491673us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.280180  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.284761  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 779) took 2884 ms. Trace:
I20260925 16:44:12.274245  9049 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.276194 12462 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:12.285260  9701 rpcz_store.cc:276] 0925 16:44:09.400148 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.059153 (+2659005us) service_pool.cc:227] Handling call
0925 16:44:12.059668 (+   515us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.174549 (+114881us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.281612 (+107063us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54006ae0d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:12.284695 (+  3083us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":235398400}
I20260925 16:44:12.275509 12504 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.301733  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1659) took 2892 ms. Trace:
I20260925 16:44:12.272761 12013 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.302114  9045 rpcz_store.cc:276] 0925 16:44:09.406243 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.179755 (+2773512us) service_pool.cc:227] Handling call
0925 16:44:12.241674 (+ 61919us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.246809 (+  5135us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.298684 (+ 51875us) spinlock_profiling.cc:243] Waited 46.7 ms on lock 0x7b54001707d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.298837 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":107354880}
I20260925 16:44:12.352783  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.329574  9042 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.294267 12462 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:12.361768  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.365680  9694 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.361789  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.366750  9043 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:12.367035  9043 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:12.301225 12597 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:12.368185  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.369375  9701 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.368381  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 634) took 1139 ms. Trace:
I20260925 16:44:12.376259  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.372686  9041 rpcz_store.cc:276] 0925 16:44:11.229125 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.288350 (+1059225us) service_pool.cc:227] Handling call
0925 16:44:12.354140 (+ 65790us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.368082 (+ 13942us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.368122 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.368158 (+    36us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:12.368187 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.368240 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.368336 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.358783 12453 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:12.378868  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.362361 12462 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:12.380254  9118 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:12.383307  9049 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:12.386270  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2405) took 1655 ms. Trace:
I20260925 16:44:12.386720  9118 rpcz_store.cc:276] 0925 16:44:10.731338 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.276994 (+1545656us) service_pool.cc:227] Handling call
0925 16:44:12.386198 (+109204us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.388724  9697 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:12.373219 12597 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:12.386024 12525 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:12.394209  9042 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.389505  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:12.392573  9702 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.393115  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 633) took 1178 ms. Trace:
I20260925 16:44:12.395401  9048 rpcz_store.cc:276] 0925 16:44:11.214653 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.273928 (+1059275us) service_pool.cc:227] Handling call
0925 16:44:12.303919 (+ 29991us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.390351 (+ 86432us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.390380 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.392851 (+  2471us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:12.392889 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.392958 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.393062 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7417,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":6289}
I20260925 16:44:12.396631  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.404883  9117 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:12.394958 12597 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:12.359345 12587 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:12.409706  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 226923us
I20260925 16:44:12.408468  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1624) took 4349 ms. Trace:
W20260925 16:44:12.410151  8940 connection.cc:232] RPC call timeout handler was delayed by -1.4781350389998806s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24500000000000002s for a response
I20260925 16:44:12.410476  8969 rpcz_store.cc:276] 0925 16:44:08.056066 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.224803 (+3168737us) service_pool.cc:227] Handling call
0925 16:44:11.225114 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.218109 (+992995us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.398990 (+180881us) spinlock_profiling.cc:243] Waited 980 ms on lock 0x7b54002ff654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:12.405372 (+  6382us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2255111936}
I20260925 16:44:12.411473  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.415952  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.418545  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1660) took 3012 ms. Trace:
I20260925 16:44:12.418784  9050 rpcz_store.cc:276] 0925 16:44:09.406565 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.163053 (+2756488us) service_pool.cc:227] Handling call
0925 16:44:12.202731 (+ 39678us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.221965 (+ 19234us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.418371 (+196406us) spinlock_profiling.cc:243] Waited 4.53 ms on lock 0x7b54001219a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2db42 00007f719bf29f26 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:12.418501 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":10409856}
I20260925 16:44:12.413739  9043 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.414908  9118 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:12.424748  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2324) took 3841 ms. Trace:
I20260925 16:44:12.425181  9047 rpcz_store.cc:276] 0925 16:44:08.575454 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.141745 (+3566291us) service_pool.cc:227] Handling call
0925 16:44:12.145573 (+  3828us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.146295 (+   722us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.416748 (+270453us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b540008d750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.416869 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8025856}
I20260925 16:44:12.401412 12525 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.427744  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.425423  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.433686  9048 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 4 FOLLOWER]: Advancing to term 5
W20260925 16:44:12.434860  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73725.5us
I20260925 16:44:12.438021  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2421) took 1422 ms. Trace:
I20260925 16:44:12.438355  9117 rpcz_store.cc:276] 0925 16:44:11.015586 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.415552 (+1399966us) service_pool.cc:227] Handling call
0925 16:44:12.437975 (+ 22423us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.437278  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 714) took 2605 ms (client timeout 1856 ms). Trace:
I20260925 16:44:12.440311  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:12.439335 12612 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260925 16:44:12.443203  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.417749 12558 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:12.447764  9695 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10.
W20260925 16:44:12.439841  9115 rpcz_store.cc:269] 0925 16:44:09.832289 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:09.833020 (+   731us) service_pool.cc:227] Handling call
0925 16:44:12.425771 (+2592751us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b540007dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.437208 (+ 11437us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3170058112}
I20260925 16:44:12.448410  9043 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:12.420368 12489 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:12.449239  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.449514  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.449681  9697 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:12.450001  9118 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:12.451516  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.435379 12409 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:12.462754  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.462752  9695 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:12.460093  8940 connection.cc:232] RPC call timeout handler was delayed by -1.0668350389998977s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2907s for a response
I20260925 16:44:12.464881  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.467094  9042 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:12.467809  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2333) took 3320 ms. Trace:
I20260925 16:44:12.468796  9042 rpcz_store.cc:276] 0925 16:44:09.147634 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.166299 (+3018665us) service_pool.cc:227] Handling call
0925 16:44:12.215378 (+ 49079us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.467529 (+252151us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.467757 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.465953  9700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1003) took 8682 ms (client timeout 1659 ms). Trace:
I20260925 16:44:12.474362  9119 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:12.478937  9120 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:12.478756 12368 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.481834  9120 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 3. Current term is 5. Ops: []
I20260925 16:44:12.482511  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2407) took 1724 ms. Trace:
I20260925 16:44:12.482780  9120 rpcz_store.cc:276] 0925 16:44:10.758119 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.479522 (+1721403us) service_pool.cc:227] Handling call
0925 16:44:12.481644 (+  2122us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.482288 (+   644us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.482443 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:12.471045  9700 rpcz_store.cc:269] 0925 16:44:03.783008 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.783119 (+   111us) service_pool.cc:227] Handling call
0925 16:44:12.464181 (+8681062us) spinlock_profiling.cc:243] Waited 8.38 s on lock 0x7b5400691754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.465844 (+  1663us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":19278031616}
I20260925 16:44:12.486270  9702 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:12.487558  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.488473  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:12.489135  9042 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:12.489382  9115 raft_consensus.cc:2396] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 8 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260925 16:44:12.465744 12409 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.460518 12453 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260925 16:44:12.452243 12342 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260925 16:44:12.500869  9118 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:12.502112 12368 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.487363 12489 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:12.504441  9120 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:12.503762 12541 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:12.508061  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61335.4us
I20260925 16:44:12.512089  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.513011  9700 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:12.517385  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:12.496483 12504 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:12.472882 12558 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.524257  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2408) took 1743 ms. Trace:
I20260925 16:44:12.531103  9120 rpcz_store.cc:276] 0925 16:44:10.768480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.483646 (+1715166us) service_pool.cc:227] Handling call
0925 16:44:12.483991 (+   345us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.511453 (+ 27462us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.511710 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.524714  9695 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:12.518842  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2394) took 1782 ms. Trace:
I20260925 16:44:12.532337  9118 rpcz_store.cc:276] 0925 16:44:10.728082 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.453540 (+1725458us) service_pool.cc:227] Handling call
0925 16:44:12.487256 (+ 33716us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.510345 (+ 23089us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.510532 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.528201  9042 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:12.503579 12389 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:12.486931 12392 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.555850  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:12.509912 12489 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:12.565385  9116 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.564469  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.567492  9120 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.568858  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:12.569257  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46831us
I20260925 16:44:12.569588  9118 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.570749  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.566382  9119 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:12.571363  9050 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:12.571759  9050 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:12.525475 12504 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:12.574463  9123 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.572940  9115 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260925 16:44:12.580231  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2398) took 1842 ms. Trace:
I20260925 16:44:12.580693  9119 rpcz_store.cc:276] 0925 16:44:10.729289 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.474942 (+1745653us) service_pool.cc:227] Handling call
0925 16:44:12.503295 (+ 28353us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.571372 (+ 68077us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.571576 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14208}
I20260925 16:44:12.564282 12489 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:12.576773  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:12.583099  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2410) took 1805 ms. Trace:
W20260925 16:44:12.585716  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 180938us
I20260925 16:44:12.586057  9115 rpcz_store.cc:276] 0925 16:44:10.777959 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.492173 (+1714214us) service_pool.cc:227] Handling call
0925 16:44:12.564168 (+ 71995us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.582846 (+ 18678us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.583046 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.587404  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.587759  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2406) took 1856 ms. Trace:
I20260925 16:44:12.588171  9116 rpcz_store.cc:276] 0925 16:44:10.731650 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.164472 (+1432822us) service_pool.cc:227] Handling call
0925 16:44:12.587585 (+423113us) spinlock_profiling.cc:243] Waited 354 ms on lock 0x7b54001efad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.587690 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":813512960}
I20260925 16:44:12.590615  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.591168 12388 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:12.591276  9695 raft_consensus.cc:2362] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:44:12.592866  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:12.594429  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.596517  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.597404  9119 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.568189 12618 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:12.598526  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1033) took 1055 ms. Trace:
I20260925 16:44:12.580992 12504 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.604791  9120 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:12.558822 12368 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
W20260925 16:44:12.610626  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 255775us
I20260925 16:44:12.607285  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.609812  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.606156  9046 rpcz_store.cc:276] 0925 16:44:11.530385 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.403944 (+873559us) service_pool.cc:227] Handling call
0925 16:44:12.585437 (+181493us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.612768  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.591792 12388 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:12.615773  9119 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:12.610662  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.617843  9115 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:12.618594  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.622731  9118 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:12.623457 12388 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.606623 12342 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:12.622604 12492 raft_consensus.cc:2741] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260925 16:44:12.574313 12013 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.040s
I20260925 16:44:12.623605  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.608811 12618 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:12.630477  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.647008  9119 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.624684  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.645701  9116 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:12.617251  9050 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.664433  9048 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260925 16:44:12.663394  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:12.642742 12616 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.135s	user 0.000s	sys 0.001s
I20260925 16:44:12.632464 12242 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:12.703648  9042 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:44:12.706046  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.706640  9120 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:44:12.699385  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 129259us
I20260925 16:44:12.669865  9702 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:12.669204  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.709789  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.711083  9118 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:12.711169  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.712340  9044 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:12.703758  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.656998 12618 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:12.726482  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.730713  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.724094  9119 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 2.
I20260925 16:44:12.727574  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.733309  9050 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:12.736603  9123 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:12.746212  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.746769  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:12.747531  9115 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.715932 12409 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:12.750288  9116 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 7 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:12.727177 12368 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:12.752784  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:12.758037  9693 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:12.758128  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:12.759068  9120 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:12.731988 12392 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.764117  9698 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260925 16:44:12.771054  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2415) took 1746 ms. Trace:
I20260925 16:44:12.770181  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:12.771428  9120 rpcz_store.cc:276] 0925 16:44:11.014016 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.744853 (+1730837us) service_pool.cc:227] Handling call
0925 16:44:12.758854 (+ 14001us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.759538 (+   684us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.759906 (+   368us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.770370  9700 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:12.769731 12624 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:12.786347  9120 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:12.789469  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2305) took 1280 ms. Trace:
I20260925 16:44:12.788287  9118 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 4. Current term is 6. Ops: []
I20260925 16:44:12.790529  9120 rpcz_store.cc:276] 0925 16:44:11.509503 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.772175 (+1262672us) service_pool.cc:227] Handling call
0925 16:44:12.772460 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.789041 (+ 16581us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.789393 (+   352us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.795878  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2418) took 1781 ms. Trace:
I20260925 16:44:12.796243  9118 rpcz_store.cc:276] 0925 16:44:11.014858 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.738247 (+1723389us) service_pool.cc:227] Handling call
0925 16:44:12.788134 (+ 49887us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.795605 (+  7471us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.795824 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.764513 12405 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:12.799891  8968 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 12. Ops: []
W20260925 16:44:12.814771  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 168152us
W20260925 16:44:12.812470  8939 connection.cc:232] RPC call timeout handler was delayed by -1.3906148609999036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21920000000000003s for a response
I20260925 16:44:12.788735 12013 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:12.800791 12611 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.563s	user 0.002s	sys 0.004s
W20260925 16:44:12.822643  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 158753us
I20260925 16:44:12.788270 12624 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:12.739493 12242 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.792862 12368 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:12.803679  9124 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.521s	user 0.006s	sys 0.000s
I20260925 16:44:12.830873  9702 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:12.908438  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2337) took 3496 ms. Trace:
W20260925 16:44:12.910364  9666 connection.cc:232] RPC call timeout handler was delayed by -1.5460062780000499s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17980000000000002s for a response
W20260925 16:44:12.910769  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4938062779999655s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18560000000000001s for a response
W20260925 16:44:12.911073  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4542062779999014s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19s for a response
W20260925 16:44:12.911440  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4488062779998927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260925 16:44:12.911875  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4488062779998927s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1906s for a response
W20260925 16:44:12.912251  9666 connection.cc:232] RPC call timeout handler was delayed by -1.3453062779999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260925 16:44:12.912623  9666 connection.cc:232] RPC call timeout handler was delayed by -1.3453062779999527s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
I20260925 16:44:12.914311  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:12.915369 11883 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:12.864681  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
W20260925 16:44:12.833770  9122 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.617s	user 0.009s	sys 0.001s
W20260925 16:44:12.804520 12625 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260925 16:44:12.812608 12509 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:12.904575  9700 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:12.907291  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2345) took 1386 ms. Trace:
I20260925 16:44:12.915670  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:12.915766 11883 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:12.918941  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 131623us
I20260925 16:44:12.832988  9123 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:12.916599  9122 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
W20260925 16:44:12.879714  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 251239us
I20260925 16:44:12.804423 12467 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:12.896136 12646 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:12.812188 12614 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:12.878338 12541 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:12.869238 12558 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:12.917999  9045 rpcz_store.cc:276] 0925 16:44:11.515102 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.320130 (+805028us) service_pool.cc:227] Handling call
0925 16:44:12.366226 (+ 46096us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.396675 (+ 30449us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:12.583921 (+187246us) log.cc:842] Serialized 14 byte log entry
0925 16:44:12.900902 (+316981us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.900961 (+    59us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:12.901025 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.901097 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.901206 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":353285,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":435317,"threads_started":2}
I20260925 16:44:12.943630  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:12.940903  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:12.941527  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2417) took 1921 ms. Trace:
I20260925 16:44:12.918393 11883 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:12.947300  9123 rpcz_store.cc:276] 0925 16:44:11.014597 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.744957 (+1730360us) service_pool.cc:227] Handling call
0925 16:44:12.789383 (+ 44426us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.935766 (+146383us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.936012 (+   246us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:12.955180  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:12.804936 12462 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.885296 12013 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.927222 12467 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:12.928208 12646 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:12.939851 12388 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:12.946475 12597 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.529s	user 0.010s	sys 0.000s
I20260925 16:44:12.936674 12614 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:12.983523  9121 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.695s	user 0.005s	sys 0.005s
W20260925 16:44:12.984683  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2057) took 5974 ms (client timeout 1798 ms). Trace:
I20260925 16:44:12.984942 12467 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:12.985091 12368 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.018282  9050 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:12.937217 12509 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.986294 12646 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:12.988368  9124 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260925 16:44:12.964599 12494 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:12.986346 12619 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.272s	user 0.000s	sys 0.002s
I20260925 16:44:12.989992 12405 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:12.990703  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:12.991801 12632 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:12.991890 12389 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260925 16:44:12.992642  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 77088.4us
W20260925 16:44:12.993847 12629 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.001s
I20260925 16:44:12.994199  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1626) took 4937 ms. Trace:
W20260925 16:44:12.994855 12630 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260925 16:44:12.999874 12525 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.031579  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:12.981056 12457 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:12.991577  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.009315  9121 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
W20260925 16:44:13.020248  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 76719.8us
I20260925 16:44:13.037192  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2307) took 1428 ms. Trace:
W20260925 16:44:12.980075  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43921.4us
I20260925 16:44:12.908854  9049 rpcz_store.cc:276] 0925 16:44:09.401539 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.156287 (+2754748us) service_pool.cc:227] Handling call
0925 16:44:12.159864 (+  3577us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.861679 (+701815us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.861724 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:12.861764 (+    40us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:12.896753 (+ 34989us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.897420 (+   667us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:12.897525 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":253428,"raft.run_cpu_time_us":204,"raft.run_wall_time_us":18176,"thread_start_us":222728,"threads_started":1}
I20260925 16:44:12.978287 12489 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.024047  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:13.025380  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 281302us
W20260925 16:44:13.008837  8972 rpcz_store.cc:269] 0925 16:44:06.824773 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:06.824934 (+   161us) service_pool.cc:227] Handling call
0925 16:44:10.780645 (+3955711us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:44:12.788988 (+2008343us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54001c4654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.798761 (+  9773us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3412691072}
W20260925 16:44:13.031596  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 180302us
I20260925 16:44:12.986523 12380 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:13.030850  8968 rpcz_store.cc:276] 0925 16:44:08.057201 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:11.512674 (+3455473us) service_pool.cc:227] Handling call
0925 16:44:12.799597 (+1286923us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.832029 (+ 32432us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.991569 (+159540us) spinlock_profiling.cc:243] Waited 1.28 s on lock 0x7b54001c4650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:12.994129 (+  2560us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2948114176}
I20260925 16:44:13.034353  8969 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Handling vote request from an unknown peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.013274 12597 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.036201  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.038720  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.040706  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.039626  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.053417  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.043854  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2397) took 2314 ms. Trace:
I20260925 16:44:13.037662  9121 rpcz_store.cc:276] 0925 16:44:11.608661 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.246640 (+637979us) service_pool.cc:227] Handling call
0925 16:44:13.037117 (+790477us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:13.045332  8974 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:13.048007 12242 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.048600 12380 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:13.048600  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111112us
I20260925 16:44:13.046305  8969 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:13.052021  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.031826 12632 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.045888  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.055874  9117 rpcz_store.cc:276] 0925 16:44:10.728997 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.453597 (+1724600us) service_pool.cc:227] Handling call
0925 16:44:12.495902 (+ 42305us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.544676 (+ 48774us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:44:12.741618 (+196942us) log.cc:842] Serialized 14 byte log entry
0925 16:44:13.043412 (+301794us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:13.043488 (+    76us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:13.043543 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.043629 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:13.043789 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":53754,"prepare.queue_time_us":268717,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":2019,"raft.queue_time_us":68850,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":1280,"thread_start_us":282649,"threads_started":3,"wal-append.queue_time_us":174591}
I20260925 16:44:13.059381  8970 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:13.067999  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:13.026767 12618 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.070065  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.080765  8968 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:13.081161  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43706.6us
I20260925 16:44:13.082033  9665 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:13.083732  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.084604  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.089491  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.089084  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.067044 12632 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:13.092686 12614 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.093874 12614 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:13.096503 12509 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.096246 12380 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.098112  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.100222  8967 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:13.101130  9049 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:13.102252  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.052510 12405 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.103765  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:13.083868 12646 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.088034 12388 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:13.087935 12242 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:13.088171 12641 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.110649  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.122498  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.126183  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 726) took 1932 ms. Trace:
I20260925 16:44:13.120122  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.134289  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:13.116581  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46803.8us
I20260925 16:44:13.135389  9119 rpcz_store.cc:276] 0925 16:44:11.193878 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.788057 (+1594179us) service_pool.cc:227] Handling call
0925 16:44:12.804892 (+ 16835us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.805154 (+   262us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.805178 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:12.805640 (+   462us) log.cc:842] Serialized 26 byte log entry
0925 16:44:12.928722 (+123082us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:12.928760 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.928820 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:13.125938 (+197118us) raft_consensus.cc:1671] finished
0925 16:44:13.125958 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:13.126100 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":122748,"threads_started":1,"wal-append.queue_time_us":223430}
I20260925 16:44:13.137122  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.111891 12657 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:13.135793  8967 raft_consensus.cc:2362] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7. Re-sending same reply.
I20260925 16:44:13.140652  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 721) took 2111 ms. Trace:
I20260925 16:44:13.144366  9116 rpcz_store.cc:276] 0925 16:44:11.029718 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.764661 (+1734943us) service_pool.cc:227] Handling call
0925 16:44:12.818238 (+ 53577us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:12.818435 (+   197us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:13.049426 (+230991us) log.cc:842] Serialized 14 byte log entry
0925 16:44:13.126940 (+ 77514us) log.cc:842] Serialized 14 byte log entry
0925 16:44:13.140255 (+ 13315us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:13.140309 (+    54us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:13.140363 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.140459 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:13.140591 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61593,"prepare.queue_time_us":130761,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":16365,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":2165,"thread_start_us":180105,"threads_started":2}
I20260925 16:44:13.141705  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:13.124307 12650 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260925 16:44:13.147894  8968 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 10. Ops: []
I20260925 16:44:13.108882 12467 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:13.034471 12624 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.135778  9044 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:13.126406  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 723) took 2096 ms. Trace:
I20260925 16:44:13.104734 12457 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:13.155572  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:13.155853 12457 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:13.156217  9050 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.156813 12405 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.124498  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.157441  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.157887  8972 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:13.160436 12627 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260925 16:44:13.160611 12618 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:13.161544 12652 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260925 16:44:13.124430 12633 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:13.163352 12643 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:13.163779 12643 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:13.164136 12643 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:13.139744 12525 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:13.164458  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.166133 12597 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.152510 12242 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:13.167078 12013 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.139799 12494 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:13.167258 12242 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.167950 12494 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:13.168252 12504 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.001s
I20260925 16:44:13.168327 12494 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.162619  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:13.151039  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48879.2us
W20260925 16:44:13.119791 12628 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260925 16:44:13.153339  9115 rpcz_store.cc:276] 0925 16:44:11.030210 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.752842 (+1722632us) service_pool.cc:227] Handling call
0925 16:44:12.862302 (+109460us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.878834 (+ 16532us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.878863 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:12.903074 (+ 24211us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.007916 (+104842us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:13.007962 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.008042 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:13.126233 (+118191us) raft_consensus.cc:1671] finished
0925 16:44:13.126257 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:13.126358 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":329,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":9673,"thread_start_us":62165,"threads_started":1,"wal-append.queue_time_us":157378}
I20260925 16:44:13.117125 12489 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.117458 12462 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.134555 12388 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.175638  9049 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:13.176993  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.121527 12639 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:13.179270  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.182440  9050 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:13.194918  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.168782 12504 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.201578  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.198945  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.179191 12409 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260925 16:44:13.181366 12657 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:13.202275  9046 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:13.194795 12388 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.214709  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.219161  8972 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.195025 12460 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:13.221282  9048 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:13.196059 12637 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:13.223029  8974 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:13.226260  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.231923  8968 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:13.233548  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:13.233803  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 201024us
I20260925 16:44:13.211239 12624 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:13.214462 12509 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260925 16:44:13.247435  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 97049.9us
W20260925 16:44:13.248790  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81226.4us
I20260925 16:44:13.252240  9089 leader_election.cc:398] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:13.252663  9089 leader_election.cc:401] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260925 16:44:13.274681  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:13.271039 11883 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.276679 12444 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260925 16:44:13.277837 11883 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.277994 12517 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
W20260925 16:44:13.288560  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62602.2us
I20260925 16:44:13.261600 12637 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:13.279538 12405 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:13.207157 12639 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.326042  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2350) took 1126 ms. Trace:
I20260925 16:44:13.322762  9016 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10.
I20260925 16:44:13.329187  9016 leader_election.cc:401] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260925 16:44:13.328315  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:13.329507  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.900s (SENT)
I20260925 16:44:13.332664  8974 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:13.333577  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:13.326308  9041 rpcz_store.cc:276] 0925 16:44:12.199979 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:12.384848 (+184869us) service_pool.cc:227] Handling call
0925 16:44:12.399048 (+ 14200us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:12.417825 (+ 18777us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:12.417854 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:12.436127 (+ 18273us) log.cc:842] Serialized 26 byte log entry
0925 16:44:12.607976 (+171849us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:12.715040 (+107064us) log.cc:842] Serialized 14 byte log entry
0925 16:44:12.819027 (+103987us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:12.819114 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:13.325863 (+506749us) raft_consensus.cc:1671] finished
0925 16:44:13.325881 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:13.325998 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44187,"prepare.queue_time_us":174444,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":44,"raft.queue_time_us":347078,"raft.run_cpu_time_us":310,"raft.run_wall_time_us":13486,"thread_start_us":322709,"threads_started":3,"wal-append.queue_time_us":436096}
W20260925 16:44:13.331574 12342 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.685s	user 0.011s	sys 0.000s
W20260925 16:44:13.345041  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 114865us
I20260925 16:44:13.329139 12517 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:13.359058  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.360172  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.360924  9048 raft_consensus.cc:2354] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8.
I20260925 16:44:13.361670  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.362155  9044 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:13.363181  8971 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:13.340394 12460 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:13.366755 12460 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.368131  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.368829  8968 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:13.373387  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.377041  8966 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
W20260925 16:44:13.377585  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 128133us
I20260925 16:44:13.362896 12342 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:13.343010 12665 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10.
I20260925 16:44:13.338861 12666 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:13.383471 12653 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260925 16:44:13.345899 12655 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:13.391508  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:13.395643 12658 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:44:13.400141 12492 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:13.400731 12492 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.401185 12492 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:13.401849 12663 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:44:13.404102 12657 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.404544 12657 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.400007 12637 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.339113 12614 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260925 16:44:13.392300 12457 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.421437  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.422638  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.422917  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.423897  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.429970  9049 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 7 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:44:13.426643 12657 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:13.427284  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63638.6us
W20260925 16:44:13.383517 12661 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260925 16:44:13.428941  9050 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:13.375857 12504 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:13.434441  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44458.3us
I20260925 16:44:13.435994  8940 leader_election.cc:398] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8.
I20260925 16:44:13.436414  8940 leader_election.cc:401] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:13.379310 12517 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:13.440848  9046 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:13.428318 12666 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:13.441242  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47227.7us
I20260925 16:44:13.441345  9041 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:44:13.441926  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.442801  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.444366  9043 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:13.452455  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:13.457480  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.458487  9700 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:13.458546 12242 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:13.464193  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:13.465085 12380 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:13.467114  9122 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:13.467614 12444 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:13.468039  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:13.468196 12639 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.468276  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:13.469066  9118 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:13.469997  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:13.470482 12457 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.470749  9115 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:13.454980  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.474840  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.475373  9702 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:13.445739 12509 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.477483  9698 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:13.477854  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:13.478401  9695 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:13.479490  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.478269  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.484092  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.484400 12632 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.484886 12388 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.487128  9044 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:13.487421  9697 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:13.488457  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.489166  9700 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:13.487874  9043 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:13.492578  9702 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:13.440097 12494 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.496559  9693 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260925 16:44:13.486660 12632 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.477478 12525 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:13.501305  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:13.502861  9699 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:13.504356  9700 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:13.509968  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:13.512614  9695 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:13.513670  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58860.6us
I20260925 16:44:13.513754  8972 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:13.517097 12669 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:13.517735 12672 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
I20260925 16:44:13.516961  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.522125  8968 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:13.522330  9693 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:13.522665  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.524562  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.527307  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:13.515844 12624 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260925 16:44:13.529094  9049 pending_rounds.cc:76] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 4
I20260925 16:44:13.529428  9049 pending_rounds.cc:97] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260925 16:44:13.529564 12624 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:44:13.529728  9049 raft_consensus.cc:2866] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:13.530092 12624 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:13.530525  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.531961 12666 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.538589  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.543872  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.525435 12460 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:13.534142 12517 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.555686 12462 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:13.534741 12388 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:13.558604 12666 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:13.531173 12624 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.547114 12633 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:13.574333  9699 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:13.568264 12666 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.572234 12657 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.588333 12494 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:13.581974 12666 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:13.595973 12624 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:13.605211  8966 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
W20260925 16:44:13.605806  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71058us
I20260925 16:44:13.600075  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.556870 12669 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260925 16:44:13.591259 12655 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:13.643942  8873 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 5, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:13.655915  8968 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:13.656204  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:13.640115 12655 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:13.631331 12641 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:13.645473  8873 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 5, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:13.680719  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:13.689271  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61086us
I20260925 16:44:13.659653  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.697595  9050 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:13.681986  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 85797.2us
I20260925 16:44:13.699350  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:13.705701  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46157us
I20260925 16:44:13.702245  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.703620  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:13.681951  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:13.671814 12643 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.003s
I20260925 16:44:13.723250  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:13.722352  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:13.755599  8967 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:13.724848  8873 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:44:13.777616  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.313s (SENT)
W20260925 16:44:13.756412  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 397415us
I20260925 16:44:13.785146  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:13.756724  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74833.6us
W20260925 16:44:13.753393  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49866.9us
I20260925 16:44:13.784884 12665 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:13.802711 12509 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8.
I20260925 16:44:13.679889 12638 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:13.756244 12641 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260925 16:44:13.808463  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.808725 12665 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:13.634241 12467 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260925 16:44:13.809008 12655 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.755722 12388 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:13.755548 12633 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:13.811002 12655 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:13.810038  8873 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 7, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 7 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:13.724814 12368 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:13.789002  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.785125 12558 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:44:13.791594  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69296.5us
I20260925 16:44:13.722643 12636 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:13.816706 12636 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:13.817276  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:13.817811 12636 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:13.795562  9050 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:13.664254 12657 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:13.809311 12453 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:13.820223 12453 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:13.820395 12657 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:13.820905 12657 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.821431 12657 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:13.821061 12453 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.822540 12453 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:13.723533  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:13.823721  9115 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:13.722852 12494 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:13.824316 12494 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:13.825309 12494 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:13.727921 12654 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:44:13.818315  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.828624  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.829474 12462 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:13.829841 12462 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:13.830178 12462 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:13.830495  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.831558 12494 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.835831 12665 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:13.755728  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.836483 12462 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.838274 12462 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:13.812336  8873 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:44:13.841647  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64081.2us
I20260925 16:44:13.811094 12633 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:13.869071  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 144756us
W20260925 16:44:13.870806  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83541.5us
I20260925 16:44:13.870898  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:13.871624  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.871805  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:13.717769 12517 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.123s
I20260925 16:44:13.656091 12492 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.875715  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.877085  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:13.881840  9050 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:44:13.815646 12368 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.885424  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.841063 12558 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:13.889734  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 121371us
I20260925 16:44:13.890327  8968 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:13.716224 12688 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.165s
I20260925 16:44:13.874749 12525 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:13.905326  9702 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:13.880193 12409 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:13.884543 12444 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:13.910036  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:13.884152 12013 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:13.898916 12558 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:13.898178 12368 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:13.870450 12405 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
W20260925 16:44:13.923489  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 150469us
I20260925 16:44:13.910591 12656 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:13.798589 12643 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:13.968532  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:13.926186  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:13.918025 12462 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:13.923293 12013 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:13.910760 12646 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260925 16:44:13.969966  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.435s (SENT)
I20260925 16:44:13.897929 12504 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
W20260925 16:44:13.971796  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 100059us
I20260925 16:44:13.904428 12380 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.050s
I20260925 16:44:13.986732  9047 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260925 16:44:13.925609 12388 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:13.981441  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:13.973112  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46996.5us
I20260925 16:44:13.973857  9050 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:14.005220  9697 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:14.000272  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:14.004433  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:14.006011  9701 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:14.006423  8968 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:13.988128 12687 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260925 16:44:13.928359 12655 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260925 16:44:14.052440  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68398.8us
I20260925 16:44:13.980819 12013 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:14.044075  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74151us
I20260925 16:44:14.044902  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:13.982877 12342 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:13.975474 12467 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:13.982704 12462 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:14.049355  9123 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:14.051841  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:14.051877  9700 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:14.055101  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:14.057126  9694 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:14.059199  9693 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:13.973273 12637 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260925 16:44:14.060504  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:14.081123  9696 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:14.081386  8966 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:14.059835 12682 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260925 16:44:14.062958 12655 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Stepping down as leader of term 6
W20260925 16:44:14.063174 12685 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.140s	user 0.000s	sys 0.001s
I20260925 16:44:14.063777 12492 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:14.064517 12467 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:14.082304  9050 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:14.046828 12656 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:14.063555 12643 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:14.102344  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:14.060925 12701 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.150s
I20260925 16:44:14.103981  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:14.897168 12639 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:14.192279 12643 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.762s
I20260925 16:44:14.954186 12639 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:14.112454 12342 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:14.175006 12698 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260925 16:44:14.956334 12342 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:14.956951  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2375) took 1441 ms. Trace:
I20260925 16:44:14.223461  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:14.104060  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:14.467599  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:14.136035  9089 connection.cc:232] RPC call timeout handler was delayed by -3.3421159969998371s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1626s for a response
W20260925 16:44:14.972488  9089 connection.cc:232] RPC call timeout handler was delayed by -3.3394159969998327s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16290000000000002s for a response
W20260925 16:44:14.275871  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 214758us
I20260925 16:44:14.281203 12467 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:14.112614 12460 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.845s
I20260925 16:44:14.693456  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:14.215525  8967 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:14.978335  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2104) took 1052 ms. Trace:
I20260925 16:44:14.085693 12655 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:14.201452  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:14.387074  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 302171us
I20260925 16:44:14.516830 12703 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:14.757954  8968 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.002s
I20260925 16:44:14.992312  8968 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:14.994714  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2105) took 1018 ms. Trace:
I20260925 16:44:14.995193  8968 rpcz_store.cc:276] 0925 16:44:13.976823 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.977048 (+   225us) service_pool.cc:227] Handling call
0925 16:44:14.994625 (+1017577us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:14.952649  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:14.494702 12702 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260925 16:44:14.469863  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:14.997210  9666 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.628s (SENT)
W20260925 16:44:14.968595  9698 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.900s	user 0.000s	sys 0.010s
I20260925 16:44:14.113826  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:14.998284  8966 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10.
W20260925 16:44:14.981724 12368 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.002s	user 0.011s	sys 0.000s
W20260925 16:44:14.963933  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 488573us
I20260925 16:44:14.176972 12636 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.777s
I20260925 16:44:14.969686  9046 rpcz_store.cc:276] 0925 16:44:13.515289 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.515442 (+   153us) service_pool.cc:227] Handling call
0925 16:44:13.517020 (+  1578us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.596594 (+ 79574us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:13.596636 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:13.597864 (+  1228us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.841389 (+243525us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:13.841579 (+   190us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.841647 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:13.868710 (+ 27063us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:14.956688 (+1087978us) raft_consensus.cc:1671] finished
0925 16:44:14.956710 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:14.956898 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":91686,"raft.queue_time_us":81666,"raft.run_cpu_time_us":1669,"raft.run_wall_time_us":270267,"spinlock_wait_cycles":9588096,"thread_start_us":119149,"threads_started":1,"wal-append.queue_time_us":203409}
W20260925 16:44:14.952649  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 859967us
I20260925 16:44:14.978735  8967 rpcz_store.cc:276] 0925 16:44:13.926033 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.926154 (+   121us) service_pool.cc:227] Handling call
0925 16:44:14.978278 (+1052124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.005836  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:14.982964  8972 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:14.903726 12657 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.082s	user 0.013s	sys 0.000s
W20260925 16:44:14.704417 12558 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.000s
W20260925 16:44:14.525149 12666 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.922s	user 0.005s	sys 0.005s
I20260925 16:44:14.693853  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:14.996097  9050 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:14.996097  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:14.997753  9698 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.929s	user 0.000s	sys 0.010s
I20260925 16:44:14.974098  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 650) took 1400 ms. Trace:
I20260925 16:44:15.017958  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1056) took 1018 ms. Trace:
I20260925 16:44:15.017804  9047 rpcz_store.cc:276] 0925 16:44:13.573497 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.720928 (+147431us) service_pool.cc:227] Handling call
0925 16:44:13.724246 (+  3318us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.989323 (+265077us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:14.973867 (+984544us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54000a7dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:14.974051 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":603090816}
I20260925 16:44:15.001643  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:15.002951  9015 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.929s (SENT)
I20260925 16:44:15.003069  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:14.976536 12699 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:14.960525  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 897) took 1362 ms. Trace:
I20260925 16:44:15.020617  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:14.997732 12409 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.013s	sys 0.002s
I20260925 16:44:15.007819  8967 raft_consensus.cc:2362] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8. Re-sending same reply.
I20260925 16:44:15.009374  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.010843  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.012393  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:14.387392 12462 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.013150 12657 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:15.014385 12697 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.605s	user 0.006s	sys 0.013s
I20260925 16:44:15.014537  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.018222  9698 rpcz_store.cc:276] 0925 16:44:13.999161 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:14.000449 (+  1288us) service_pool.cc:227] Handling call
0925 16:44:14.040547 (+ 40098us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:14.040775 (+   228us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:14.040804 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:14.052128 (+ 11324us) log.cc:842] Serialized 26 byte log entry
0925 16:44:15.017759 (+965631us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:15.017784 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.017823 (+    39us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:15.017850 (+    27us) raft_consensus.cc:1671] finished
0925 16:44:15.017856 (+     6us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.017924 (+    68us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":948944,"threads_started":1,"wal-append.queue_time_us":939593}
I20260925 16:44:15.022369  9049 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:15.019624  8968 raft_consensus.cc:2362] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:44:15.023886 12708 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:15.025215 12670 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:15.020560  9695 rpcz_store.cc:276] 0925 16:44:13.598082 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.603496 (+  5414us) service_pool.cc:227] Handling call
0925 16:44:13.603838 (+   342us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.604210 (+   372us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:13.604237 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:13.604638 (+   401us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.911381 (+306743us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:13.911414 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.911492 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:14.510605 (+599113us) raft_consensus.cc:1671] finished
0925 16:44:14.510631 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:14.960427 (+449796us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1364,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":36298,"thread_start_us":230908,"threads_started":1,"wal-append.queue_time_us":880493}
I20260925 16:44:15.028409  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.042866  9050 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:14.173622 12704 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.844s
I20260925 16:44:15.028928  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.015616 12712 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.033442  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.011159 12639 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.039343  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:15.027247 12409 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.013s	sys 0.002s
I20260925 16:44:15.042032  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:15.052700  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:15.042500 12013 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.961s	user 0.007s	sys 0.003s
I20260925 16:44:15.005283 12368 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:15.042682  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59634.5us
I20260925 16:44:15.057246  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.057427  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.076007  9117 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:15.070315  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.071000  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:15.071357 12657 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.071902  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:15.071991  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.104907  9120 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:15.105072  9124 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:15.054479  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:15.053218  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.015177 12558 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:15.040712 12670 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:15.074373  8969 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:15.073923  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.002477 12703 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.020816 12666 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.103578  9121 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:15.103979  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.103750  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.029222 12699 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:15.075088  9044 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:15.112764  8972 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:15.112151  9123 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:15.076278  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:15.107969 12707 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260925 16:44:15.113020  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1680) took 1005 ms. Trace:
I20260925 16:44:15.113576  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.114257  9050 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:15.072657 12643 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.116251  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.116398  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.117735  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:15.118041 12709 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260925 16:44:15.117853 12242 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:15.118343  9050 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:15.118943  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.119210  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.119520 12460 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:15.119954  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2382) took 1140 ms. Trace:
I20260925 16:44:15.122393  9121 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:15.123925  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.120828  9044 rpcz_store.cc:276] 0925 16:44:14.107936 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:14.972669 (+864733us) service_pool.cc:227] Handling call
0925 16:44:15.112967 (+140298us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.103181 12013 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.125458  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.102978 12708 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.122255 12643 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:15.126121 12686 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.143s	user 0.011s	sys 0.007s
I20260925 16:44:15.126566 12636 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:15.126699  9118 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:15.127050  8968 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:15.127292 12703 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:15.079885 12655 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:15.128132 12666 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.128407 12368 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:15.174917 12655 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 8
I20260925 16:44:15.176707  9046 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260925 16:44:15.177165 12643 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.177985  9047 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:15.179200 12013 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:15.122622  9045 rpcz_store.cc:276] 0925 16:44:13.979241 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.980619 (+  1378us) service_pool.cc:227] Handling call
0925 16:44:13.981035 (+   416us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.996253 (+ 15218us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:13.996287 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:14.008801 (+ 12514us) log.cc:842] Serialized 26 byte log entry
0925 16:44:14.103941 (+ 95140us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:14.103977 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:14.104035 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:15.119760 (+1015725us) raft_consensus.cc:1671] finished
0925 16:44:15.119781 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.119898 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5015,"raft.queue_time_us":15302,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":35957,"thread_start_us":39698,"threads_started":1,"wal-append.queue_time_us":966472}
I20260925 16:44:15.180363  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:15.180518  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:15.181226  9045 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260925 16:44:15.181582  9698 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:15.181699  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1677) took 1095 ms. Trace:
I20260925 16:44:15.182147  9045 rpcz_store.cc:276] 0925 16:44:14.086897 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.180113 (+1093216us) service_pool.cc:227] Handling call
0925 16:44:15.181620 (+  1507us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.182978  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.184607 12558 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.184818 12666 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.130476  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1678) took 1029 ms. Trace:
I20260925 16:44:15.131096  8970 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:15.183495  9045 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:15.132315  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:15.185732  9050 rpcz_store.cc:276] 0925 16:44:14.100717 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.118969 (+1018252us) service_pool.cc:227] Handling call
0925 16:44:15.130414 (+ 11445us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.186455  9049 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:15.187098  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1675) took 1112 ms. Trace:
I20260925 16:44:15.134117 12699 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:15.134552  8974 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:15.135977  9700 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260925 16:44:15.126773 12665 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:15.147400  8973 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:15.149009  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:15.201342  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1684) took 1026 ms. Trace:
I20260925 16:44:15.201834  9047 rpcz_store.cc:276] 0925 16:44:14.174721 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.019227 (+844506us) service_pool.cc:227] Handling call
0925 16:44:15.201168 (+181941us) spinlock_profiling.cc:243] Waited 108 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:15.201285 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":248689024}
W20260925 16:44:15.150327 12695 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.734s	user 0.011s	sys 0.000s
I20260925 16:44:15.122542 12460 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:15.159431  9015 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.561s (SENT)
I20260925 16:44:15.160742  9124 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:15.076531 12712 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.163970 12708 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:15.143653 12453 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:15.172456  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.135393 12639 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260925 16:44:15.132146  9119 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260925 16:44:15.187451  9049 rpcz_store.cc:276] 0925 16:44:14.074591 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.113299 (+1038708us) service_pool.cc:227] Handling call
0925 16:44:15.187032 (+ 73733us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.119315 12670 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:15.193384 12690 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.222s	user 0.011s	sys 0.017s
I20260925 16:44:15.198263  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:15.200604  9115 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:15.208719  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:15.218052  9044 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:15.223031  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1676) took 1141 ms. Trace:
I20260925 16:44:15.223568  9050 rpcz_store.cc:276] 0925 16:44:14.081543 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.186579 (+1105036us) service_pool.cc:227] Handling call
0925 16:44:15.222962 (+ 36383us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.219496  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:15.200322 12665 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:15.185316 12666 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.225162  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1673) took 1151 ms. Trace:
I20260925 16:44:15.230506  9047 rpcz_store.cc:276] 0925 16:44:14.073988 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.206226 (+1132238us) service_pool.cc:227] Handling call
0925 16:44:15.225099 (+ 18873us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.209758 12646 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:15.232757  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73376.2us
I20260925 16:44:15.239688  9050 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:15.219143 12453 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:15.242075  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 255259us
W20260925 16:44:15.242323  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.662s (SENT)
I20260925 16:44:15.240322  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1679) took 1137 ms. Trace:
I20260925 16:44:15.245151  9050 rpcz_store.cc:276] 0925 16:44:14.102970 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.224378 (+1121408us) service_pool.cc:227] Handling call
0925 16:44:15.239450 (+ 15072us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.240108 (+   658us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.240277 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:15.247934  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 264269us
I20260925 16:44:15.250016  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:15.263541  9698 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:15.268011  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 144124us
W20260925 16:44:15.257910  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 111083us
I20260925 16:44:15.274075  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2383) took 1070 ms. Trace:
I20260925 16:44:15.232344  9049 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:15.233057 12670 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:15.527685  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 513193us
I20260925 16:44:15.235389 12646 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:15.528681  9049 raft_consensus.cc:595] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
W20260925 16:44:15.452770  9666 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.798s (SENT)
I20260925 16:44:15.537429  9049 raft_consensus.cc:603] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:44:15.373974  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.970s (SENT)
W20260925 16:44:15.370797  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 101925us
I20260925 16:44:15.538863  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.480803  9045 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:15.274560  9050 rpcz_store.cc:276] 0925 16:44:14.204019 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.268594 (+1064575us) service_pool.cc:227] Handling call
0925 16:44:15.269510 (+   916us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.269725 (+   215us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:15.269761 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:15.269813 (+    52us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:15.269854 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.269917 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.273991 (+  4074us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.364843  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:15.467777  9044 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:15.544389  9047 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:15.386615  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2372) took 1906 ms. Trace:
I20260925 16:44:15.545495  9042 rpcz_store.cc:276] 0925 16:44:13.480455 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.480594 (+   139us) service_pool.cc:227] Handling call
0925 16:44:13.497033 (+ 16439us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.579953 (+ 82920us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:13.579993 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:13.580370 (+   377us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.890774 (+310404us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:44:13.890812 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.890889 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:15.145028 (+1254139us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:15.376610 (+231582us) raft_consensus.cc:1671] finished
0925 16:44:15.376638 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.386549 (+  9911us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":123399,"raft.queue_time_us":83549,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":6689,"spinlock_wait_cycles":37973376,"thread_start_us":310059,"threads_started":1,"wal-append.queue_time_us":512345}
I20260925 16:44:15.549355  9698 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:15.559636  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:15.560427  9115 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:15.537624  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:15.567554  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.377602 12342 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.572988 12342 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.575146 12342 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:15.576399 12692 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.160s	user 0.006s	sys 0.026s
I20260925 16:44:15.576871 12731 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:15.393352 12708 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.577782  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2374) took 2072 ms. Trace:
I20260925 16:44:15.577741 12708 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:15.520644 12723 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260925 16:44:15.578256  9041 rpcz_store.cc:276] 0925 16:44:13.505517 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.505928 (+   411us) service_pool.cc:227] Handling call
0925 16:44:13.513885 (+  7957us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.514084 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:13.514106 (+    22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:13.525287 (+ 11181us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.925102 (+399815us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:13.925151 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.925229 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:15.575639 (+1650410us) spinlock_profiling.cc:243] Waited 1.12 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:15.577507 (+  1868us) raft_consensus.cc:1671] finished
0925 16:44:15.577528 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.577726 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2576128,"thread_start_us":353866,"threads_started":1,"wal-append.queue_time_us":429465}
W20260925 16:44:15.580973  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 207025us
I20260925 16:44:15.581007  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:15.581805  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.886s (SENT)
I20260925 16:44:15.582226  9045 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:15.582301  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.583776  9045 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260925 16:44:15.246232 12453 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:15.585755 12013 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.275612 12669 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.586434  9049 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:15.587277  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.426713 12666 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:15.420679 12718 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.202s	user 0.001s	sys 0.000s
I20260925 16:44:15.607165 12013 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:15.371194 12558 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.237s
I20260925 16:44:15.592581  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:15.360601 12665 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:15.612027  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 159299us
I20260925 16:44:15.616888  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:15.342024  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:15.362149  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 357325us
I20260925 16:44:15.300231 12462 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:15.295054 12460 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.607043 12669 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.607218 12242 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:15.300938 12690 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260925 16:44:15.342056 12711 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.370606 12721 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:15.655783  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.856s (SENT)
I20260925 16:44:15.385066  9124 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:15.616518  8873 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:15.364432  9123 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:15.620018  9701 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:15.622690  9050 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:15.689456  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2384) took 1462 ms. Trace:
I20260925 16:44:15.689841  9050 rpcz_store.cc:276] 0925 16:44:14.226825 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.582840 (+1356015us) service_pool.cc:227] Handling call
0925 16:44:15.613035 (+ 30195us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.689205 (+ 76170us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.689405 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:15.532282 12712 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.628922  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:15.630529  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1668) took 1543 ms (client timeout 2003 ms). Trace:
W20260925 16:44:15.690819  9043 rpcz_store.cc:269] 0925 16:44:14.072373 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:14.072513 (+   140us) service_pool.cc:227] Handling call
0925 16:44:15.615182 (+1542669us) spinlock_profiling.cc:243] Waited 1.13 s on lock 0x7b54002a3d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:15.615293 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2602948992}
W20260925 16:44:15.632464  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 65003.5us
W20260925 16:44:15.634805  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 92829.1us
I20260925 16:44:15.691629  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:15.640576  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48115.8us
I20260925 16:44:15.644585  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:15.652424  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.889s (SENT)
I20260925 16:44:15.693903  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.609332  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:15.641134 12405 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.612643 12708 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:15.699311  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 90035.8us
I20260925 16:44:15.701114  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:15.689144  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88226.1us
I20260925 16:44:15.699026  9697 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:15.652853 12665 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:15.703522  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47805.9us
I20260925 16:44:15.654548 12368 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:15.654783 12636 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260925 16:44:15.698503  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.794s (SENT) [suppressed 62 similar messages]
W20260925 16:44:15.692020 12722 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260925 16:44:15.705772  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.906s (SENT)
I20260925 16:44:15.644955 12643 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:15.657968 12703 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:15.691604 12667 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.720482  9043 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:15.696720 12740 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.647060 12462 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.706923 12712 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:15.704316 12405 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:15.727823  9666 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.021s (SENT)
I20260925 16:44:15.705169 12242 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:15.731806  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 144608us
I20260925 16:44:15.730316  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:15.719383 12368 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:15.689174 12711 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.741937  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:15.727466 12643 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:15.728024 12639 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
W20260925 16:44:15.746127  9089 connection.cc:232] RPC call timeout handler was delayed by -3.16469898299988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.3154s for a response
I20260925 16:44:15.729668 12708 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:15.722055 12013 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:15.748256  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:15.771746  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:15.733803 12712 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.750228 12462 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:15.750480 12405 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:15.750974 12669 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:15.748545  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 96140.8us
W20260925 16:44:15.795732  9015 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.924s (SENT)
I20260925 16:44:15.796185  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:15.747464  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:15.728833 12742 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:15.698086 12721 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.769002  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:15.734935 12633 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:15.794514  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 896) took 2184 ms. Trace:
W20260925 16:44:15.795302  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 101861us
I20260925 16:44:15.824018  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2385) took 1519 ms. Trace:
I20260925 16:44:15.824694  9044 rpcz_store.cc:276] 0925 16:44:14.304257 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.581084 (+1276827us) service_pool.cc:227] Handling call
0925 16:44:15.581354 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.581598 (+   244us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:44:15.741191 (+159593us) log.cc:842] Serialized 14 byte log entry
0925 16:44:15.823565 (+ 82374us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:15.823635 (+    70us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:15.823692 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.823796 (+   104us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.823948 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":135607,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":2595,"thread_start_us":213611,"threads_started":2}
I20260925 16:44:15.730115 12703 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.755522 12636 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:15.730408 12740 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.833734  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 803) took 1772 ms. Trace:
I20260925 16:44:15.848549  9700 rpcz_store.cc:276] 0925 16:44:14.061791 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:14.084835 (+ 23044us) service_pool.cc:227] Handling call
0925 16:44:14.103653 (+ 18818us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:15.189041 (+1085388us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.833451 (+644410us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:15.833669 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2364383616}
W20260925 16:44:15.836596  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 750) took 2144 ms (client timeout 1641 ms). Trace:
I20260925 16:44:15.844748  8873 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 8, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:44:15.849911  9118 rpcz_store.cc:269] 0925 16:44:13.692629 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.705232 (+ 12603us) service_pool.cc:227] Handling call
0925 16:44:15.836363 (+2131131us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:15.836513 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3087512960}
W20260925 16:44:15.795620 12693 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.387s	user 0.015s	sys 0.016s
I20260925 16:44:15.796408 12712 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:15.795994 12666 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:15.799422  9699 rpcz_store.cc:276] 0925 16:44:13.577151 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.577271 (+   120us) service_pool.cc:227] Handling call
0925 16:44:13.592363 (+ 15092us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.605019 (+ 12656us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:13.634084 (+ 29065us) log.cc:842] Serialized 14 byte log entry
0925 16:44:13.709972 (+ 75888us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:13.710692 (+   720us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.710839 (+   147us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:13.710883 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.710965 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:15.192681 (+1481716us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:15.752836 (+560155us) raft_consensus.cc:1671] finished
0925 16:44:15.761561 (+  8725us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:15.761707 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10086,"prepare.queue_time_us":61072,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":63,"raft.queue_time_us":10038,"raft.run_cpu_time_us":251,"raft.run_wall_time_us":6572,"spinlock_wait_cycles":33717504,"thread_start_us":64345,"threads_started":1,"wal-append.queue_time_us":237929}
W20260925 16:44:15.859135  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1671) took 1785 ms (client timeout 2158 ms). Trace:
I20260925 16:44:15.732290 12667 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.796254 12242 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
W20260925 16:44:15.911594  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 115905us
W20260925 16:44:15.935091  9046 rpcz_store.cc:269] 0925 16:44:14.073404 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.039682 (+966278us) service_pool.cc:227] Handling call
0925 16:44:15.858895 (+819213us) spinlock_profiling.cc:243] Waited 71.4 ms on lock 0x7b54002611d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:15.859074 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":164233088}
W20260925 16:44:15.936177  9015 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.980s (SENT)
I20260925 16:44:15.831629 12462 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:15.799144 12742 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:15.869228  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 121832us
I20260925 16:44:15.793402 12708 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.832422 12633 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.937892  9700 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260925 16:44:15.891924 12525 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
W20260925 16:44:15.984272 12739 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.228s	user 0.000s	sys 0.001s
W20260925 16:44:15.905750  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 134100us
I20260925 16:44:15.995774  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:15.965131  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9613338379999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15510000000000002s for a response
I20260925 16:44:15.848272 12636 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:15.949478 12509 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.992s	user 0.016s	sys 0.022s
I20260925 16:44:16.004891  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:15.984351 12742 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:15.992678 12738 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:44:15.892386 12751 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:15.994107  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:15.947538  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 212491us
W20260925 16:44:15.994890  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58752.2us
I20260925 16:44:15.995158  8873 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 5, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:44:15.905400  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72873.9us
I20260925 16:44:15.991942 12708 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:15.999003  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9199338379999062s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1597s for a response
I20260925 16:44:15.998045  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:16.025919  9123 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:16.000908  9121 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260925 16:44:16.026764  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.775s (SENT)
I20260925 16:44:16.007951 12703 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.008888 12721 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.010126 12740 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.036286 12711 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.010046 12646 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.010905 12744 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.040130 12744 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:15.993965  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:16.017140 12756 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260925 16:44:16.004626 12489 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260925 16:44:16.017418 12669 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.017832 12749 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:16.046321  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:16.017977 12467 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:15.953725 12368 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.021273  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1063) took 1038 ms. Trace:
W20260925 16:44:16.027091  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6895338379999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18530000000000002s for a response
I20260925 16:44:15.949158 12666 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:16.029315  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:16.032372  9046 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:16.034463  9122 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:16.035332  9121 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:16.067032  9046 raft_consensus.cc:595] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:16.022775  9119 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:16.005299 12636 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:16.005254 12509 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.052s	user 0.016s	sys 0.025s
W20260925 16:44:16.075583 12689 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.666s	user 0.019s	sys 0.006s
I20260925 16:44:15.950816 12242 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:16.044346  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:16.051757  9702 rpcz_store.cc:276] 0925 16:44:14.983027 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:14.983130 (+   103us) service_pool.cc:227] Handling call
0925 16:44:14.994191 (+ 11061us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:15.414102 (+419911us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:15.414139 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:15.589321 (+175182us) log.cc:842] Serialized 26 byte log entry
0925 16:44:15.724177 (+134856us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:15.724302 (+   125us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.724460 (+   158us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:16.020979 (+296519us) raft_consensus.cc:1671] finished
0925 16:44:16.021008 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.021199 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":37287,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"thread_start_us":472839,"threads_started":2,"wal-append.queue_time_us":322831}
I20260925 16:44:16.050146 12669 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.056159 12726 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:16.058130  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2387) took 1649 ms. Trace:
I20260925 16:44:16.060096  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1685) took 1885 ms. Trace:
I20260925 16:44:16.084705  9047 rpcz_store.cc:276] 0925 16:44:14.175053 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.231343 (+1056290us) service_pool.cc:227] Handling call
0925 16:44:15.544185 (+312842us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.544790 (+   605us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:16.059906 (+515116us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b5400362750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:16.060043 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":664996736}
I20260925 16:44:16.031847 12525 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.067550  9046 raft_consensus.cc:603] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:44:16.072712  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45986.5us
I20260925 16:44:16.093406  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.083599  9041 rpcz_store.cc:276] 0925 16:44:14.409015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.579831 (+1170816us) service_pool.cc:227] Handling call
0925 16:44:15.580206 (+   375us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:15.612427 (+ 32221us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:15.612458 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:15.656030 (+ 43572us) log.cc:842] Serialized 26 byte log entry
0925 16:44:15.845663 (+189633us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:15.845713 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.859445 (+ 13732us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:16.057872 (+198427us) raft_consensus.cc:1671] finished
0925 16:44:16.057898 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.058063 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":29656,"raft.queue_time_us":20378,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":12838,"thread_start_us":129989,"threads_started":1,"wal-append.queue_time_us":369304}
I20260925 16:44:16.102023  8873 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 7, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:16.103128  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:16.108783  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 406984us
I20260925 16:44:16.112110  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 658) took 1007 ms. Trace:
I20260925 16:44:16.112684  8873 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:16.051935 12751 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:16.112571  9049 rpcz_store.cc:276] 0925 16:44:15.104451 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.601756 (+497305us) service_pool.cc:227] Handling call
0925 16:44:15.633459 (+ 31703us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:15.696025 (+ 62566us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:15.696061 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:15.703713 (+  7652us) log.cc:842] Serialized 26 byte log entry
0925 16:44:15.940240 (+236527us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:15.940732 (+   492us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:15.940792 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:16.111883 (+171091us) raft_consensus.cc:1671] finished
0925 16:44:16.111901 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.112035 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2938,"raft.queue_time_us":66697,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5629,"thread_start_us":206991,"threads_started":1,"wal-append.queue_time_us":287849}
I20260925 16:44:16.114092  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:16.048506 12638 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260925 16:44:16.083436 12726 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.123565 12462 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:16.125722  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:16.159180  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 649) took 2769 ms. Trace:
I20260925 16:44:16.122984  8873 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 1 to 4, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 4 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:16.177664  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.180250  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:16.126485  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 103387us
I20260925 16:44:16.189404  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:16.187589  9048 rpcz_store.cc:276] 0925 16:44:13.390188 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:13.390305 (+   117us) service_pool.cc:227] Handling call
0925 16:44:13.392412 (+  2107us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:13.392622 (+   210us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:13.392652 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:13.393046 (+   394us) log.cc:842] Serialized 26 byte log entry
0925 16:44:13.902679 (+509633us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:13.902733 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:13.902827 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:16.075000 (+2172173us) spinlock_profiling.cc:243] Waited 16.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:16.123291 (+ 48291us) raft_consensus.cc:1671] finished
0925 16:44:16.123311 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.159099 (+ 35788us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":38060416,"thread_start_us":451516,"threads_started":1,"wal-append.queue_time_us":600694}
I20260925 16:44:16.191092  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.192126  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.111554 12703 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:16.192262  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.193068  9046 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
W20260925 16:44:16.186970  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61313.2us
I20260925 16:44:16.181599 12460 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:16.127522  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.192963  9119 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:16.083204 12721 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.074s
I20260925 16:44:16.201211  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:16.201776  9046 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:16.201917  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.076350 12740 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.050s
I20260925 16:44:16.199867  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:16.203323  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:16.205983  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:16.207276  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:16.209730  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.210546  9118 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:16.219852  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:16.221141  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:16.228225  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.229231  9048 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:16.236033  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:16.240396  9049 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 8. Ops: []
I20260925 16:44:16.241855  9049 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 12. Ops: []
I20260925 16:44:16.247793 12759 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:16.248893 12763 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.167s
I20260925 16:44:16.193176 12744 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.198745 12624 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:16.253774  9046 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
W20260925 16:44:16.257989  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.524s (SENT)
W20260925 16:44:16.261307  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49852.2us
I20260925 16:44:16.217571 12708 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:16.283685  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.220855 12688 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:16.226349 12633 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.288805  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:16.253242 12667 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:16.286073  9121 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:16.188429 12749 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260925 16:44:16.204070 12701 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260925 16:44:16.278208 12388 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:16.263465 12721 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:16.269833 12624 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:16.283201 12730 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:16.288868 12765 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260925 16:44:16.260577 12703 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.285881 12708 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:16.285427 12761 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.321044  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 900) took 1044 ms. Trace:
I20260925 16:44:16.330524  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:16.333734  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 144401us
I20260925 16:44:16.223613 12638 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.088s
I20260925 16:44:16.200865 12525 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.268958 12462 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.045s
W20260925 16:44:16.345234  9045 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.017s	sys 0.028s
W20260925 16:44:16.367519  9045 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.018s	sys 0.028s
I20260925 16:44:16.316185 12753 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:16.366647  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.368709  9695 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:16.327601 12388 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:16.332500 12721 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.341903  9693 rpcz_store.cc:276] 0925 16:44:15.276254 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.276378 (+   124us) service_pool.cc:227] Handling call
0925 16:44:15.602175 (+325797us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:15.792317 (+190142us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:15.792364 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:15.792887 (+   523us) log.cc:842] Serialized 26 byte log entry
0925 16:44:16.052693 (+259806us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:16.052735 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:16.108045 (+ 55310us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400426154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:16.108095 (+    50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:16.320762 (+212667us) raft_consensus.cc:1671] finished
0925 16:44:16.320786 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.320991 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":7119,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":16792,"spinlock_wait_cycles":436184448,"thread_start_us":203014,"threads_started":1,"wal-append.queue_time_us":324565}
I20260925 16:44:16.328944 12646 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.330938 12624 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:16.338615 12759 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.353089 12708 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:16.344332 12703 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:16.451095 12453 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.837s	user 0.011s	sys 0.001s
I20260925 16:44:16.445186 12742 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.251843 12242 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:16.431159  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.704s (SENT)
I20260925 16:44:16.496677  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:16.268718 12666 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.432566  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.435611  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.342427 12751 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.277597 12726 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.340759 12368 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.396109 12388 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:16.451608 12467 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.427223  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:16.451648 12453 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.452595 12743 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:44:16.396976 12669 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:16.504153  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 137593us
W20260925 16:44:16.505294 12770 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260925 16:44:16.364742 12761 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.509150 12636 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.511179 12703 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:16.513537  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82412.6us
W20260925 16:44:16.578805  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.741s (SENT)
I20260925 16:44:16.513240 12759 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.514163 12460 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:16.522253  9122 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:16.523645  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:16.520962  9116 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
W20260925 16:44:16.530893  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 124067us
W20260925 16:44:16.530956  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 329337us
W20260925 16:44:16.532655  9042 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.000s	sys 0.018s
W20260925 16:44:16.581962  9042 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.000s	sys 0.018s
W20260925 16:44:16.530424 12769 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
W20260925 16:44:16.555526 12712 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.606s	user 0.009s	sys 0.000s
I20260925 16:44:16.573032  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.532485 12646 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:16.583017  9043 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:16.609294  9043 raft_consensus.cc:603] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:16.581270  9693 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:16.566946 12743 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:16.606272  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2389) took 1312 ms. Trace:
I20260925 16:44:16.607788  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:16.611450  9015 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.003s	sys 0.011s
W20260925 16:44:16.611790  9015 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.505s	user 0.003s	sys 0.011s
W20260925 16:44:16.612176  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 506086us
I20260925 16:44:16.613320  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.613991  9046 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:16.613369  9695 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:16.623020  9046 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:16.582921 12639 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.560114 12368 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.611886  9045 rpcz_store.cc:276] 0925 16:44:15.293880 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.700606 (+406726us) service_pool.cc:227] Handling call
0925 16:44:15.700895 (+   289us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.701114 (+   219us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:44:15.798643 (+ 97529us) log.cc:842] Serialized 14 byte log entry
0925 16:44:16.604924 (+806281us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:16.606028 (+  1104us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:16.606073 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:16.606130 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.606224 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":38917,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":3606,"raft.queue_time_us":70143,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":98,"thread_start_us":890703,"threads_started":3,"wal-append.queue_time_us":678433}
I20260925 16:44:16.626894  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.627285  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.565793 12467 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.630767  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:16.631405  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 108479us
I20260925 16:44:16.627861  9045 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:16.609237 12665 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:16.620525 12743 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:44:16.620795 12013 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:16.628608 12509 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:16.582679 12641 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260925 16:44:16.586318 12703 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260925 16:44:16.623471 12701 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.641319  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.652686  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
W20260925 16:44:16.653610  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 80683.2us
I20260925 16:44:16.654299  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.634824  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:16.648053 12778 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260925 16:44:16.611078 12712 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.645750  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:16.606007 12721 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:16.631806 12730 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:16.656558  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:16.662374  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.168s (SENT)
I20260925 16:44:16.662910  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.664646  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.661257  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:16.664218  9015 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.238s (SENT)
I20260925 16:44:16.665913  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:16.639609 12763 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:16.631047 12639 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:16.736845  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 102086us
I20260925 16:44:16.745661  9702 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:16.746022  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.746264  9044 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:16.747301  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 109249us
I20260925 16:44:16.761875  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.762843  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.670336 12670 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:44:16.766175  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 99496.6us
W20260925 16:44:16.766956  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 99795.6us
W20260925 16:44:16.768167  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 103972us
I20260925 16:44:16.776643  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:16.761905 12688 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:16.745428 12742 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.668385 12749 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
W20260925 16:44:16.771840  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 119030us
I20260925 16:44:16.784438  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.658833 12701 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.765817 12509 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.778976 12467 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:16.770125 12670 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:16.651561 12780 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.128s
I20260925 16:44:16.783766 12667 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.770452 12792 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:16.771951 12794 raft_consensus.cc:2741] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260925 16:44:16.776687 12766 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.821748 12766 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.823864 12766 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.776047 12711 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:16.819797  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 165546us
I20260925 16:44:16.820895 12780 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:16.789800 12688 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:16.828658  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:16.789626 12453 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.832991  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:16.773358 12624 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.840011  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:16.812320 12740 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:16.843318  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.843962  9123 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:16.813752 12646 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:16.815639 12670 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:16.777022 12460 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260925 16:44:16.845016  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:16.817649 12786 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:16.847780  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:16.850308  9048 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:16.825120 12792 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:16.849145  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:16.787572 12708 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.827816 12467 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:16.838297 12780 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:16.842516 12688 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:16.847929 12669 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:16.832504 12667 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.865116 12740 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.860222 12753 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:16.876968 12796 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:16.879405 12409 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:16.852587 12766 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:16.883610  9050 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:16.865934 12779 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:16.884510  9123 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260925 16:44:16.865857 12368 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:16.841114 12711 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:16.885063 12791 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260925 16:44:16.856160 12792 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:16.881748 12460 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:16.882684 12761 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.879825 12793 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:16.847754 12636 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.884171 12669 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:16.923148 12669 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:16.891530 12409 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:16.893512 12766 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:16.890966 12712 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.892486 12753 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:16.857086 12786 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:16.912243 12771 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.739s	user 0.004s	sys 0.000s
I20260925 16:44:16.908921 12460 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:16.917305 12768 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.550s	user 0.001s	sys 0.000s
I20260925 16:44:16.920293  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2386) took 2531 ms. Trace:
W20260925 16:44:16.901546 12782 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.167s	user 0.000s	sys 0.001s
I20260925 16:44:16.938381  9042 rpcz_store.cc:276] 0925 16:44:14.388890 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.547911 (+1159021us) service_pool.cc:227] Handling call
0925 16:44:15.859662 (+311751us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:15.859915 (+   253us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:15.958042 (+ 98127us) log.cc:842] Serialized 14 byte log entry
0925 16:44:16.582752 (+624710us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:16.582798 (+    46us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:16.582835 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:16.582905 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:16.920129 (+337224us) spinlock_profiling.cc:243] Waited 264 ms on lock 0x7b54002611d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:16.920238 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":95507,"prepare.queue_time_us":99065,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":7463,"raft.queue_time_us":22388,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":12118,"spinlock_wait_cycles":608061824,"thread_start_us":623959,"threads_started":1,"wal-append.queue_time_us":692344}
I20260925 16:44:16.902931 12779 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:16.964948  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 119987us
I20260925 16:44:16.964694  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:16.967231  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 130615us
I20260925 16:44:16.880288 12509 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:16.928092 12766 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:16.984539  9700 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260925 16:44:17.008307  9693 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:44:17.008526  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.009074  9119 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:17.010689  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:16.938900 12712 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:17.020087  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.020848  9118 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:17.017453  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:16.944530 12639 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:16.937989 12460 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:17.021667  9700 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 8.
I20260925 16:44:17.000705  9123 raft_consensus.cc:2354] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7.
I20260925 16:44:17.002346 12701 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:17.022863 12768 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260925 16:44:17.158977  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 135785us
W20260925 16:44:17.016403  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 232040us
I20260925 16:44:17.168552  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:17.068044 12624 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:17.183535 12743 consensus_meta.cc:287] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.540s	user 0.019s	sys 0.000s
I20260925 16:44:17.166550 12639 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:17.198210  8862 maintenance_manager.cc:419] P ba21ddca249c4cf39e72526cc8696c60: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033383
I20260925 16:44:17.068491 12467 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.135s
I20260925 16:44:17.227970 12814 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:17.246016 12814 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.251763 12779 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.270552  9119 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:17.299507  9118 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:17.201589 12667 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:16.964792 12780 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.198896 12804 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:17.067624 12740 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:17.333859  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 175850us
W20260925 16:44:17.335093  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 166616us
I20260925 16:44:17.336468  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:17.235473 12708 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.348282  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:17.069670 12409 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.348953  9700 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:17.167176 12712 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.356889  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:17.348101 12624 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:17.306124 12467 consensus_queue.cc:1225] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260925 16:44:17.414111  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:17.365850 12688 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.366740 12726 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:17.365875  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.371835  9118 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:17.374203 12409 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:17.375322 12388 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.806s	user 0.008s	sys 0.000s
I20260925 16:44:17.377025  9700 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:17.446106  9042 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:17.378592 12806 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:17.344347 12751 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:17.379985  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.381570 12786 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.385526 12669 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.393376 12013 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:17.393810 12796 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260925 16:44:17.408421  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51619.1us
I20260925 16:44:17.365129 12721 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:17.429049  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.437973  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:17.488554  9041 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:17.183724 12793 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.067s
I20260925 16:44:17.256175 12639 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.451478  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.258489 12743 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.460259  9695 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260925 16:44:17.507958  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.510842  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.512231  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.441463 12624 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:17.520694  9700 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:17.432873 12711 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.513296  9118 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:17.513774  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.504562  9123 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:17.487126 12765 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260925 16:44:17.528224  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.528601  9120 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:17.516649  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54899.5us
W20260925 16:44:17.461167  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47153.2us
I20260925 16:44:17.512825  8973 raft_consensus.cc:2362] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7. Re-sending same reply.
I20260925 16:44:17.520426  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.530444  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:17.530534  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.505844  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.531574  8970 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.452854 12780 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:17.525756  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:17.515146  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.487994 12013 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:17.542672  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.544409  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.543226  9123 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:17.543100  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.550196  8969 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Handling vote request from an unknown peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:17.550593  8969 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:17.552875  9120 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:44:17.554884  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.546446  9119 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:17.547319  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.547567  8966 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260925 16:44:17.507018 12759 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.041s	sys 0.101s
I20260925 16:44:17.520759 12798 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:17.565532  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:17.569971  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44288.2us
I20260925 16:44:17.579165  8967 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.523708 12752 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:17.451018 12388 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.457026 12751 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.549263 12694 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:17.584448  9120 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:44:17.584400  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:17.591298  9116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2446) took 2535 ms (client timeout 2785 ms). Trace:
W20260925 16:44:17.592165  9116 rpcz_store.cc:269] 0925 16:44:15.056319 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:15.056447 (+   128us) service_pool.cc:227] Handling call
0925 16:44:17.591154 (+2534707us) spinlock_profiling.cc:243] Waited 1.33 s on lock 0x7b54001eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:17.591248 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3066934144}
I20260925 16:44:17.582828  9123 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260925 16:44:17.553886 12342 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:17.591606  9118 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:17.595130  8969 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:17.595904  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.596931  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.599560  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.565157 12242 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:17.575022 12701 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:17.573056 12453 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260925 16:44:17.610984 12453 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:17.611310 12453 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:17.612301 12670 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.003s
I20260925 16:44:17.612079 12453 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.612720 12670 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.613375 12453 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:17.613790  9693 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:17.614704 12670 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:17.617128 12792 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.680s	user 0.006s	sys 0.003s
I20260925 16:44:17.600244  9116 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:17.603152  9694 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:17.609611  8975 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:17.601928  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:17.626695  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46351.4us
I20260925 16:44:17.633371  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.634752 12813 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:17.635404 12813 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:17.635747  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 776) took 1310 ms. Trace:
I20260925 16:44:17.636286 12824 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:17.636421 12812 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:17.636812 12824 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:17.637178 12824 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:17.637717 12808 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260925 16:44:17.618112 12666 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:44:17.638669 12820 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260925 16:44:17.638855 12666 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:17.639364 12666 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:17.640210 12809 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260925 16:44:17.641499 12803 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:17.558434 12711 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260925 16:44:17.643137  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.643821 12711 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:17.644156 12711 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:17.644668  9124 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:44:17.644894 12711 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.645812  9124 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260925 16:44:17.646063 12711 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:17.647311  9118 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260925 16:44:17.636312 12813 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.649328  9118 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:17.651678 12639 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:17.652518 12624 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.655733  8873 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:17.656849 12669 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.587725 12814 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.657015  8873 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 6 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:17.480851 12806 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.650461  9118 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260925 16:44:17.640269 12818 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260925 16:44:17.658367  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:17.659108  9123 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:17.623541  9119 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:17.675058  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.625383  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.668646  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.636145  9121 rpcz_store.cc:276] 0925 16:44:16.325612 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.325761 (+   149us) service_pool.cc:227] Handling call
0925 16:44:16.326076 (+   315us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:16.326258 (+   182us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:16.496727 (+170469us) log.cc:842] Serialized 14 byte log entry
0925 16:44:16.519445 (+ 22718us) log.cc:842] Serialized 14 byte log entry
0925 16:44:17.386931 (+867486us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18000dc780. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11
0925 16:44:17.387799 (+   868us) spinlock_profiling.cc:243] Waited 21.2 ms on lock 0x7b18000dc780. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:17.635312 (+247513us) spinlock_profiling.cc:243] Waited 19 ms on lock 0x7b18000dc780. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:44:17.635402 (+    90us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:17.635450 (+    48us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:17.635494 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:17.635556 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:17.635676 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":302576,"prepare.run_cpu_time_us":96,"prepare.run_wall_time_us":3420,"raft.queue_time_us":153081,"raft.run_cpu_time_us":941,"raft.run_wall_time_us":42261,"spinlock_wait_cycles":119638784,"thread_start_us":235744,"threads_started":2}
I20260925 16:44:17.677963  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.595832 12342 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:17.600380 12798 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:17.686296 12766 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.665s	user 0.004s	sys 0.005s
I20260925 16:44:17.678756  9118 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:17.682440  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:17.690095  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.617560 12792 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.690981  8975 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.603852 12242 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:17.691711  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 163207us
I20260925 16:44:17.678701  9116 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:17.692920  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.693507  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.693955 12751 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.694803 12743 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:17.695156 12706 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:17.695955  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.625573 12694 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:17.725257  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.726715  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:17.727085  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2467) took 1070 ms. Trace:
I20260925 16:44:17.686846 12766 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.591389 12752 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.731675  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.691318 12342 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:17.737353  9118 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:17.739089  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:17.700855 12242 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:17.734302  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.691s (SENT)
I20260925 16:44:17.735106  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.737996  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.727628  9122 rpcz_store.cc:276] 0925 16:44:16.656747 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.656883 (+   136us) service_pool.cc:227] Handling call
0925 16:44:16.670526 (+ 13643us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:16.787528 (+117002us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:16.787558 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:16.921601 (+134043us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b2c000d80e8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:16.921961 (+   360us) log.cc:842] Serialized 26 byte log entry
0925 16:44:17.157747 (+235786us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:17.157795 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:17.157890 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:17.698001 (+540111us) raft_consensus.cc:1671] finished
0925 16:44:17.698027 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:17.727008 (+ 28981us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17259,"raft.queue_time_us":19900,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":25104,"spinlock_wait_cycles":4145536,"thread_start_us":235431,"threads_started":1,"wal-append.queue_time_us":398197}
I20260925 16:44:17.741122  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:17.754622  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.762284  8974 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:17.733371 12688 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.741524 12712 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.772303  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.783424  8970 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:17.759478 12753 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.823s	user 0.005s	sys 0.004s
W20260925 16:44:17.777431  9666 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.724s (SENT)
I20260925 16:44:17.787670  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:17.753561 12706 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:17.794112  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.794816  8966 raft_consensus.cc:2362] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9. Re-sending same reply.
W20260925 16:44:17.789111  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.792s (SENT)
I20260925 16:44:17.682958 12666 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.798065  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.798146  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.798607  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.798777  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.823954  8975 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.799646 12388 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.828236  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.828809  9123 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:17.802094 12819 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260925 16:44:17.806742 12806 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:17.808208 12766 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:17.820140  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:17.847218  9697 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:17.821487 12792 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:17.855546  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.828189  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.856564  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:17.804198 12752 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:17.836534  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:17.841497  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52440.7us
I20260925 16:44:17.862576  8970 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:17.842280  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.863296  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.843647  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.844233  9119 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:17.772194 12827 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:17.871088  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.877760  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.845026  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 669) took 1212 ms. Trace:
I20260925 16:44:17.848068  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.849225  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:17.851545  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:17.857475  9044 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:17.883641  9041 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:17.823071 12712 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:17.861552  8975 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.868861  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.870028  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.871088  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.878944  9046 rpcz_store.cc:276] 0925 16:44:16.632861 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.633051 (+   190us) service_pool.cc:227] Handling call
0925 16:44:16.633346 (+   295us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:16.777735 (+144389us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:16.777764 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:16.811892 (+ 34128us) log.cc:842] Serialized 26 byte log entry
0925 16:44:16.942098 (+130206us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:16.942155 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:17.835320 (+893165us) spinlock_profiling.cc:243] Waited 141 ms on lock 0x7b54002a2454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:17.835383 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:17.835444 (+    61us) raft_consensus.cc:1671] finished
0925 16:44:17.835463 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:17.844949 (+  9486us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22999,"raft.queue_time_us":68200,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10451,"spinlock_wait_cycles":324909952,"thread_start_us":97659,"threads_started":1,"wal-append.queue_time_us":116675}
I20260925 16:44:17.892740  8972 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.895812  8968 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 7 because replica has last-logged OpId of term: 6 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 2.
W20260925 16:44:17.896706  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45278.8us
I20260925 16:44:17.894457  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:17.901806  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.900365  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.822893 12786 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260925 16:44:17.901394  9041 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:17.905735  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:17.865760 12806 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:17.796324 12753 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.914040  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:17.914891  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50833.4us
I20260925 16:44:17.921180  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:17.921639  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.985s (SENT)
I20260925 16:44:17.922190  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.922786  8966 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 5.
I20260925 16:44:17.923655  9701 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:17.924304  9050 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:17.919523  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.925420  8972 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:17.926173  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40140 (request call id 31) took 1550 ms. Trace:
I20260925 16:44:17.926613  9043 rpcz_store.cc:276] 0925 16:44:16.364310 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.365001 (+   691us) service_pool.cc:227] Handling call
0925 16:44:17.914048 (+1549047us) spinlock_profiling.cc:243] Waited 23.6 ms on lock 0x7b54002611d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:17.914160 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54288128}
I20260925 16:44:17.928617  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:17.920738 12798 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.930976 12666 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:17.931320  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.987s (SENT)
I20260925 16:44:17.931759  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:17.902127 12558 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:17.931981  9117 raft_consensus.cc:2396] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260925 16:44:17.926656  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.933267  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:17.937170  9119 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:17.934000  9666 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.130s (SENT)
I20260925 16:44:17.934391  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.933825  8969 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:17.937989  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:17.938669  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.940356 12706 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.959614  9047 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:17.957170  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:17.960167  8873 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:17.962224  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:17.962839  9041 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:17.952337  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:17.962517  9666 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.221s (SENT)
I20260925 16:44:17.966416  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.967341  8966 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.940263  9045 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:18.004125  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.005403  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:18.005875  9050 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:18.003501  9119 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:18.007143  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:18.007148  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:17.952625 12726 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.514s	user 0.004s	sys 0.004s
I20260925 16:44:17.939807 12558 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:18.015367  8967 raft_consensus.cc:2396] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:17.939460 12666 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:18.012418  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:18.021534  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59043.1us
I20260925 16:44:18.009142  8972 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 3: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:17.963153 12813 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.010928  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:17.921335 12806 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:17.957343 12633 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:17.957273 12753 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:17.850394 12694 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:17.965220 12801 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:18.025378  8966 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:18.016220  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.036581  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:18.037245  9045 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:18.025934  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.032902  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.033829  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.020771 12558 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:18.035279  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 811) took 1053 ms. Trace:
I20260925 16:44:18.040006  9695 rpcz_store.cc:276] 0925 16:44:16.982023 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.982159 (+   136us) service_pool.cc:227] Handling call
0925 16:44:17.015306 (+ 33147us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:17.509208 (+493902us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:18.030939 (+521731us) spinlock_profiling.cc:243] Waited 445 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:18.035197 (+  4258us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1022718720}
I20260925 16:44:18.038400  8972 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 6: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:18.042698  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.032488  9041 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:18.007033 12827 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260925 16:44:17.941422 12798 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.084s
I20260925 16:44:18.020710 12807 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:18.047945  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.048817  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.025023 12763 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.028419 12633 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:18.058931  9050 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:18.066880  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.067500  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.056720 12492 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:18.072683  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.073275  8975 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:18.074019  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.074994  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.059449  8966 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:18.076376  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.077234  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.078449  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.079521  9119 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:18.075274  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:18.050520 12669 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:18.080729  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.092604  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.095472  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.096693  9121 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:18.097893  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.044679 12801 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.103010  9123 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:18.104112  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:18.106740  9045 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:18.086555 12832 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.250s	user 0.000s	sys 0.001s
I20260925 16:44:18.100632  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.031420 12813 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.041699 12666 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.035s
W20260925 16:44:18.144203 12839 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260925 16:44:18.150511  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.124955  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.129945 12814 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
W20260925 16:44:18.130877 12721 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.618s	user 0.007s	sys 0.002s
I20260925 16:44:18.131886 12824 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.070665 12342 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:18.066551 12763 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:18.134519 12840 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260925 16:44:18.136261 12837 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260925 16:44:18.078455 12807 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:18.161314  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.103307 12753 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260925 16:44:18.214517 12460 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.086s	user 0.014s	sys 0.000s
I20260925 16:44:18.214774 12753 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:18.215184 12753 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:18.214907 12460 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.217044 12460 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:18.170068 12013 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.585s	user 0.007s	sys 0.003s
I20260925 16:44:18.219036 12013 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:18.093871 12827 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.177956  8971 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:18.102177  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:18.204049  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 184851us
I20260925 16:44:18.227953  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.228693  9123 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 10
W20260925 16:44:18.229485  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.109s (SENT)
I20260925 16:44:18.229827  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.069679 12822 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260925 16:44:18.207378  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2399) took 1952 ms. Trace:
W20260925 16:44:18.203650  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.088s (SENT)
I20260925 16:44:18.139209 12242 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.212817  9694 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:18.214259  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.222792  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.232053 12827 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.233367 12013 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.233816  9042 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:18.236575 12807 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.238188  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.227763  8966 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:18.297640  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.298887  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.239575 12804 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260925 16:44:18.239933  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 640047us
I20260925 16:44:18.240540 12753 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:18.240893 12812 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:18.242213 12342 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.243961  9122 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:18.246425 12751 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:18.189554 12814 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:18.247968 12838 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.207s	user 0.000s	sys 0.001s
I20260925 16:44:18.249585  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:18.326804  9043 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:18.258008  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.259049  8968 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260925 16:44:18.230551  9049 rpcz_store.cc:276] 0925 16:44:16.254503 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.254640 (+   137us) service_pool.cc:227] Handling call
0925 16:44:16.282054 (+ 27414us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:16.607204 (+325150us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:16.607233 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:16.607683 (+   450us) log.cc:842] Serialized 26 byte log entry
0925 16:44:16.748884 (+141201us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:16.748918 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:18.206916 (+1457998us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:18.206963 (+    47us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:18.207018 (+    55us) raft_consensus.cc:1671] finished
0925 16:44:18.207032 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:18.207328 (+   296us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":30049,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":14506,"spinlock_wait_cycles":699291392,"thread_start_us":114939,"threads_started":1,"wal-append.queue_time_us":254380,"wal-append.run_cpu_time_us":1518,"wal-append.run_wall_time_us":1001685}
I20260925 16:44:18.262997 12824 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.264743  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.268990  8970 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:18.275565  9121 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:18.276947  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.278301  9116 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:18.251507 12409 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.799s	user 0.008s	sys 0.002s
I20260925 16:44:18.284543  8975 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:18.292600  9123 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:18.302423  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.306890  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:18.341018  9121 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:18.310236  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.341729  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:18.342717  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.343798  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.312889  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:18.310823  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 217022us
I20260925 16:44:18.332914  8967 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:18.333810  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 130198us
I20260925 16:44:18.334551  9118 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:18.334914  8968 pending_rounds.cc:76] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 7
I20260925 16:44:18.364138  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.364130  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:18.364976  8968 pending_rounds.cc:97] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260925 16:44:18.365243  9702 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:18.347012  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:18.365003  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:18.351082  9701 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260925 16:44:18.347615  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:18.369236  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.958s (SENT)
I20260925 16:44:18.344782  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:18.370076  8966 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:18.370323  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.505s (SENT)
I20260925 16:44:18.370934  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.378301  9118 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:18.374805  8968 raft_consensus.cc:2866] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:18.381047  8972 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:18.371249  8966 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:18.305750 12813 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:18.379477  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:18.329566 12801 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:18.344705 12821 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.590s	user 0.003s	sys 0.001s
I20260925 16:44:18.304986 12013 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.080s
I20260925 16:44:18.338668 12836 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.399099  8967 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:18.374037 12409 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.340523 12822 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:18.380375 12798 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.394280 12492 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:18.345113 12793 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260925 16:44:18.410808  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2473) took 1427 ms. Trace:
I20260925 16:44:18.419489  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:18.421195  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 191711us
I20260925 16:44:18.437346  8971 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:18.454599  8973 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:18.458050  9049 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:18.491674  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:18.521148  9048 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:18.492666  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:18.410032  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 835679us
I20260925 16:44:18.416741 12368 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:18.401320 12641 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.124s
I20260925 16:44:18.420045  8975 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:18.424409  9046 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
W20260925 16:44:18.528118  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 108703us
I20260925 16:44:18.524695  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:18.407642  9043 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:18.430230  9702 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:18.459446 12822 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.072s
W20260925 16:44:18.514086  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76323.9us
I20260925 16:44:18.537830  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.516922  9115 rpcz_store.cc:276] 0925 16:44:16.983611 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.983776 (+   165us) service_pool.cc:227] Handling call
0925 16:44:16.984050 (+   274us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:17.022299 (+ 38249us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:17.159487 (+137188us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:17.159913 (+   426us) log.cc:842] Serialized 26 byte log entry
0925 16:44:17.503420 (+343507us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:17.560269 (+ 56849us) log.cc:842] Serialized 14 byte log entry
0925 16:44:18.237221 (+676952us) spinlock_profiling.cc:243] Waited 1.37 ms on lock 0x7b180040e7c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:44:18.410237 (+173016us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:18.410370 (+   133us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:18.410450 (+    80us) raft_consensus.cc:1671] finished
0925 16:44:18.410574 (+   124us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:18.410738 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4430,"prepare.queue_time_us":44288,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":710205,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":46870,"spinlock_wait_cycles":3154304,"thread_start_us":462961,"threads_started":2,"wal-append.queue_time_us":518882}
W20260925 16:44:18.559901  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 213027us
I20260925 16:44:18.560883  8939 leader_election.cc:398] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7.
I20260925 16:44:18.561169  8939 leader_election.cc:401] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260925 16:44:18.554236  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:18.568003  9699 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:18.580322  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.580698  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.580893  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.581526  9122 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:18.585760  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:18.589789  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52047.2us
I20260925 16:44:18.450735 12763 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:18.526508 12242 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.416474 12806 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.614153  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:18.614877  9043 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:18.442030 12725 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:18.490429 12492 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:18.420928 12815 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:18.567018 12846 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:18.594290  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.565682 12822 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:18.582731 12558 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.532s	user 0.007s	sys 0.003s
W20260925 16:44:18.616436  8871 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 340) took 26485 ms (client timeout 15000 ms). Trace:
I20260925 16:44:18.617630  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.421598 12460 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.182s
I20260925 16:44:18.450081 12798 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.596244 12792 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:18.598012 12624 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:18.625998  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2472) took 1633 ms. Trace:
I20260925 16:44:18.639849  9117 rpcz_store.cc:276] 0925 16:44:16.983077 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:16.983216 (+   139us) service_pool.cc:227] Handling call
0925 16:44:18.613833 (+1630617us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b54003becd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:18.616683 (+  2850us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2116577152}
I20260925 16:44:18.642153  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.623368 12752 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:18.622067  9045 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:18.456017 12409 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.421665 12712 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.193s
I20260925 16:44:18.613973 12509 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:18.636466  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:18.638082  9693 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:18.606490  9122 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
W20260925 16:44:18.643899  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63663.8us
I20260925 16:44:18.646128  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:18.458910 12814 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.639986 12725 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:18.667687  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.668059  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:18.648983 12815 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:18.653723 12848 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:44:18.675258 12853 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:18.675740 12853 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:18.653887 12861 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.069s	user 0.000s	sys 0.001s
I20260925 16:44:18.676072 12853 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:18.653132 12847 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:18.661432  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43966.7us
I20260925 16:44:18.629443 12803 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.029s
I20260925 16:44:18.654197 12865 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.664613  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:18.674710  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:18.654837 12827 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.679665  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:18.671948  8966 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:44:18.674394 12242 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:18.647851 12792 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:18.632241 12558 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.681063  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:18.648783  9043 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:18.686611 12706 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:18.677117 12798 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:18.701058  9043 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:18.688527  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:18.664549 12752 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:18.666837 12763 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:18.665045  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:18.709169  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44213.2us
I20260925 16:44:18.711189 12729 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260925 16:44:18.712664 12729 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:18.713219 12729 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:44:18.418488 12724 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.274s
I20260925 16:44:18.716111  9119 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:18.678468 12815 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:18.676877 12795 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.118s
W20260925 16:44:18.725346  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47478.3us
W20260925 16:44:18.727911  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58142.5us
I20260925 16:44:18.733723  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.733450  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.734931  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:18.714570 12763 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:18.738940  9089 connection.cc:232] RPC call timeout handler was delayed by -2.2930761210000128s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.24910000000000002s for a response
W20260925 16:44:18.627811  8871 rpcz_store.cc:269] 0925 16:43:51.833793 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:51.900707 (+ 66914us) service_pool.cc:227] Handling call
0925 16:44:18.305137 (+26404430us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:44:03.473215 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:44:03.606455 (+133240us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:44:03.606511 (+    56us) write_op.cc:435] Acquired schema lock
0925 16:44:03.606529 (+    18us) tablet.cc:660] Decoding operations
0925 16:44:03.664210 (+ 57681us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:44:03.664299 (+    89us) write_op.cc:641] Partition lock acquired for write op
0925 16:44:03.664330 (+    31us) tablet.cc:683] Acquiring locks for 19 operations
0925 16:44:03.666386 (+  2056us) tablet.cc:699] Row locks acquired
0925 16:44:03.666441 (+    55us) write_op.cc:260] PREPARE: finished
0925 16:44:03.666617 (+   176us) write_op.cc:270] Start()
0925 16:44:03.666787 (+   170us) write_op.cc:276] Timestamp: P: 1790354643666548 usec, L: 0
0925 16:44:03.666828 (+    41us) op_driver.cc:331] REPLICATION: starting
0925 16:44:03.667597 (+   769us) log.cc:842] Serialized 7481 byte log entry
0925 16:44:07.675973 (+4008376us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f7198fe45fe 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb
0925 16:44:11.591801 (+3915828us) spinlock_profiling.cc:243] Waited 47.9 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:12.624967 (+1033166us) op_driver.cc:444] REPLICATION: finished
0925 16:44:12.794340 (+169373us) write_op.cc:301] APPLY: starting
0925 16:44:12.827909 (+ 33569us) tablet.cc:1365] starting BulkCheckPresence
0925 16:44:13.036113 (+208204us) tablet.cc:1368] finished BulkCheckPresence
0925 16:44:13.038105 (+  1992us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:44:13.117557 (+ 79452us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:44:13.117988 (+   431us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=19
0925 16:44:13.118033 (+    45us) write_op.cc:312] APPLY: finished
0925 16:44:13.118613 (+   580us) log.cc:842] Serialized 132 byte log entry
0925 16:44:13.118833 (+   220us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:13.119264 (+   431us) write_op.cc:454] Released schema lock
0925 16:44:13.119339 (+    75us) write_op.cc:341] FINISH: Updating metrics
0925 16:44:13.119680 (+   341us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:13.133991 (+ 14311us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":372836,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":123096,"apply.run_cpu_time_us":7478,"apply.run_wall_time_us":431215,"num_ops":19,"prepare.queue_time_us":220889,"prepare.run_cpu_time_us":73722,"prepare.run_wall_time_us":5972841,"raft.queue_time_us":321100,"raft.run_cpu_time_us":9284,"raft.run_wall_time_us":55386,"replication_time_us":8957994,"spinlock_wait_cycles":173075584,"thread_start_us":6026670,"threads_started":4,"wal-append.queue_time_us":5667108,"wal-append.run_cpu_time_us":57156,"wal-append.run_wall_time_us":4830602}]]}
I20260925 16:44:18.716120 12801 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:18.741746  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.742314  9117 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:18.714874 12242 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:18.744331  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:18.722987 12694 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:18.754954  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 914) took 1251 ms. Trace:
I20260925 16:44:18.755363  9700 rpcz_store.cc:276] 0925 16:44:17.503469 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.504937 (+  1468us) service_pool.cc:227] Handling call
0925 16:44:17.505231 (+   294us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:17.521144 (+ 15913us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:18.754744 (+1233600us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:18.754904 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35140352}
I20260925 16:44:18.747463  9119 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:18.690230 12790 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.044s
I20260925 16:44:18.726059 12724 consensus_queue.cc:1225] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 7.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260925 16:44:18.730608 12815 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:18.777585  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.731141 12712 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.779927  9049 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:18.782162  9049 raft_consensus.cc:595] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:18.782590  9049 raft_consensus.cc:603] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:18.786528  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:18.439746 12836 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:18.741331 12763 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:18.798215  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 109761us
I20260925 16:44:18.850901  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.726019 12752 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.053s
I20260925 16:44:18.678030 12492 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.674707 12725 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.343025 12812 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.875438  9117 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:18.783512 12801 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:18.790676 12694 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:18.898195  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:18.904062  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:18.690477 12865 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.802089 12871 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:18.780552 12740 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.108s
I20260925 16:44:18.779640 12827 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.112s
W20260925 16:44:18.914309  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56853.8us
I20260925 16:44:18.918706  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:18.876943 12706 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:18.921686  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9393761209998956s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2884s for a response
W20260925 16:44:18.932411  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7998761209998975s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30390000000000006s for a response
I20260925 16:44:18.913465  9119 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:18.781878 12712 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:18.935318 12712 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.745538 12864 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:18.945479  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:18.926848 12711 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.278s	user 0.013s	sys 0.003s
I20260925 16:44:18.907341 12868 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:19.014806  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:18.920744 12409 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:18.928076 12846 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:18.948606 12864 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:19.040395  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:18.955601  9117 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:18.958877 12893 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:18.789904 12855 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.147s
I20260925 16:44:18.951149 12795 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:19.043577  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:18.978375 12869 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
W20260925 16:44:18.981880 12856 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260925 16:44:18.987047 12753 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:18.991474 12467 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:18.995280 12752 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:18.852258 12792 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.001272  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2418) took 1067 ms. Trace:
I20260925 16:44:19.211628  9041 rpcz_store.cc:276] 0925 16:44:17.933949 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.043441 (+109492us) service_pool.cc:227] Handling call
0925 16:44:18.043671 (+   230us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:18.169043 (+125372us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:18.169087 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:18.169126 (+    39us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:18.169154 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:19.000995 (+831841us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:19.001047 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:19.001213 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":287961472}
W20260925 16:44:19.213594  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 309589us
I20260925 16:44:19.041118  9045 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:18.967974 12877 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:19.049113 12795 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.049817 12872 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:19.025805 12868 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:19.023458 12558 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:19.017606 12879 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.121s
I20260925 16:44:18.927273 12242 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.124821 12867 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:19.182775 12409 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260925 16:44:19.052120  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:19.188052 12509 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260925 16:44:19.026402 12846 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.189709  9043 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:19.131978  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2412) took 1432 ms. Trace:
I20260925 16:44:19.212567  9122 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:19.044173  9697 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:19.294798  9042 rpcz_store.cc:276] 0925 16:44:17.699309 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.699459 (+   150us) service_pool.cc:227] Handling call
0925 16:44:17.724487 (+ 25028us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:18.293716 (+569229us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:19.131721 (+838005us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54002611d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:19.131911 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1170935552}
I20260925 16:44:19.216442  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:19.051651 12865 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:19.248682  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:19.253363  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:19.253870  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:19.185178 12793 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:19.188777 12467 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:19.052330 12862 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:19.244490 12405 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Stepping down as leader of term 6
W20260925 16:44:19.304392  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55831.7us
I20260925 16:44:19.258793 12877 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.268788 12882 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:19.269819 12872 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:19.247514 12624 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.602s	user 0.006s	sys 0.003s
I20260925 16:44:19.030249 12694 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.192022 12752 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:19.282733  9045 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:19.030373 12801 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.298473  9041 raft_consensus.cc:595] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:19.337761  9041 raft_consensus.cc:603] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:19.250553 12796 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
W20260925 16:44:19.287158 12853 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.611s	user 0.009s	sys 0.000s
W20260925 16:44:19.308398  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92051.4us
W20260925 16:44:19.343237  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.528s (SENT)
W20260925 16:44:19.344069  9015 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.648s (SENT)
W20260925 16:44:19.344877  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.696s (SENT)
I20260925 16:44:19.267989 12850 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:19.309504  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.012s	sys 0.002s
W20260925 16:44:19.350893  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.012s	sys 0.002s
I20260925 16:44:19.311916  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:19.330400 12753 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:19.292822 12509 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7.
I20260925 16:44:19.309777 12405 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:19.305751 12790 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:19.335927  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:19.052551 12706 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.323450  9702 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
W20260925 16:44:19.351253  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 679519us
I20260925 16:44:19.353993  9700 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260925 16:44:19.358752  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46938.4us
I20260925 16:44:19.337581 12624 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:19.341754 12796 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:19.329005 12641 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
W20260925 16:44:19.412927  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 77111.8us
W20260925 16:44:19.426944  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63284.8us
I20260925 16:44:19.429557  9119 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:19.310575 12793 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.216625 12864 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.334815 12882 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.292368 12867 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:19.435114  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.001s	sys 0.005s
W20260925 16:44:19.444662  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.001s	sys 0.005s
I20260925 16:44:19.418995  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2344) took 1654 ms. Trace:
I20260925 16:44:19.332460 12670 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260925 16:44:19.413039  9697 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:19.431466  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.000s	sys 0.029s
W20260925 16:44:19.446033  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.001s	sys 0.029s
I20260925 16:44:19.415920  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:19.362387 12467 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.329458 12887 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.087s
I20260925 16:44:19.426714 12753 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:19.444571  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2406) took 2048 ms. Trace:
I20260925 16:44:19.445472  9124 rpcz_store.cc:276] 0925 16:44:17.764710 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.764867 (+   157us) service_pool.cc:227] Handling call
0925 16:44:17.766051 (+  1184us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:18.241745 (+475694us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:18.241791 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:18.242317 (+   526us) log.cc:842] Serialized 26 byte log entry
0925 16:44:18.581387 (+339070us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:18.633952 (+ 52565us) log.cc:842] Serialized 14 byte log entry
0925 16:44:18.715775 (+ 81823us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:18.715856 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:19.418791 (+702935us) raft_consensus.cc:1671] finished
0925 16:44:19.418810 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:19.418929 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":487193,"prepare.queue_time_us":149485,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":34,"raft.queue_time_us":623103,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13853,"thread_start_us":440792,"threads_started":3,"wal-append.queue_time_us":499049}
I20260925 16:44:19.452764  9047 rpcz_store.cc:276] 0925 16:44:17.396105 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.396687 (+   582us) service_pool.cc:227] Handling call
0925 16:44:17.445172 (+ 48485us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:17.960270 (+515098us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:19.432834 (+1472564us) spinlock_profiling.cc:243] Waited 514 ms on lock 0x7b54002a2954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:19.444517 (+ 11683us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1182667648}
I20260925 16:44:19.411638 12776 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:19.460345  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:19.351214 12853 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:19.456769 12822 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.821s	user 0.009s	sys 0.001s
I20260925 16:44:19.451984 12886 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:19.454833 12893 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:19.455802 12864 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:19.361575 12850 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.505067  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:44:19.505920 12898 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:19.506485 12898 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.507002 12900 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:19.507418  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:44:19.507566 12900 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:19.507826 12885 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:19.508188  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:19.508337 12885 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.508685 12867 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:19.508795  9115 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 5.
I20260925 16:44:19.508571 12900 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.413364 12868 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.510269 12885 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:19.511037 12898 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:19.514590  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:19.515460  9115 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:19.511173 12877 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:19.517251  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:19.529819  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:19.520587  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:19.535960  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72681.7us
I20260925 16:44:19.457687 12641 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260925 16:44:19.493095 12467 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:19.462160 12790 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.054s
I20260925 16:44:19.485216 12822 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:19.482640 12886 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:19.586145 12906 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260925 16:44:19.586622  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:19.586349 12886 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.587450 12886 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:19.462397 12409 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.042s
I20260925 16:44:19.564546  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:19.465823 12743 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
W20260925 16:44:19.575129  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59253us
I20260925 16:44:19.511085 12853 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:19.497282 12865 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.088s
I20260925 16:44:19.444607 12405 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.501667 12776 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260925 16:44:19.595037  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77877.8us
I20260925 16:44:19.438519 12752 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.477633 12558 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:19.599625  9693 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:19.598994  9124 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:19.515404 12795 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:19.497570 12887 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.084s
I20260925 16:44:19.611719 12509 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260925 16:44:19.472190 12796 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.439354 12872 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:19.626514  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 164636us
W20260925 16:44:19.707077  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 279796us
I20260925 16:44:19.613209 12753 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:19.972543 12633 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:19.775178 12891 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.426s	user 0.001s	sys 0.000s
W20260925 16:44:20.279577 12886 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.691s	user 0.002s	sys 0.004s
W20260925 16:44:19.844396 12909 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
I20260925 16:44:20.282274 12798 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:20.137310 12342 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:20.336336 12633 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:20.344964 12342 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:20.345817 12342 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:20.346455 12467 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.003s
I20260925 16:44:19.760470 12882 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:20.101214 12857 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.434s	user 0.002s	sys 0.001s
W20260925 16:44:20.000768  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.006s	sys 0.007s
W20260925 16:44:20.347874  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.076s	user 0.010s	sys 0.015s
I20260925 16:44:19.796337 12892 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:20.348712 12892 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.349403 12836 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:20.350873  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2491) took 1096 ms. Trace:
I20260925 16:44:20.351161 12892 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:20.125218  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.007s	sys 0.009s
W20260925 16:44:20.352690  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.007s	sys 0.017s
I20260925 16:44:20.353377  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:19.605818 12763 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.005s
I20260925 16:44:20.351223  9116 rpcz_store.cc:276] 0925 16:44:19.254225 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:19.255027 (+   802us) service_pool.cc:227] Handling call
0925 16:44:19.255447 (+   420us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:19.265181 (+  9734us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:19.265214 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:19.271261 (+  6047us) log.cc:842] Serialized 26 byte log entry
0925 16:44:19.321182 (+ 49921us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:19.321242 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:19.321327 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:20.350689 (+1029362us) raft_consensus.cc:1671] finished
0925 16:44:20.350712 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:20.350823 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9336,"raft.queue_time_us":12546,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":87,"thread_start_us":49539,"threads_started":1,"wal-append.queue_time_us":165727}
W20260925 16:44:19.760207 12624 consensus_queue.cc:1159] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 7 status { last_received { term: 7 index: 8 } last_committed_idx: 7 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7. Ops: [6.8-6.8]" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:44:20.303356  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:20.309206 12910 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.549s	user 0.001s	sys 0.000s
I20260925 16:44:20.310981  9046 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:20.363862  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2428) took 1806 ms. Trace:
W20260925 16:44:20.277742  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1662) took 2369 ms (client timeout 2081 ms). Trace:
W20260925 16:44:20.314755 12864 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.813s	user 0.007s	sys 0.003s
I20260925 16:44:20.364518  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 816) took 1177 ms. Trace:
I20260925 16:44:20.316493  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 814) took 1299 ms. Trace:
W20260925 16:44:20.364782  8972 rpcz_store.cc:269] 0925 16:44:17.908709 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.042543 (+133834us) service_pool.cc:227] Handling call
0925 16:44:20.277351 (+2234808us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002cb5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:20.277644 (+   293us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":694404352}
I20260925 16:44:20.365238  9119 rpcz_store.cc:276] 0925 16:44:19.017406 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:19.017616 (+   210us) service_pool.cc:227] Handling call
0925 16:44:19.017896 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:19.429939 (+412043us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.316293 (+886354us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b5400165154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:20.316445 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":946364672}
I20260925 16:44:20.364228  9046 rpcz_store.cc:276] 0925 16:44:18.557508 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.557661 (+   153us) service_pool.cc:227] Handling call
0925 16:44:18.557943 (+   282us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.310788 (+1752845us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b54003acda0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:44:20.363591 (+ 52803us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.363804 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28160256}
I20260925 16:44:20.367723  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.368458  9696 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:20.372114 12892 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:20.372553 12892 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:20.372968 12892 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:20.376451  9124 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:20.147883  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2154) took 1964 ms. Trace:
I20260925 16:44:20.122817  9695 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:20.290406  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.010s	sys 0.013s
W20260925 16:44:20.377844  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.950s	user 0.011s	sys 0.014s
I20260925 16:44:20.377488  8966 rpcz_store.cc:276] 0925 16:44:18.183742 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.395133 (+211391us) service_pool.cc:227] Handling call
0925 16:44:18.395516 (+   383us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:18.690287 (+294771us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.147586 (+1457299us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b54003575d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:20.147819 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":624260352}
W20260925 16:44:20.145510  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1658) took 2314 ms (client timeout 1654 ms). Trace:
W20260925 16:44:20.123332  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 705) took 2443 ms (client timeout 1892 ms). Trace:
W20260925 16:44:20.379624  8969 rpcz_store.cc:269] 0925 16:44:17.680299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.680433 (+   134us) service_pool.cc:227] Handling call
0925 16:44:20.123090 (+2442657us) spinlock_profiling.cc:243] Waited 234 ms on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:20.123251 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":537873664}
I20260925 16:44:20.269631  9120 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
W20260925 16:44:20.379324  8970 rpcz_store.cc:269] 0925 16:44:17.831306 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.869785 (+ 38479us) service_pool.cc:227] Handling call
0925 16:44:20.145321 (+2275536us) spinlock_profiling.cc:243] Waited 311 ms on lock 0x7b54002ffb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:20.145435 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":715901696}
I20260925 16:44:19.578679 12898 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260925 16:44:19.987332  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 695) took 2452 ms (client timeout 2524 ms). Trace:
W20260925 16:44:20.382876  8974 rpcz_store.cc:269] 0925 16:44:17.513420 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.513557 (+   137us) service_pool.cc:227] Handling call
0925 16:44:19.965876 (+2452319us) spinlock_profiling.cc:243] Waited 237 ms on lock 0x7b54002fec54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:19.966034 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":544834944}
I20260925 16:44:20.322340  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:20.298581  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 838243us
I20260925 16:44:20.384122  9121 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:20.384162  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.328876 12694 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.078280 12850 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:19.796221 12881 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.885s
I20260925 16:44:20.386183 12694 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:19.707289 12701 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:19.614007 12815 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.816s	user 0.007s	sys 0.002s
I20260925 16:44:20.395395 12725 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:20.395908 12815 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.397080 12881 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.397589 12881 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.398066 12815 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:19.796486 12894 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260925 16:44:20.398993  9696 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:20.399557  9121 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260925 16:44:20.400044 12701 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.401628  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.402355 12701 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:20.382615 12898 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:19.795468 12911 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.241s	user 0.001s	sys 0.000s
W20260925 16:44:19.984411 12908 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260925 16:44:19.797156 12901 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.345s	user 0.000s	sys 0.000s
I20260925 16:44:20.344169  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.342553 12798 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:20.346885 12342 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:19.843544 12907 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.284s	user 0.000s	sys 0.000s
I20260925 16:44:19.603041 12492 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:20.353438  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:19.612964 12896 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260925 16:44:19.864585 12867 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:19.759974 12405 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:19.986621 12779 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:20.356778  9116 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:20.358059  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.317312 12558 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:20.358851  9698 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
W20260925 16:44:20.360381  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57105.2us
I20260925 16:44:19.775672 12846 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:19.986047 12793 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:20.359965 12763 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.148357  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 917) took 2397 ms. Trace:
I20260925 16:44:20.364970  9117 rpcz_store.cc:276] 0925 16:44:19.187123 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:19.187230 (+   107us) service_pool.cc:227] Handling call
0925 16:44:19.187487 (+   257us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:19.188052 (+   565us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:19.188080 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:19.188512 (+   432us) log.cc:842] Serialized 26 byte log entry
0925 16:44:19.357513 (+169001us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:19.357549 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:19.357609 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:20.308657 (+951048us) spinlock_profiling.cc:243] Waited 14.8 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:20.364210 (+ 55553us) raft_consensus.cc:1671] finished
0925 16:44:20.364237 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:20.364461 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":98,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":34064640,"thread_start_us":168686,"threads_started":1,"wal-append.queue_time_us":365097}
I20260925 16:44:20.379231  9046 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:20.381350  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:20.422214  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.385080  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:20.430398  9047 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:20.385593  9045 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:20.343068 12795 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:20.390770  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:20.442937  9120 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260925 16:44:20.444523 12786 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:20.394625  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.394897 12918 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:20.429172 12867 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.445719 12884 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.448196 12884 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.403549 12898 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:20.342530 12666 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.450469 12666 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.451565  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 927) took 1435 ms. Trace:
I20260925 16:44:20.451943  9695 rpcz_store.cc:276] 0925 16:44:19.016048 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:19.016194 (+   146us) service_pool.cc:227] Handling call
0925 16:44:19.025488 (+  9294us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.377590 (+1352102us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.451367 (+ 73777us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54006eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:20.451514 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2523132288}
I20260925 16:44:20.410408 12881 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:20.459980  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 65430.4us
I20260925 16:44:20.461067  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:20.408062  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.920s (SENT)
I20260925 16:44:20.360239 12900 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.405670  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.381740 12886 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.390872 12752 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:20.469887  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:20.429852  9041 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:20.436055 12726 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:20.409432 12790 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260925 16:44:20.473793 12864 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:20.436754 12763 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:20.474550 12864 consensus_queue.cc:1225] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260925 16:44:20.467819 12836 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260925 16:44:20.475071 12763 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:20.475409 12763 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:20.475749 12801 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:20.476121 12801 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:20.476239 12763 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.476876 12801 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.477475 12763 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:20.478048 12801 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:20.429181  9694 rpcz_store.cc:276] 0925 16:44:17.751174 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.751778 (+   604us) service_pool.cc:227] Handling call
0925 16:44:17.769448 (+ 17670us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:18.293501 (+524053us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.148116 (+1854615us) spinlock_profiling.cc:243] Waited 443 ms on lock 0x7b540066dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:20.148300 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1019308800}
I20260925 16:44:20.437886 12798 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:20.479508 12798 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:20.471580 12900 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.481648 12900 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:20.416663 12492 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:20.482359 12492 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:20.441236  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2438) took 1416 ms. Trace:
I20260925 16:44:20.441715 12558 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:20.392204 12694 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:20.432612  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.446478 12846 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.403041  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:20.463912  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55872.4us
I20260925 16:44:20.426743 12779 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:20.473235  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 51127.6us
I20260925 16:44:20.416004 12815 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.044s
I20260925 16:44:20.484017  9049 rpcz_store.cc:276] 0925 16:44:19.024542 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:19.026024 (+  1482us) service_pool.cc:227] Handling call
0925 16:44:19.041783 (+ 15759us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:19.188986 (+147203us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:19.189012 (+    26us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:19.257896 (+ 68884us) log.cc:842] Serialized 52 byte log entry
0925 16:44:20.348280 (+1090384us) raft_consensus.cc:1631] Marking committed up to 2
0925 16:44:20.348334 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.348414 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:20.441030 (+ 92616us) raft_consensus.cc:1671] finished
0925 16:44:20.441048 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:20.441165 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13146,"raft.queue_time_us":138967,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":22114,"thread_start_us":1075858,"threads_started":1,"wal-append.queue_time_us":1161180}
I20260925 16:44:20.475473 12836 consensus_queue.cc:1225] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 7.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:44:20.502673  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:20.444972 12786 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:20.502684  9043 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:20.504613  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.461894 12887 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260925 16:44:20.522547  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61813.1us
I20260925 16:44:20.522279  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.459497 12795 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:20.474411 12790 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:20.469373 12881 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:44:20.523669 12558 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:20.529565  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 726) took 2704 ms. Trace:
I20260925 16:44:20.544238  8968 rpcz_store.cc:276] 0925 16:44:17.825105 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.148279 (+323174us) service_pool.cc:227] Handling call
0925 16:44:18.258618 (+110339us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:18.380610 (+121992us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.529397 (+2148787us) spinlock_profiling.cc:243] Waited 72.3 ms on lock 0x7b54001e2b50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:20.529513 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":166375680}
I20260925 16:44:20.530122 12867 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:20.530354  9118 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260925 16:44:20.464746 12787 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260925 16:44:20.533115 12796 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:20.459237 12725 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.065s
W20260925 16:44:20.535837 12921 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260925 16:44:20.538065  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:20.491607 12388 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:20.543030  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:20.545665  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:20.479343 12914 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
I20260925 16:44:20.543174 12836 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260925 16:44:20.548918 12926 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260925 16:44:20.549046  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:20.479247 12898 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:20.472083 12886 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:20.545809  9118 pending_rounds.cc:76] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:44:20.522419 12846 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.550276  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:20.649922  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:20.678032  9118 pending_rounds.cc:97] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260925 16:44:20.602072  9124 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:20.550201  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.502532 12918 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.096s
I20260925 16:44:20.688575  9118 raft_consensus.cc:2866] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:20.550522  9701 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:20.678205  9116 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:20.689469  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:20.694514  9050 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: []
W20260925 16:44:20.700325  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 151296us
W20260925 16:44:20.703050  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 152834us
I20260925 16:44:20.599475 12624 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.704833  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:20.707270  9043 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:20.709026  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 158870us
I20260925 16:44:20.650182 12666 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:20.544488 12884 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:20.704656 12836 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:20.602133 12669 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:20.690225 12388 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.714479 12898 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:20.704667 12694 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:20.714828 12624 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.715960 12920 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:20.738209 12694 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:20.717278 12887 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:20.718397  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 688) took 2153 ms. Trace:
I20260925 16:44:20.750339  9048 rpcz_store.cc:276] 0925 16:44:18.565162 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.565285 (+   123us) service_pool.cc:227] Handling call
0925 16:44:18.565621 (+   336us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:18.596434 (+ 30813us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:18.596477 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:18.617517 (+ 21040us) log.cc:842] Serialized 52 byte log entry
0925 16:44:19.145045 (+527528us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:19.244961 (+ 99916us) log.cc:842] Serialized 14 byte log entry
0925 16:44:19.245194 (+   233us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:19.245281 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:20.345679 (+1100398us) spinlock_profiling.cc:243] Waited 4.8 ms on lock 0x7b1800394540. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:20.716151 (+370472us) spinlock_profiling.cc:243] Waited 5.31 ms on lock 0x7b1800394540. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:20.718206 (+  2055us) raft_consensus.cc:1671] finished
0925 16:44:20.718226 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:20.718346 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":306,"prepare.queue_time_us":99085,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":27644,"raft.run_cpu_time_us":273,"raft.run_wall_time_us":25462,"spinlock_wait_cycles":23260672,"thread_start_us":495148,"threads_started":1,"wal-append.queue_time_us":644476}
I20260925 16:44:20.752156  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:20.719544  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:20.753095  9124 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:20.719640  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:20.690412 12701 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:20.702162  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.683284 12492 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.716830 12641 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:20.743597 12920 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:20.749312 12624 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:20.749967 12694 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:20.598937 12900 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.168s
I20260925 16:44:20.721483 12836 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:20.759528  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55689.3us
I20260925 16:44:20.763262  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.667049 12779 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.801045  9702 raft_consensus.cc:2354] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:20.785053  9042 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
W20260925 16:44:20.805439  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 302501us
I20260925 16:44:20.756078 12701 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:20.842662  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 140576us
I20260925 16:44:20.737443 12669 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:20.779640 12920 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:20.770028 12641 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:20.843863  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.245s (SENT)
I20260925 16:44:20.771311 12887 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:20.844269  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 81131.9us
I20260925 16:44:20.861129  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:20.863656  9048 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:20.845491 12786 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:20.845695 12900 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:20.846640  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:20.843307  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46361.7us
I20260925 16:44:20.915128  9122 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:20.916427  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:20.916565  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:20.917146  8974 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:20.918329  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:20.777204 12793 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:20.800843 12836 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:20.899211  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55429.3us
I20260925 16:44:20.853008 12701 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:20.908380  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59347.5us
I20260925 16:44:20.804723 12790 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.920516  8966 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:20.921553  8970 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:44:20.959079  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:20.959832  8970 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Handling vote request from an unknown peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:20.960239  8970 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:20.928399  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:20.945474  9122 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260925 16:44:20.917955  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:20.970204  9122 pending_rounds.cc:76] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 5
I20260925 16:44:20.970584  9122 pending_rounds.cc:97] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260925 16:44:20.970868  9122 raft_consensus.cc:2866] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:20.972133  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:20.972960  9124 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260925 16:44:20.974148  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:20.975878  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:20.953576 12935 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:44:20.805781 12752 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.086s
I20260925 16:44:20.953799  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:20.954322  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.002147  8972 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:20.860749 12864 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:20.862078 12887 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:20.994555  9015 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.564s (SENT)
I20260925 16:44:20.996002  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.050621  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.050762  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:20.996214  8969 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:20.996621  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:20.997786  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.051795  9122 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: [5.3-5.3]
I20260925 16:44:21.051175  8971 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260925 16:44:20.999105  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1097) took 2300 ms. Trace:
I20260925 16:44:20.888545 12801 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:21.053092  9693 rpcz_store.cc:276] 0925 16:44:18.698269 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.698414 (+   145us) service_pool.cc:227] Handling call
0925 16:44:18.698771 (+   357us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.326336 (+1627565us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:20.998864 (+672528us) spinlock_profiling.cc:243] Waited 901 ms on lock 0x7b540064aad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:20.999049 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2071244672}
I20260925 16:44:21.071139  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.077024  9049 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260925 16:44:21.085836  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:20.972218 12786 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:21.099392  9124 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260925 16:44:21.103814  9666 connection.cc:232] RPC call timeout handler was delayed by -1.3486872260000382s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17120000000000002s for a response
W20260925 16:44:21.110205  9666 connection.cc:232] RPC call timeout handler was delayed by -1.2680435669999497s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1892s for a response
I20260925 16:44:21.049542 12639 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:21.106151  9697 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260925 16:44:20.973353 12886 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.113768  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.124491  8972 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:21.114092  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:21.103884  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 109381us
I20260925 16:44:21.125173  8966 raft_consensus.cc:2362] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9. Re-sending same reply.
W20260925 16:44:21.125332  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.785s (SENT)
I20260925 16:44:21.125960  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:21.128680 12933 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
I20260925 16:44:21.131249  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.132057  8968 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:21.132789  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.133811  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.134600  8969 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:21.135421  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.140147  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.107026 12453 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.144827 12753 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.144419 12453 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.145336 12753 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.147346 12753 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.085671 12641 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:21.148401  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.532s (SENT) [suppressed 40 similar messages]
I20260925 16:44:21.063925 12864 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.150904 12864 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:21.151954  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.822s (SENT)
I20260925 16:44:21.152750 12669 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:21.154342 12892 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.781s	user 0.010s	sys 0.001s
I20260925 16:44:21.089949 12793 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:44:21.154758 12892 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:21.155522  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.983s (SENT)
I20260925 16:44:21.156845  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.058310 12887 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:21.121760  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1938202320000073s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1678s for a response
W20260925 16:44:21.160283  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0489202320000004s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1839s for a response
I20260925 16:44:21.161907  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:21.003365 12846 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.047366 12706 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.159403 12342 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:21.165364  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.169467  9046 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:21.171141  9041 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:21.172232  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:21.175025  8971 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:21.178346  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.185312  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:21.195819  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.197016  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.198720  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.199998  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.115952 12898 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.201452  9044 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:21.109606 12786 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:21.220386  9046 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:21.202638  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.193560 12639 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:21.222391 12753 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.222836 12753 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.222950 12639 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.224784 12753 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.225272 12753 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.194787 12669 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:21.225636 12753 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.227447 12753 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.211274  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.147092 12453 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.229913 12694 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.232412  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2421) took 3170 ms. Trace:
I20260925 16:44:21.239858 12886 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:44:21.261639  8966 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:21.004163 12790 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.242763 12918 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:44:21.262759  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.263021  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:21.263582  9049 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
W20260925 16:44:21.263999  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61450.7us
I20260925 16:44:21.205490  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.252156  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.254359  8969 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
W20260925 16:44:21.254601  9117 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.021s	sys 0.040s
I20260925 16:44:21.260190  9050 rpcz_store.cc:276] 0925 16:44:18.062454 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.075677 (+ 13223us) service_pool.cc:227] Handling call
0925 16:44:20.310262 (+2234585us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:44:20.310437 (+   175us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.702266 (+391829us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.232182 (+529916us) spinlock_profiling.cc:243] Waited 384 ms on lock 0x7b5400252bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:21.232357 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":887389952}
W20260925 16:44:21.269768  9117 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.021s	sys 0.042s
I20260925 16:44:21.266710  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.270792  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.271045  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.193027 12706 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.260442 12242 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260925 16:44:21.273509 12706 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.254887 12898 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.183250 12795 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.274750  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.280004  9120 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:21.278680  9116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.022s	sys 0.042s
I20260925 16:44:21.275318  9124 raft_consensus.cc:1203] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Deduplicated request from leader. Original: 6.8->[7.9-7.9]   Dedup: 7.9->[]
W20260925 16:44:21.281483  9116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.022s	sys 0.042s
I20260925 16:44:21.281854  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260925 16:44:21.246938 12786 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:21.177157 12801 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260925 16:44:21.265950  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.287679  8966 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:21.259939  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:21.289147  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.193439 12725 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.084s
I20260925 16:44:21.207026 12666 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260925 16:44:21.266505 12492 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.310257  9045 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:21.277755 12895 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:21.311707  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.283449 12721 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:21.310628  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.318768  9695 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:21.289023  9046 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:21.309129 12405 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.289373 12918 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:21.321172 12895 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:21.331729  9120 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260925 16:44:21.333779 12895 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:21.334192 12892 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.335407 12790 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.337720 12920 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.338047 12887 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.339243  8968 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:21.340170  9120 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:44:21.340037  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:21.340878  9702 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:21.344139  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.323872  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.345741  9117 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:21.325922 12721 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:21.310659 12850 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
W20260925 16:44:21.333454 12798 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.852s	user 0.003s	sys 0.008s
I20260925 16:44:21.349099 12887 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.350498 12694 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.352512 12920 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:21.353530  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 355790us
W20260925 16:44:21.363868  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76585.1us
W20260925 16:44:21.286087  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 80678.4us
I20260925 16:44:21.381318  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:21.383011  9115 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.026s
W20260925 16:44:21.383337  9115 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.536s	user 0.006s	sys 0.026s
I20260925 16:44:21.382916  9117 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260925 16:44:21.390959  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:21.392168  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.392767  9117 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:21.341490 12405 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.396139  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.396677  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:21.405562  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:21.408453  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 244993us
I20260925 16:44:21.413861  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:21.390668 12624 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:21.367595 12813 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260925 16:44:21.382596 12790 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
W20260925 16:44:21.445320  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64109.4us
I20260925 16:44:21.446254  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.411645 12846 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:21.410316 12776 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:21.457894  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.441506 12453 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:21.486267  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 807) took 2995 ms. Trace:
I20260925 16:44:21.497105  9118 rpcz_store.cc:276] 0925 16:44:18.491167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.491306 (+   139us) service_pool.cc:227] Handling call
0925 16:44:18.491573 (+   267us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.689199 (+2197626us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.485981 (+796782us) spinlock_profiling.cc:243] Waited 2.04 s on lock 0x7b54001a04d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:21.486186 (+   205us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4687984512}
I20260925 16:44:21.499130  9118 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:44:21.505434  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.506858  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 821) took 1213 ms. Trace:
I20260925 16:44:21.508255  9123 rpcz_store.cc:276] 0925 16:44:20.293118 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.293282 (+   164us) service_pool.cc:227] Handling call
0925 16:44:20.293679 (+   397us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:20.401337 (+107658us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:20.401372 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:20.401747 (+   375us) log.cc:842] Serialized 26 byte log entry
0925 16:44:20.762855 (+361108us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:20.762893 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.473281 (+710388us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54003bf6d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:21.473322 (+    41us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:21.473517 (+   195us) raft_consensus.cc:1671] finished
0925 16:44:21.473539 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:21.506759 (+ 33220us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1515,"raft.run_cpu_time_us":61,"raft.run_wall_time_us":63,"spinlock_wait_cycles":246792448,"thread_start_us":360783,"threads_started":1,"wal-append.queue_time_us":669071}
I20260925 16:44:21.413259 12918 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.053s
I20260925 16:44:21.513603  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.525514  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:21.526693  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91068us
I20260925 16:44:21.527612  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:21.530479  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.439122 12886 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
I20260925 16:44:21.435106 12665 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:21.461934 12776 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:21.490944 12453 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:21.440393  8966 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:21.548069  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.506589 12898 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.528295 12790 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:21.552300  9118 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260925 16:44:21.555222  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.025s
I20260925 16:44:21.541643  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.543841 12460 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:21.552255  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.547470 12776 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:21.543272 12850 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:21.539778 12846 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:21.549842 12453 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:21.561357  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:21.561581  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.576049  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.543676 12694 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260925 16:44:21.395807 12721 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:21.563869  9048 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.012s	sys 0.030s
I20260925 16:44:21.565510 12850 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:21.557842 12900 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.603s	user 0.008s	sys 0.001s
I20260925 16:44:21.581532 12850 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:21.577674  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.591233  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:21.560989 12460 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:44:21.581351  9048 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.013s	sys 0.030s
I20260925 16:44:21.553741 12923 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:21.537451  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:21.559989 12895 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.592427  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:21.580603 12813 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:21.608220  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70888.4us
I20260925 16:44:21.608567  8966 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260925 16:44:21.618383  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:21.562397  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.006s	sys 0.025s
I20260925 16:44:21.593710 12900 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:21.595911 12405 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.607456 12460 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:21.615077 12721 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:21.608408 12923 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:21.628687  8975 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
W20260925 16:44:21.621245  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.032s
W20260925 16:44:21.624300  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 500004us
W20260925 16:44:21.635075  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.032s
I20260925 16:44:21.614040 12846 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:21.638648  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:21.640976  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:21.628631  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:21.621855  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:21.619668  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:21.648910  8966 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:21.664197  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:21.655037 12763 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.012s	sys 0.029s
W20260925 16:44:21.670022 12763 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.012s	sys 0.029s
I20260925 16:44:21.673672 12884 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:21.674278 12884 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:21.671885  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:21.676469 12669 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:21.676815 12669 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:21.677134 12669 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:21.677104  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:21.678395  9697 raft_consensus.cc:2396] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:21.675441 12884 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.682792  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:21.684258  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:21.685490  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:21.686311  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.712s (SENT)
W20260925 16:44:21.687440  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.124s (SENT)
I20260925 16:44:21.693645  9049 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:21.614086 12936 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.000s	sys 0.038s
W20260925 16:44:21.696352 12936 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.000s	sys 0.039s
I20260925 16:44:21.696647  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:21.697335  9050 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:21.620409 12920 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:21.699918 12920 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:21.700441 12920 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:21.705083 12942 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260925 16:44:21.625109 12725 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.083s
I20260925 16:44:21.712857 12895 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.692963 12405 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:21.715274 12777 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.715847 12777 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.718408 12777 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.718988 12777 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:21.626734 12814 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.094s
I20260925 16:44:21.722923  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:21.726203  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:21.769773  9116 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:21.770670  9045 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:21.771363  9116 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260925 16:44:21.626336 12887 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.620739 12898 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:21.733649 12793 consensus_meta.cc:287] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.579s	user 0.011s	sys 0.000s
I20260925 16:44:21.737648 12726 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:21.793053 12882 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:21.663456 12665 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:21.756400 12937 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.901s	user 0.004s	sys 0.000s
I20260925 16:44:21.832803 12460 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.744901  9118 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:21.774760 12558 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.223s	user 0.012s	sys 0.000s
I20260925 16:44:21.711129 12923 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.834775 12923 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:21.834857 12460 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.804868 12726 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:21.805253 12793 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:44:21.835614 12850 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.912467  9123 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
I20260925 16:44:21.913421 12850 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:21.841779 12950 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260925 16:44:21.839087 12796 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.174s	user 0.011s	sys 0.001s
W20260925 16:44:21.841111 12836 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.844s	user 0.009s	sys 0.000s
I20260925 16:44:21.789023 12887 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.839187 12920 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:21.902856 12726 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:21.838595 12342 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.636s	user 0.004s	sys 0.005s
I20260925 16:44:21.905575 12776 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.881042 12814 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.907073  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 922) took 3486 ms. Trace:
W20260925 16:44:21.840502 12701 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.783s	user 0.004s	sys 0.007s
W20260925 16:44:21.912460 12786 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.595s	user 0.011s	sys 0.000s
I20260925 16:44:21.840787 12388 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:21.929687  9701 rpcz_store.cc:276] 0925 16:44:18.420309 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:18.421432 (+  1123us) service_pool.cc:227] Handling call
0925 16:44:18.452753 (+ 31321us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.689606 (+2236853us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.906794 (+1217188us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b5400426154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:21.907008 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4823906048}
I20260925 16:44:21.921490 12787 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:21.926287 12753 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:21.932988 12701 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.930878 12342 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:22.028419  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:22.029867  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 382930us
I20260925 16:44:22.032297  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 740) took 1112 ms. Trace:
W20260925 16:44:22.082906  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54946.9us
I20260925 16:44:22.082816  8974 rpcz_store.cc:276] 0925 16:44:20.919366 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.923545 (+  4179us) service_pool.cc:227] Handling call
0925 16:44:20.924626 (+  1081us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:20.924855 (+   229us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:20.924889 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:20.946548 (+ 21659us) log.cc:842] Serialized 26 byte log entry
0925 16:44:21.463431 (+516883us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:21.765193 (+301762us) log.cc:842] Serialized 14 byte log entry
0925 16:44:21.766253 (+  1060us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.766913 (+   660us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:21.766955 (+    42us) raft_consensus.cc:1671] finished
0925 16:44:21.766968 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.031934 (+264966us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":474520,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":1433,"raft.queue_time_us":264,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":8397,"thread_start_us":705084,"threads_started":2,"wal-append.queue_time_us":740304}
I20260925 16:44:22.086215 12701 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:22.086422  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.087457 12740 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:22.088126 12740 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.087591 12706 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:22.088634 12740 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:22.090435 12798 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.090350 12558 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:22.091285 12949 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:22.091527 12798 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.092638 12558 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.093976 12776 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.925307 12836 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.034453  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2461) took 1119 ms. Trace:
I20260925 16:44:22.036711  9042 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:21.745661  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1069) took 1261 ms. Trace:
I20260925 16:44:21.809785  9050 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:44:22.048187  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.615s	user 0.017s	sys 0.037s
W20260925 16:44:22.048770  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.582s	user 0.004s	sys 0.011s
W20260925 16:44:22.048566  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 502276us
I20260925 16:44:22.049119  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2511) took 1298 ms. Trace:
I20260925 16:44:22.050294  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 836) took 1311 ms. Trace:
I20260925 16:44:22.050423  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2364) took 1043 ms. Trace:
I20260925 16:44:22.055800  9122 raft_consensus.cc:1203] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Deduplicated request from leader. Original: 8.5->[9.6-9.6]   Dedup: 9.6->[]
I20260925 16:44:22.066609  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:22.069245  8969 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:21.954092 12492 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:44:22.183337 12492 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:22.133339 12558 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.184924 12492 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.186362 12558 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.186668 12492 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:44:21.944082 12787 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.188504 12798 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:21.888161 12669 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.189258  9043 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:22.092214 12949 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.193740 12949 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:21.943388 12753 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:21.938289 12786 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:21.953685 12920 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.151814  9115 rpcz_store.cc:276] 0925 16:44:20.750476 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.757226 (+  6750us) service_pool.cc:227] Handling call
0925 16:44:20.757635 (+   409us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:20.782493 (+ 24858us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:44:21.383774 (+601281us) log.cc:842] Serialized 14 byte log entry
0925 16:44:21.812177 (+428403us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:21.828388 (+ 16211us) log.cc:842] Serialized 52 byte log entry
0925 16:44:21.829371 (+   983us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:21.858245 (+ 28874us) log.cc:842] Serialized 14 byte log entry
0925 16:44:21.858512 (+   267us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.858616 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.048444 (+189828us) raft_consensus.cc:1671] finished
0925 16:44:22.048482 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.048856 (+   374us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15644,"prepare.queue_time_us":448577,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":59,"raft.queue_time_us":76569,"raft.run_cpu_time_us":282,"raft.run_wall_time_us":16139,"spinlock_wait_cycles":740224,"thread_start_us":905421,"threads_started":2,"wal-append.queue_time_us":575955}
W20260925 16:44:22.034263  8967 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.005s	sys 0.001s
I20260925 16:44:22.032796  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.089753 12706 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:22.092227  9041 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 6.
I20260925 16:44:21.944563 12726 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:22.082952 12342 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:22.087004 12388 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260925 16:44:22.144030  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2166) took 1005 ms. Trace:
I20260925 16:44:22.154143  9122 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260925 16:44:22.155335  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.018s	sys 0.037s
W20260925 16:44:22.157294  8970 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.524s	user 0.006s	sys 0.001s
I20260925 16:44:22.157142  8971 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:22.158517  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:22.162537  9047 rpcz_store.cc:276] 0925 16:44:20.404453 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.431161 (+ 26708us) service_pool.cc:227] Handling call
0925 16:44:21.655528 (+1224367us) spinlock_profiling.cc:243] Waited 34.8 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:21.666155 (+ 10627us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":80145152}
I20260925 16:44:22.167192 12836 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.167636 12872 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:22.168203 12917 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:22.169917  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.007s	sys 0.014s
I20260925 16:44:22.126063  9048 rpcz_store.cc:276] 0925 16:44:20.915120 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.915321 (+   201us) service_pool.cc:227] Handling call
0925 16:44:20.915596 (+   275us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:20.915808 (+   212us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:44:21.607108 (+691300us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.033267 (+426159us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.033647 (+   380us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:22.033729 (+    82us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:22.033879 (+   150us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.034012 (+   133us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.034236 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":317653,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":105118,"raft.run_cpu_time_us":467,"raft.run_wall_time_us":23420,"thread_start_us":1078679,"threads_started":2}
I20260925 16:44:21.934049 12814 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:22.176000  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 698) took 1784 ms (client timeout 1711 ms). Trace:
W20260925 16:44:22.176734  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110390us
I20260925 16:44:22.177022 12887 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.177948 12460 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:22.236703 12917 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.237785 12460 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.238286 12460 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:22.240449 12342 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.242262 12814 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:22.242929 12779 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:22.243117 12920 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Stepping down as leader of term 4
W20260925 16:44:22.179386  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.005s	sys 0.011s
I20260925 16:44:22.243593 12920 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:22.217141 12706 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:22.244894  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 786998us
I20260925 16:44:22.152091  9117 rpcz_store.cc:276] 0925 16:44:21.006794 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.393387 (+386593us) service_pool.cc:227] Handling call
0925 16:44:21.393655 (+   268us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:21.393939 (+   284us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:21.393963 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:21.394339 (+   376us) log.cc:842] Serialized 26 byte log entry
0925 16:44:21.797673 (+403334us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:21.825812 (+ 28139us) log.cc:842] Serialized 14 byte log entry
0925 16:44:21.826028 (+   216us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.826119 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:21.909812 (+ 83693us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b18003a62a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:22.049700 (+139888us) raft_consensus.cc:1671] finished
0925 16:44:22.049895 (+   195us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.050192 (+   297us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":29625,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":29,"raft.queue_time_us":61939,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":9897,"spinlock_wait_cycles":31379200,"thread_start_us":354459,"threads_started":1,"wal-append.queue_time_us":585177}
I20260925 16:44:22.244989 12920 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.246145  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.245851 12706 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.179644 12776 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.246793 12920 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:22.247219 12776 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:22.231830  9044 rpcz_store.cc:269] 0925 16:44:20.389983 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.390570 (+   587us) service_pool.cc:227] Handling call
0925 16:44:22.173968 (+1783398us) spinlock_profiling.cc:243] Waited 751 ms on lock 0x7b540011e754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.174178 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1727602048}
I20260925 16:44:22.250324 12776 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:22.222095  8967 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.693s	user 0.008s	sys 0.001s
I20260925 16:44:22.222208  8974 rpcz_store.cc:276] 0925 16:44:21.131602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.085934 (+954332us) service_pool.cc:227] Handling call
0925 16:44:22.136456 (+ 50522us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.198361 12669 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.207222 12786 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:22.261500  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.008s	sys 0.014s
I20260925 16:44:22.207273  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.151916  9119 rpcz_store.cc:276] 0925 16:44:20.738461 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.738751 (+   290us) service_pool.cc:227] Handling call
0925 16:44:20.739146 (+   395us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:20.748499 (+  9353us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:21.245552 (+497053us) log.cc:842] Serialized 14 byte log entry
0925 16:44:21.668814 (+423262us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:21.669352 (+   538us) log.cc:842] Serialized 26 byte log entry
0925 16:44:21.669491 (+   139us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:21.669534 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:21.669618 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.049670 (+380052us) raft_consensus.cc:1671] finished
0925 16:44:22.049719 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.050017 (+   298us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":428119,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":37,"raft.queue_time_us":129627,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":187,"thread_start_us":879250,"threads_started":2,"wal-append.queue_time_us":630766}
I20260925 16:44:22.259987  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.246827  9117 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:22.231225  8970 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.598s	user 0.006s	sys 0.001s
I20260925 16:44:22.195812 12753 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.247532 12706 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:22.265983  9046 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:44:22.266053  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.243027 12342 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.255414 12917 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.298426  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.300637  8966 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260925 16:44:22.303272  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.309703  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 752) took 1122 ms. Trace:
I20260925 16:44:22.310062  8966 rpcz_store.cc:276] 0925 16:44:21.187124 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.302525 (+1115401us) service_pool.cc:227] Handling call
0925 16:44:22.309621 (+  7096us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.311189  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.280186 12639 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260925 16:44:22.326121  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 741) took 1406 ms. Trace:
I20260925 16:44:22.327013  9115 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:22.326426  8970 rpcz_store.cc:276] 0925 16:44:20.924170 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.960993 (+ 36823us) service_pool.cc:227] Handling call
0925 16:44:20.961369 (+   376us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:20.961765 (+   396us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:20.961804 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:20.962250 (+   446us) log.cc:842] Serialized 26 byte log entry
0925 16:44:21.244592 (+282342us) spinlock_profiling.cc:243] Waited 18.6 ms on lock 0x7b18002c55a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:44:21.626552 (+381960us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:22.266254 (+639702us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.325692 (+ 59438us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.325780 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.325857 (+    77us) raft_consensus.cc:1671] finished
0925 16:44:22.325950 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.326083 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51989,"prepare.queue_time_us":323187,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":49771,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":31107,"spinlock_wait_cycles":42861952,"thread_start_us":1012814,"threads_started":2,"wal-append.queue_time_us":780806}
I20260925 16:44:22.328469  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.328670  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.331893 12963 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:22.336018  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.337814  9049 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:22.330240  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:22.329304  9115 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:22.332034  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.339175  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:22.289563  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:22.339529  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50066us
W20260925 16:44:22.347301  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 510078us
I20260925 16:44:22.361894  9119 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:22.349428 12639 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.368758  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.369974  9118 raft_consensus.cc:2396] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260925 16:44:22.370880  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:22.371894  9695 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:22.372223  9118 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
I20260925 16:44:22.373872 12881 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:22.374861  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 739) took 1455 ms. Trace:
I20260925 16:44:22.375403  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.377177  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.377918  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1684) took 1263 ms. Trace:
I20260925 16:44:22.378266  9119 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:22.378214  8971 rpcz_store.cc:276] 0925 16:44:21.114837 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.376795 (+1261958us) service_pool.cc:227] Handling call
0925 16:44:22.377841 (+  1046us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.378937  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:22.379231  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.379669  9119 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
W20260925 16:44:22.383821  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125282us
I20260925 16:44:22.384579  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.390213  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.380472  8971 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:22.368781  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.339056 12740 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.386322  9042 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:44:22.381188  9048 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.395166  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.398319  8970 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:22.379894  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:22.400197  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1681) took 1286 ms. Trace:
I20260925 16:44:22.401038  8970 rpcz_store.cc:276] 0925 16:44:21.113969 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.384282 (+1270313us) service_pool.cc:227] Handling call
0925 16:44:22.400142 (+ 15860us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.393741  9119 pending_rounds.cc:76] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 9
I20260925 16:44:22.391266  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.375248  8967 rpcz_store.cc:276] 0925 16:44:20.919024 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.919364 (+   340us) service_pool.cc:227] Handling call
0925 16:44:20.919731 (+   367us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:20.920168 (+   437us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:20.920212 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:20.954894 (+ 34682us) log.cc:842] Serialized 26 byte log entry
0925 16:44:21.470860 (+515966us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:22.274945 (+804085us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.363536 (+ 88591us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.366959 (+  3423us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.374660 (+  7701us) raft_consensus.cc:1671] finished
0925 16:44:22.374672 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.374795 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":92219,"prepare.queue_time_us":474102,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":35,"raft.queue_time_us":47085,"raft.run_cpu_time_us":248,"raft.run_wall_time_us":28066,"thread_start_us":1105777,"threads_started":2,"wal-append.queue_time_us":770418}
I20260925 16:44:22.402426  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.403025  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.404177  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.404834  8967 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:22.405714  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.407436  9049 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:22.403294 12786 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.006s
I20260925 16:44:22.407586  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.380803 12509 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:22.410245 12509 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:22.410544 12786 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.411358 12509 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.412529 12509 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:22.382400  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2162) took 1254 ms. Trace:
I20260925 16:44:22.406860  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.400120  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2169) took 1262 ms. Trace:
I20260925 16:44:22.420120  8971 rpcz_store.cc:276] 0925 16:44:21.133801 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.378931 (+1245130us) service_pool.cc:227] Handling call
0925 16:44:22.396151 (+ 17220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.401623  9119 pending_rounds.cc:97] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260925 16:44:22.413741  8968 rpcz_store.cc:276] 0925 16:44:21.128637 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.132545 (+  3908us) service_pool.cc:227] Handling call
0925 16:44:22.382044 (+1249499us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54002ffb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.382233 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":473151744}
I20260925 16:44:22.411168 12786 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.386654 12639 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:22.426056 12882 consensus_meta.cc:287] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.512s	user 0.015s	sys 0.000s
I20260925 16:44:22.426072  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.426705 12882 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:22.427169  8971 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260925 16:44:22.428071  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.429489  8971 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260925 16:44:22.428077  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.427861 12986 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:22.352330 12460 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.430358  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.431051  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2174) took 1038 ms. Trace:
I20260925 16:44:22.431368  8971 rpcz_store.cc:276] 0925 16:44:21.392490 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.430039 (+1037549us) service_pool.cc:227] Handling call
0925 16:44:22.431001 (+   962us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.432009 12460 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:22.432071 12884 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.432264  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.429280  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.432786 12884 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.433389  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.434203  8971 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:22.434895  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.435762  8971 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:22.435833  9695 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:22.436035  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.436650  8974 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Handling vote request from an unknown peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.436967  8974 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.437024  8971 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:22.437626  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1688) took 1313 ms. Trace:
I20260925 16:44:22.437889  8971 rpcz_store.cc:276] 0925 16:44:21.124014 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.436389 (+1312375us) service_pool.cc:227] Handling call
0925 16:44:22.436771 (+   382us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.437414 (+   643us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.437562 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.428352 12342 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:22.439374 12342 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.428244  9046 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:22.440231 12966 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:22.446870  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:22.448414  8966 raft_consensus.cc:2354] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14.
I20260925 16:44:22.445873  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:22.428395  8967 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:22.451246  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2179) took 1018 ms. Trace:
I20260925 16:44:22.451615  8967 rpcz_store.cc:276] 0925 16:44:21.432838 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.406562 (+973724us) service_pool.cc:227] Handling call
0925 16:44:22.451184 (+ 44622us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.424902  9119 raft_consensus.cc:2866] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:22.434839 12884 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.454800 12881 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.455492  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.455605  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.456894  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2164) took 1326 ms. Trace:
I20260925 16:44:22.469062  8967 rpcz_store.cc:276] 0925 16:44:21.130143 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.456055 (+1325912us) service_pool.cc:227] Handling call
0925 16:44:22.456392 (+   337us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.456583 (+   191us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.456608 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:22.456665 (+    57us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:22.456691 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.456741 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.456832 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.460813  8970 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:22.462538  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:22.448685  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54903us
I20260925 16:44:22.463052 12836 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:22.461212 12786 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.452028  9049 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:22.473080  9117 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:22.472929  9048 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:22.427628 12639 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.476442 12763 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:22.477583  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2165) took 1344 ms. Trace:
I20260925 16:44:22.477825 12763 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.476205 12881 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.477972  8970 rpcz_store.cc:276] 0925 16:44:21.130839 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.460306 (+1329467us) service_pool.cc:227] Handling call
0925 16:44:22.460621 (+   315us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.474470 (+ 13849us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.474659 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.478142 12836 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.451141 12342 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.480098 12881 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.480142  9119 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 10
I20260925 16:44:22.482924  8967 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:22.476236  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:22.483539  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2168) took 1350 ms. Trace:
I20260925 16:44:22.483861  8967 rpcz_store.cc:276] 0925 16:44:21.133018 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.474952 (+1341934us) service_pool.cc:227] Handling call
0925 16:44:22.482772 (+  7820us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.483335 (+   563us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.483494 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.484371 12881 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:22.484798 12881 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.485073 12726 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.485316 12881 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:22.485709 12726 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.486176  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:22.423043 12963 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.487643 12786 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:22.479559  8970 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260925 16:44:22.489048  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.478331 12763 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:22.498363  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.501346  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2170) took 1362 ms. Trace:
I20260925 16:44:22.502972  8970 rpcz_store.cc:276] 0925 16:44:21.134453 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.478958 (+1344505us) service_pool.cc:227] Handling call
0925 16:44:22.479278 (+   320us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.495384 (+ 16106us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.496346 (+   962us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.508066  8974 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:22.500623 12864 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:22.509327  9115 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:22.511480  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104038us
I20260925 16:44:22.491744 12787 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.518342  9119 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:22.522455 12984 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.214s	user 0.001s	sys 0.001s
I20260925 16:44:22.522783  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.523331 12864 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:22.523578 12740 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.525404  9697 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:22.524660  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.535979  9046 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:22.537748  9117 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.538331  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2163) took 1407 ms. Trace:
I20260925 16:44:22.538738  8966 rpcz_store.cc:276] 0925 16:44:21.129498 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.310840 (+1181342us) service_pool.cc:227] Handling call
0925 16:44:22.536648 (+225808us) spinlock_profiling.cc:243] Waited 133 ms on lock 0x7b54001c4654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.536797 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":306819328}
I20260925 16:44:22.540207  8966 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
W20260925 16:44:22.540342  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 735) took 1622 ms (client timeout 2124 ms). Trace:
I20260925 16:44:22.540553  8966 pending_rounds.cc:76] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 8
I20260925 16:44:22.540890  8966 pending_rounds.cc:97] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260925 16:44:22.541173  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 703) took 1371 ms. Trace:
I20260925 16:44:22.541314  8966 raft_consensus.cc:2866] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:22.541616  9041 rpcz_store.cc:276] 0925 16:44:21.169602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.171976 (+  2374us) service_pool.cc:227] Handling call
0925 16:44:22.541018 (+1369042us) spinlock_profiling.cc:243] Waited 919 ms on lock 0x7b54001afc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.541111 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2113332480}
I20260925 16:44:22.542095  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 747) took 1356 ms. Trace:
I20260925 16:44:22.542194  8974 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:22.542542  8966 rpcz_store.cc:276] 0925 16:44:21.185852 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.539515 (+1353663us) service_pool.cc:227] Handling call
0925 16:44:22.539862 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.541870 (+  2008us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.542038 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.543102  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2355) took 1592 ms. Trace:
I20260925 16:44:22.543438  9122 rpcz_store.cc:276] 0925 16:44:20.950968 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.053488 (+102520us) service_pool.cc:227] Handling call
0925 16:44:22.051197 (+997709us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:22.224274 (+173077us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.542939 (+318665us) spinlock_profiling.cc:243] Waited 997 ms on lock 0x7b5400164250. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.543054 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2293261568}
W20260925 16:44:22.544842 12987 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.234s	user 0.002s	sys 0.000s
I20260925 16:44:22.544792  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.545095  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 746) took 1375 ms. Trace:
I20260925 16:44:22.532078 12836 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.539518  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.545671  8974 rpcz_store.cc:276] 0925 16:44:21.185560 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.524541 (+1338981us) service_pool.cc:227] Handling call
0925 16:44:22.541852 (+ 17311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.542633 (+   781us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.542788 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.546733  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.540634  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2158) took 1414 ms. Trace:
I20260925 16:44:22.536804  9701 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:22.547533  8969 rpcz_store.cc:276] 0925 16:44:21.126280 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.270830 (+144550us) service_pool.cc:227] Handling call
0925 16:44:22.540425 (+1269595us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b54002cbfd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.540559 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1745623808}
I20260925 16:44:22.544813 12864 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.550160  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 749) took 1363 ms. Trace:
I20260925 16:44:22.550242  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.550598  8974 rpcz_store.cc:276] 0925 16:44:21.186355 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.546410 (+1360055us) service_pool.cc:227] Handling call
0925 16:44:22.546718 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.549749 (+  3031us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.549782 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:22.549844 (+    62us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:22.549919 (+    75us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.549987 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.550101 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2555,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":90}
W20260925 16:44:22.540773  8975 rpcz_store.cc:269] 0925 16:44:20.917575 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.917721 (+   146us) service_pool.cc:227] Handling call
0925 16:44:22.540025 (+1622304us) spinlock_profiling.cc:243] Waited 658 ms on lock 0x7b54003e8854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.540182 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1513682688}
I20260925 16:44:22.547540  9115 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 11
I20260925 16:44:22.545524  9122 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:22.553740  8966 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:22.554524  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 748) took 1368 ms. Trace:
I20260925 16:44:22.554965  8966 rpcz_store.cc:276] 0925 16:44:21.186109 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.543250 (+1357141us) service_pool.cc:227] Handling call
0925 16:44:22.543545 (+   295us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.554251 (+ 10706us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.554466 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.555563  8974 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:22.560873  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2177) took 1163 ms. Trace:
I20260925 16:44:22.561281  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.561426  8974 rpcz_store.cc:276] 0925 16:44:21.393217 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.551797 (+1158580us) service_pool.cc:227] Handling call
0925 16:44:22.555228 (+  3431us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.556748 (+  1520us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.556967 (+   219us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.568388 12641 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.573707  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2356) took 1604 ms. Trace:
W20260925 16:44:22.573999 12989 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260925 16:44:22.574265  9124 rpcz_store.cc:276] 0925 16:44:20.968839 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.120863 (+152024us) service_pool.cc:227] Handling call
0925 16:44:21.275177 (+154314us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:21.282327 (+  7150us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.561440 (+1279113us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b540010c050. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.573498 (+ 12058us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":353961216}
I20260925 16:44:22.576117 12985 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:22.576275  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2357) took 1607 ms. Trace:
I20260925 16:44:22.577258  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:22.576871 12985 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.578472 12796 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:22.578825 12796 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.579134 12796 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:22.583042 12952 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:22.583207 12886 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:22.583940 12980 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260925 16:44:22.583667 12952 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.585137 12886 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.585585  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2369) took 1206 ms. Trace:
I20260925 16:44:22.585137 12872 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:22.579278 12985 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.585619  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2361) took 1583 ms. Trace:
W20260925 16:44:22.593304  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 84341.9us
I20260925 16:44:22.588290  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.586611 12872 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.596506  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.588650  8968 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:22.598011  8969 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:44:22.575539  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:22.597697  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45426.8us
I20260925 16:44:22.600998  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:22.601341  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 87394.6us
W20260925 16:44:22.605336 12453 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.014s	user 0.021s	sys 0.000s
I20260925 16:44:22.605764 12453 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.606827  8971 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 9. Ops: []
I20260925 16:44:22.587312 12886 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.610333  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.586018  9116 rpcz_store.cc:276] 0925 16:44:21.378599 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.776088 (+397489us) service_pool.cc:227] Handling call
0925 16:44:21.776514 (+   426us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:21.776927 (+   413us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:21.776967 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:21.777479 (+   512us) log.cc:842] Serialized 26 byte log entry
0925 16:44:22.291938 (+514459us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:22.367541 (+ 75603us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.420545 (+ 53004us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.420610 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.585245 (+164635us) raft_consensus.cc:1671] finished
0925 16:44:22.585264 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.585411 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":13298,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":38,"raft.queue_time_us":57887,"raft.run_cpu_time_us":170,"raft.run_wall_time_us":175,"thread_start_us":434626,"threads_started":1,"wal-append.queue_time_us":700697}
I20260925 16:44:22.576771  9121 rpcz_store.cc:276] 0925 16:44:20.969157 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.129988 (+160831us) service_pool.cc:227] Handling call
0925 16:44:21.130308 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:21.626079 (+495771us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:21.626120 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:22.248665 (+622545us) spinlock_profiling.cc:243] Waited 13.6 ms on lock 0x7b2c000d80e8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:22.249408 (+   743us) log.cc:842] Serialized 26 byte log entry
0925 16:44:22.343200 (+ 93792us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:22.343539 (+   339us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.344162 (+   623us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.344251 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.575871 (+231620us) raft_consensus.cc:1671] finished
0925 16:44:22.575976 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.576101 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":207,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":27,"raft.queue_time_us":23648,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":276,"spinlock_wait_cycles":31354752,"thread_start_us":588228,"threads_started":2,"wal-append.queue_time_us":220515}
I20260925 16:44:22.615233  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:22.616068 12982 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.304s	user 0.003s	sys 0.000s
I20260925 16:44:22.617741  8966 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:44:22.618333  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2178) took 1224 ms. Trace:
I20260925 16:44:22.618618  8966 rpcz_store.cc:276] 0925 16:44:21.393448 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.566168 (+1172720us) service_pool.cc:227] Handling call
0925 16:44:22.617574 (+ 51406us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.618104 (+   530us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.618267 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:22.603621  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:22.623986  9117 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 8 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:22.625663  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.622967  8968 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:44:22.626308  9117 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:22.624068  8972 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260925 16:44:22.602475 12753 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.619539  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.628711  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2173) took 1236 ms. Trace:
I20260925 16:44:22.629294  9697 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:22.630352  8969 rpcz_store.cc:276] 0925 16:44:21.392238 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.548589 (+1156351us) service_pool.cc:227] Handling call
0925 16:44:22.597728 (+ 49139us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.598298 (+   570us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.628483 (+ 30185us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b54001e3550. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.628644 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112254720}
I20260925 16:44:22.631453  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2156) took 1503 ms. Trace:
I20260925 16:44:22.636557  8971 rpcz_store.cc:276] 0925 16:44:21.124695 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.438509 (+1313814us) service_pool.cc:227] Handling call
0925 16:44:22.438822 (+   313us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.607159 (+168337us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.627851 (+ 20692us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b540020e754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:22.627998 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":386008448}
I20260925 16:44:22.591843  9120 rpcz_store.cc:276] 0925 16:44:20.978747 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.343123 (+364376us) service_pool.cc:227] Handling call
0925 16:44:21.343492 (+   369us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:21.343924 (+   432us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:21.343959 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:21.349303 (+  5344us) log.cc:842] Serialized 26 byte log entry
0925 16:44:21.757303 (+408000us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:21.789269 (+ 31966us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.380922 (+591653us) spinlock_profiling.cc:243] Waited 7.41 ms on lock 0x7b18003a6ba0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:44:22.502919 (+121997us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.512266 (+  9347us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.528034 (+ 15768us) raft_consensus.cc:1671] finished
0925 16:44:22.537449 (+  9415us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.562423 (+ 24974us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":31459,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":6598,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":10662,"spinlock_wait_cycles":17033472,"thread_start_us":476290,"threads_started":2,"wal-append.queue_time_us":588054}
I20260925 16:44:22.640295  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.640350  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.633050  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:22.613339 12453 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.646737 12666 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:22.621202 12763 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.647965  8966 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:44:22.647881  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.648082 12726 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.648861  8969 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 2. Current term is 3. Ops: []
W20260925 16:44:22.648988  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1687) took 1533 ms (client timeout 1964 ms). Trace:
W20260925 16:44:22.648994  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 87286.9us
I20260925 16:44:22.656704  8971 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:44:22.649816  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:22.652197  8972 rpcz_store.cc:269] 0925 16:44:21.123262 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:21.199801 (+ 76539us) service_pool.cc:227] Handling call
0925 16:44:22.648781 (+1448980us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b540020ec54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.648936 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3243105536}
I20260925 16:44:22.661783  9119 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:22.629735 12952 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.647091 12796 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.669582  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:22.671028  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 66809.8us
I20260925 16:44:22.671494 12796 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.671828 12882 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:22.672430  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.673554 12763 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.673483  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:22.674343  9121 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:22.673417  9124 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260925 16:44:22.666879  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:22.670327  8872 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:22.679982  9117 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:44:22.681596  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:22.679340  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:22.670691 12881 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.686055  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:22.687774  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54827.7us
I20260925 16:44:22.689522  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:22.692420  9117 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:22.697674  9119 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:22.698947  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.699719  8968 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:22.700687  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:22.702422  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:22.699345 12995 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260925 16:44:22.707581 12996 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:22.708837 12795 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:22.708897  9123 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:22.713608  8973 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:22.703608 12796 raft_consensus.cc:2741] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260925 16:44:22.715284 12963 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.714516 12872 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:22.718021  9116 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:22.716694  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 744) took 1549 ms. Trace:
I20260925 16:44:22.719381  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.704298  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.714051  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:22.719408  8970 rpcz_store.cc:276] 0925 16:44:21.167056 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.503629 (+1336573us) service_pool.cc:227] Handling call
0925 16:44:22.536801 (+ 33172us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:22.538801 (+  2000us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.538835 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:22.539326 (+   491us) log.cc:842] Serialized 26 byte log entry
0925 16:44:22.590405 (+ 51079us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:22.609049 (+ 18644us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.609229 (+   180us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.609301 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.716475 (+107174us) raft_consensus.cc:1671] finished
0925 16:44:22.716502 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.716640 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":20057,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":2580,"raft.queue_time_us":5708,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":10048,"thread_start_us":50732,"threads_started":1,"wal-append.queue_time_us":98272}
I20260925 16:44:22.731614 12956 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.014s
I20260925 16:44:22.732283  8872 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 4 to 7, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:22.733618  8967 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260925 16:44:22.733824 12509 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:22.734755  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.734985  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 743) took 1568 ms. Trace:
I20260925 16:44:22.717007 12882 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:22.734766  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:22.735435  9702 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:22.735420  8967 rpcz_store.cc:276] 0925 16:44:21.166784 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.484516 (+1317732us) service_pool.cc:227] Handling call
0925 16:44:22.733314 (+248798us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:22.733997 (+   683us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.734828 (+   831us) spinlock_profiling.cc:243] Waited 248 ms on lock 0x7b54003561d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.734940 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":571414784}
I20260925 16:44:22.737565 12887 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:22.738126 12887 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:22.739745 12786 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:22.740183 12786 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.739171 12887 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.740602 12786 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:22.743028  9121 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260925 16:44:22.706314 12558 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.748100  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:22.746449  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 737) took 1825 ms (client timeout 1678 ms). Trace:
W20260925 16:44:22.748828  8973 rpcz_store.cc:269] 0925 16:44:20.918307 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:20.918430 (+   123us) service_pool.cc:227] Handling call
0925 16:44:22.732940 (+1814510us) spinlock_profiling.cc:243] Waited 1.62 s on lock 0x7b54003561d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:22.743326 (+ 10386us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3715164032}
I20260925 16:44:22.752270  9121 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 5. Current term is 6. Ops: []
I20260925 16:44:22.727723 12872 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:22.754091 12558 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.756946  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.757769 12796 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:22.758452  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:22.759969  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 137974us
I20260925 16:44:22.763176  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:22.763125  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2183) took 1258 ms. Trace:
I20260925 16:44:22.768936  9116 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260925 16:44:22.770594  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:22.771157  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83719.2us
I20260925 16:44:22.758136 12558 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.758144 12796 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.776948  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.780282  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:22.783094 12796 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.785332 12795 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:22.787403  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.788116  9701 raft_consensus.cc:2354] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:22.787952  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.772097 12985 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:22.769096  8975 rpcz_store.cc:276] 0925 16:44:21.503951 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.559782 (+1055831us) service_pool.cc:227] Handling call
0925 16:44:22.572059 (+ 12277us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:22.582088 (+ 10029us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.582116 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:22.582597 (+   481us) log.cc:842] Serialized 26 byte log entry
0925 16:44:22.676855 (+ 94258us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:22.695564 (+ 18709us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.728594 (+ 33030us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.728670 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:22.758817 (+ 30147us) raft_consensus.cc:1671] finished
0925 16:44:22.758840 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:22.762473 (+  3633us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":37686,"prepare.queue_time_us":41551,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":48,"raft.queue_time_us":43684,"raft.run_cpu_time_us":301,"raft.run_wall_time_us":15026,"thread_start_us":93955,"threads_started":1,"wal-append.queue_time_us":137513}
I20260925 16:44:22.745714 12920 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.031s
I20260925 16:44:22.794155  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:22.796087  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:22.800923  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:22.803736  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.796085  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:22.810624  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:22.810850  9697 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:22.812143  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49032.5us
I20260925 16:44:22.779024 12872 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:22.775098 12666 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260925 16:44:22.809389  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.796087 12558 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:44:22.811488 12763 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.820406 12740 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.825845 12763 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.826232 12740 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.828023 12763 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.828070 12740 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.829818  9043 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:22.830263  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59806.4us
I20260925 16:44:22.830417  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:22.831897 12992 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.216s	user 0.004s	sys 0.000s
I20260925 16:44:22.833495 12694 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:22.835909 12669 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:22.836519 12669 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:22.836633  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.837472 12669 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.839771 12460 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:22.835808  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:22.835369 12694 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260925 16:44:22.841425 12999 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260925 16:44:22.842145 12796 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.817482 12881 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.844592 12787 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:44:22.846779 12787 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:44:22.848011 12342 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Stepping down as leader of term 5
I20260925 16:44:22.848425 12342 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:22.849571 12342 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:22.856315  8872 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 5 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:44:22.889909  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95836.2us
I20260925 16:44:22.831583  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:22.811625 12641 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.899933  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:22.906235  9041 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:22.907270  8872 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 3 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 6 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:22.913693  8872 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:22.920302 12666 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:22.921005 12666 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:22.921033 12706 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260925 16:44:22.923419  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91910.4us
I20260925 16:44:22.924985  9044 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260925 16:44:22.925997  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:22.926851 12920 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:22.927232 12920 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:22.927641 12920 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:22.931444  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:22.932171 12975 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:22.933681 12975 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:22.934149 12975 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:22.935846 12963 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:22.935928 12558 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:22.936371 12963 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:22.936965 12963 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:22.937461 12558 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:22.920183  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 98458.1us
I20260925 16:44:22.940685  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:22.902417 12740 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:22.941702 12740 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:22.942065 12740 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:22.944155 12694 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:22.944878 12694 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:22.946008 12694 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.958778  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:22.935017 12975 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.959826  9045 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:22.981127  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:22.982575  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56661.6us
I20260925 16:44:22.922443 12666 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:22.897707 12763 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:22.990772  9115 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:22.995410  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:22.997349  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104275us
W20260925 16:44:23.002218  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 92017.1us
W20260925 16:44:23.007318  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 223817us
I20260925 16:44:23.006758  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:23.009294 12725 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:23.009608  9045 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:23.009964 12795 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:23.010855 12850 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:23.011380 12850 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.013360 12850 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.007149 12796 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:22.995807 12342 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:22.902802 12641 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.036689  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.019371 12920 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.041330  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:23.002871 12763 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.048897  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.035092 12795 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:44:23.069796  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.033864 12996 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260925 16:44:23.053617 12796 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:23.074988  9049 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:23.076620  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.082783  9116 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 9
I20260925 16:44:23.079116  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.079849  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.083958  9124 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 10
I20260925 16:44:23.081362 12763 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.092191  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.092800  9117 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:23.093762  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.094220  9117 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:23.095939  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:23.081593  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.058339 12795 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:23.083386  9115 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:23.087945 12786 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:23.103595  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.110500  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.110718  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.111935  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.112638  9123 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:23.112975 12342 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:23.113410 12342 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:23.113700  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.114398  9123 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:23.114585  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49615.5us
I20260925 16:44:23.113750 12342 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:23.115988 12872 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 6.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:44:23.117187 12872 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:23.117774  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:23.118155 12872 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:23.119439 12872 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:23.119889 12850 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:23.123205  9117 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:23.123562  9118 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:44:23.120579 12753 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:23.124231 12753 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:23.125523  9044 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:23.125075 12753 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.125672  9118 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:23.126487 12753 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:23.127185 12882 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:23.121050 12787 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:23.121533 12985 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:23.128448  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.129048 12872 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:23.135321 12872 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:23.128549 12985 consensus_queue.cc:1225] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 12.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260925 16:44:23.129833 12453 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:23.136700 12453 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:23.137151 12453 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:23.130394 12786 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:23.133976  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2187) took 1510 ms. Trace:
I20260925 16:44:23.129365  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.140450  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.084693 12801 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:23.141333  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.139966  8974 rpcz_store.cc:276] 0925 16:44:21.590847 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.563128 (+972281us) service_pool.cc:227] Handling call
0925 16:44:22.567764 (+  4636us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:22.588130 (+ 20366us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.588164 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:22.600161 (+ 11997us) log.cc:842] Serialized 26 byte log entry
0925 16:44:22.656566 (+ 56405us) spinlock_profiling.cc:243] Waited 5.81 ms on lock 0x7b480024c258. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:22.688162 (+ 31596us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:22.717936 (+ 29774us) log.cc:842] Serialized 14 byte log entry
0925 16:44:22.729881 (+ 11945us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:22.730025 (+   144us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:23.081779 (+351754us) raft_consensus.cc:1671] finished
0925 16:44:23.101552 (+ 19773us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:23.101673 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55409,"prepare.queue_time_us":30355,"prepare.run_cpu_time_us":58,"prepare.run_wall_time_us":1183,"raft.queue_time_us":33983,"raft.run_cpu_time_us":1351,"raft.run_wall_time_us":82788,"spinlock_wait_cycles":13365120,"thread_start_us":50597,"threads_started":1,"wal-append.queue_time_us":371545}
I20260925 16:44:23.142648 12887 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:23.142815 12763 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:23.143036 12887 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:23.143343 12763 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:23.143453 12887 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:23.144300 12763 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.145877 12881 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260925 16:44:23.146281 12881 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:23.146881 12881 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:44:23.150758 12887 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.152323 12641 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.153766 12881 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.153847 12795 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:23.155867 12786 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:23.186257  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.186640 12453 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.187723 12881 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.188714 12453 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.157155  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:23.157099  9050 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:23.157671 12872 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:23.157934  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:23.161074  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:23.161652 12882 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:23.139444 12342 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.163987  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:23.105548  8872 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 8, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:44:23.168110  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57474.4us
I20260925 16:44:23.166067  9124 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:23.209175  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.209748  9124 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:23.106598  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.211864  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.186285 12786 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.212678  9043 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:23.213150 12887 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.189419  9041 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:23.217053  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:23.213375  9043 raft_consensus.cc:595] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:23.220641  9090 leader_election.cc:398] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:23.221046  9090 leader_election.cc:401] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:23.224253 12342 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.228024 12786 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.140806 12920 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:23.208140  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.238068  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:23.251124  9123 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:23.252142  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.252184  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:23.254742  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 93760.2us
I20260925 16:44:23.258343  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.310321  9702 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:23.258755 12777 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:23.259268  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:23.259913 12881 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:23.260639  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.261270  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:23.261565  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 155067us
I20260925 16:44:23.312848  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.262046 12641 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:23.314646  9694 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 3.
I20260925 16:44:23.262673  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.319012  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.319617  9124 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:23.262914 12903 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:23.268805 12996 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:23.281824 12796 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:23.288167  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.322471  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.243649 12882 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:23.291774  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.323472 12887 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:23.326954 12887 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:23.327834 12887 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:23.330385 12864 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:23.331789 12453 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:23.332136 12453 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:23.332937 12453 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.333601  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.334158 12453 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:23.336409  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:23.337101  9047 raft_consensus.cc:595] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:23.337461  9047 raft_consensus.cc:603] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:23.338495 12996 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:23.339056 12996 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:23.294492 12963 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:23.340063 12996 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.341123 12963 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:23.341823 12996 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:23.342486  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:23.343043  9047 raft_consensus.cc:595] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:23.343362  9047 raft_consensus.cc:603] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:23.295415  8872 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:23.300405  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.308284  9116 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:23.293900  8873 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 341) took 19870 ms (client timeout 15000 ms). Trace:
I20260925 16:44:23.257637 12786 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260925 16:44:23.322515  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59909.3us
I20260925 16:44:23.293381  9698 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:23.324015  9123 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:44:23.318787 12801 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:23.352909  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:23.353541 12801 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:23.352949  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:23.354678  9121 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260925 16:44:23.354888  9699 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:23.355886  9121 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:44:23.357647  8872 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index -1 to 3, term changed from 2 to 4, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 4 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:44:23.358131 12903 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.338598 12882 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:23.309083  9041 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:23.360250 12903 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.347141  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.346284  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:23.354476 12801 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.349700  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:23.361562  9700 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 3 FOLLOWER]: Advancing to term 4
I20260925 16:44:23.361672  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.359432  9123 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:23.315779 12753 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:23.370972  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:23.371659  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61403.5us
I20260925 16:44:23.374270  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:23.360442 12796 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:23.375615  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:23.390913 12740 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.351389 12786 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:23.417883  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47144.8us
W20260925 16:44:23.392864  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 409499us
I20260925 16:44:23.369395  9699 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:23.434468  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:23.377065 12342 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:23.445665  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:23.442713  9116 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260925 16:44:23.381448 12903 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:23.376930 12641 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:23.454082  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.454702  9693 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:23.456883 12850 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:23.457348 12850 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.459404 12850 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.461112  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.463173 12453 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:23.433003 12786 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:23.391870 12920 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.100s
I20260925 16:44:23.580476  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:23.581329  9047 raft_consensus.cc:595] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:23.581923  9047 raft_consensus.cc:603] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:23.418828 12956 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.151s
I20260925 16:44:23.463688 12453 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:23.448731 12753 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.471827 12740 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.492664 12669 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:23.481077 12641 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:23.471241 12787 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
W20260925 16:44:23.611219  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 165654us
I20260925 16:44:23.694161  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:23.504220 12666 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:23.656231  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:23.519783 12903 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:23.578081 12558 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Leader election won for term 4
I20260925 16:44:23.698513  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:23.703496  9041 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:23.703850  9041 raft_consensus.cc:603] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:44:23.345907  8873 rpcz_store.cc:269] 0925 16:44:03.423571 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:03.423767 (+   196us) service_pool.cc:227] Handling call
0925 16:44:11.617078 (+8193311us) spinlock_profiling.cc:243] Waited 5.71 s on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:44:23.293602 (+11676524us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:44:18.589028 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:44:18.721765 (+132737us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:44:18.734711 (+ 12946us) write_op.cc:435] Acquired schema lock
0925 16:44:18.738277 (+  3566us) tablet.cc:660] Decoding operations
0925 16:44:19.117516 (+379239us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:44:19.244001 (+126485us) write_op.cc:641] Partition lock acquired for write op
0925 16:44:19.247659 (+  3658us) tablet.cc:683] Acquiring locks for 14 operations
0925 16:44:19.603876 (+356217us) tablet.cc:699] Row locks acquired
0925 16:44:19.708055 (+104179us) write_op.cc:260] PREPARE: finished
0925 16:44:19.845759 (+137704us) write_op.cc:270] Start()
0925 16:44:19.951387 (+105628us) write_op.cc:276] Timestamp: P: 1790354659760485 usec, L: 0
0925 16:44:19.951414 (+    27us) op_driver.cc:331] REPLICATION: starting
0925 16:44:20.098418 (+147004us) log.cc:842] Serialized 5536 byte log entry
0925 16:44:21.047038 (+948620us) op_driver.cc:444] REPLICATION: finished
0925 16:44:21.791580 (+744542us) write_op.cc:301] APPLY: starting
0925 16:44:21.791659 (+    79us) tablet.cc:1365] starting BulkCheckPresence
0925 16:44:21.792691 (+  1032us) tablet.cc:1368] finished BulkCheckPresence
0925 16:44:21.792801 (+   110us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:44:21.793834 (+  1033us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:44:21.794063 (+   229us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=28
0925 16:44:21.794115 (+    52us) write_op.cc:312] APPLY: finished
0925 16:44:21.795975 (+  1860us) log.cc:842] Serialized 101 byte log entry
0925 16:44:22.158452 (+362477us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:22.159019 (+   567us) write_op.cc:454] Released schema lock
0925 16:44:22.159148 (+   129us) write_op.cc:341] FINISH: Updating metrics
0925 16:44:22.159777 (+   629us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:22.159804 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4143431,"reported_tablets":41,"spinlock_wait_cycles":13129313664,"child_traces":[["op",{"apply.queue_time_us":744172,"apply.run_cpu_time_us":39444,"apply.run_wall_time_us":369144,"num_ops":14,"prepare.queue_time_us":190987,"prepare.run_cpu_time_us":24286,"prepare.run_wall_time_us":1800240,"raft.queue_time_us":491031,"raft.run_cpu_time_us":39838,"raft.run_wall_time_us":787946,"replication_time_us":1041013,"thread_start_us":1564631,"threads_started":5,"wal-append.queue_time_us":790404,"wal-append.run_cpu_time_us":19928,"wal-append.run_wall_time_us":2449495}]]}
I20260925 16:44:23.491894 12460 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.201s
I20260925 16:44:23.643851 12868 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:23.708801  9116 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:23.693462 12787 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:23.716140  9124 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:23.695255 12669 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:23.716315  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.018s	sys 0.013s
W20260925 16:44:23.722908  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.018s	sys 0.013s
I20260925 16:44:23.723161  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 857) took 1245 ms. Trace:
W20260925 16:44:23.723294  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 604406us
I20260925 16:44:23.723878  9122 rpcz_store.cc:276] 0925 16:44:22.477860 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.721795 (+243935us) service_pool.cc:227] Handling call
0925 16:44:22.758997 (+ 37202us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:22.759555 (+   558us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.759590 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:22.774924 (+ 15334us) log.cc:842] Serialized 26 byte log entry
0925 16:44:23.300357 (+525433us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:23.300390 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:23.300458 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:23.643814 (+343356us) raft_consensus.cc:1671] finished
0925 16:44:23.643840 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:23.717751 (+ 73911us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b54001ef0d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:23.723091 (+  5340us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2051,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":6025,"spinlock_wait_cycles":84689664,"thread_start_us":483621,"threads_started":1,"wal-append.queue_time_us":848983}
W20260925 16:44:23.710270 12975 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.026s	sys 0.043s
W20260925 16:44:23.718436 12763 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.020s	sys 0.078s
I20260925 16:44:23.744793 12850 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260925 16:44:23.749559  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:23.750191 12850 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:23.750610 12850 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:23.752693 12753 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:23.753801 12492 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:23.754305  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:23.761005 12492 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:23.762032 12492 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.726373 12558 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:23.751405 12850 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:23.722332 12694 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.009s	sys 0.020s
W20260925 16:44:23.746389 12763 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.020s	sys 0.079s
W20260925 16:44:23.747321 12975 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.026s	sys 0.043s
I20260925 16:44:23.767926  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2535) took 1285 ms. Trace:
I20260925 16:44:23.748208 12460 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:23.777717  9700 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
W20260925 16:44:23.813392  9118 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.010s	sys 0.064s
W20260925 16:44:23.815828  9118 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.064s
W20260925 16:44:23.819255  9115 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.029s	sys 0.046s
W20260925 16:44:23.823658  9115 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.029s	sys 0.047s
W20260925 16:44:23.776423 12694 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.010s	sys 0.020s
I20260925 16:44:23.763631 12492 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:23.784328  9120 rpcz_store.cc:276] 0925 16:44:22.482353 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:22.759574 (+277221us) service_pool.cc:227] Handling call
0925 16:44:22.776587 (+ 17013us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:22.800083 (+ 23496us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:22.800110 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:22.825276 (+ 25166us) log.cc:842] Serialized 52 byte log entry
0925 16:44:23.361876 (+536600us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:23.378781 (+ 16905us) log.cc:842] Serialized 14 byte log entry
0925 16:44:23.378952 (+   171us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:23.379016 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:23.468865 (+ 89849us) spinlock_profiling.cc:243] Waited 1.47 ms on lock 0x7b18002e9d80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:23.756521 (+287656us) raft_consensus.cc:1671] finished
0925 16:44:23.767666 (+ 11145us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:23.767858 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45273,"prepare.queue_time_us":27984,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":9821,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":7353,"spinlock_wait_cycles":3372288,"thread_start_us":420958,"threads_started":1,"wal-append.queue_time_us":730556}
I20260925 16:44:23.764051 12796 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
W20260925 16:44:23.816983  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58432.5us
I20260925 16:44:23.843320 12795 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:23.844520  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:23.847226 12641 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260925 16:44:23.794490 12342 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:23.819109 12985 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:23.837189 12868 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:23.838757 12850 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:23.822072 13017 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
W20260925 16:44:23.868656  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.020s	sys 0.017s
W20260925 16:44:23.871208  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.020s	sys 0.017s
W20260925 16:44:23.880225  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.008s	sys 0.026s
W20260925 16:44:23.881619  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.543s	user 0.009s	sys 0.026s
W20260925 16:44:23.881017  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.039s	sys 0.017s
W20260925 16:44:23.883127  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.039s	sys 0.017s
W20260925 16:44:23.870395  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.021s	sys 0.065s
W20260925 16:44:23.892310  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.703s	user 0.021s	sys 0.065s
W20260925 16:44:23.872292  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 542882us
I20260925 16:44:23.813058 12453 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:23.867281 12868 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:23.897361  9123 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.017s	sys 0.047s
W20260925 16:44:23.899295  9123 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.017s	sys 0.047s
I20260925 16:44:23.897306  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.820307 12669 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:23.891588 12881 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.039s
I20260925 16:44:23.818344 12903 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:23.891535 12887 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.012s	sys 0.034s
I20260925 16:44:23.859929 12342 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:23.915769 12976 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.028s	sys 0.017s
W20260925 16:44:23.915956  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 627873us
W20260925 16:44:23.916131 12976 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.028s	sys 0.017s
I20260925 16:44:23.918347 12787 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.919848 12787 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:23.918798  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.921121 12963 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:23.922374  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:23.923149 12963 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:23.907382 12753 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
I20260925 16:44:23.925202 12753 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:23.925068  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:23.901544 12868 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:23.867075 12985 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.910714  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:23.907610 12881 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.006s	sys 0.039s
W20260925 16:44:23.909498 12887 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.013s	sys 0.034s
I20260925 16:44:23.931166  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:23.907565 12801 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.005s	sys 0.022s
I20260925 16:44:23.905313 12641 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:23.926496 12796 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:23.976460  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:23.978307  9700 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:23.943864  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.003s	sys 0.019s
W20260925 16:44:23.985989  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.003s	sys 0.020s
W20260925 16:44:23.986573  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 610978us
I20260925 16:44:23.928200 12963 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:23.987305  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:23.937695 12777 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:23.994889  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:23.965843 12801 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.006s	sys 0.022s
I20260925 16:44:23.896282 12558 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:23.944839 12763 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:23.999380  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:24.012486  9693 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:23.976475 12669 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:24.009562  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84531.8us
I20260925 16:44:24.017241  9699 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:23.937464 12753 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.025574 13025 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:24.026533 12753 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.026677 13025 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:24.027120 13025 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:24.027595 13019 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260925 16:44:24.031013 13018 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260925 16:44:24.034116  9700 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:44:24.034688  9700 raft_consensus.cc:595] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:24.002072 12777 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:24.036432 12777 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.038445 12985 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.040040  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.042099  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.052933  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:44:24.014313 12763 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:24.054742  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260925 16:44:24.056196  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.016s	sys 0.021s
W20260925 16:44:24.071202  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.016s	sys 0.021s
W20260925 16:44:24.095629  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 676832us
I20260925 16:44:24.104262  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:24.101393 13021 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:24.108901  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:24.109112 13021 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.110424  9122 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:24.057794 12864 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:24.128153 12864 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:24.128505 12864 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:24.128814 12864 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:24.134672 12706 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:24.135210 12706 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:24.136128 13021 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:24.111346  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53561.8us
W20260925 16:44:24.112298 13024 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260925 16:44:24.112080 12881 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260925 16:44:24.114745 12996 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.772s	user 0.015s	sys 0.001s
W20260925 16:44:24.116297 12786 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.643s	user 0.009s	sys 0.000s
I20260925 16:44:24.062938 12763 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:24.189484  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.194758  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:24.182746 13031 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260925 16:44:24.193441 12342 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.193811 13021 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.123314 13025 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.143667 12864 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.188009 12786 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:24.277719 13032 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260925 16:44:24.226440 12460 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:24.292812 12725 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.541s	user 0.011s	sys 0.033s
I20260925 16:44:24.344270  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:24.352512 12725 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.011s	sys 0.033s
I20260925 16:44:24.258453 13034 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.281062  9047 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:24.242008  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 864) took 1067 ms. Trace:
I20260925 16:44:24.355495  9121 rpcz_store.cc:276] 0925 16:44:23.175033 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:23.356495 (+181462us) service_pool.cc:227] Handling call
0925 16:44:23.356752 (+   257us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:23.357037 (+   285us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:23.357064 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:23.357470 (+   406us) log.cc:842] Serialized 26 byte log entry
0925 16:44:23.883658 (+526188us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:23.883762 (+   104us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:23.883861 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:24.241712 (+357851us) raft_consensus.cc:1671] finished
0925 16:44:24.241740 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:24.241931 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3135,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":73,"thread_start_us":525812,"threads_started":1,"wal-append.queue_time_us":738447}
W20260925 16:44:24.229776  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 385308us
I20260925 16:44:24.353026 13034 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:24.288944  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 297962us
W20260925 16:44:24.289610  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 294796us
W20260925 16:44:24.274325 13022 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260925 16:44:24.287184  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2541) took 1179 ms. Trace:
I20260925 16:44:24.360698  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:24.212268  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 462742us
I20260925 16:44:24.362643  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.282464 12786 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.372695  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.225827 13021 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.378755  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.382206  9693 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:24.388453  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:24.380522  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.224541 12641 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
W20260925 16:44:24.374845 12666 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.672s	user 0.009s	sys 0.003s
I20260925 16:44:24.368223 12985 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.408772 13054 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:24.408730 12985 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.409381 13054 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:24.397377 12342 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.410370 12342 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.410247 13054 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.410809 12985 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.368489 13042 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:24.411260 12881 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:24.412204  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:24.398972 12872 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.375670 12903 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.403775 13035 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260925 16:44:24.396847 12864 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.405315 13025 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:24.374091 13043 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.408087 13044 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:24.411942 13042 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.412333 12342 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.214183 12706 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.410261  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.282469 12868 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.413914  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.414369  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:24.398348  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:24.364229  9118 rpcz_store.cc:276] 0925 16:44:23.108023 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:23.126425 (+ 18402us) service_pool.cc:227] Handling call
0925 16:44:23.126769 (+   344us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:23.127111 (+   342us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:23.127140 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:23.127678 (+   538us) log.cc:842] Serialized 52 byte log entry
0925 16:44:23.818230 (+690552us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:23.853558 (+ 35328us) log.cc:842] Serialized 14 byte log entry
0925 16:44:23.858907 (+  5349us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:23.858981 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:24.286908 (+427927us) raft_consensus.cc:1671] finished
0925 16:44:24.286935 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:24.287114 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5089,"prepare.queue_time_us":21924,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2345,"raft.queue_time_us":49864,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":21927,"thread_start_us":608061,"threads_started":1,"wal-append.queue_time_us":728840}
I20260925 16:44:24.425877  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.445482  9121 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:24.442863  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.396302 12641 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:24.447278  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:24.433750 12976 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:24.451031  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.451803  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:24.458729  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.453384  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.459515  9043 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:24.454543  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.454900  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:24.460744  9045 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:24.456130  9050 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260925 16:44:24.456418  9702 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260925 16:44:24.462024  9702 pending_rounds.cc:76] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 8
I20260925 16:44:24.462239  9702 pending_rounds.cc:97] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260925 16:44:24.462447  9702 raft_consensus.cc:2866] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:24.451442 12777 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:24.438400 12753 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:24.438786 13044 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.465757  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.468420 12801 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:24.451910 12881 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:24.479188  9041 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260925 16:44:24.481595 12864 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:24.481632 13048 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:24.458546 12887 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:24.458398 12342 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:24.465202 12850 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:24.424455 12872 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.431095 12903 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.507597 12903 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.496403  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.504686 12786 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:44:24.487777 12706 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:24.508278  9698 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:24.509043 12453 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:24.509522 12453 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.477777 12787 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:24.511276 12787 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:24.511865 12787 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:24.476145 12976 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:24.511318 12453 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.469302 12460 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260925 16:44:24.488157 12864 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:24.523389  9045 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:24.433600 13043 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.532987  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.530702  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.534412  9702 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:24.535946  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:24.482594 13042 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.488621 13044 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.545262 13044 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.430750 13034 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.547418  9699 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260925 16:44:24.547806  9699 pending_rounds.cc:76] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 7
I20260925 16:44:24.547986  9699 pending_rounds.cc:97] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260925 16:44:24.548182  9699 raft_consensus.cc:2866] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:24.523537 12975 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260925 16:44:24.519502 12887 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.549036 12975 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:24.502197 12725 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260925 16:44:24.517907 12641 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.557955 12641 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:24.487988 12753 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.556802 12975 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:24.523097 12903 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.571131 12903 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.571511 12864 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.574635 12787 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.576768 12903 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.581020 12787 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.611737  9045 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:24.613128  9049 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260925 16:44:24.550673 13021 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.613575  9049 pending_rounds.cc:76] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 7
I20260925 16:44:24.613934  9049 pending_rounds.cc:97] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 13.8
W20260925 16:44:24.615002  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 149311us
I20260925 16:44:24.618881  9047 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 14. Ops: [12.10-12.10]
I20260925 16:44:24.570571 12558 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:24.620026  9016 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:24.614210  9049 raft_consensus.cc:2866] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:24.614595  9046 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:24.622752  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.629113  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.626000 12460 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260925 16:44:24.621803 12558 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:24.620261 12903 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.632231  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.630502  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.637122  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.650471  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.642513  9699 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:24.653038  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:24.653513  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.654627  9041 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:24.653569  9043 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:24.655925  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.656920  9045 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:24.659941  9044 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:24.660156 12787 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:24.661275  9044 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:24.636046 12903 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.621244 12868 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:24.570310 12887 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.666769  9050 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: [13.10-13.10]
I20260925 16:44:24.669497  9042 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:24.668414  9041 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260925 16:44:24.668645  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:24.666039 13068 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:24.672120 13051 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:24.672464 13068 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.666554 13030 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:24.673674 13030 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.674580 13068 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.663546 12975 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.634078 12558 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:24.629993 13027 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:24.682025  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:24.676887  9045 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:44:24.671319  9043 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:24.638177 12753 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.663369 13021 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:24.672521 12903 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.676072 12975 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:24.705688  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.706470  9696 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:24.707557  9048 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:24.651572 13035 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260925 16:44:24.677903 13051 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:24.704298  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:24.675948 13065 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.556818 12976 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.687318 12777 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:24.708792  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.675664 13030 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:24.738922  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57039.7us
I20260925 16:44:24.697152 13068 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:24.692180 13027 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:24.731009  9123 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 8. (term mismatch)
I20260925 16:44:24.742679  9123 pending_rounds.cc:76] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:44:24.742967  9123 pending_rounds.cc:97] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 10.8
I20260925 16:44:24.743268  9123 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:24.743880  9122 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:24.634895 12763 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.733453  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:24.699435 13021 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:24.705493 12963 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:24.753049  9045 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:24.694988 13034 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260925 16:44:24.726519 12753 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.760208  9115 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:44:24.770704  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.771307  9123 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:24.736847 13065 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.776000 13065 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.779181  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:24.782860 13059 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.222s	user 0.000s	sys 0.002s
I20260925 16:44:24.783604  9123 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:24.782897  8972 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:24.784946  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:24.789274  9045 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260925 16:44:24.780009  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:24.780560  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.781207  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.781646  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:24.781898  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.791754  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:24.792817  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85668.7us
I20260925 16:44:24.742375 13068 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:24.754173 13027 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:24.749028 13040 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:24.728892 13048 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260925 16:44:24.768366 13021 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:24.808832  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.811877  8975 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:24.812980  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.814389  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.815081  8975 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:24.817071  8971 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:24.825950  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.804932 13068 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:24.830859  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.836586  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.839201  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.840174  9049 raft_consensus.cc:2354] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:24.760219 12777 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.832710  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.790117 12963 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.850687  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:24.784296 12753 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.826910 13040 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:24.832297 13065 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.829735 13043 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:24.849370 12492 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260925 16:44:24.855571 12868 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:24.853298  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:24.867425  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68893.1us
I20260925 16:44:24.828742 13051 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.859872  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.868322  8971 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:24.816083 13041 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260925 16:44:24.859476 12872 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.869040  9699 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260925 16:44:24.874608  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 193728us
I20260925 16:44:24.879545  9115 raft_consensus.cc:2396] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260925 16:44:24.880419  9041 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:24.888157  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:24.889030  8975 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:24.895855  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.867574 12492 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
W20260925 16:44:24.900653  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 424716us
I20260925 16:44:24.902590  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.904572  8971 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:24.850853 12666 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260925 16:44:24.911029  9042 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:24.906941  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.907583  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.912374  9121 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 5 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 5.
I20260925 16:44:24.912966  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.916607  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.919901  9041 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:24.895843 12725 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:24.931217  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.912307 12777 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.937467  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:24.938319  9119 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:24.937268  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:24.925293  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56296.1us
I20260925 16:44:24.887926 12887 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.904059 12492 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:24.928125 12872 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:24.948247  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.867105 13065 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:24.950238  9116 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 6: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:24.948638  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.955847  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:24.958916  8975 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:24.965967  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 2 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.967092  8971 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:24.968055  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:24.969698  8975 raft_consensus.cc:2362] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7. Re-sending same reply.
I20260925 16:44:24.972599  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:24.973237  9118 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:24.975921  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.976958 12963 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.977277  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.979223 12669 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:24.979614 12669 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:24.980983 13060 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.444s	user 0.002s	sys 0.000s
I20260925 16:44:24.983163  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:24.992861  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.993809  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:24.996387  8972 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:24.971726  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.021759  8971 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:25.030154  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.050305  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:24.949923 12725 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:25.109570 12725 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:24.961566 12763 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.111658 13048 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:24.969054 12777 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:25.112778 12777 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:25.113242 12777 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:25.115032  9117 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:25.073061  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:25.116613  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:25.050573  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.117877  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:25.118671  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.119871  8975 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:25.050839  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:25.121322  9048 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:25.031690  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.038200  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:25.122458  9699 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:25.122735  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.124097  8975 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:25.125304  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.050305  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.095597 12753 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:24.984366 13030 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.130035  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.097944 12881 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:25.100610  9119 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:25.101079  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.130844 12881 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:25.105612 13078 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:25.106022  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:25.132107  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.132555 13078 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:25.129786 13030 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.133122  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.104519 12453 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:25.133003 12881 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:25.133201  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:25.134986 13030 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.135162  8968 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:25.136672 12453 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:25.134220  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.138236  8972 raft_consensus.cc:2396] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:44:25.136701  9699 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:25.141763  9117 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:24.923975 12641 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.103s
I20260925 16:44:25.133168 13078 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:25.146960  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:25.128783  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.149977  8975 raft_consensus.cc:2354] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
W20260925 16:44:25.085866  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 180236us
W20260925 16:44:25.054582 13024 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260925 16:44:25.052045 12787 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:25.032226 13042 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:24.965921 12872 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:25.038280 12887 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.140s
W20260925 16:44:25.194514  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 211418us
I20260925 16:44:25.247911  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:25.249917  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:24.949615 13040 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:25.195492  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 209869us
I20260925 16:44:25.210816 13030 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.085628 12669 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.221518  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:25.223448 13063 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.234s	user 0.001s	sys 0.000s
I20260925 16:44:25.174949 12492 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.202411 12795 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:25.228130  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:25.312479  9046 raft_consensus.cc:2396] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:25.235034  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:25.244791  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:25.313176  9042 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:25.313478  9043 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:25.313647  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68947.9us
I20260925 16:44:25.251295  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:25.297724  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:25.228899 12985 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.234206  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:25.318128  9047 raft_consensus.cc:2354] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
W20260925 16:44:25.319007  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67808us
I20260925 16:44:25.321204  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:25.321738 12985 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.299556 13043 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:25.297250 13044 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:25.312171 13065 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:25.321382 12753 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:25.323336 13071 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.325s	user 0.000s	sys 0.001s
W20260925 16:44:25.356515  9044 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.693s	user 0.032s	sys 0.088s
W20260925 16:44:25.357702  9044 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.032s	sys 0.088s
I20260925 16:44:25.333570 12963 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.355409 12669 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:25.355995  9089 connection.cc:232] RPC call timeout handler was delayed by -4.2500074810002388s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1525s for a response
W20260925 16:44:25.404157  9089 connection.cc:232] RPC call timeout handler was delayed by -3.1457074810002723s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2752s for a response
I20260925 16:44:25.359472 13043 raft_consensus.cc:2741] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260925 16:44:25.333794 13030 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.335976 12903 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.030s
I20260925 16:44:25.416867  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:25.365206 12492 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:25.365543 12864 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:25.421123  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 100021us
I20260925 16:44:25.422621  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:25.371084 12453 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.422169  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:25.467623  9123 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:25.467758  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45683.6us
I20260925 16:44:25.468974  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:25.471252  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:25.472919 13034 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
W20260925 16:44:25.479497  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 180837us
I20260925 16:44:25.485945  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:25.422792 13088 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.237s	user 0.001s	sys 0.000s
I20260925 16:44:25.492213  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:25.368480 12963 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.406641 13104 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
W20260925 16:44:25.535373  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54886.9us
I20260925 16:44:25.538126  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:44:25.539019  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53139us
I20260925 16:44:25.539804  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:25.540993  9696 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260925 16:44:25.541523  8967 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:25.541390  9696 pending_rounds.cc:76] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 8
I20260925 16:44:25.542513  9696 pending_rounds.cc:97] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260925 16:44:25.542790  9696 raft_consensus.cc:2866] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:25.542606  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:25.547260  9699 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:25.488569 13081 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election won for term 7
W20260925 16:44:25.534127 13055 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.998s	user 0.000s	sys 0.003s
I20260925 16:44:25.485067 13043 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:25.540551 12753 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:25.470841 12641 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260925 16:44:25.541369 13044 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:25.599474 13104 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:25.484905 12453 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:25.547881 13051 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:25.611888  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:25.615445  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73159.2us
I20260925 16:44:25.634516  9123 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:44:25.555169 13034 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:25.614614 13044 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:25.624406 13043 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:25.600770 13065 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:25.683458 13109 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:44:25.683542 13025 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.734174 13025 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.684118 12753 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.735877 12753 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:25.738049 12753 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:25.684741 13100 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260925 16:44:25.685951 13106 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
W20260925 16:44:25.693744 13089 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.355s	user 0.001s	sys 0.000s
W20260925 16:44:25.694244 13068 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.000s
I20260925 16:44:25.694828 13082 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.694443 13104 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.753634 13068 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.696537 13124 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:25.754508 13027 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.927s	user 0.007s	sys 0.003s
W20260925 16:44:25.683615 12777 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.569s	user 0.009s	sys 0.003s
I20260925 16:44:25.697357  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2556) took 1534 ms. Trace:
I20260925 16:44:25.769948  9120 rpcz_store.cc:276] 0925 16:44:24.162775 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.162935 (+   160us) service_pool.cc:227] Handling call
0925 16:44:24.188361 (+ 25426us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:24.188603 (+   242us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:24.188638 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:24.189135 (+   497us) log.cc:842] Serialized 26 byte log entry
0925 16:44:24.342746 (+153611us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:24.342789 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:24.342872 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:25.243995 (+901123us) spinlock_profiling.cc:243] Waited 5.35 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:25.697081 (+453086us) raft_consensus.cc:1671] finished
0925 16:44:25.697102 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:25.697301 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12303744,"thread_start_us":126719,"threads_started":1,"wal-append.queue_time_us":238496}
I20260925 16:44:25.698114 12963 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.698527  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:25.700598 13094 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:44:25.683871 12787 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.701385 13110 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:25.702617 13030 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:25.703963 13053 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.015s	user 0.000s	sys 0.004s
W20260925 16:44:25.704844 13103 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260925 16:44:25.705116 13113 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:44:25.681371 12872 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:25.678624 13112 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:25.711901 13102 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.393s	user 0.001s	sys 0.001s
I20260925 16:44:25.819043  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 768) took 1044 ms. Trace:
I20260925 16:44:25.713080 13034 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.715078 12985 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.717667 12453 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:25.720901 12558 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.015s	user 0.010s	sys 0.001s
I20260925 16:44:25.680733 13044 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:25.730271  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:25.779110 12975 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.070s	user 0.007s	sys 0.005s
I20260925 16:44:25.754753 13124 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:25.848647  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.044s	sys 0.036s
W20260925 16:44:25.848991  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.811s	user 0.044s	sys 0.037s
I20260925 16:44:25.644912 13051 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.838217  8970 rpcz_store.cc:276] 0925 16:44:24.774797 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.795764 (+ 20967us) service_pool.cc:227] Handling call
0925 16:44:24.819071 (+ 23307us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:24.860119 (+ 41048us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:24.860166 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:24.890064 (+ 29898us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.151596 (+261532us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:25.151649 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:25.152395 (+   746us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:25.818779 (+666384us) raft_consensus.cc:1671] finished
0925 16:44:25.818808 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:25.818975 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":38479,"raft.queue_time_us":47732,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":8122,"thread_start_us":227370,"threads_started":1,"wal-append.queue_time_us":345106}
I20260925 16:44:25.754925 13027 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.752996 13082 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.844846  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2418) took 1063 ms. Trace:
I20260925 16:44:25.860882  9115 rpcz_store.cc:276] 0925 16:44:24.776533 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.780309 (+  3776us) service_pool.cc:227] Handling call
0925 16:44:25.839983 (+1059674us) spinlock_profiling.cc:243] Waited 84.4 ms on lock 0x7b5400166554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:25.840120 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":194077952}
W20260925 16:44:25.815361 13101 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260925 16:44:25.843786  8975 raft_consensus.cc:2354] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
W20260925 16:44:25.771498 13021 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.944s	user 0.008s	sys 0.004s
I20260925 16:44:25.848883 13068 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.838370 13113 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:25.781672  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 168170us
I20260925 16:44:25.863232  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:25.867816  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 450985us
I20260925 16:44:25.868633  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:25.869227  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:25.871352  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.871719  9699 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:25.871953  8970 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:25.870736  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:25.873435  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.779592 12777 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:25.875423  8975 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:25.876304  8974 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:25.877169  8969 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.005s	sys 0.005s
W20260925 16:44:25.878425  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 277469us
W20260925 16:44:25.881848  8969 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.005s	sys 0.005s
I20260925 16:44:25.878954  9119 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260925 16:44:25.860656 12753 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.884047  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:25.842878 12787 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.845916 12558 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.887066 13051 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.889313 13078 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:25.890326  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.872591 13021 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.891845 13108 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:25.892117  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2204) took 1115 ms. Trace:
I20260925 16:44:25.892781  9698 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:44:25.895895 13025 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:25.903676  9701 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:25.926244 12669 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:25.884176  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:25.927943  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:25.928776  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44679.9us
I20260925 16:44:25.904989  9699 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:25.905635  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:25.916535  8972 rpcz_store.cc:276] 0925 16:44:24.777041 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.138762 (+361721us) service_pool.cc:227] Handling call
0925 16:44:25.139036 (+   274us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:25.139352 (+   316us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:25.139384 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:25.139810 (+   426us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.217866 (+ 78056us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:25.217924 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:25.218021 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:25.743134 (+525113us) spinlock_profiling.cc:243] Waited 51.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:25.891850 (+148716us) raft_consensus.cc:1671] finished
0925 16:44:25.891872 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:25.892067 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":549,"raft.run_cpu_time_us":80,"raft.run_wall_time_us":82,"spinlock_wait_cycles":118674688,"thread_start_us":77656,"threads_started":1,"wal-append.queue_time_us":200057}
I20260925 16:44:25.905799  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:25.901619  8970 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:25.932551  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 730) took 1278 ms. Trace:
I20260925 16:44:25.911253  8971 raft_consensus.cc:2354] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:25.911677  9048 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:25.910750  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:25.871266 13113 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:25.911896  8975 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:25.932762  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:25.939098  8973 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:25.939678  9695 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:25.929852  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2407) took 1825 ms. Trace:
W20260925 16:44:25.935458  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51103.7us
I20260925 16:44:25.900157 13048 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:25.943825  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:25.944588  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:25.945168  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:25.940704  9124 rpcz_store.cc:276] 0925 16:44:24.104844 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.105004 (+   160us) service_pool.cc:227] Handling call
0925 16:44:24.105382 (+   378us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:24.113771 (+  8389us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:24.113799 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:24.114325 (+   526us) log.cc:842] Serialized 26 byte log entry
0925 16:44:24.395361 (+281036us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:24.395395 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:24.395458 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:25.329029 (+933571us) spinlock_profiling.cc:243] Waited 5.55 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:25.914346 (+585317us) raft_consensus.cc:1671] finished
0925 16:44:25.914377 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:25.929749 (+ 15372us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":45610,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":4459,"spinlock_wait_cycles":12775168,"thread_start_us":280720,"threads_started":1,"wal-append.queue_time_us":378761}
I20260925 16:44:25.911234 13081 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:25.951061  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:25.873001 12453 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
I20260925 16:44:25.951337  8970 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:44:25.953574  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:25.953994  9119 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:25.955971  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:25.956745  9122 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260925 16:44:25.958328  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:25.957695  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:25.932919  9044 rpcz_store.cc:276] 0925 16:44:24.654138 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.661948 (+  7810us) service_pool.cc:227] Handling call
0925 16:44:24.662226 (+   278us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:24.662512 (+   286us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:24.662541 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:24.662937 (+   396us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.358893 (+695956us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:25.358945 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:25.360448 (+  1503us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:25.932323 (+571875us) raft_consensus.cc:1671] finished
0925 16:44:25.932352 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:25.932505 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3829,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":22441,"thread_start_us":695550,"threads_started":1,"wal-append.queue_time_us":825513}
I20260925 16:44:25.928040 13075 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:25.840480 13112 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:25.964498  8972 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:25.963132  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2203) took 1186 ms. Trace:
W20260925 16:44:25.996477  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 459915us
I20260925 16:44:25.969710  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:25.907533 12903 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260925 16:44:25.910348 12753 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:25.997030  8968 rpcz_store.cc:276] 0925 16:44:24.776802 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.135967 (+359165us) service_pool.cc:227] Handling call
0925 16:44:25.136288 (+   321us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:25.140338 (+  4050us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:25.140370 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:25.140833 (+   463us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.204796 (+ 63963us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:25.210486 (+  5690us) log.cc:842] Serialized 14 byte log entry
0925 16:44:25.357074 (+146588us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:25.357188 (+   114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:25.962860 (+605672us) raft_consensus.cc:1671] finished
0925 16:44:25.962887 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:25.963041 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":159061,"prepare.queue_time_us":5208,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":150083,"raft.run_cpu_time_us":253,"raft.run_wall_time_us":30282,"thread_start_us":60193,"threads_started":1,"wal-append.queue_time_us":82480}
I20260925 16:44:26.010037  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:26.011121  9044 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:26.000949  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:26.109421  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111947us
W20260925 16:44:26.167730  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.007s	sys 0.008s
I20260925 16:44:26.182786  9119 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 6. (term mismatch)
I20260925 16:44:25.968261 12975 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.145s
I20260925 16:44:26.189502  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:26.183259  9119 pending_rounds.cc:76] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 5
I20260925 16:44:26.191466  9119 pending_rounds.cc:97] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 5.6
I20260925 16:44:26.191797  9119 raft_consensus.cc:2866] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:26.106379 13068 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:25.996088 13035 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.189s
I20260925 16:44:25.958405 13048 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.180517 13093 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:26.208340 13129 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:26.212222 13133 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:26.212633 13105 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:26.212775 13128 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:26.160467 12872 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:26.213721 13125 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:26.228520  9701 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
W20260925 16:44:26.232560  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 263585us
I20260925 16:44:26.214049 13124 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:26.265897  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61254.6us
I20260925 16:44:25.996701 13075 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.246802 13093 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:26.284886  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:26.289268  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 114265us
I20260925 16:44:26.259445 13129 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:26.288446  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 286953us
I20260925 16:44:26.299302  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.265770 13027 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.301075  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.303141  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:26.271152 12903 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:26.300956  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.753s (SENT) [suppressed 12 similar messages]
I20260925 16:44:26.215811 13068 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:26.309803  9701 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12.
I20260925 16:44:26.275003 13043 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:26.317010  9043 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:26.308029 13131 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:26.291319 12777 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:26.369587  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57122.5us
I20260925 16:44:26.358867  8941 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12.
I20260925 16:44:26.302369 13093 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:26.358651  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:26.304684 13051 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:26.370177  9043 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:26.370178  8941 leader_election.cc:401] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260925 16:44:26.372300  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1709) took 1127 ms. Trace:
I20260925 16:44:26.306885 12558 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.276335 13095 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.440s
W20260925 16:44:26.386062  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 385170us
W20260925 16:44:26.424813  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54591.5us
I20260925 16:44:26.387080  9048 rpcz_store.cc:276] 0925 16:44:25.245323 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.698184 (+452861us) service_pool.cc:227] Handling call
0925 16:44:26.372111 (+673927us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b54000d48d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:26.372241 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":73181056}
I20260925 16:44:26.426635  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:26.427714  9048 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12.
I20260925 16:44:26.309580 13124 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:26.304351 13129 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:26.285660 12872 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.364842  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:26.356943 12453 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:26.447664  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:26.448422  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:26.447714  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:26.462713  9122 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:26.462868  9048 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
W20260925 16:44:26.463215 13143 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.251s	user 0.000s	sys 0.000s
I20260925 16:44:26.359186 13125 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:26.468348 13125 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.471012 13125 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.451598 13113 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:26.457420 13135 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.351s	user 0.001s	sys 0.000s
I20260925 16:44:26.460975 12872 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.461799  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:26.471671 13125 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:26.477418 13125 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:26.368086 13082 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.479492  9116 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:26.478639 13125 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.480852 13068 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:26.482051  8968 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260925 16:44:26.483083  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:26.272334 13105 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:26.487169  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 130535us
I20260925 16:44:26.483613  8968 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:26.356535 12787 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:26.486567  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61096.1us
I20260925 16:44:26.475945  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 771) took 1700 ms. Trace:
I20260925 16:44:26.201539 13081 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:26.494984  9089 leader_election.cc:398] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:26.476653  9695 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:26.475651  9122 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
W20260925 16:44:26.495949  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 195016us
I20260925 16:44:26.491393  9048 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:26.500411  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:26.500576  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:26.501682  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:26.501734  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:26.494863  8969 rpcz_store.cc:276] 0925 16:44:24.775746 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.795562 (+ 19816us) service_pool.cc:227] Handling call
0925 16:44:24.818531 (+ 22969us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:25.247522 (+428991us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:25.247566 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:25.248081 (+   515us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.886077 (+637996us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:25.892860 (+  6783us) log.cc:842] Serialized 14 byte log entry
0925 16:44:25.920487 (+ 27627us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:25.920590 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:26.475625 (+555035us) raft_consensus.cc:1671] finished
0925 16:44:26.475652 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:26.475860 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":97668,"prepare.queue_time_us":2618,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":45,"raft.queue_time_us":96730,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":10251,"thread_start_us":929503,"threads_started":2,"wal-append.queue_time_us":623296}
I20260925 16:44:26.503902  9048 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 7: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:26.518289  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:26.519013  8968 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:26.495572 13051 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:26.525270  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.006s	sys 0.018s
W20260925 16:44:26.537127  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.006s	sys 0.018s
I20260925 16:44:26.475907 13137 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:26.538115  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.496208 12777 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:26.474073 13113 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:26.544389  9048 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:26.516119 13068 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:26.527727 12872 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:26.504774 12753 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:26.454754 13124 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.453864 13108 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260925 16:44:26.554118  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.537545 13027 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:26.475812 13130 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.247s
I20260925 16:44:26.517213 13133 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:26.375286 13131 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.550767 13068 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:26.580971 13068 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:26.496395 12558 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260925 16:44:26.588423  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.590054  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.590636  9118 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:26.591209  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.591430  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.592047  9123 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:26.593041 13131 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.593359  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.593971  9124 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:26.550557 12777 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.598806 12777 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.537015 13051 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:26.473142 13129 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.602427 13129 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.563970 13054 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:26.576014 13048 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:26.579620 13044 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.731s	user 0.009s	sys 0.000s
I20260925 16:44:26.575618 13040 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:26.603056 13051 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:26.603331 13040 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.553421 12872 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:26.604801 12872 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:26.605036 13044 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.606153  9049 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260925 16:44:26.609510 13044 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:26.613667 13144 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260925 16:44:26.546684 13082 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:26.593050  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.631495  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.630576  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.629081  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:26.631560  9116 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:44:26.609491 13134 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.526s	user 0.000s	sys 0.001s
I20260925 16:44:26.644526  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.372758 13043 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.646916  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.648623  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:26.562232 13039 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:26.576843 13130 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:26.627725 13137 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:26.669931  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 103759us
I20260925 16:44:26.670965  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.640430 13129 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:26.639076 13113 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:26.639253 13054 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:26.634965 13127 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:26.677939  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 229584us
I20260925 16:44:26.678676  9089 leader_election.cc:398] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:26.688022  9089 leader_election.cc:401] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260925 16:44:26.692592  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:26.693747 13124 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.695482 13157 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:26.696022 13157 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.697321 12796 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:26.697918 13157 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.699051  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:26.698961 12872 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:26.700805 13043 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.701041 13133 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.704850 13075 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.706138  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2523) took 1486 ms. Trace:
I20260925 16:44:26.675745 13141 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:26.707408 13141 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:26.688858 13137 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:26.708333 13137 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:26.709252  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:26.710443 13137 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:26.710819 13021 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:26.711884  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:26.667528 13082 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:26.687392 13127 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.716815  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:26.706607  9050 rpcz_store.cc:276] 0925 16:44:25.220108 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.221402 (+  1294us) service_pool.cc:227] Handling call
0925 16:44:25.221676 (+   274us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:25.336013 (+114337us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:25.336041 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:25.339778 (+  3737us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.535791 (+196013us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:25.535826 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:26.705594 (+1169768us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54002a3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:26.705692 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:26.705772 (+    80us) raft_consensus.cc:1671] finished
0925 16:44:26.705790 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:26.706067 (+   277us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2166,"raft.queue_time_us":26235,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":6219,"spinlock_wait_cycles":257065344,"thread_start_us":164988,"threads_started":1,"wal-append.queue_time_us":343475,"wal-append.run_cpu_time_us":1715,"wal-append.run_wall_time_us":1004677}
I20260925 16:44:26.737076  8940 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12.
I20260925 16:44:26.759984  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:26.736534 13021 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:26.685199 13113 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:26.750072  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 252647us
I20260925 16:44:26.674883 13130 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.667424 13039 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:26.740464 13157 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.130s
I20260925 16:44:26.721216 13082 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:26.791026  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:27.004951  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 245050us
I20260925 16:44:27.004659  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:26.992844  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 346000us
W20260925 16:44:27.004385  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 504029us
I20260925 16:44:27.008571  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:27.009142  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:27.010180  9122 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:27.011201  9697 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:26.880479  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:26.873256  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:27.013984  9693 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:26.791406  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:27.016541  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 338060us
I20260925 16:44:27.017486  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:27.020987  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:27.005877  9694 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:27.045687  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:26.964181 13104 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.006s	sys 0.010s
I20260925 16:44:27.050992  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:27.052194  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:26.770161 13021 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:27.053900  9042 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:27.059903  9694 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:27.053792  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:27.061591  9045 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:27.051487  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:27.063555  9049 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:26.872933 13076 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:26.946776 13027 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12.
I20260925 16:44:27.063215  9695 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:27.003635 13043 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:27.072021  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.011s	sys 0.014s
W20260925 16:44:27.080320  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.011s	sys 0.014s
I20260925 16:44:27.080385  9049 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
W20260925 16:44:27.053215 13104 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.006s	sys 0.014s
I20260925 16:44:27.016692 12872 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:26.852968 13105 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:27.080497  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:27.080770  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 563225us
I20260925 16:44:27.016999 12787 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:26.741247 13051 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.028895 13137 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:26.751550 13075 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.307s
I20260925 16:44:26.818154 12777 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:27.092597  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.131142  8968 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:27.059161 12887 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:27.101547  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:27.104089 13176 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:27.140271 13176 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.141131 13051 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:27.142418 13176 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:27.107766 13162 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260925 16:44:27.144483  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2210) took 2365 ms. Trace:
I20260925 16:44:27.129271 12787 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.114961  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.067415 13021 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:27.119854  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49126.5us
I20260925 16:44:27.158782  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:27.160550  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:27.146989  8969 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:26.889248 13068 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.145454 13041 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:27.144824  8975 rpcz_store.cc:276] 0925 16:44:24.778593 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.939385 (+1160792us) service_pool.cc:227] Handling call
0925 16:44:25.964957 (+ 25572us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.374436 (+409479us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.374475 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.392763 (+ 18288us) log.cc:842] Serialized 26 byte log entry
0925 16:44:26.639807 (+247044us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:26.639887 (+    80us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:26.640033 (+   146us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:27.144265 (+504232us) raft_consensus.cc:1671] finished
0925 16:44:27.144284 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:27.144433 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44778,"raft.queue_time_us":42160,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":65845,"thread_start_us":555825,"threads_started":2,"wal-append.queue_time_us":443782}
I20260925 16:44:27.109375 13130 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:27.165550  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 763) took 2379 ms (client timeout 2908 ms). Trace:
I20260925 16:44:27.167403  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.167969  9049 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:27.172456  8974 rpcz_store.cc:269] 0925 16:44:24.768080 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.779771 (+ 11691us) service_pool.cc:227] Handling call
0925 16:44:27.146796 (+2367025us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b540036ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:27.146925 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2490179840}
I20260925 16:44:27.099514  9693 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:27.180786  9049 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260925 16:44:27.138064 13113 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:27.217033  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:26.818804 13054 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.212595  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:27.213594  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54914.7us
I20260925 16:44:27.220933  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:27.154606 12666 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:27.095759 13043 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.166528 13137 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:27.172156 13041 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:27.175577 13124 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260925 16:44:27.313927  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 228563us
I20260925 16:44:27.332186  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.335489  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:27.339736  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.155505 12887 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.342059  8969 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:27.321959  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:27.346568  8968 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:27.328583  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:27.222613 13161 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.332s	user 0.000s	sys 0.001s
I20260925 16:44:27.344450  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:27.400419  8968 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:27.413270  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:27.449060  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 223655us
I20260925 16:44:27.155306 12777 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.456146  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:27.310519 13148 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:27.336513 12872 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:27.343993 13124 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:27.461159  8969 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:27.512588  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.192932 13051 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:27.453755 12763 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:27.461709  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:27.493866  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:27.462828  8974 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:27.215292 13172 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:27.557657  8969 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: [7.8-8.9]
I20260925 16:44:27.519835 13124 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:27.581205  8975 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:44:27.345554 12868 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.219s
I20260925 16:44:27.521831 13128 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:27.527948 13148 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:27.584582  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 984) took 1374 ms. Trace:
W20260925 16:44:27.577139  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 127197us
I20260925 16:44:27.525928 13039 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:27.350742 12666 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.523324 13051 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.572039 12787 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:27.593107  9696 rpcz_store.cc:276] 0925 16:44:26.199425 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.199529 (+   104us) service_pool.cc:227] Handling call
0925 16:44:26.208347 (+  8818us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.425645 (+217298us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.425672 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.426085 (+   413us) log.cc:842] Serialized 26 byte log entry
0925 16:44:26.627765 (+201680us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:26.627817 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:26.627915 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:27.573528 (+945613us) raft_consensus.cc:1671] finished
0925 16:44:27.573577 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:27.573736 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58116,"raft.queue_time_us":96273,"raft.run_cpu_time_us":161,"raft.run_wall_time_us":57262,"thread_start_us":328522,"threads_started":2,"wal-append.queue_time_us":295312}
I20260925 16:44:27.610782 13181 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:27.548946 12763 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.589452 13128 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:27.597556 13148 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:27.571343 13034 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260925 16:44:27.589605 13082 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:27.558645 12872 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.604274 13113 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:27.651625  9696 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:27.653427  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 766) took 2877 ms. Trace:
I20260925 16:44:27.653802  8967 rpcz_store.cc:276] 0925 16:44:24.769133 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.782051 (+ 12918us) service_pool.cc:227] Handling call
0925 16:44:24.782319 (+   268us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:25.541916 (+759597us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:27.638986 (+2097070us) spinlock_profiling.cc:243] Waited 757 ms on lock 0x7b540036f454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:27.646773 (+  7787us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1741800320}
I20260925 16:44:27.628355 13128 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:27.577597 13137 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:27.662683  9089 connection.cc:232] RPC call timeout handler was delayed by -1.4330396830000609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1529s for a response
W20260925 16:44:27.664548  9089 connection.cc:232] RPC call timeout handler was delayed by -1.35203968299993s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
W20260925 16:44:27.665076  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3466396829999212s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1625s for a response
W20260925 16:44:27.665894  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3205396830001064s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1654s for a response
W20260925 16:44:27.666262  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2944396830000642s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260925 16:44:27.666690  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2809396830000424s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
I20260925 16:44:27.632608 13141 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:27.659276 13182 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.474s	user 0.001s	sys 0.000s
W20260925 16:44:27.671559  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 741) took 2885 ms (client timeout 1619 ms). Trace:
W20260925 16:44:27.667054  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1954396829999041s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
I20260925 16:44:27.616019 13038 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.050s
I20260925 16:44:27.563961 13172 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:27.676347  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1945396829999027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1794s for a response
W20260925 16:44:27.676121  9041 rpcz_store.cc:269] 0925 16:44:24.780478 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.784735 (+  4257us) service_pool.cc:227] Handling call
0925 16:44:27.665849 (+2881114us) spinlock_profiling.cc:243] Waited 94.8 ms on lock 0x7b54000b0ed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:27.665953 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":218055936}
W20260925 16:44:27.683362  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0766396829999394s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1925s for a response
I20260925 16:44:27.569595 13041 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.611945 13181 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:27.662899 13068 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:27.656987 13113 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.665688 13081 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.101s
W20260925 16:44:27.683665  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0631396829999176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.194s for a response
I20260925 16:44:27.888461  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:28.257704  9089 connection.cc:232] RPC call timeout handler was delayed by -1.04153968300011s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19640000000000002s for a response
I20260925 16:44:27.948596  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:28.033107  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 745) took 1750 ms. Trace:
W20260925 16:44:28.236745  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.017s	sys 0.008s
I20260925 16:44:27.750582  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:28.261464  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:28.168745  9014 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.950s	user 0.006s	sys 0.017s
W20260925 16:44:27.765856  9697 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.752s	user 0.007s	sys 0.002s
I20260925 16:44:27.961193  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:28.261059  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.736s	user 0.017s	sys 0.008s
W20260925 16:44:28.236074  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.671s	user 0.006s	sys 0.019s
I20260925 16:44:27.666917 13207 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.757s
I20260925 16:44:28.259394  9048 rpcz_store.cc:276] 0925 16:44:26.283191 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.547688 (+264497us) service_pool.cc:227] Handling call
0925 16:44:26.558187 (+ 10499us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.635402 (+ 77215us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.635433 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.635963 (+   530us) log.cc:842] Serialized 26 byte log entry
0925 16:44:27.006314 (+370351us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:27.006356 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:28.032629 (+1026273us) spinlock_profiling.cc:243] Waited 77 ms on lock 0x7b540008dc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:28.032691 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:28.032751 (+    60us) raft_consensus.cc:1671] finished
0925 16:44:28.032769 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:28.033040 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":177020160,"thread_start_us":238330,"threads_started":1,"wal-append.queue_time_us":456627,"wal-append.run_cpu_time_us":1791,"wal-append.run_wall_time_us":1022124}
W20260925 16:44:27.782861  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 500173us
W20260925 16:44:28.034520  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1698) took 3053 ms (client timeout 1683 ms). Trace:
W20260925 16:44:28.636271  8971 rpcz_store.cc:269] 0925 16:44:24.981511 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.031314 (+ 49803us) service_pool.cc:227] Handling call
0925 16:44:28.034334 (+3003020us) spinlock_profiling.cc:243] Waited 789 ms on lock 0x7b54001c3c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:28.034458 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1813731200}
I20260925 16:44:27.750488  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:28.635528  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.012s	sys 0.022s
I20260925 16:44:28.364315  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:28.406668  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:28.637889  9697 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:28.638305  9041 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
W20260925 16:44:28.573390  9118 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.125s	user 0.019s	sys 0.027s
I20260925 16:44:28.639070  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 753) took 1288 ms. Trace:
W20260925 16:44:28.639230  9118 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.020s	sys 0.027s
I20260925 16:44:28.639427  9041 rpcz_store.cc:276] 0925 16:44:27.350424 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.750196 (+399772us) service_pool.cc:227] Handling call
0925 16:44:28.639023 (+888827us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:28.639843  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 899) took 1866 ms. Trace:
W20260925 16:44:28.363865  9122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2590) took 1176 ms (client timeout 1510 ms). Trace:
I20260925 16:44:28.395493  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:28.640687  9122 rpcz_store.cc:269] 0925 16:44:27.085293 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.675520 (+590227us) service_pool.cc:227] Handling call
0925 16:44:28.262034 (+586514us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:28.498000  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 266200us
W20260925 16:44:28.262439  9014 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.043s	user 0.006s	sys 0.020s
W20260925 16:44:28.642127  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.42328e+06us
I20260925 16:44:28.642202  9123 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:28.305730  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2595) took 1166 ms. Trace:
W20260925 16:44:28.642812  9123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2454) took 1565 ms (client timeout 1700 ms). Trace:
I20260925 16:44:28.642901  9120 rpcz_store.cc:276] 0925 16:44:27.138997 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.888117 (+749120us) service_pool.cc:227] Handling call
0925 16:44:28.305649 (+417532us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:28.641443  9115 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
W20260925 16:44:28.646178  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2592) took 1545 ms (client timeout 2028 ms). Trace:
W20260925 16:44:28.646621  9115 rpcz_store.cc:269] 0925 16:44:27.100438 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.961931 (+861493us) service_pool.cc:227] Handling call
0925 16:44:28.646127 (+684196us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:27.686484  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:27.973582  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2525) took 2237 ms. Trace:
I20260925 16:44:28.648420  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2546) took 1492 ms. Trace:
W20260925 16:44:28.017640 13090 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.688s	user 0.006s	sys 0.002s
W20260925 16:44:27.692209 13171 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.230s	user 0.000s	sys 0.000s
I20260925 16:44:28.648522  9044 rpcz_store.cc:276] 0925 16:44:25.735672 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.107607 (+371935us) service_pool.cc:227] Handling call
0925 16:44:26.167259 (+ 59652us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:26.369558 (+202299us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.369599 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:26.369651 (+    52us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:26.369693 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:27.973296 (+1603603us) spinlock_profiling.cc:243] Waited 202 ms on lock 0x7b54002625d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:27.973353 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:27.973509 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":464658688}
I20260925 16:44:29.317142  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1703) took 3908 ms. Trace:
I20260925 16:44:29.317109  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:27.849902 13203 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:29.318467 13203 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.317726  8972 rpcz_store.cc:276] 0925 16:44:25.408594 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.997271 (+588677us) service_pool.cc:227] Handling call
0925 16:44:26.109649 (+112378us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.521096 (+411447us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.521178 (+    82us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.522186 (+  1008us) log.cc:842] Serialized 26 byte log entry
0925 16:44:26.830676 (+308490us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:27.059969 (+229293us) log.cc:842] Serialized 14 byte log entry
0925 16:44:27.073846 (+ 13877us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:27.073916 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:29.316972 (+2243056us) raft_consensus.cc:1671] finished
0925 16:44:29.316990 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.317092 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":53901,"prepare.queue_time_us":362424,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":44,"raft.queue_time_us":213005,"raft.run_cpu_time_us":226,"raft.run_wall_time_us":7932,"thread_start_us":864751,"threads_started":3,"wal-append.queue_time_us":718684}
I20260925 16:44:27.926012 12666 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.320240 13233 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.320422 12666 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:29.321130 12666 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:28.609532 13096 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:27.994251 13021 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.818s	user 0.009s	sys 0.001s
I20260925 16:44:28.964733 13181 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.322713 13208 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:28.660153  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:28.649827  9042 rpcz_store.cc:276] 0925 16:44:27.156459 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.156688 (+   229us) service_pool.cc:227] Handling call
0925 16:44:27.157036 (+   348us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:27.157267 (+   231us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:27.557067 (+399800us) log.cc:842] Serialized 14 byte log entry
0925 16:44:28.648028 (+1090961us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:28.648084 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:28.648141 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:28.648223 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:28.648358 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22626,"prepare.queue_time_us":468660,"prepare.run_cpu_time_us":3195,"prepare.run_wall_time_us":15363,"thread_start_us":541235,"threads_started":2}
W20260925 16:44:28.654148  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1168) took 1785 ms (client timeout 1868 ms). Trace:
I20260925 16:44:29.320906 13233 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:28.707911  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:27.694584 13184 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260925 16:44:28.303462 13168 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:28.957068 13226 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.313s	user 0.000s	sys 0.000s
W20260925 16:44:28.493927 13048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.890s	user 0.003s	sys 0.012s
I20260925 16:44:28.653836  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:28.389180 12881 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:28.913761  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 549498us
I20260925 16:44:28.640350  9118 rpcz_store.cc:276] 0925 16:44:26.773192 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.773314 (+   122us) service_pool.cc:227] Handling call
0925 16:44:26.773557 (+   243us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:26.773734 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:27.178560 (+404826us) log.cc:842] Serialized 14 byte log entry
0925 16:44:28.639552 (+1460992us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:28.639589 (+    37us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:28.639615 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:28.639658 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:28.639797 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":787030,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":255583,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10948,"thread_start_us":1768505,"threads_started":3,"wal-append.queue_time_us":833381}
I20260925 16:44:28.757823  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.332952  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:29.323167 12666 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:29.338449  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 700806us
W20260925 16:44:27.779327 13093 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.334s	user 0.012s	sys 0.000s
I20260925 16:44:28.027335 12795 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:28.241768 12453 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.539s	user 0.011s	sys 0.039s
W20260925 16:44:27.692751 13173 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260925 16:44:27.685417 13043 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:27.700084 13175 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.364s	user 0.000s	sys 0.001s
W20260925 16:44:27.693351 13180 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260925 16:44:27.709949 13075 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:28.661651 13131 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:27.765318 13129 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.089s	user 0.002s	sys 0.009s
W20260925 16:44:28.167137 13124 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.572s	user 0.010s	sys 0.000s
I20260925 16:44:29.322185 13222 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:27.928972 12872 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:27.950122 13105 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:29.152097 13068 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:28.690078 12641 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:29.488076 13068 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.488242 12641 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.490242 13068 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.490756 12641 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.414781  9048 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:29.491834  9048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2554) took 1725 ms (client timeout 1638 ms). Trace:
W20260925 16:44:29.492280  9048 rpcz_store.cc:269] 0925 16:44:27.766879 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:28.636097 (+869218us) service_pool.cc:227] Handling call
0925 16:44:29.491739 (+855642us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:28.690645 13039 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.725s
W20260925 16:44:29.414264  9697 rpcz_store.cc:269] 0925 16:44:26.853234 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.853450 (+   216us) service_pool.cc:227] Handling call
0925 16:44:28.638840 (+1785390us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:29.131788  9695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 990) took 2343 ms (client timeout 2195 ms). Trace:
I20260925 16:44:27.684944 13197 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:27.693168 12763 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:28.129518 13209 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:28.643573  9123 rpcz_store.cc:269] 0925 16:44:27.077562 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.960926 (+883364us) service_pool.cc:227] Handling call
0925 16:44:28.642746 (+681820us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:29.253754 13217 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.564s	user 0.005s	sys 0.001s
I20260925 16:44:27.886103 13027 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:44:27.863039 13172 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:29.153321 13215 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260925 16:44:29.499001 13197 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:28.303606 12887 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:28.771880 13137 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:29.502637 13137 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.504117 13197 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.504642 13137 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:27.924685 13044 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:29.492120 13131 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.505332 13044 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.506788 13131 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.507175 13044 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:27.839138 13125 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:28.860440 13218 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.485s	user 0.000s	sys 0.001s
I20260925 16:44:29.508044 13125 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.418746  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:29.509619  9042 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:29.509887 13125 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.510406  9041 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:28.426005 13154 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:29.482401 13129 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:29.419879  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:29.164748 13113 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:28.912719 13081 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.389993 13065 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:29.320529 13203 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:29.425536  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 770) took 4650 ms. Trace:
W20260925 16:44:29.432268  9120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2457) took 2260 ms (client timeout 2988 ms). Trace:
I20260925 16:44:29.548767  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:29.549181  9120 rpcz_store.cc:269] 0925 16:44:27.171403 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:28.665423 (+1494020us) service_pool.cc:227] Handling call
0925 16:44:29.432203 (+766780us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.430523  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:29.549726  9014 connection.cc:232] RPC call timeout handler was delayed by -1.4081980659998408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1776s for a response
I20260925 16:44:28.949433 13212 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:27.678768 13141 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.428952 12881 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:29.421025 13048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.822s	user 0.022s	sys 0.018s
I20260925 16:44:29.448277 13093 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.422564 13168 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.452827 13223 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.452980  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.574370  9115 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:29.419499 13181 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:29.416262 13021 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:28.157718 13128 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.421645 13216 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:29.413270 13096 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:29.459229 12453 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.756s	user 0.020s	sys 0.062s
I20260925 16:44:29.562434 13203 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:29.593516  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:28.032145 13148 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.481683  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:29.482563 13124 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:29.415540  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50707.6us
I20260925 16:44:29.586743 13048 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:29.493741  9695 rpcz_store.cc:269] 0925 16:44:26.788308 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.789438 (+  1130us) service_pool.cc:227] Handling call
0925 16:44:29.131542 (+2342104us) spinlock_profiling.cc:243] Waited 48.9 ms on lock 0x7b5400436054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:29.131673 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112421120}
I20260925 16:44:29.475106 13043 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.504160 13209 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:27.861804 13206 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:29.614296 13206 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.614866 13241 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:29.483443 13222 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:29.615350 13241 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.616391 13222 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.617596 13222 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:29.618508 13224 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260925 16:44:29.620663 13093 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.621018 13209 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:29.621114  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2545) took 2465 ms. Trace:
I20260925 16:44:29.621950 12881 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.621819 13043 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.623539 13168 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.550940 13081 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.624553  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:29.541093  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.621564  9045 rpcz_store.cc:276] 0925 16:44:27.156067 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.172140 (+ 16073us) service_pool.cc:227] Handling call
0925 16:44:27.213890 (+ 41750us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:27.214287 (+   397us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:27.214324 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:27.214929 (+   605us) log.cc:842] Serialized 52 byte log entry
0925 16:44:27.901927 (+686998us) spinlock_profiling.cc:243] Waited 68.8 ms on lock 0x7b1800437ec0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:44:28.176616 (+274689us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:28.843902 (+667286us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.119595 (+275693us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.418350 (+298755us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.418434 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:29.620900 (+202466us) raft_consensus.cc:1671] finished
0925 16:44:29.620930 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.621044 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":414132,"prepare.queue_time_us":1467044,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":59,"raft.queue_time_us":617389,"raft.run_cpu_time_us":387,"raft.run_wall_time_us":35810,"spinlock_wait_cycles":158300032,"thread_start_us":911151,"threads_started":3,"wal-append.queue_time_us":2009733}
I20260925 16:44:29.541507  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:29.626474  9123 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 10
I20260925 16:44:29.464176 12795 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.547358  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:29.550462  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:29.476178 13075 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.625639  9697 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:29.552443  9014 connection.cc:232] RPC call timeout handler was delayed by -1.380298066000023s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1807s for a response
I20260925 16:44:29.431156  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.499624 13027 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:29.558194  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 139862us
W20260925 16:44:29.562714  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 132247us
I20260925 16:44:29.562081  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:29.548725  8966 rpcz_store.cc:276] 0925 16:44:24.775433 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.779805 (+  4372us) service_pool.cc:227] Handling call
0925 16:44:24.780124 (+   319us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:24.844484 (+ 64360us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:24.844515 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:24.844901 (+   386us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.064250 (+219349us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:25.064287 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:28.017107 (+2952820us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:28.859875 (+842768us) spinlock_profiling.cc:243] Waited 64.1 ms on lock 0x7b54003c4bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:28.859954 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:29.425249 (+565295us) raft_consensus.cc:1671] finished
0925 16:44:29.425273 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.425452 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":180887808,"thread_start_us":218988,"threads_started":1,"wal-append.queue_time_us":385028}
I20260925 16:44:29.569378  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.545753 12763 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.551048 12641 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.680076 13233 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.679980 12641 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.495328 13105 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.681298  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:29.682188 13245 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260925 16:44:29.682490  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:29.682601 13075 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.682727 13105 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:29.584270  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.683090  8967 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:29.683355 13043 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.683678  9115 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260925 16:44:29.683843 13241 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.685043  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2452) took 2622 ms. Trace:
I20260925 16:44:29.549103 13054 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:29.589058 13181 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.566232 13113 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:29.603884  9700 raft_consensus.cc:2362] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8. Re-sending same reply.
I20260925 16:44:29.495867  9048 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260925 16:44:29.558179 13065 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.627775  8971 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:29.638044  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:29.610070 12864 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.671869  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:29.672019  9118 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:29.674993  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:29.674252  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:29.548336 13154 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:29.677567  9014 connection.cc:232] RPC call timeout handler was delayed by -1.07249806599998s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2149s for a response
I20260925 16:44:29.598186 13203 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:29.686242  9694 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:29.586335  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 751) took 2236 ms. Trace:
I20260925 16:44:29.688211  9044 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:44:29.637692 13096 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:44:29.570096 13212 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.625272 13048 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.684464 13206 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.797242 13141 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:29.795022 13128 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.800374  9045 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260925 16:44:29.801098 13048 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.801645  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 754) took 2451 ms. Trace:
I20260925 16:44:29.792382 13065 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.796679 12641 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.794028 13148 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.791766 12795 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:29.723129  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 223173us
W20260925 16:44:29.805620  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.619s (SENT)
I20260925 16:44:29.805387 13231 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:29.806433  8969 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:29.806149 12864 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.806926  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 750) took 2639 ms. Trace:
I20260925 16:44:29.809674  9118 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:29.809742  9048 rpcz_store.cc:276] 0925 16:44:27.167199 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.495064 (+2327865us) service_pool.cc:227] Handling call
0925 16:44:29.495456 (+   392us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.689065 (+193609us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.806877 (+117812us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.586625 13223 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.807379  9045 rpcz_store.cc:276] 0925 16:44:27.350724 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.799717 (+2448993us) service_pool.cc:227] Handling call
0925 16:44:29.800023 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.801299 (+  1276us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.801589 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.685376  9115 rpcz_store.cc:276] 0925 16:44:27.062885 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.684330 (+2621445us) service_pool.cc:227] Handling call
0925 16:44:29.684595 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.684765 (+   170us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.684788 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.684822 (+    34us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:29.684845 (+    23us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.684888 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.684999 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.808211  9042 rpcz_store.cc:276] 0925 16:44:27.349807 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.510225 (+2160418us) service_pool.cc:227] Handling call
0925 16:44:29.510497 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.510664 (+   167us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:29.510975 (+   311us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.585990 (+ 75015us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.586070 (+    80us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:29.586117 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.586174 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.586279 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":24162,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":706,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":10337,"thread_start_us":74586,"threads_started":1,"wal-append.queue_time_us":169579}
W20260925 16:44:29.815811  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 140904us
I20260925 16:44:29.817081  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2550) took 2168 ms. Trace:
I20260925 16:44:29.817553  9042 rpcz_store.cc:276] 0925 16:44:27.648774 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.816383 (+2167609us) service_pool.cc:227] Handling call
0925 16:44:29.816635 (+   252us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.816800 (+   165us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.816831 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.816871 (+    40us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:29.816887 (+    16us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.816921 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.817007 (+    86us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.818463 13043 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:29.819301  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 145161us
W20260925 16:44:29.819904  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 210663us
W20260925 16:44:29.818967  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 251003us
I20260925 16:44:29.593164 13216 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.718776  9123 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:29.674901 13093 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.792027 13246 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.840921 13246 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.822670  9120 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260925 16:44:29.811988 12795 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:29.691814 12763 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.821929 13043 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.855330  9700 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:29.817548 13068 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:29.820591  9118 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.782104 13113 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:29.795750 13021 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.863741 13043 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.864216  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.865054 13236 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:29.865587 13236 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:29.865697 13154 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.866827  9118 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:29.823019  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:29.779313  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 141431us
I20260925 16:44:29.868426  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:29.828336 13181 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.792168 13243 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:29.876962 13243 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.819573 13208 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:29.884424  9122 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:29.814177 13237 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:29.785607 13027 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.884948 13237 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:29.885250 13027 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:29.885365 13237 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:29.833406 13081 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:29.833992 13225 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.688s	user 0.000s	sys 0.006s
I20260925 16:44:29.836951 13212 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.691071 13054 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.821202  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2551) took 2169 ms. Trace:
I20260925 16:44:29.891571  9042 rpcz_store.cc:276] 0925 16:44:27.651456 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.818657 (+2167201us) service_pool.cc:227] Handling call
0925 16:44:29.818927 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.820829 (+  1902us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.820860 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.820905 (+    45us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:29.820940 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.821059 (+   119us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.821156 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.839486  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:29.840000  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 281101us
I20260925 16:44:29.815476 13141 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:29.847210  8967 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:29.852052  9697 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:29.848096 13233 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:29.867483  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.814805 13203 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:29.870682 12777 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.870733  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.872035 12864 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.866844 13068 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.873343 12763 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.854887 12795 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.875728 13113 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.870621 13236 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.883782 13243 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:29.914125  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 752) took 2564 ms (client timeout 2127 ms). Trace:
W20260925 16:44:29.914669  9041 rpcz_store.cc:269] 0925 16:44:27.350140 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:28.659817 (+1309677us) service_pool.cc:227] Handling call
0925 16:44:29.913906 (+1254089us) spinlock_profiling.cc:243] Waited 96.5 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:29.914040 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":221927680}
I20260925 16:44:29.904537 13048 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:29.916100 13048 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:29.916531 13048 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:29.918286  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 743) took 3635 ms. Trace:
I20260925 16:44:29.831027 13216 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.857822  8968 raft_consensus.cc:858] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }.
  Pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }: 
  New config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.895555  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:29.896687  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:29.898305  9118 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
W20260925 16:44:29.898746  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59343.4us
I20260925 16:44:29.895597  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:29.900563  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91701.6us
I20260925 16:44:29.927493  9118 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:44:29.927882  9118 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 9.8
I20260925 16:44:29.928179  9118 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:29.928371  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.900810  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:29.929509  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.930508 13243 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:29.903411  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:29.905442  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82467.2us
I20260925 16:44:29.852859 13093 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.894322 13181 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:29.908448  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.941394  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:29.921345  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:29.942306  9700 raft_consensus.cc:2396] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:44:29.929118  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2451) took 2872 ms. Trace:
I20260925 16:44:29.942996  9118 rpcz_store.cc:276] 0925 16:44:27.056298 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.669838 (+2613540us) service_pool.cc:227] Handling call
0925 16:44:29.671861 (+  2023us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.928910 (+257049us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.929076 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:29.943369  9041 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:29.944007  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.944959  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.945313  9118 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:29.945817  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.946218  9118 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:29.946729  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.947389  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.927479  9042 raft_consensus.cc:2362] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9. Re-sending same reply.
I20260925 16:44:29.930716  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:29.936290  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:29.931121  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2453) took 2861 ms. Trace:
I20260925 16:44:29.939283  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:29.939930  8861 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.244s	user 0.012s	sys 0.003s
W20260925 16:44:29.927181  8968 raft_consensus.cc:1565] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Could not prepare op 'term: 4 index: 5' and following 1 ops. Status for this op: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }.
  Pending config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }: 
  New config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:29.918817  9043 rpcz_store.cc:276] 0925 16:44:26.282573 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.447782 (+165209us) service_pool.cc:227] Handling call
0925 16:44:26.448052 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:26.675442 (+227390us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.675471 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:26.675513 (+    42us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:26.675548 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.918011 (+3242463us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:29.918070 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.918223 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":522417408}
I20260925 16:44:29.902943 13233 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:29.906220 13075 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.037s
I20260925 16:44:29.912534 13141 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.060s
I20260925 16:44:29.911927 13112 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.989177 13093 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:29.947918  9118 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:44:30.487135  9697 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:29.991932  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.273619  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:29.994203  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 749) took 2827 ms. Trace:
I20260925 16:44:29.974923  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.153187  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.071262  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.494148  9115 rpcz_store.cc:276] 0925 16:44:27.069313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.815332 (+2746019us) service_pool.cc:227] Handling call
0925 16:44:29.825210 (+  9878us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.825387 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:29.898634 (+ 73247us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.930137 (+ 31503us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.930805 (+   668us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.930855 (+    50us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:29.930902 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.930982 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.931072 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":125782,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":584,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":150,"spinlock_wait_cycles":35200,"thread_start_us":80568,"threads_started":2,"wal-append.queue_time_us":54596}
W20260925 16:44:30.496879  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 560656us
I20260925 16:44:29.969265  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:30.499608  9042 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:29.970165  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.489470  9124 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:30.501389  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:29.974072  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.493160  9050 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:44:29.975386  9696 raft_consensus.cc:2362] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7. Re-sending same reply.
I20260925 16:44:30.505550  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.506788  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.507372  9043 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:30.509909  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.510025  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.502027  9118 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:30.490669  9049 rpcz_store.cc:276] 0925 16:44:27.166907 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.220415 (+ 53508us) service_pool.cc:227] Handling call
0925 16:44:27.221171 (+   756us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:27.340769 (+119598us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:27.340817 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:27.381231 (+ 40414us) log.cc:842] Serialized 26 byte log entry
0925 16:44:28.637825 (+1256594us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:29.463968 (+826143us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.464178 (+   210us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.993716 (+529538us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002a3d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:29.993774 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:29.993869 (+    95us) raft_consensus.cc:1671] finished
0925 16:44:29.993984 (+   115us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:29.994139 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6828,"prepare.queue_time_us":677561,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":29487,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1727,"spinlock_wait_cycles":274126976,"thread_start_us":1197598,"threads_started":2,"wal-append.queue_time_us":738557}
I20260925 16:44:30.511266  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.511225  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:30.513722  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2216) took 5666 ms (client timeout 1753 ms). Trace:
I20260925 16:44:29.948730 13154 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.566s
W20260925 16:44:30.514151  8973 rpcz_store.cc:269] 0925 16:44:24.838352 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.838952 (+   600us) service_pool.cc:227] Handling call
0925 16:44:30.504565 (+5665613us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b54001e2654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:30.504697 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2528037248}
I20260925 16:44:30.514582 13243 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:30.497900 13169 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:30.257526 13237 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.516494 13051 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:29.948846 13133 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.569s
W20260925 16:44:30.518489  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2552) took 2859 ms (client timeout 2339 ms). Trace:
W20260925 16:44:30.000921 13170 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 2.996s	user 0.000s	sys 0.014s
W20260925 16:44:29.984040 13140 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 3.684s	user 0.021s	sys 0.043s
I20260925 16:44:30.524972  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.526168  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:30.518887  9044 rpcz_store.cc:269] 0925 16:44:27.659109 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.316842 (+1657733us) service_pool.cc:227] Handling call
0925 16:44:30.518321 (+1201479us) spinlock_profiling.cc:243] Waited 370 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:30.518431 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":850998144}
I20260925 16:44:30.510494  9043 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:30.527426  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.527505  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.527777  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:30.511294  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.528194  9044 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:30.143922 13186 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 2.530s	user 0.011s	sys 0.003s
I20260925 16:44:30.520208  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.383626 13054 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:30.529090 13051 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:29.982067 13246 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:30.531049 13048 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.614s	user 0.006s	sys 0.002s
I20260925 16:44:30.512048  9118 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 6.
I20260925 16:44:30.535223  9041 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260925 16:44:30.535781  9042 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:30.533252  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.508513  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:30.369582 12795 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:30.533134  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.536810  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:30.081506 13040 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:30.383375 13068 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:30.597852  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2560) took 1193 ms. Trace:
I20260925 16:44:30.602100  9049 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260925 16:44:30.537375  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.545373  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 989) took 4053 ms. Trace:
I20260925 16:44:30.602149  9041 rpcz_store.cc:276] 0925 16:44:29.404133 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.596805 (+1192672us) service_pool.cc:227] Handling call
0925 16:44:30.597210 (+   405us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.597455 (+   245us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.597493 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.597553 (+    60us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.597597 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.597665 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.597787 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.602805  9118 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:30.544255  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:30.550868  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.537389  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2553) took 2853 ms. Trace:
I20260925 16:44:30.544535  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.535813  9697 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:30.549711  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:30.605058  9124 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:30.552310  9050 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:30.538906  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2555) took 2756 ms. Trace:
I20260925 16:44:30.604849  9044 rpcz_store.cc:276] 0925 16:44:27.684425 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.536636 (+2852211us) service_pool.cc:227] Handling call
0925 16:44:30.536902 (+   266us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.537058 (+   156us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.537085 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.537119 (+    34us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.537159 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.537213 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.537327 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:30.598570  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 90118us
I20260925 16:44:30.605630  9043 rpcz_store.cc:276] 0925 16:44:27.782415 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.538050 (+2755635us) service_pool.cc:227] Handling call
0925 16:44:30.538329 (+   279us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.538529 (+   200us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.538564 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.538611 (+    47us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.538651 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.538711 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.538850 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.534641 13051 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:30.607481 13051 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:30.600175  9700 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:30.608379  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2557) took 2760 ms. Trace:
I20260925 16:44:30.602942  9701 rpcz_store.cc:276] 0925 16:44:26.491948 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.492088 (+   140us) service_pool.cc:227] Handling call
0925 16:44:26.492393 (+   305us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.495969 (+  3576us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.495996 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.504029 (+  8033us) log.cc:842] Serialized 26 byte log entry
0925 16:44:26.741597 (+237568us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:26.741657 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:26.741752 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:30.000231 (+3258479us) spinlock_profiling.cc:243] Waited 1.31 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:30.544982 (+544751us) raft_consensus.cc:1671] finished
0925 16:44:30.545010 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.545274 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3257,"raft.queue_time_us":64861,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":1736,"spinlock_wait_cycles":3004288,"thread_start_us":223669,"threads_started":1,"wal-append.queue_time_us":436543}
I20260925 16:44:30.608677  9044 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:30.608752  9050 rpcz_store.cc:276] 0925 16:44:27.848515 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.551668 (+2703153us) service_pool.cc:227] Handling call
0925 16:44:30.551969 (+   301us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.608156 (+ 56187us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.608332 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.610054  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.610924  9047 raft_consensus.cc:2396] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 7 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:30.612035  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.612612  9118 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:30.613632  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2556) took 2781 ms. Trace:
I20260925 16:44:30.613631  9043 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
W20260925 16:44:30.614311  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64702.9us
I20260925 16:44:30.616572  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:30.518502 13237 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:30.617697  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:30.611472  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:30.618096  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.619266  9050 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260925 16:44:30.620131  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:30.624099  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.632725  9046 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:30.633293  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1121) took 3464 ms. Trace:
I20260925 16:44:30.633670  9047 rpcz_store.cc:276] 0925 16:44:27.168518 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.632289 (+3463771us) service_pool.cc:227] Handling call
0925 16:44:30.633238 (+   949us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.633981  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:30.631214  9118 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 4.
I20260925 16:44:30.548518 13133 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:30.617182 13154 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:44:30.639583 13154 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:30.639966 13154 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:30.640278  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 898) took 3868 ms. Trace:
I20260925 16:44:30.640362 13093 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:30.640877 13093 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:30.641506 13093 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:30.640659  9117 rpcz_store.cc:276] 0925 16:44:26.771852 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.772032 (+   180us) service_pool.cc:227] Handling call
0925 16:44:26.772418 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.880589 (+108171us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.880632 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.881140 (+   508us) log.cc:842] Serialized 26 byte log entry
0925 16:44:27.194740 (+313600us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:27.194791 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:27.194879 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:30.082745 (+2887866us) spinlock_profiling.cc:243] Waited 3.47 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:30.639998 (+557253us) raft_consensus.cc:1671] finished
0925 16:44:30.640018 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.640207 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9715,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":43993,"spinlock_wait_cycles":7980416,"thread_start_us":214966,"threads_started":1,"wal-append.queue_time_us":556721}
I20260925 16:44:30.642590  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:30.644924 13142 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 4.252s	user 0.006s	sys 0.006s
W20260925 16:44:30.649001 13221 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.886s	user 0.001s	sys 0.010s
I20260925 16:44:30.638844  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.650254  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2548) took 3003 ms. Trace:
I20260925 16:44:30.650619  9118 raft_consensus.cc:2362] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10. Re-sending same reply.
I20260925 16:44:30.650743  9048 rpcz_store.cc:276] 0925 16:44:27.646589 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.810865 (+2164276us) service_pool.cc:227] Handling call
0925 16:44:29.819468 (+  8603us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.864397 (+ 44929us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.864432 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.864472 (+    40us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:29.864499 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.649995 (+785496us) spinlock_profiling.cc:243] Waited 44.8 ms on lock 0x7b54000a87d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:30.650053 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.650189 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":102932736}
I20260925 16:44:30.651594  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.653257  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.654208  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.654695  9118 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:30.655330  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.655831  9118 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:30.656483  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.656950  9118 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:30.657666  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.660321 13093 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.661051  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:30.662118 13093 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:30.658358  9118 raft_consensus.cc:2396] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 12 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260925 16:44:30.663121 13169 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:30.663280  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:30.637604 13068 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:30.664418  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.665544  9118 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260925 16:44:30.643633  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:30.670419  9117 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:30.621206  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.622800  9697 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 11
I20260925 16:44:30.635418  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2559) took 1967 ms. Trace:
I20260925 16:44:30.614104  9049 rpcz_store.cc:276] 0925 16:44:27.832270 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.601549 (+2769279us) service_pool.cc:227] Handling call
0925 16:44:30.601854 (+   305us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:30.613409 (+ 11555us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.613585 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.625586  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:30.636643  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.636083  9124 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:30.672499  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.671484  9042 rpcz_store.cc:276] 0925 16:44:28.668415 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.606795 (+1938380us) service_pool.cc:227] Handling call
0925 16:44:30.607011 (+   216us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.631758 (+ 24747us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.631809 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.631853 (+    44us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.631886 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.635244 (+  3358us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.635363 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24289,"raft.queue_time_us":28267}
I20260925 16:44:30.673527  9701 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:30.676287  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.617751 13246 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:30.608035 13054 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:30.680588  9697 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:30.683401  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.683764  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.684019  9697 raft_consensus.cc:2362] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11. Re-sending same reply.
W20260925 16:44:30.685030  9090 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.626s (SENT)
W20260925 16:44:30.685381  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59872us
I20260925 16:44:30.686167  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.686249  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:30.688184  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.692552  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.551961 13048 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.699986  9117 raft_consensus.cc:2396] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:44:30.697671  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.699015  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:30.695382  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:30.705673  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:30.706660  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:30.702538  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.707832  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:30.708252  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:30.708926  9693 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:30.709336  9117 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:30.710839  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:30.702113  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2432) took 5275 ms. Trace:
I20260925 16:44:30.676601 13068 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:30.704264  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.697940  9700 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:30.701645  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.674873 12795 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:30.712176  9121 rpcz_store.cc:276] 0925 16:44:25.420966 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.421072 (+   106us) service_pool.cc:227] Handling call
0925 16:44:25.421395 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:25.874804 (+453409us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:25.874844 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:25.877737 (+  2893us) log.cc:842] Serialized 26 byte log entry
0925 16:44:25.971467 (+ 93730us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:25.971500 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:25.971561 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:29.983407 (+4011846us) spinlock_profiling.cc:243] Waited 36.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:30.679300 (+695893us) raft_consensus.cc:1671] finished
0925 16:44:30.679320 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.695814 (+ 16494us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":263201,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":84048768,"thread_start_us":546399,"threads_started":2,"wal-append.queue_time_us":316263}
I20260925 16:44:30.719987  9701 raft_consensus.cc:2362] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12. Re-sending same reply.
I20260925 16:44:30.707414 13131 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:30.721621 13131 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:30.721786  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2456) took 3555 ms. Trace:
I20260925 16:44:30.714885 13113 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:30.722623 13113 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:30.722138  9124 rpcz_store.cc:276] 0925 16:44:27.166591 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.715058 (+3548467us) service_pool.cc:227] Handling call
0925 16:44:30.721331 (+  6273us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.721508 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.721530 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.721569 (+    39us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.721595 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.721647 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.721739 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.723116 13113 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:30.730995  9121 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:44:30.731510  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2458) took 1409 ms. Trace:
I20260925 16:44:30.731832  9121 rpcz_store.cc:276] 0925 16:44:29.322237 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.730604 (+1408367us) service_pool.cc:227] Handling call
0925 16:44:30.730843 (+   239us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.731323 (+   480us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.731468 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.707299  9118 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 7.
I20260925 16:44:30.732583  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2593) took 3615 ms. Trace:
I20260925 16:44:30.733106  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2597) took 1408 ms. Trace:
I20260925 16:44:30.733327  9117 rpcz_store.cc:276] 0925 16:44:27.117138 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.731942 (+3614804us) service_pool.cc:227] Handling call
0925 16:44:30.732180 (+   238us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.732323 (+   143us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.732346 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.732383 (+    37us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.732414 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.732460 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.732541 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.735138  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2462) took 1394 ms. Trace:
I20260925 16:44:30.735421  9117 rpcz_store.cc:276] 0925 16:44:29.340350 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.734367 (+1394017us) service_pool.cc:227] Handling call
0925 16:44:30.734732 (+   365us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.734895 (+   163us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.734916 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.734949 (+    33us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:30.734975 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.735017 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.735096 (+    79us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.736775  9117 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260925 16:44:30.737246  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2463) took 1396 ms. Trace:
I20260925 16:44:30.737490  9117 rpcz_store.cc:276] 0925 16:44:29.340594 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.736343 (+1395749us) service_pool.cc:227] Handling call
0925 16:44:30.736595 (+   252us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:30.737066 (+   471us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.737207 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.738639  9117 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:30.739100  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2598) took 1322 ms. Trace:
I20260925 16:44:30.739521  9117 rpcz_store.cc:276] 0925 16:44:29.417065 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.738104 (+1321039us) service_pool.cc:227] Handling call
0925 16:44:30.738375 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.738914 (+   539us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.739060 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.741127  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:30.701296 13237 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:30.746333  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2460) took 1406 ms. Trace:
I20260925 16:44:30.780329 13041 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:30.780553  9118 rpcz_store.cc:276] 0925 16:44:29.339718 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.733081 (+1393363us) service_pool.cc:227] Handling call
0925 16:44:30.745934 (+ 12853us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.746073 (+   139us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.746095 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.746128 (+    33us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:30.746154 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.746196 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.746269 (+    73us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.782274  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2600) took 1358 ms. Trace:
I20260925 16:44:30.782096 13113 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.782584  9118 rpcz_store.cc:276] 0925 16:44:29.424229 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.781505 (+1357276us) service_pool.cc:227] Handling call
0925 16:44:30.781808 (+   303us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.781992 (+   184us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.782014 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.782051 (+    37us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:30.782078 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.782128 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.782226 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.733443  9121 rpcz_store.cc:276] 0925 16:44:29.325184 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.732472 (+1407288us) service_pool.cc:227] Handling call
0925 16:44:30.732715 (+   243us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.732870 (+   155us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.732890 (+    20us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.732923 (+    33us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:30.732948 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.732992 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.733066 (+    74us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.777730  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 901) took 1227 ms. Trace:
I20260925 16:44:30.797387  9120 rpcz_store.cc:276] 0925 16:44:29.550675 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.557346 (+  6671us) service_pool.cc:227] Handling call
0925 16:44:30.777447 (+1220101us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:30.777655 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":341029248}
I20260925 16:44:30.804200  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2455) took 3726 ms. Trace:
I20260925 16:44:30.804713  9123 rpcz_store.cc:276] 0925 16:44:27.077934 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.824857 (+2746923us) service_pool.cc:227] Handling call
0925 16:44:29.825262 (+   405us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:29.902955 (+ 77693us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.902989 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:29.903025 (+    36us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:29.903056 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.803918 (+900862us) spinlock_profiling.cc:243] Waited 77.5 ms on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:30.803976 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.804139 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":178277376}
I20260925 16:44:30.675005 13133 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.785847  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 902) took 1214 ms. Trace:
I20260925 16:44:30.712739 13246 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:30.793051  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 903) took 1208 ms. Trace:
I20260925 16:44:30.808394 13155 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:30.786293 12795 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:30.817641 13068 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:30.786741 13237 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:30.822664  9693 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:30.820669  9121 rpcz_store.cc:276] 0925 16:44:29.584324 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.792190 (+1207866us) service_pool.cc:227] Handling call
0925 16:44:30.792504 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.792687 (+   183us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.792721 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.792771 (+    50us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:30.792811 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.792869 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.792993 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.821815  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 904) took 1237 ms. Trace:
I20260925 16:44:30.821362  9118 rpcz_store.cc:276] 0925 16:44:29.571086 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.783426 (+1212340us) service_pool.cc:227] Handling call
0925 16:44:30.785396 (+  1970us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.785560 (+   164us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.785590 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.785629 (+    39us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:30.785654 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.785709 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.785800 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.823659  9120 rpcz_store.cc:276] 0925 16:44:29.584711 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.798394 (+1213683us) service_pool.cc:227] Handling call
0925 16:44:30.821248 (+ 22854us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.821416 (+   168us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.821487 (+    71us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.821538 (+    51us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:30.821578 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.821642 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.821753 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:30.820261  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2448) took 3811 ms. Trace:
I20260925 16:44:30.699529 13054 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.826359  9116 rpcz_store.cc:276] 0925 16:44:27.008707 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.021690 (+ 12983us) service_pool.cc:227] Handling call
0925 16:44:27.022003 (+   313us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:27.022173 (+   170us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:27.338710 (+316537us) log.cc:842] Serialized 14 byte log entry
0925 16:44:29.506507 (+2167797us) spinlock_profiling.cc:243] Waited 7.64 ms on lock 0x7b18003a81c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:30.812396 (+1305889us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b18003a81c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:44:30.819941 (+  7545us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:30.819998 (+    57us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:30.820048 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.820113 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.820209 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":567799,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":87998,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":118,"spinlock_wait_cycles":26502400,"thread_start_us":564005,"threads_started":3,"wal-append.queue_time_us":339471,"wal-append.run_cpu_time_us":1136,"wal-append.run_wall_time_us":1010879}
I20260925 16:44:30.834304  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:30.778818 13048 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:30.836944  9697 raft_consensus.cc:2396] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260925 16:44:30.837967  9120 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:30.842157  9693 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:30.825827 13237 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:30.822614 13246 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:30.836130 13233 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:30.905887  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 784) took 1355 ms. Trace:
I20260925 16:44:30.906407  8969 rpcz_store.cc:276] 0925 16:44:29.550151 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.550244 (+    93us) service_pool.cc:227] Handling call
0925 16:44:30.905633 (+1355389us) spinlock_profiling.cc:243] Waited 179 ms on lock 0x7b540036ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:30.905815 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":410585344}
I20260925 16:44:30.861507 13246 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:30.830257 13155 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:30.888561 13113 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:30.922209 13220 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.766s	user 0.004s	sys 0.004s
I20260925 16:44:30.923548  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 977) took 5385 ms. Trace:
I20260925 16:44:30.923905  9702 rpcz_store.cc:276] 0925 16:44:25.538995 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.539251 (+   256us) service_pool.cc:227] Handling call
0925 16:44:25.555638 (+ 16387us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:25.932712 (+377074us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:25.932739 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:27.700393 (+1767654us) spinlock_profiling.cc:243] Waited 8.05 ms on lock 0x7b2c00168008. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:27.700751 (+   358us) log.cc:842] Serialized 26 byte log entry
0925 16:44:27.791949 (+ 91198us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:27.792004 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:27.792096 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:30.921557 (+3129461us) spinlock_profiling.cc:243] Waited 82.8 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:30.923305 (+  1748us) raft_consensus.cc:1671] finished
0925 16:44:30.923330 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.923473 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1366,"raft.queue_time_us":93682,"raft.run_cpu_time_us":63,"raft.run_wall_time_us":63,"spinlock_wait_cycles":208860672,"thread_start_us":385204,"threads_started":2,"wal-append.queue_time_us":1454999}
W20260925 16:44:30.927292 13211 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.320s	user 0.010s	sys 0.009s
I20260925 16:44:30.928186  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 774) took 4542 ms. Trace:
I20260925 16:44:30.928562  8970 rpcz_store.cc:276] 0925 16:44:26.385562 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.385720 (+   158us) service_pool.cc:227] Handling call
0925 16:44:26.448415 (+ 62695us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:26.468067 (+ 19652us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.468102 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:26.468142 (+    40us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:26.468175 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:30.927920 (+4459745us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:30.927987 (+    67us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:30.928128 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":44715264}
I20260925 16:44:30.899000 13131 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:30.954851  9693 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:44:30.961239 13127 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:30.964537 13265 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260925 16:44:30.973063  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.04048e+06us
I20260925 16:44:30.973974  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:30.901796  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 13.649s	user 0.201s	sys 0.141s Metrics: {"bytes_written":30431,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":389143,"dirs.run_cpu_time_us":640,"dirs.run_wall_time_us":84491,"drs_written":1,"lbm_read_time_us":54147,"lbm_reads_10-100_ms":2,"lbm_reads_lt_1ms":2,"lbm_write_time_us":343401,"lbm_writes_1-10_ms":1,"lbm_writes_10-100_ms":11,"lbm_writes_lt_1ms":22,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":314116,"threads_started":2,"update_count":22,"wal-append.queue_time_us":119590}
W20260925 16:44:30.975157  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 312481us
W20260925 16:44:30.976202 13027 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.090s	user 0.010s	sys 0.003s
I20260925 16:44:30.963901 13131 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:30.993501  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 282679us
I20260925 16:44:30.971799 13169 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:30.916955 12795 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.005726  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:31.009560  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:30.990681 13155 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:31.011970  8975 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.013s	sys 0.019s
W20260925 16:44:31.012316  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.007s	sys 0.025s
W20260925 16:44:31.017203  8975 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.512s	user 0.013s	sys 0.019s
I20260925 16:44:31.012804  8968 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:44:31.014804  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 376287us
I20260925 16:44:30.994562  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:31.013273  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:31.019300  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.007s	sys 0.025s
W20260925 16:44:31.027537  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 528596us
W20260925 16:44:31.015839  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 377221us
I20260925 16:44:31.022328  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:31.038956  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.039530  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:31.039829  9116 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260925 16:44:31.040292  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:31.041805  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:31.043143  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.048506  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.053794  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:31.018105 13141 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.012s	sys 0.020s
I20260925 16:44:31.015394 13127 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:30.991571 13087 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260925 16:44:31.025506 12706 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260925 16:44:31.045325 13179 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:44:31.069628  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 235415us
I20260925 16:44:31.045428 13113 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:31.050714 13133 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:31.054239 13233 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:31.077092 13113 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.077641  8862 maintenance_manager.cc:419] P ba21ddca249c4cf39e72526cc8696c60: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 10293 bytes on disk
W20260925 16:44:31.068962 13141 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.012s	sys 0.020s
I20260925 16:44:31.079669  9695 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:31.059122 13054 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:31.073243 13127 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.069327 13155 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260925 16:44:31.165365  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 94071.7us
I20260925 16:44:31.073372 12706 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:31.159444  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 163521us
I20260925 16:44:31.212785  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:31.073719 13179 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:31.085425 13233 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:31.270040  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57448.9us
I20260925 16:44:31.162745 13207 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:31.272518  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.098s	user 0.001s	sys 0.001s Metrics: {"cfile_init":1,"lbm_read_time_us":384,"lbm_reads_lt_1ms":4}
W20260925 16:44:31.216338 13260 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260925 16:44:31.286175  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.216557 13155 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:31.076092 13040 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.147s
I20260925 16:44:31.360548  9089 leader_election.cc:398] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
W20260925 16:44:31.360334  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 136213us
I20260925 16:44:31.268865 12706 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:31.277722 13179 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:31.270236 13272 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:31.247988 13141 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:31.368166 13154 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.728s	user 0.009s	sys 0.001s
I20260925 16:44:31.361202 13233 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:31.277396 13270 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:31.239921 13277 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:31.402288  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2459) took 2078 ms. Trace:
I20260925 16:44:31.075408 13131 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:31.425700  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 139612us
I20260925 16:44:31.519200  9124 rpcz_store.cc:276] 0925 16:44:29.324283 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.723364 (+1399081us) service_pool.cc:227] Handling call
0925 16:44:30.723627 (+   263us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.729415 (+  5788us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:31.037723 (+308308us) log.cc:842] Serialized 14 byte log entry
0925 16:44:31.401935 (+364212us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:31.401993 (+    58us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:31.402038 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.402106 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:31.402230 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":515505,"prepare.run_cpu_time_us":10623,"prepare.run_wall_time_us":40293,"raft.queue_time_us":393,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":14855,"thread_start_us":613465,"threads_started":2}
I20260925 16:44:31.526623  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.529785  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:31.533659  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.535770  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2549) took 3888 ms. Trace:
I20260925 16:44:31.536262  9045 rpcz_store.cc:276] 0925 16:44:27.647752 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.815106 (+2167354us) service_pool.cc:227] Handling call
0925 16:44:29.816010 (+   904us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:29.824776 (+  8766us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.824841 (+    65us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:29.843925 (+ 19084us) log.cc:842] Serialized 26 byte log entry
0925 16:44:29.967902 (+123977us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:29.967949 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:29.968017 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:31.535484 (+1567467us) raft_consensus.cc:1671] finished
0925 16:44:31.535512 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:31.535686 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10650,"raft.queue_time_us":4572,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":106359,"threads_started":1,"wal-append.queue_time_us":982147}
W20260925 16:44:31.378793  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 350556us
I20260925 16:44:31.428627  9089 leader_election.cc:401] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260925 16:44:31.446770  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 404978us
W20260925 16:44:31.445932  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 225303us
I20260925 16:44:31.085018 13169 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.388450 13155 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:31.504089  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 267670us
I20260925 16:44:31.515683  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:31.541648  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:31.541744  9016 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 3.200s (SENT) [suppressed 31 similar messages]
I20260925 16:44:31.388863 13296 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:31.369422 13207 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.523015 13270 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:31.514711 12453 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:31.574131  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.523259 13277 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:31.516884 13294 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260925 16:44:31.586463  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 373721us
I20260925 16:44:31.588030  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:31.539119 13068 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:31.589972  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 365611us
I20260925 16:44:31.590960  9089 leader_election.cc:398] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:31.592391  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:31.592795  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.539786 13279 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:31.594935  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:31.585569 13273 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.216s	user 0.000s	sys 0.001s
I20260925 16:44:31.605018  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.577219 13141 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:31.524377 13154 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.581764 13272 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:31.589135 13294 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:31.621737  9702 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260925 16:44:31.622406  9702 pending_rounds.cc:76] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 8
I20260925 16:44:31.622704  9702 pending_rounds.cc:97] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260925 16:44:31.588173 13296 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:31.622978  9702 raft_consensus.cc:2866] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:31.587841 13277 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:31.595678 13113 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:31.598660 13288 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:31.635905  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54799.4us
I20260925 16:44:31.597611 13267 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260925 16:44:31.640173  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66121.9us
I20260925 16:44:31.627238 13285 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260925 16:44:31.585287 13159 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260925 16:44:31.625787 13294 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:31.641074  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:31.642066 13281 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260925 16:44:31.641979 12920 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:31.600696 13068 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.645094 13154 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:31.645920  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 756) took 1790 ms. Trace:
I20260925 16:44:31.626540 13127 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:31.646732 13203 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.740s	user 0.012s	sys 0.000s
I20260925 16:44:31.612763 13271 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:31.611891 13306 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:31.629269 13141 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:31.626766 13133 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260925 16:44:31.626539 13296 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:31.645152 13246 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.696s	user 0.009s	sys 0.000s
I20260925 16:44:31.654286 13279 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:31.654757 13293 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:31.655632 13270 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.680997  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.687649 12920 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:31.681586  9115 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.003s	sys 0.003s
I20260925 16:44:31.686318  9041 rpcz_store.cc:276] 0925 16:44:29.855964 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.603604 (+747640us) service_pool.cc:227] Handling call
0925 16:44:30.604017 (+   413us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:30.612793 (+  8776us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:30.971546 (+358753us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b18001b0e20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:44:31.050073 (+ 78527us) log.cc:842] Serialized 14 byte log entry
0925 16:44:31.291011 (+240938us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:31.295329 (+  4318us) log.cc:842] Serialized 26 byte log entry
0925 16:44:31.295477 (+   148us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:31.295689 (+   212us) log.cc:842] Serialized 14 byte log entry
0925 16:44:31.504727 (+209038us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.504819 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:31.645721 (+140902us) raft_consensus.cc:1671] finished
0925 16:44:31.645739 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:31.645869 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":100562,"prepare.queue_time_us":737374,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":73,"raft.queue_time_us":800584,"raft.run_cpu_time_us":262,"raft.run_wall_time_us":4594,"spinlock_wait_cycles":4685056,"thread_start_us":430189,"threads_started":4,"wal-append.queue_time_us":556867}
W20260925 16:44:31.693154  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 88195.6us
W20260925 16:44:31.735117  9115 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.587s	user 0.003s	sys 0.003s
I20260925 16:44:31.735823  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.682005 13113 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:31.681864 13288 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:31.738330 13288 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.625047 13272 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:31.715780 13237 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.827s	user 0.011s	sys 0.000s
I20260925 16:44:31.736078  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2591) took 4642 ms. Trace:
I20260925 16:44:31.691809 13271 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:31.714380 13141 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:31.681789 13267 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.084s
I20260925 16:44:31.708410 13203 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:31.691116 13277 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:31.841790  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2445) took 5458 ms. Trace:
I20260925 16:44:31.751575  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:31.754926  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 74009.7us
I20260925 16:44:31.875263  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1003) took 1843 ms. Trace:
I20260925 16:44:31.875629  9697 rpcz_store.cc:276] 0925 16:44:30.032088 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.704067 (+671979us) service_pool.cc:227] Handling call
0925 16:44:31.875070 (+1171003us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b5400689cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:31.875210 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":273905920}
I20260925 16:44:31.877382  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.783535  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:31.783751  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.824218  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.825381  8972 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:31.752199  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.883517  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.743610  9115 rpcz_store.cc:276] 0925 16:44:27.093798 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.717285 (+3623487us) service_pool.cc:227] Handling call
0925 16:44:30.806827 (+ 89542us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.807112 (+   285us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:31.147492 (+340380us) log.cc:842] Serialized 14 byte log entry
0925 16:44:31.735645 (+588153us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:31.735724 (+    79us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:31.735779 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.735861 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:31.736012 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":698730,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"thread_start_us":918206,"threads_started":2,"wal-append.queue_time_us":677336}
I20260925 16:44:31.872628  9119 rpcz_store.cc:276] 0925 16:44:26.383174 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.426317 (+ 43143us) service_pool.cc:227] Handling call
0925 16:44:26.426574 (+   257us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:26.554822 (+128248us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.554858 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:26.554902 (+    44us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:26.554941 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.838127 (+5283186us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b540009ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:31.841561 (+  3434us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:31.841721 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":294493568}
I20260925 16:44:31.892817  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:31.751303  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.894018  9121 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:31.895265  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.896638  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:31.743176  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 905) took 1870 ms. Trace:
I20260925 16:44:31.792073  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.880344  8970 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:31.874660  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:31.746253  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.745904  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.898970  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.897753  9123 rpcz_store.cc:276] 0925 16:44:29.872492 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.823707 (+951215us) service_pool.cc:227] Handling call
0925 16:44:30.836059 (+ 12352us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:30.836244 (+   185us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:30.836266 (+    22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:30.836628 (+   362us) log.cc:842] Serialized 26 byte log entry
0925 16:44:31.152526 (+315898us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:31.152557 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.152619 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:31.742927 (+590308us) raft_consensus.cc:1671] finished
0925 16:44:31.742950 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:31.743110 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":283702,"threads_started":1,"wal-append.queue_time_us":663255}
W20260925 16:44:31.899549  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 200918us
I20260925 16:44:31.902113  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:31.898157  8966 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:31.915035  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:31.917249  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.918330  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:31.920483  9045 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:31.923882  9120 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:31.925051  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.980580  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.732679 13279 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:31.999357  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.734299 13293 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:31.985806  9117 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
W20260925 16:44:32.000638  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 404560us
I20260925 16:44:31.766525 13270 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:31.841655 13051 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.202s	user 0.012s	sys 0.005s
I20260925 16:44:31.742049 12920 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:31.998876  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.847200 13068 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:31.765499 13237 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:31.919334  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:32.001267  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:32.000882  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:31.841678 13285 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:32.006059  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:31.848453 13272 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:32.008303  9116 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260925 16:44:32.008858  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.010808  9123 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:32.000119 13113 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:31.765419 13291 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:31.903914 13266 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:32.008421 13177 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:44:32.049817 13124 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.051359  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 986) took 5766 ms. Trace:
I20260925 16:44:32.053004 13155 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.051859  9698 rpcz_store.cc:276] 0925 16:44:26.284683 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.284821 (+   138us) service_pool.cc:227] Handling call
0925 16:44:26.285151 (+   330us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:26.740943 (+455792us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:26.740987 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:26.770232 (+ 29245us) log.cc:842] Serialized 26 byte log entry
0925 16:44:27.118142 (+347910us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:27.118194 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.050865 (+4932671us) spinlock_profiling.cc:243] Waited 240 ms on lock 0x7b54006eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:32.050928 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:32.051003 (+    75us) raft_consensus.cc:1671] finished
0925 16:44:32.051020 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:32.051291 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":66826,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":82,"spinlock_wait_cycles":552256768,"thread_start_us":442663,"threads_started":2,"wal-append.queue_time_us":533572,"wal-append.run_cpu_time_us":49328,"wal-append.run_wall_time_us":3005205}
I20260925 16:44:32.055083  8970 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:32.021991  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:32.056381 13155 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.057425  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1189) took 1564 ms. Trace:
I20260925 16:44:32.057791  9693 rpcz_store.cc:276] 0925 16:44:30.493054 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.858047 (+364993us) service_pool.cc:227] Handling call
0925 16:44:30.858344 (+   297us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.955361 (+ 97017us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.057210 (+1101849us) spinlock_profiling.cc:243] Waited 94.9 ms on lock 0x7b540062f2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:32.057372 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":218256128}
I20260925 16:44:32.058210 13276 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:31.885668 13271 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:32.025840  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106587us
I20260925 16:44:32.060791  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.061386  9116 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:32.010989  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.027397  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 776) took 4904 ms. Trace:
I20260925 16:44:31.906877 13141 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:32.005281 13279 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:32.062312  8974 rpcz_store.cc:276] 0925 16:44:27.122910 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.549058 (+426148us) service_pool.cc:227] Handling call
0925 16:44:31.714325 (+4165267us) spinlock_profiling.cc:243] Waited 3.71 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:44:31.714595 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:31.714796 (+   201us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:31.732214 (+ 17418us) log.cc:842] Serialized 14 byte log entry
0925 16:44:32.026710 (+294496us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:32.027120 (+   410us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:32.027171 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.027242 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:32.027343 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3095,"prepare.queue_time_us":19010,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":33,"raft.queue_time_us":3201,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":5918,"spinlock_wait_cycles":8526720,"thread_start_us":290846,"threads_started":1}
I20260925 16:44:32.025038  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
W20260925 16:44:32.077232  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.014s	sys 0.037s
I20260925 16:44:31.733767 13246 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:32.033022  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 498240us
I20260925 16:44:32.014863  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.040191  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:32.042637 13163 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 5.295s	user 0.001s	sys 0.033s
W20260925 16:44:32.045699  9122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2594) took 4911 ms (client timeout 2029 ms). Trace:
I20260925 16:44:32.010011 13293 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:32.049151 13179 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.533s	user 0.005s	sys 0.002s
W20260925 16:44:32.082038  9122 rpcz_store.cc:269] 0925 16:44:27.134161 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:28.653531 (+1519370us) service_pool.cc:227] Handling call
0925 16:44:32.045486 (+3391955us) spinlock_profiling.cc:243] Waited 463 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:32.045614 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1065044864}
I20260925 16:44:32.085391  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.038601 13266 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:31.917601 13092 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:32.068239  9699 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:32.068166  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.068917  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:32.072853  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2239) took 2508 ms. Trace:
W20260925 16:44:32.074856  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 339131us
I20260925 16:44:32.077627  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.093128  8967 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:32.035660 13285 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:32.092758  8975 rpcz_store.cc:276] 0925 16:44:29.564324 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.564447 (+   123us) service_pool.cc:227] Handling call
0925 16:44:30.504717 (+940270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:31.018131 (+513414us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:31.018173 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:31.018229 (+    56us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:31.018271 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.018350 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:32.072683 (+1054333us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b54001e2650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:32.072801 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":9406,"raft.run_cpu_time_us":72,"raft.run_wall_time_us":72,"spinlock_wait_cycles":2137892736,"thread_start_us":513055,"threads_started":1}
I20260925 16:44:32.094107  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.094867  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.079681  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 763) took 2175 ms. Trace:
I20260925 16:44:32.030649 13272 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:32.085407  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.087059  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:32.088303  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:32.077638  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.014s	sys 0.037s
I20260925 16:44:32.010586 12795 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
I20260925 16:44:32.017655 13051 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.115644  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:32.116704  9122 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:32.116978  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.120092  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:32.091794 13179 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.126543  9048 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:32.127179 13179 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.094940 13092 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.128015 13301 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:32.129447 13092 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:32.143721  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.146255  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.148360  9116 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:44:32.097056  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.155180  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.167405  9122 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:32.097481  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:32.103652  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 675220us
I20260925 16:44:32.107723  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.081513 12753 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:32.029834 13091 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260925 16:44:32.112883  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:32.108873 12903 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:32.185890  8970 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:32.186580  8971 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
W20260925 16:44:32.186760  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89343.8us
I20260925 16:44:32.203187  9089 leader_election.cc:398] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:32.203575  9089 leader_election.cc:401] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
W20260925 16:44:32.201943  9666 connection.cc:232] RPC call timeout handler was delayed by -1.5631483659999503s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2908s for a response
I20260925 16:44:32.095014 13021 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.090s
I20260925 16:44:32.208354  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.209417  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:32.214130  8973 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:32.216238  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:32.216167  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.218709  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:32.216084  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71173.8us
I20260925 16:44:32.225499  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.226472  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.109413 13113 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260925 16:44:32.098536 13285 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.185561 13302 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:32.228523  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:32.237232  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82134.9us
I20260925 16:44:32.247339  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.247917  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.248605  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.249511  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.249663  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:32.258292  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55284.9us
I20260925 16:44:32.266903  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.268054  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.248519  8975 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:32.271031  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:32.272097  9123 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 7.
I20260925 16:44:32.273875  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.275252  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.276742  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:32.280663  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53568.6us
I20260925 16:44:32.209291 13299 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:32.281829  9043 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:32.282332  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:32.223054 12706 consensus_meta.cc:287] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.705s	user 0.009s	sys 0.000s
I20260925 16:44:32.287984  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:32.288434  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.104s	sys 0.207s
I20260925 16:44:32.289273  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.256273 13284 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:32.228181 13272 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 6. Current term is 7.
I20260925 16:44:32.224735 13203 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:32.246783 12881 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:32.256235 13216 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:32.298434  8970 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
W20260925 16:44:32.347839  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.104s	sys 0.208s
I20260925 16:44:32.255728 12976 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:44:32.365752  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.313773  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:32.367684  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 79465.5us
I20260925 16:44:32.367864  8974 raft_consensus.cc:2362] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10. Re-sending same reply.
I20260925 16:44:32.316493  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.312476  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.310418  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:32.256125 13310 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:32.355093  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.359154 12881 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:32.368400  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:32.372130  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.306341 13302 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:32.304905 13304 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:32.385036  9043 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:32.389535 13284 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:32.392830 13246 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.187791 13266 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.433158  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.434515  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.394368 13293 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:32.396134 13329 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260925 16:44:32.396396 13272 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:32.399201 13092 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:32.399849 13326 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:32.401026 13325 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.282s	user 0.000s	sys 0.001s
I20260925 16:44:32.321249 13299 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.402168 13051 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.384061 13323 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:32.404718 13285 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:32.359714 13237 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.407398  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1188) took 2409 ms. Trace:
I20260925 16:44:32.408636 12920 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.410866 13223 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:32.309013 13277 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:32.414499 13294 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.000s
I20260925 16:44:32.386907  9115 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:32.416150  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47824.1us
W20260925 16:44:32.416322  9695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 854) took 2563 ms (client timeout 2176 ms). Trace:
I20260925 16:44:32.552568  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:32.552299  9695 rpcz_store.cc:269] 0925 16:44:29.853386 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.853533 (+   147us) service_pool.cc:227] Handling call
0925 16:44:32.416176 (+2562643us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:32.416266 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2793575296}
I20260925 16:44:32.554433  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:32.438388  8975 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:44:32.469883  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:32.557358  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:32.477267  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 227654us
I20260925 16:44:32.478204  8974 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:44:32.391117 12881 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:32.426100 12976 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:32.426312 12956 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:32.321749 12706 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.489128  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:32.514082  8973 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:32.471115 12887 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:32.545140  9047 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:32.543529  9700 rpcz_store.cc:276] 0925 16:44:29.997495 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.809111 (+811616us) service_pool.cc:227] Handling call
0925 16:44:31.875211 (+1066100us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:31.875468 (+   257us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:31.875503 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:31.875546 (+    43us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:31.875578 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:31.875636 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:32.407203 (+531567us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b5400689cd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:32.407333 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2406115072}
I20260925 16:44:32.361615 13279 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.557528  9041 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:32.425078  8972 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:32.558424  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.474864 13272 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.560356  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.475556 13318 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260925 16:44:32.565372  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:32.432909 13141 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.583081  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.583937  9698 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
W20260925 16:44:32.555568 13076 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 3.423s	user 0.013s	sys 0.033s
I20260925 16:44:32.581177  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:32.559303 13160 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:32.585237  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.566465 13276 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:32.593443  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:32.577639 13296 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.836s	user 0.010s	sys 0.000s
I20260925 16:44:32.587349  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:32.585907 13131 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:32.480436 13326 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.589649  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.591799  9041 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:44:32.592211  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.598004  9124 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:32.604254 12976 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.624740  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:32.592033 13076 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 3.458s	user 0.013s	sys 0.034s
I20260925 16:44:32.644403  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.645224  9041 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:32.586242  8975 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260925 16:44:32.645998  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:32.646600  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89348.3us
W20260925 16:44:32.647150  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55003.5us
I20260925 16:44:32.592630 13021 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:32.647800  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.648070  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.592054 13323 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:32.648911  9115 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:32.659343  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.575651 12887 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.564800 13294 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.596932 13302 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:32.593818 13276 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:32.665505  9041 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:32.644943 13304 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:32.604290 13131 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:32.674568  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.651710 13112 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:32.677311 13333 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260925 16:44:32.678020 12706 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
W20260925 16:44:32.678135 13330 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260925 16:44:32.678675 13276 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:32.679267 13299 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:32.679416 13233 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.146s	user 0.012s	sys 0.000s
I20260925 16:44:32.679759 13315 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:32.653923 13160 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:32.681326 12887 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.681424 12920 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.652582 13152 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:32.734411 13160 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:32.682211 13279 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.696540  9697 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:32.735942 13344 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260925 16:44:32.629788 13296 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.691181 13141 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.738327 13296 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.742799 13294 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.744361 13326 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:32.703159 13306 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.969s	user 0.008s	sys 0.003s
I20260925 16:44:32.745185 13306 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:32.746145 13293 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:32.748377 13271 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.688s	user 0.009s	sys 0.001s
I20260925 16:44:32.748867 13271 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.673149 13313 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:32.713366 13340 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:32.716037 13278 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:32.717554 13203 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:32.689903 13131 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:32.697688 13272 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:32.730530 13233 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.735379 13160 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.756907 13340 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.751392 13271 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:32.753562 13270 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.736s	user 0.008s	sys 0.003s
I20260925 16:44:32.764957 13340 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.757081 13315 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:32.770515 13131 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.770676 13315 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.772518 13131 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.758365 13278 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.777294 13233 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:32.778240 13278 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:32.808991  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 160760us
I20260925 16:44:32.811035  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.814733  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:32.817346  8967 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260925 16:44:32.818631  8969 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:32.095433  9044 rpcz_store.cc:276] 0925 16:44:29.904015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.609754 (+705739us) service_pool.cc:227] Handling call
0925 16:44:30.609986 (+   232us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:30.610189 (+   203us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:44:31.016241 (+406052us) log.cc:842] Serialized 14 byte log entry
0925 16:44:32.062250 (+1046009us) spinlock_profiling.cc:243] Waited 7 ms on lock 0x7b18000c7240. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b
0925 16:44:32.079334 (+ 17084us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:32.079403 (+    69us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:32.079443 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.079533 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:32.079634 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16873,"prepare.queue_time_us":552792,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":27842,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":4085,"spinlock_wait_cycles":16109824,"thread_start_us":532627,"threads_started":2,"wal-append.queue_time_us":1016241}
W20260925 16:44:32.825348  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.701s (SENT)
I20260925 16:44:32.826264  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.826752  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:32.719067  9089 connection.cc:232] RPC call timeout handler was delayed by -3.8412244669998472s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1555s for a response
I20260925 16:44:32.828440  9050 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:32.828768  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:32.828230  9119 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:32.830938  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:32.836438  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.837172  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.837816  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.839072  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:32.829336  9071 diagnostics_log.cc:230] Unable to collect stacks to diagnostics log: Incomplete: not collecting stack trace since debugger or strace is attached
I20260925 16:44:32.844228  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:32.846076  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:32.827490  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.847630  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:32.828020  9042 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:32.848322  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:32.834332  9089 connection.cc:232] RPC call timeout handler was delayed by -3.7269244669998898s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
W20260925 16:44:32.849045  9089 connection.cc:232] RPC call timeout handler was delayed by -2.6775244669997846s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2848s for a response
I20260925 16:44:32.849274  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:32.850076  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:32.850257  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.851944  9700 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260925 16:44:32.839138  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:32.857648  9043 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:32.830029  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:32.860287  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:32.866964  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:32.867146  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:32.890066  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71566us
W20260925 16:44:32.893957  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47114.5us
I20260925 16:44:32.759459 13203 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.896390 13279 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:32.898727 12887 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:32.895566  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.899005 13027 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:32.899961 13027 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:32.900200  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.900559 13027 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:32.903355 13279 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.905479 13338 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:32.906006 13338 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:32.906438 13338 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:32.906985 13271 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:32.892678 13034 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:32.747488 12881 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.906239 13279 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:32.916504  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:32.903198 13340 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:32.773090 13276 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:32.919817 13340 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:32.920989 13340 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:32.921347  9693 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:32.919906 13293 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:32.893489 13078 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260925 16:44:32.927044  8970 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:32.914865 13296 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:32.929563  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.932044 13308 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:32.933151  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.934343  9700 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12.
I20260925 16:44:32.921892 12881 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:32.939589  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 114546us
I20260925 16:44:32.940430  9090 leader_election.cc:398] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12.
I20260925 16:44:32.940894  9090 leader_election.cc:401] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260925 16:44:32.942860  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2249) took 1068 ms. Trace:
I20260925 16:44:32.946331 13068 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:32.946605 13272 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:32.947290  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:32.948275  9041 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:32.949481 13068 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:32.950048 13068 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:32.951316  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2582) took 1326 ms. Trace:
I20260925 16:44:32.951862  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:32.951787  9045 rpcz_store.cc:276] 0925 16:44:31.624916 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.625949 (+  1033us) service_pool.cc:227] Handling call
0925 16:44:31.626719 (+   770us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:31.985304 (+358585us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.950809 (+965505us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001af754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:32.951121 (+   312us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":675035008}
I20260925 16:44:32.953977  9044 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260925 16:44:32.951357 13203 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:32.935937 13355 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.150s	user 0.000s	sys 0.002s
I20260925 16:44:32.943297  8969 rpcz_store.cc:276] 0925 16:44:31.874015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.877110 (+  3095us) service_pool.cc:227] Handling call
0925 16:44:32.942520 (+1065410us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b54003c3cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:32.942719 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2157383552}
I20260925 16:44:32.959978  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1196) took 1047 ms. Trace:
I20260925 16:44:32.960100 13021 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:32.960541  9697 rpcz_store.cc:276] 0925 16:44:31.912519 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.912683 (+   164us) service_pool.cc:227] Handling call
0925 16:44:31.913050 (+   367us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.736261 (+823211us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.959461 (+223200us) spinlock_profiling.cc:243] Waited 780 ms on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:32.959798 (+   337us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1794926976}
I20260925 16:44:32.963603  9045 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:32.967373 13203 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:32.967473 12753 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:32.968179 12753 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:32.971243 13203 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:32.973955 13021 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:32.990563  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:32.993649  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58151.2us
I20260925 16:44:33.000121 13203 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:33.002329  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:33.003343  9700 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:33.004877 13207 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:33.010314 13159 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:33.012223 13150 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:33.012681 13150 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:33.013832 13150 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.015231 13150 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:33.015517 13265 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:33.015972 13265 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:33.016906 13265 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.018446 13265 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:33.025362  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:33.031024 13272 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:33.042299 13324 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.753s	user 0.005s	sys 0.002s
I20260925 16:44:33.044123  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2585) took 1414 ms. Trace:
I20260925 16:44:33.045332  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.047143  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:33.047786  9115 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:33.044482  9049 rpcz_store.cc:276] 0925 16:44:31.629461 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.629852 (+   391us) service_pool.cc:227] Handling call
0925 16:44:31.630204 (+   352us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:31.630404 (+   200us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:31.630427 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:31.645916 (+ 15489us) log.cc:842] Serialized 26 byte log entry
0925 16:44:32.945264 (+1299348us) spinlock_profiling.cc:243] Waited 5.05 ms on lock 0x7b1800437da0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411
0925 16:44:32.945660 (+   396us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:32.945741 (+    81us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:32.945855 (+   114us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:33.040269 (+ 94414us) spinlock_profiling.cc:243] Waited 19.7 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:33.043777 (+  3508us) raft_consensus.cc:1671] finished
0925 16:44:33.043807 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:33.043930 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":56851584,"thread_start_us":713563,"threads_started":1,"wal-append.queue_time_us":642058}
I20260925 16:44:33.048686  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.049268  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:33.050206  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.050778  9049 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:33.051824 13246 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260925 16:44:33.052980 13246 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:33.053339 13246 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:33.054311  9115 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:44:33.054847  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:33.055612  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2588) took 1389 ms. Trace:
I20260925 16:44:33.057094 13277 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:33.057279  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2477) took 1306 ms. Trace:
I20260925 16:44:33.057546 13277 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:33.058104 13277 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:33.058761  9123 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:33.056577  9048 rpcz_store.cc:276] 0925 16:44:31.665766 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.665877 (+   111us) service_pool.cc:227] Handling call
0925 16:44:31.685687 (+ 19810us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.126886 (+441199us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.055103 (+928217us) spinlock_profiling.cc:243] Waited 441 ms on lock 0x7b54000a87d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.055408 (+   305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1013495424}
I20260925 16:44:33.051653  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.060536  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:33.057788  9124 rpcz_store.cc:276] 0925 16:44:31.750861 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.906309 (+155448us) service_pool.cc:227] Handling call
0925 16:44:33.056874 (+1150565us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b5400166554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.057102 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1331550976}
I20260925 16:44:33.067782 13338 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.108604 13203 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:33.108747  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:33.109272 13203 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.109895 13338 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:33.110529 13141 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:33.114760  9043 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:33.084223  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:33.116747  9123 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:33.118162  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:33.111436 13203 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:33.130627  9041 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260925 16:44:33.131034  9119 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:33.137511 13271 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:33.144435  9049 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
W20260925 16:44:33.150547  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89499us
I20260925 16:44:33.056458 13246 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.159423  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.116532 13068 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.120894 12753 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.158872  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:33.175873  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.128038 13277 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.179311  9697 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:33.179500  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:33.179750  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1175) took 5216 ms (client timeout 3200 ms). Trace:
I20260925 16:44:33.179926 13326 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12.
I20260925 16:44:33.158010 13279 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260925 16:44:33.180349 13276 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:33.182736  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.662s (SENT)
I20260925 16:44:33.183501  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.185027 13266 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:33.149570 13340 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.186911  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.187368 13095 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:33.187876 13219 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:33.189618  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68707.9us
W20260925 16:44:33.181201  9694 rpcz_store.cc:269] 0925 16:44:27.947938 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:27.948320 (+   382us) service_pool.cc:227] Handling call
0925 16:44:33.148895 (+5200575us) spinlock_profiling.cc:243] Waited 1.43 s on lock 0x7b540053e8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.164073 (+ 15178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3281450880}
W20260925 16:44:33.198444  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57970.8us
I20260925 16:44:33.207549  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 924) took 1147 ms. Trace:
I20260925 16:44:33.187798 13131 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:33.204094  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:33.216020  9122 rpcz_store.cc:276] 0925 16:44:32.060080 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.085176 (+ 25096us) service_pool.cc:227] Handling call
0925 16:44:33.205029 (+1119853us) spinlock_profiling.cc:243] Waited 30.7 ms on lock 0x7b54001c9b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.207339 (+  2310us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":70659456}
I20260925 16:44:33.229987  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:33.231123 13203 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:33.231567  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:33.231789 13203 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:33.232457 13203 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:33.232693  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:33.234700 13272 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:33.235270 13272 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:33.236064 13318 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:33.236720 12753 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:33.248311 13272 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:33.249964  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:33.252254 13267 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:33.252753 13267 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:33.244910  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:33.255120  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.255270  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.256590 13078 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:33.256999 13298 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:33.257215 13078 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.257733 13298 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.259941 13054 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:33.245230 13068 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:33.205605 13095 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:33.251993 13157 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:44:33.239820 13271 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:33.259440 13078 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:33.260492 13054 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.260933  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:33.422115  9696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 853) took 3569 ms (client timeout 1626 ms). Trace:
W20260925 16:44:33.324194  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 159477us
I20260925 16:44:33.261056  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.419853  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 771) took 1116 ms. Trace:
I20260925 16:44:33.334077  9116 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:33.419114  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2584) took 1790 ms. Trace:
I20260925 16:44:33.322252  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.412168  9049 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:33.422911  9701 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 8. Ops: [6.7-6.7]
W20260925 16:44:33.425992  9119 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2472) took 1676 ms (client timeout 1759 ms). Trace:
W20260925 16:44:33.441382  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 220736us
I20260925 16:44:33.331712  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2254) took 1290 ms. Trace:
I20260925 16:44:33.416538  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2589) took 1750 ms. Trace:
I20260925 16:44:33.424491  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.321118  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.334378  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2247) took 1564 ms. Trace:
I20260925 16:44:33.260514  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:33.478299  9119 rpcz_store.cc:269] 0925 16:44:31.749626 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.892524 (+142898us) service_pool.cc:227] Handling call
0925 16:44:33.425812 (+1533288us) spinlock_profiling.cc:243] Waited 934 ms on lock 0x7b5400142b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.425938 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2148763008}
I20260925 16:44:33.335037  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 770) took 1032 ms. Trace:
I20260925 16:44:33.444377  9042 rpcz_store.cc:276] 0925 16:44:31.629141 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.629308 (+   167us) service_pool.cc:227] Handling call
0925 16:44:31.629641 (+   333us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.848856 (+1219215us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.418776 (+569920us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54000a82d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.419055 (+   279us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2754584832}
W20260925 16:44:33.442620  9696 rpcz_store.cc:269] 0925 16:44:29.852846 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.852971 (+   125us) service_pool.cc:227] Handling call
0925 16:44:33.421758 (+3568787us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b54004f06d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.421917 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":242865408}
I20260925 16:44:33.479277  8970 rpcz_store.cc:276] 0925 16:44:32.041301 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.364325 (+323024us) service_pool.cc:227] Handling call
0925 16:44:32.396105 (+ 31780us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.927726 (+531621us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.331373 (+403647us) spinlock_profiling.cc:243] Waited 526 ms on lock 0x7b54003557d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.331579 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1209404288}
I20260925 16:44:33.479682  9050 rpcz_store.cc:276] 0925 16:44:31.666114 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.666223 (+   109us) service_pool.cc:227] Handling call
0925 16:44:31.666504 (+   281us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.834580 (+1168076us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.416258 (+581678us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54002b6bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.416471 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2670643584}
W20260925 16:44:33.326067 13362 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
I20260925 16:44:33.335556  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:33.497714  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 778) took 1111 ms. Trace:
I20260925 16:44:33.507329  9049 rpcz_store.cc:276] 0925 16:44:32.365330 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.292218 (+926888us) service_pool.cc:227] Handling call
0925 16:44:33.411862 (+119644us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.476813 (+ 64951us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.477046 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:33.488776  9044 rpcz_store.cc:276] 0925 16:44:32.302824 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.847947 (+545123us) service_pool.cc:227] Handling call
0925 16:44:32.953561 (+105614us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:32.955452 (+  1891us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.334823 (+379371us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002512d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.334975 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":241406848}
I20260925 16:44:33.417672  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2599) took 3995 ms. Trace:
I20260925 16:44:33.508337  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.324573 13167 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:33.508638  9117 rpcz_store.cc:276] 0925 16:44:29.422009 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.740342 (+1318333us) service_pool.cc:227] Handling call
0925 16:44:30.740553 (+   211us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.005913 (+1265360us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.417166 (+1411253us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b540010ca54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.417480 (+   314us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2863307648}
I20260925 16:44:33.443549  9041 rpcz_store.cc:276] 0925 16:44:32.303171 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.948999 (+645828us) service_pool.cc:227] Handling call
0925 16:44:33.116088 (+167089us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:33.137688 (+ 21600us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.419609 (+281921us) spinlock_profiling.cc:243] Waited 166 ms on lock 0x7b54001afc50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.419792 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":381700992}
I20260925 16:44:33.472587 13095 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:33.296217  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.550153  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.336187 13298 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:33.497262 13271 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:33.581496 13271 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:33.582828  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.583911  8974 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:33.584247  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.584734 13336 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:33.585078  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.585352  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.586287  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.586907  8974 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:33.535795  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1132) took 1514 ms. Trace:
I20260925 16:44:33.245922 13278 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:33.573030  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:33.559764  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 299380us
I20260925 16:44:33.573463 13169 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:44:33.574819  9048 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:33.419049 13272 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.322482 13131 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.253871 13267 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.576846  9116 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:33.577394  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2597) took 1155 ms. Trace:
I20260925 16:44:33.324833 13154 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.260s
I20260925 16:44:33.580667  9049 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:33.583741  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:33.588501  9046 rpcz_store.cc:276] 0925 16:44:31.900870 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.901029 (+   159us) service_pool.cc:227] Handling call
0925 16:44:33.413836 (+1512807us) spinlock_profiling.cc:243] Waited 38.3 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.415505 (+  1669us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":88005504}
I20260925 16:44:33.553170  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.586539  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.587380 13336 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:33.627061  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2587) took 1704 ms. Trace:
I20260925 16:44:33.333688 13219 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.628147  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:33.637519  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 781) took 1164 ms. Trace:
I20260925 16:44:33.431949 13075 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.196s
I20260925 16:44:33.762836  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 791) took 2010 ms. Trace:
I20260925 16:44:33.480275  8966 rpcz_store.cc:276] 0925 16:44:31.770252 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.360365 (+590113us) service_pool.cc:227] Handling call
0925 16:44:32.400071 (+ 39706us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.432040 (+ 31969us) raft_consensus.cc:1520] Early marking committed up to index 4
0925 16:44:32.483054 (+ 51014us) log.cc:842] Serialized 14 byte log entry
0925 16:44:32.644969 (+161915us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:32.645043 (+    74us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:32.645099 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.333902 (+688803us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b54001b3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.333995 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:33.334176 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11052,"prepare.queue_time_us":151092,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":3131,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":3147,"spinlock_wait_cycles":72138624,"thread_start_us":64539,"threads_started":1,"wal-append.queue_time_us":104944}
I20260925 16:44:33.816009  9050 rpcz_store.cc:276] 0925 16:44:32.422221 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.539167 (+1116946us) service_pool.cc:227] Handling call
0925 16:44:33.576769 (+ 37602us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.577088 (+   319us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:33.577112 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:33.577157 (+    45us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:33.577198 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.577244 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:33.577324 (+    80us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:33.820282  9122 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.049s	sys 0.080s
W20260925 16:44:33.820748  9122 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.049s	sys 0.080s
I20260925 16:44:33.821758  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 782) took 1309 ms. Trace:
I20260925 16:44:33.697611  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.814527  9048 rpcz_store.cc:276] 0925 16:44:32.473458 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.550574 (+1077116us) service_pool.cc:227] Handling call
0925 16:44:33.574486 (+ 23912us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.637276 (+ 62790us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.637468 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:33.777757  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 997) took 3770 ms. Trace:
I20260925 16:44:33.823370  9049 rpcz_store.cc:276] 0925 16:44:32.512874 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.580097 (+1067223us) service_pool.cc:227] Handling call
0925 16:44:33.580467 (+   370us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.821473 (+241006us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.821698 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:33.763222  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2479) took 1997 ms. Trace:
I20260925 16:44:33.824810  8972 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:33.836964  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:33.804387  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 76695.2us
W20260925 16:44:33.758795  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61575us
I20260925 16:44:33.822990  8971 rpcz_store.cc:276] 0925 16:44:31.752107 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.752213 (+   106us) service_pool.cc:227] Handling call
0925 16:44:31.752503 (+   290us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:32.202670 (+450167us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.747378 (+1544708us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b540036ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.762639 (+ 15261us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":997775616}
I20260925 16:44:33.815099  9047 rpcz_store.cc:276] 0925 16:44:31.631091 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.631204 (+   113us) service_pool.cc:227] Handling call
0925 16:44:31.631494 (+   290us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.568299 (+936805us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.335612 (+767313us) spinlock_profiling.cc:243] Waited 913 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.335946 (+   334us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2100590848}
I20260925 16:44:33.824331  9701 rpcz_store.cc:276] 0925 16:44:30.007063 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.801201 (+794138us) service_pool.cc:227] Handling call
0925 16:44:33.422374 (+2621173us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:33.501210 (+ 78836us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.777477 (+276267us) spinlock_profiling.cc:243] Waited 2.62 s on lock 0x7b54004f06d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.777637 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6026895744}
W20260925 16:44:33.771576 13203 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.538s	user 0.007s	sys 0.004s
W20260925 16:44:33.652494 13027 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.750s	user 0.007s	sys 0.005s
W20260925 16:44:33.851058  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 267794us
I20260925 16:44:33.605319 13167 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:33.851511  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.769660 13095 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.852101 13154 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:33.852329  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.763299 12787 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.089s
I20260925 16:44:33.911433 13326 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:33.817158 13336 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:33.853302 12903 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:33.913859 12903 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:33.914476 13336 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.915777 13336 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:33.853853 13268 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:33.854408  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46332.1us
I20260925 16:44:33.919736 13167 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:33.920188  8969 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:33.920717 13167 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.652088 13169 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:33.755743 13131 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:33.855758  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.922379 13169 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:33.922855 13133 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:33.923339  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.923733  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2257) took 1881 ms. Trace:
I20260925 16:44:33.923291 13169 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.924171  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:33.924115  8967 rpcz_store.cc:276] 0925 16:44:32.042231 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.093898 (+ 51667us) service_pool.cc:227] Handling call
0925 16:44:33.923483 (+1829585us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b54003c4bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:33.923643 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1658701696}
I20260925 16:44:33.924739 13054 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:33.925134  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.925316  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.851502  9042 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:33.926541  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.859650  9049 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:33.922593  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.860081  9700 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:33.695842  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:33.860250  9050 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:33.860394  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:33.851501  9046 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
W20260925 16:44:33.786082 13266 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.566s	user 0.007s	sys 0.000s
W20260925 16:44:33.647588 13150 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.632s	user 0.014s	sys 0.000s
I20260925 16:44:33.860495  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.774070 13246 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:33.862077  9120 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:33.785109 12887 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
W20260925 16:44:33.888479  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45457.2us
I20260925 16:44:33.653028 13272 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:33.938139  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:33.895910  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.784277 13318 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:33.897050  9116 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:33.764029 13155 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.108s
I20260925 16:44:33.820199 13277 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:33.824638  9121 rpcz_store.cc:276] 0925 16:44:31.765964 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:31.996586 (+230622us) service_pool.cc:227] Handling call
0925 16:44:32.020281 (+ 23695us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.020518 (+   237us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:32.020899 (+   381us) log.cc:842] Serialized 14 byte log entry
0925 16:44:33.209353 (+1188454us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b18004da700. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b 00007f719bf3488a
0925 16:44:33.695335 (+485982us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:33.752232 (+ 56897us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:33.762774 (+ 10542us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.762876 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:33.763027 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":51060,"prepare.queue_time_us":129,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":4302,"raft.queue_time_us":67961,"raft.run_cpu_time_us":174,"raft.run_wall_time_us":30031,"spinlock_wait_cycles":5825408,"thread_start_us":394126,"threads_started":1}
I20260925 16:44:33.910780 13154 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:33.926852  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:33.856798 13279 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:33.957319 13154 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.957711 13279 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.958681 13154 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:33.902909 13203 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.960402  9046 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:44:33.929207  9700 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:33.936164  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:33.914918 12903 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:33.957327  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.961777  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:33.908332 13333 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.210s	user 0.000s	sys 0.008s
I20260925 16:44:33.924669 12740 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:33.942049 13157 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:33.987879 12920 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:33.988565  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2598) took 1560 ms. Trace:
I20260925 16:44:33.988358 13157 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.989558 12920 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:33.990021 12920 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:33.991833  8966 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:33.993249 13153 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:33.993706 13153 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:33.999814  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.000617  8971 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:33.999861  8870 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:34.001335  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.002377  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.002979  8971 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:34.002230  8870 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 9, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 9 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:26.597157  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:33.948058 13305 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:33.955241  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 327136us
I20260925 16:44:33.959816 13279 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:33.956032 13298 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:33.956465  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 908) took 4081 ms. Trace:
I20260925 16:44:33.966163  9042 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:33.967160  8970 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:33.970098 13164 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:33.927402 13340 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:33.970539 13266 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:33.971342 13150 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:33.971186 13087 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.011s
I20260925 16:44:33.971481  9697 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:33.969919  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:33.972966  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:33.973730  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:33.975353  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:33.975373  9665 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:33.983222  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:33.985671  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.986091  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:33.986778 13159 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:34.008802  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:33.988957  9045 rpcz_store.cc:276] 0925 16:44:32.428038 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.518726 (+1090688us) service_pool.cc:227] Handling call
0925 16:44:33.576193 (+ 57467us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.900019 (+323826us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:33.900052 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:33.928644 (+ 28592us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:33.928721 (+    77us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.988351 (+ 59630us) spinlock_profiling.cc:243] Waited 319 ms on lock 0x7b54002625d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:33.988389 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:33.988499 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":733500800}
W20260925 16:44:34.017059  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61216.1us
I20260925 16:44:34.017949  9123 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260925 16:44:34.023790 13326 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:33.970198 12740 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.026831  9047 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:34.015511  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1015) took 1895 ms. Trace:
I20260925 16:44:33.904657 13027 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.014520  9701 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260925 16:44:34.013203 13131 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:34.032944  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.033147  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:33.944080 12887 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:34.003674  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:33.991047 12920 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:33.940073 13271 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.040055  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.144434  9121 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:34.016743  9118 rpcz_store.cc:276] 0925 16:44:29.875354 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:30.824680 (+949326us) service_pool.cc:227] Handling call
0925 16:44:30.825024 (+   344us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:31.070909 (+245885us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:31.072198 (+  1289us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:31.075585 (+  3387us) log.cc:842] Serialized 26 byte log entry
0925 16:44:33.053386 (+1977801us) spinlock_profiling.cc:243] Waited 82.9 ms on lock 0x7b180009d360. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:44:33.245533 (+192147us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:33.245581 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.245690 (+   109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:33.955660 (+709970us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b54001629a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beb8771 00007f719bec3220 00007f719bec31c8 00007f719bec3148 00007f719bec3103 00007f719bec238c 00007f71a1f33206 00007f71a1f2b808 00007f719beff38b 00007f719bf01e80
0925 16:44:33.956159 (+   499us) raft_consensus.cc:1671] finished
0925 16:44:33.956180 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:33.956318 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":339502,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":74895,"spinlock_wait_cycles":193254016,"thread_start_us":379960,"threads_started":2,"wal-append.queue_time_us":2027312}
I20260925 16:44:34.178381  8966 raft_consensus.cc:2396] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260925 16:44:34.033547  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.011775 13095 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:34.195758  9044 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.023s	sys 0.065s
W20260925 16:44:34.196087  9044 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.023s	sys 0.065s
I20260925 16:44:34.179505  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.040812  9050 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260925 16:44:34.194743  9698 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
W20260925 16:44:34.199790  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 224497us
I20260925 16:44:34.040033  9700 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.214514  9124 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:34.219692  9116 raft_consensus.cc:2396] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:44:34.096210 13098 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
W20260925 16:44:34.223667  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 253819us
I20260925 16:44:34.224021  9120 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:34.030277 13278 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:34.225147  8975 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:34.174868 13131 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:34.238906  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.226776  9700 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:34.172411 13150 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:34.231662  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.248484  8969 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:34.220834  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.096113 13157 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:34.221236  9015 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.011s	sys 0.039s
W20260925 16:44:34.250048  9015 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.674s	user 0.011s	sys 0.039s
W20260925 16:44:34.250321  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 674947us
I20260925 16:44:34.032444 13272 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.193s
I20260925 16:44:34.200726 13164 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260925 16:44:34.255308  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 215375us
I20260925 16:44:34.245489  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.200026 13340 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:34.252972  9120 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:34.012696 13305 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.256986  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.174580  9702 rpcz_store.cc:276] 0925 16:44:32.119521 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:32.119635 (+   114us) service_pool.cc:227] Handling call
0925 16:44:32.119907 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:32.136910 (+ 17003us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:32.508436 (+371526us) log.cc:842] Serialized 14 byte log entry
0925 16:44:33.077415 (+568979us) spinlock_profiling.cc:243] Waited 17.3 ms on lock 0x7b18004f8be0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b
0925 16:44:33.205477 (+128062us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:33.225782 (+ 20305us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:33.261432 (+ 35650us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.015134 (+753702us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b54006badd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:34.015191 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.015329 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":214241,"prepare.queue_time_us":547852,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":6558,"raft.queue_time_us":125567,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":10194,"spinlock_wait_cycles":78503040,"thread_start_us":568047,"threads_started":2,"wal-append.queue_time_us":255322,"wal-append.run_cpu_time_us":1086,"wal-append.run_wall_time_us":1009076}
I20260925 16:44:34.228282 13098 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:34.238636 13068 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:34.272200  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.285349 13241 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:34.285507  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.286320  8972 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:34.034104 13318 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.258576 13340 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:34.278929  9120 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:44:34.247586 13278 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.281489 13219 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:34.281831 13092 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:34.282197 13098 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:34.283020 13141 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.172s	user 0.011s	sys 0.000s
I20260925 16:44:34.283434 13169 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:34.284097  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:34.276674 13114 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:34.276925  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.287474  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.216024 13326 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.261732 13155 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:34.264485 13021 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:34.271829 12920 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:34.264623 13298 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:34.281847 13203 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.319105 13141 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:34.307204 13272 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:34.306245 13340 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:34.313779 13157 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260925 16:44:34.322116 13268 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:34.322890 13266 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:34.325699 13155 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:34.326375  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.578s	user 0.008s	sys 0.007s
I20260925 16:44:34.306187 13068 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:34.333386 13265 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.315s	user 0.014s	sys 0.000s
I20260925 16:44:34.335908  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2284) took 1009 ms. Trace:
I20260925 16:44:34.349797  8969 rpcz_store.cc:276] 0925 16:44:33.326207 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.258659 (+932452us) service_pool.cc:227] Handling call
0925 16:44:34.335837 (+ 77178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:34.341939  9118 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:34.323370  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:34.285969 13241 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.330766 13114 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:34.351259  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.008s	sys 0.007s
I20260925 16:44:34.379074  9119 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260925 16:44:34.337742 13272 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:34.349316 13155 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:34.341533 13047 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260925 16:44:34.347272 13098 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:34.346128 13141 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:34.381732  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.379489  9119 pending_rounds.cc:76] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 6
I20260925 16:44:34.380502 13027 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:34.391158 12740 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.327164 13131 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.389569  9119 pending_rounds.cc:97] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260925 16:44:34.398810  9119 raft_consensus.cc:2866] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:34.324000 12887 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.399933  8969 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:34.400175 12887 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:34.409373 13153 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.410689 13153 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:34.352130 13021 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:34.397540  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74263.2us
I20260925 16:44:34.379501 13203 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:34.382737 13268 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:34.422888  8969 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:34.373031 13266 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.415623  8975 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:34.422179 13157 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:34.400157 13305 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:34.416436  9700 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:34.375800 13298 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.340075 13150 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:34.441515  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 178767us
I20260925 16:44:34.454020  8972 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:34.455310  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1722) took 1159 ms. Trace:
W20260925 16:44:34.456077  9041 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.877s	user 0.000s	sys 0.027s
I20260925 16:44:34.438645  8974 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
W20260925 16:44:34.457008  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1728) took 1135 ms (client timeout 1511 ms). Trace:
W20260925 16:44:34.462302  8970 rpcz_store.cc:269] 0925 16:44:33.321794 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.572735 (+250941us) service_pool.cc:227] Handling call
0925 16:44:34.456788 (+884053us) spinlock_profiling.cc:243] Waited 362 ms on lock 0x7b5400136854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.456947 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":831816576}
I20260925 16:44:34.422785 13271 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:34.438750 13203 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:34.431324 13268 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.455649  8972 rpcz_store.cc:276] 0925 16:44:33.295572 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.219863 (+924291us) service_pool.cc:227] Handling call
0925 16:44:34.455261 (+235398us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:34.462484  9041 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.000s	sys 0.027s
I20260925 16:44:34.458703  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.463567  8973 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:34.483305  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:34.491976  9045 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:34.486285  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:34.493064  9042 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:34.483618  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:34.463755 13189 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.069s	user 0.005s	sys 0.013s
I20260925 16:44:34.496560  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.488092  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:34.497390  8970 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260925 16:44:34.499209 13326 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:34.457086 13157 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.485055 13266 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:34.501833  8972 raft_consensus.cc:2362] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9. Re-sending same reply.
W20260925 16:44:34.485993 13154 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.527s	user 0.007s	sys 0.004s
I20260925 16:44:34.494220 13150 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:34.514943  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56314.3us
W20260925 16:44:34.490466 13372 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.195s	user 0.002s	sys 0.000s
I20260925 16:44:34.519579  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2293) took 1190 ms. Trace:
I20260925 16:44:34.527448 13305 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:34.528239  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2286) took 1201 ms. Trace:
I20260925 16:44:34.537895  8970 rpcz_store.cc:276] 0925 16:44:33.326731 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.466547 (+1139816us) service_pool.cc:227] Handling call
0925 16:44:34.528187 (+ 61640us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:34.538815  8972 rpcz_store.cc:276] 0925 16:44:33.328865 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.479678 (+1150813us) service_pool.cc:227] Handling call
0925 16:44:34.519512 (+ 39834us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:34.510257 13189 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.006s	sys 0.013s
I20260925 16:44:34.529328  9043 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:34.459228 13141 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:34.534196  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 805) took 1049 ms. Trace:
I20260925 16:44:34.550027  8966 rpcz_store.cc:276] 0925 16:44:33.485240 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.852073 (+366833us) service_pool.cc:227] Handling call
0925 16:44:34.534002 (+681929us) spinlock_profiling.cc:243] Waited 86.2 ms on lock 0x7b540021a554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.534133 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":198181120}
I20260925 16:44:34.520699 13271 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:34.519138 13246 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:34.535552  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:34.552731  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.556826  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.516865 13318 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.557447  8966 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260925 16:44:34.527896 13278 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.492898 13203 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.516067 13169 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.035s
I20260925 16:44:34.549350 13305 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:34.564482  9115 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.005s	sys 0.021s
W20260925 16:44:34.572046  9115 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.006s	sys 0.021s
I20260925 16:44:34.567370  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1720) took 1301 ms. Trace:
I20260925 16:44:34.572702  8966 rpcz_store.cc:276] 0925 16:44:33.259540 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.550802 (+1291262us) service_pool.cc:227] Handling call
0925 16:44:34.551109 (+   307us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:34.559480 (+  8371us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.560460 (+   980us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:34.459448 13068 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.571832  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1729) took 1249 ms. Trace:
I20260925 16:44:34.582556  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:34.582846  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81290us
I20260925 16:44:34.582815  8970 rpcz_store.cc:276] 0925 16:44:33.322103 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.549588 (+1227485us) service_pool.cc:227] Handling call
0925 16:44:34.571776 (+ 22188us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:34.586881  9696 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.016s	sys 0.014s
W20260925 16:44:34.588479  9696 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.669s	user 0.016s	sys 0.014s
I20260925 16:44:34.492944 13272 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:34.595237  8939 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.010s	sys 0.012s
I20260925 16:44:34.596168  8966 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:34.597056  8939 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.011s	sys 0.012s
W20260925 16:44:34.598260  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 684685us
I20260925 16:44:34.602499  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1730) took 1278 ms. Trace:
I20260925 16:44:34.602914  8966 rpcz_store.cc:276] 0925 16:44:33.322452 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.573704 (+1251252us) service_pool.cc:227] Handling call
0925 16:44:34.595908 (+ 22204us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.600654 (+  4746us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.600868 (+   214us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:34.605651 13241 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.605888 13298 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:34.606684 13203 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.608083  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2650) took 1638 ms. Trace:
I20260925 16:44:34.557040 13141 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.608767  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.610366  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:34.560957 13246 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.603525 13278 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:34.616379  8966 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:34.609601  9115 rpcz_store.cc:276] 0925 16:44:32.969242 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.173141 (+203899us) service_pool.cc:227] Handling call
0925 16:44:33.203300 (+ 30159us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.248061 (+ 44761us) raft_consensus.cc:1520] Early marking committed up to index 5
0925 16:44:33.871309 (+623248us) log.cc:842] Serialized 14 byte log entry
0925 16:44:34.607652 (+736343us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:34.607731 (+    79us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:34.607802 (+    71us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.607878 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.608008 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27919,"prepare.queue_time_us":1178595,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":36038,"thread_start_us":1094682,"threads_started":2}
I20260925 16:44:34.618057  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:34.621673  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2285) took 1295 ms. Trace:
I20260925 16:44:34.622641  8966 rpcz_store.cc:276] 0925 16:44:33.326458 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.604252 (+1277794us) service_pool.cc:227] Handling call
0925 16:44:34.616183 (+ 11931us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.619736 (+  3553us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.621606 (+  1870us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:34.610857 13267 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.756s	user 0.024s	sys 0.054s
I20260925 16:44:34.640571  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:34.614668 13021 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:34.651901 13021 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:34.652457 13021 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:34.652601 13365 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.371s	user 0.002s	sys 0.000s
I20260925 16:44:34.656064  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 784) took 1998 ms. Trace:
I20260925 16:44:34.656558  9044 rpcz_store.cc:276] 0925 16:44:32.657867 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.578144 (+920277us) service_pool.cc:227] Handling call
0925 16:44:33.578542 (+   398us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:33.579089 (+   547us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:33.579126 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:33.579614 (+   488us) log.cc:842] Serialized 26 byte log entry
0925 16:44:34.196445 (+616831us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:34.196490 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.196578 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:34.655784 (+459206us) raft_consensus.cc:1671] finished
0925 16:44:34.655811 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.655998 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":921,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":102,"thread_start_us":616414,"threads_started":1,"wal-append.queue_time_us":1002970}
I20260925 16:44:34.642802  9047 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:34.647203 13114 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:34.650882 13371 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.274s	user 0.002s	sys 0.000s
I20260925 16:44:34.617779 13272 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:34.628469 13267 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.024s	sys 0.054s
I20260925 16:44:34.660975  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:34.676260  9042 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:34.611177 13318 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.057s
I20260925 16:44:34.626657 13278 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.695474  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:34.692734  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:34.694205  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90630us
I20260925 16:44:34.660434 13087 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
I20260925 16:44:34.681799 13266 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:34.683249 13268 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.701483 13157 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:34.720397  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 457941us
W20260925 16:44:34.724088  8971 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.554s	user 0.004s	sys 0.005s
I20260925 16:44:34.724432  8971 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:34.724996  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2292) took 1396 ms. Trace:
I20260925 16:44:34.725401  8971 rpcz_store.cc:276] 0925 16:44:33.328399 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.003465 (+675066us) service_pool.cc:227] Handling call
0925 16:44:34.724947 (+721482us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:34.726891  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 488531us
I20260925 16:44:34.728704  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.729454  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2493) took 1396 ms. Trace:
I20260925 16:44:34.729823  9124 rpcz_store.cc:276] 0925 16:44:33.333241 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.335327 (+  2086us) service_pool.cc:227] Handling call
0925 16:44:34.729299 (+1393972us) spinlock_profiling.cc:243] Waited 696 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.729406 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1599714176}
W20260925 16:44:34.731382  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 450222us
I20260925 16:44:34.733088  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2288) took 1405 ms. Trace:
W20260925 16:44:34.731683  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 786) took 1726 ms (client timeout 1762 ms). Trace:
W20260925 16:44:34.733997  9043 rpcz_store.cc:269] 0925 16:44:33.004969 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.117906 (+112937us) service_pool.cc:227] Handling call
0925 16:44:34.731532 (+1613626us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b5400362754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.731633 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3008555392}
I20260925 16:44:34.733414  8975 rpcz_store.cc:276] 0925 16:44:33.327302 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.957052 (+629750us) service_pool.cc:227] Handling call
0925 16:44:34.732951 (+775899us) spinlock_profiling.cc:243] Waited 263 ms on lock 0x7b54003c46d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.733018 (+    67us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":605205760}
I20260925 16:44:34.717871 13141 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:34.746724  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:34.747072  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 812) took 1169 ms. Trace:
I20260925 16:44:34.747583  8975 rpcz_store.cc:276] 0925 16:44:33.577936 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.736387 (+1158451us) service_pool.cc:227] Handling call
0925 16:44:34.736678 (+   291us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.736837 (+   159us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.736864 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:34.746738 (+  9874us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:34.746800 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.746863 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.746987 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:34.747635  9042 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:34.758420  8975 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:34.726648 13305 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:34.760231  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:34.735035 13318 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:34.763747  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 814) took 1185 ms. Trace:
W20260925 16:44:34.767676  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57177.8us
I20260925 16:44:34.769174  8975 rpcz_store.cc:276] 0925 16:44:33.578561 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.748816 (+1170255us) service_pool.cc:227] Handling call
0925 16:44:34.758206 (+  9390us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.763429 (+  5223us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.763672 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:34.770453  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.749593 13246 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.774592  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.775308  9700 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:34.761997  8870 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:34.704803 13340 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.776445  9701 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:34.778544  9700 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 4. Current term is 5. Ops: []
I20260925 16:44:34.764777 13076 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Stepping down as leader of term 4
I20260925 16:44:34.779958 13076 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:34.780052  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.780334 13241 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:44:34.779450  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2653) took 1532 ms. Trace:
I20260925 16:44:34.780928 13076 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.781251  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.782389 13076 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 4 FOLLOWER]: Advancing to term 5
I20260925 16:44:34.783023  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.783601  9118 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:44:34.784731  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 813) took 1206 ms. Trace:
I20260925 16:44:34.785086  8969 rpcz_store.cc:276] 0925 16:44:33.578264 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.350814 (+772550us) service_pool.cc:227] Handling call
0925 16:44:34.784578 (+433764us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b54002ff654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.784677 (+    99us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":26973568}
I20260925 16:44:34.787043  8972 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:34.788775 13114 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:34.789592 13133 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:34.789901 13154 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260925 16:44:34.791445 13370 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.511s	user 0.003s	sys 0.000s
I20260925 16:44:34.792131 13269 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:34.776062 13277 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
W20260925 16:44:34.792979  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1724) took 1496 ms (client timeout 1910 ms). Trace:
I20260925 16:44:34.793768  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.787300 13312 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:34.781484  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.808452  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:34.803666  8974 rpcz_store.cc:269] 0925 16:44:33.296333 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.895596 (+599263us) service_pool.cc:227] Handling call
0925 16:44:34.792813 (+897217us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.792929 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":925621504}
W20260925 16:44:34.793226 13375 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:44:34.814764  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:34.804610  9698 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:34.802304 13269 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:34.814437  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.816341  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:34.816500  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:34.817023  9119 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:34.820139  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:34.781230  9122 rpcz_store.cc:276] 0925 16:44:33.246871 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.255792 (+  8921us) service_pool.cc:227] Handling call
0925 16:44:33.256207 (+   415us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:33.256598 (+   391us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:33.256624 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:33.257095 (+   471us) log.cc:842] Serialized 26 byte log entry
0925 16:44:33.821210 (+564115us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:33.821250 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:33.821331 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:34.650178 (+828847us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:34.775788 (+125610us) raft_consensus.cc:1671] finished
0925 16:44:34.775805 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.779395 (+  3590us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6052,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":142487,"spinlock_wait_cycles":43388800,"thread_start_us":563715,"threads_started":1,"wal-append.queue_time_us":1063771}
I20260925 16:44:34.820977  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:34.827082  8968 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.748s	user 0.009s	sys 0.025s
W20260925 16:44:34.827407  8968 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.819s	user 0.010s	sys 0.026s
I20260925 16:44:34.768906 13157 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.050s
I20260925 16:44:34.828330  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.828979  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.840252 13269 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.841758 13298 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:34.842218 13298 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:34.842576  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.842941 13298 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.851354  8870 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 8, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:34.844729  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.845515  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.846705 13377 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:34.847450  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2281) took 1524 ms. Trace:
I20260925 16:44:34.848585  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1726) took 1531 ms. Trace:
I20260925 16:44:34.858347  8972 rpcz_store.cc:276] 0925 16:44:33.317642 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.569340 (+1251698us) service_pool.cc:227] Handling call
0925 16:44:34.786885 (+217545us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.787397 (+   512us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.848356 (+ 60959us) spinlock_profiling.cc:243] Waited 195 ms on lock 0x7b54002ff650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.848510 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":449397504}
I20260925 16:44:34.849380 13131 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:34.862408  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.844038  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.856272  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:34.855487 13167 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.017s	sys 0.021s
W20260925 16:44:34.865171 13167 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.521s	user 0.017s	sys 0.021s
I20260925 16:44:34.865455  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 786) took 5301 ms. Trace:
W20260925 16:44:34.867133  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58756.9us
I20260925 16:44:34.867647  9115 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:34.868527  9049 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:34.871025  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 110023us
I20260925 16:44:34.871789  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.873301  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.857117  8970 rpcz_store.cc:276] 0925 16:44:33.323322 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.584411 (+1261089us) service_pool.cc:227] Handling call
0925 16:44:34.724950 (+140539us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.749845 (+ 24895us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.749889 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:34.749945 (+    56us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:34.750005 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.750099 (+    94us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.847274 (+ 97175us) spinlock_profiling.cc:243] Waited 130 ms on lock 0x7b54003c3cd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.847381 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3461,"raft.queue_time_us":27266,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":12504,"spinlock_wait_cycles":297865984}
I20260925 16:44:34.876602  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.802872 13095 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.058s
I20260925 16:44:34.824695 13318 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:34.876915  9120 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:34.890811  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1731) took 1568 ms. Trace:
I20260925 16:44:34.841841 13269 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:34.856914 13377 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:34.894105 13095 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:34.876264 13267 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:44:34.895962 13278 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:34.870118 13074 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:34.865849  8968 rpcz_store.cc:276] 0925 16:44:29.563955 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:29.564115 (+   160us) service_pool.cc:227] Handling call
0925 16:44:29.610841 (+ 46726us) raft_consensus.cc:1457] Updating replica for 4 ops
0925 16:44:29.691622 (+ 80781us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:29.691649 (+    27us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0925 16:44:30.508109 (+816460us) log.cc:842] Serialized 532 byte log entry
0925 16:44:31.012691 (+504582us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:31.063661 (+ 50970us) log.cc:842] Serialized 14 byte log entry
0925 16:44:33.939381 (+2875720us) spinlock_profiling.cc:243] Waited 44.7 ms on lock 0x7b18005282e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f
0925 16:44:34.007823 (+ 68442us) log.cc:842] Serialized 14 byte log entry
0925 16:44:34.864882 (+857059us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.865036 (+   154us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:34.865197 (+   161us) raft_consensus.cc:1671] finished
0925 16:44:34.865213 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.865365 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":66402,"prepare.queue_time_us":256824,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":210247,"raft.run_cpu_time_us":274,"raft.run_wall_time_us":91294,"spinlock_wait_cycles":102867328,"thread_start_us":1411796,"threads_started":5,"wal-append.queue_time_us":661592,"wal-append.run_cpu_time_us":4395,"wal-append.run_wall_time_us":1666213}
I20260925 16:44:34.897125 13312 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:34.879966 13087 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:34.899844 13299 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:34.884037 13078 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:34.891302  8973 rpcz_store.cc:276] 0925 16:44:33.322732 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.285269 (+962537us) service_pool.cc:227] Handling call
0925 16:44:34.890634 (+605365us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b54003e8d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:34.890751 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":407965952}
I20260925 16:44:34.902915  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:34.918283  9119 raft_consensus.cc:2396] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 13 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260925 16:44:34.911895  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.887951 13318 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:34.876716 13298 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:34.923614  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:34.947176  9699 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:34.909955 13267 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:34.904040 13095 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:34.953291  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 138561us
I20260925 16:44:34.953955  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:34.961777  9698 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [8.8-10.9]
W20260925 16:44:34.962100  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45941.1us
I20260925 16:44:34.962981  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:34.964211  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52405us
I20260925 16:44:34.965546  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:34.967752  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:34.970443 13153 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:34.970818 13153 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:34.970960 13095 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:34.971625 13153 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:34.972213 13095 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:34.972843 13153 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:34.949633 13271 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:34.945281 13318 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:34.975211  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 787) took 1970 ms. Trace:
I20260925 16:44:34.982080  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.982357  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:34.961617 13267 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:34.979171  9120 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:34.982998  8969 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:34.993521  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.977669  9041 rpcz_store.cc:276] 0925 16:44:33.005269 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.577505 (+572236us) service_pool.cc:227] Handling call
0925 16:44:33.577820 (+   315us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:33.578264 (+   444us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:33.578297 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:33.578761 (+   464us) log.cc:842] Serialized 26 byte log entry
0925 16:44:34.495221 (+916460us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:34.495272 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:34.497066 (+  1794us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:34.974989 (+477923us) raft_consensus.cc:1671] finished
0925 16:44:34.975011 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:34.975150 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":267,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":131,"thread_start_us":916091,"threads_started":1,"wal-append.queue_time_us":1099148}
I20260925 16:44:34.990833  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:34.998206  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:34.998224  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:35.003680  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:35.011595  8970 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:35.002602 13317 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:35.013154 13112 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:35.013230 13317 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:44:35.017491 12666 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:35.017966 12666 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:35.021152 12903 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:34.981823  9049 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "12359c2bff0b46de91daa934c219103c"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:35.022956  9049 raft_consensus.cc:595] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:35.023401  9049 raft_consensus.cc:603] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:35.018952 12666 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.026271 12666 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:35.031746  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.015s	sys 0.032s
I20260925 16:44:35.031850 13278 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260925 16:44:35.031581  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77726.3us
I20260925 16:44:35.032444 13278 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:35.032914 13278 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:35.034209  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:35.032064  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.771s	user 0.015s	sys 0.032s
I20260925 16:44:35.039958 13340 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:35.041967  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60981.9us
I20260925 16:44:34.919628 13299 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.047161  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.057493 13299 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.058700 13268 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:34.996368 13157 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:34.995482 13322 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:35.072029  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.078763  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:35.073889  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.828s	user 0.054s	sys 0.081s
W20260925 16:44:35.222944  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.054s	sys 0.081s
W20260925 16:44:35.083165 13155 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.699s	user 0.009s	sys 0.002s
W20260925 16:44:35.144071 13098 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.744s	user 0.010s	sys 0.000s
W20260925 16:44:35.084430  9117 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.039s	sys 0.030s
I20260925 16:44:35.068506 13167 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
W20260925 16:44:35.218045  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 147369us
I20260925 16:44:35.069062  9116 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:35.074133 13157 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:35.228833  9117 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.906s	user 0.039s	sys 0.034s
I20260925 16:44:35.217288  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:35.231226  9120 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:35.236828  8870 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 10, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:35.245262  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.247054 13271 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:35.252787  9119 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:34.983024 13377 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.265545  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:35.267151  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.217614 13340 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:35.269004  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:35.249241 13272 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.572s	user 0.006s	sys 0.007s
I20260925 16:44:35.268378 13087 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:35.242775 13167 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:35.272692  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.28662e+06us
I20260925 16:44:35.305826  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.228597 13268 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:35.140595 13021 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.282343  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.272217  9699 pending_rounds.cc:76] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 6
I20260925 16:44:35.308642  9699 pending_rounds.cc:97] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 7.7
I20260925 16:44:35.308910  9699 raft_consensus.cc:2866] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:35.252815 13157 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:35.309057  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:35.265312 13092 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260925 16:44:35.266456 13271 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.285872 13340 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.300659  9122 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260925 16:44:35.286440 13266 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:35.298601 13318 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.303017  8972 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:35.304235 13317 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:35.304700 13150 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.767s	user 0.008s	sys 0.008s
I20260925 16:44:35.348979  9045 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:35.274194 13322 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:35.268275 13305 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:35.310374  8967 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
W20260925 16:44:35.328076  9089 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.018s	sys 0.018s
W20260925 16:44:35.328896  9696 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.021s	sys 0.015s
I20260925 16:44:35.315939 13131 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:35.360809  9115 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
W20260925 16:44:35.339109  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.021s
W20260925 16:44:35.339479  9693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.016s	sys 0.016s
W20260925 16:44:35.362761  9693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.583s	user 0.016s	sys 0.016s
W20260925 16:44:35.341889  9118 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.012s	sys 0.020s
W20260925 16:44:35.347795  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.008s	sys 0.015s
I20260925 16:44:35.249862 13155 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.354715  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:35.327814 13189 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.015s	sys 0.021s
I20260925 16:44:35.316267 13268 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:35.328445  8968 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
W20260925 16:44:35.357728  9089 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.742s	user 0.019s	sys 0.018s
W20260925 16:44:35.376632  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 780941us
W20260925 16:44:35.358003  9696 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.763s	user 0.021s	sys 0.015s
I20260925 16:44:35.358364  9698 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:35.358887  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48793.4us
I20260925 16:44:35.322973 13169 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:35.363822  9118 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.533s	user 0.012s	sys 0.020s
W20260925 16:44:35.363912  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.008s	sys 0.015s
W20260925 16:44:35.364108  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.532s	user 0.010s	sys 0.021s
I20260925 16:44:35.383008 13021 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.383308 13271 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.384424 13340 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.385118  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:35.387306  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:35.387784 13039 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:35.388062  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:35.389180  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71950.3us
I20260925 16:44:35.390028  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1221) took 1799 ms. Trace:
I20260925 16:44:35.390460 13092 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:35.375960 13189 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.016s	sys 0.021s
I20260925 16:44:35.373564 13131 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.393102 13150 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:35.394968 13278 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.395920  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:35.465332  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 69487.8us
I20260925 16:44:35.466677  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:35.405797  8971 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.006s	sys 0.031s
I20260925 16:44:35.405248  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:35.414897  9697 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.008s	sys 0.024s
W20260925 16:44:35.470286  9697 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.024s
I20260925 16:44:35.424782 13167 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.423193 13157 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:35.476727 13271 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:35.477234 13271 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:35.435043  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 455404us
I20260925 16:44:35.412460 13326 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:35.439553  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:35.457860  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:35.403797 13265 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:35.438885  9696 rpcz_store.cc:276] 0925 16:44:33.590407 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.838449 (+248042us) service_pool.cc:227] Handling call
0925 16:44:33.889547 (+ 51098us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:33.889796 (+   249us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:44:34.594972 (+705176us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.389696 (+794724us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:35.389750 (+    54us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:35.389802 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.389868 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:35.389973 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10836,"prepare.queue_time_us":886834,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":13874,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":1454655,"threads_started":2}
W20260925 16:44:35.470366  8971 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.006s	sys 0.031s
W20260925 16:44:35.472098  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2283) took 2146 ms (client timeout 2015 ms). Trace:
I20260925 16:44:35.478143  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.438055 13039 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:35.480381  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:35.488818  8967 rpcz_store.cc:269] 0925 16:44:33.325947 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:33.926278 (+600331us) service_pool.cc:227] Handling call
0925 16:44:35.471900 (+1545622us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54003e7954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:35.472018 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3082882944}
I20260925 16:44:35.513430  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:35.515539  9047 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.005s	sys 0.038s
W20260925 16:44:35.516356  9047 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.005s	sys 0.038s
I20260925 16:44:35.527417  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:35.487768 13095 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.004s
I20260925 16:44:35.534767  8870 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 11, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 11 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:35.490023 13157 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:35.530699 13268 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:35.548434 13268 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:35.536574 13167 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:35.550733 13268 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:35.531641 13153 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.558s	user 0.015s	sys 0.000s
I20260925 16:44:35.554383  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:35.555353  9050 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:35.556197 13301 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:35.556865 13301 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.558436  9041 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
W20260925 16:44:35.560420 13398 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:44:35.563050 13271 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:35.564112 13155 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:35.565881 13131 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.569520  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2664) took 1344 ms. Trace:
I20260925 16:44:35.528360 13277 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:35.570873 13277 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:35.571369 13277 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:35.487114 12887 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:35.514604 13265 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.600126 12887 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:35.541617 13318 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:35.517508  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 299514us
I20260925 16:44:35.602172 13377 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:35.602464  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:35.602725 13021 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:35.603042 13265 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.543031 13278 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.544221  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:35.603819 12666 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:35.604323  9044 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:35.560318  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 101650us
I20260925 16:44:35.604437 12666 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.605356  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.533267  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:35.577378  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:35.606719  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:35.576181  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:35.531883  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:35.592006 13401 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260925 16:44:35.592582  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:35.730651  9043 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:35.594676 13301 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:35.514609 13039 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:35.602313 13112 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.002s
W20260925 16:44:35.736253  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 157516us
W20260925 16:44:35.584779  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46986us
I20260925 16:44:35.700925  9123 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:35.478693 13340 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:35.578015  9702 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
W20260925 16:44:35.702349  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 97064.8us
I20260925 16:44:35.703881 12666 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:35.700664 13265 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:35.606175  8870 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 8, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:35.707892 13389 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:35.708684 13131 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
W20260925 16:44:35.701565  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 153909us
I20260925 16:44:35.710497 13021 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:35.724233  9115 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: [5.5-7.6]
I20260925 16:44:35.479838 13150 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.717007  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:35.728930  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:35.807147  9118 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:35.729552  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:35.808137  9122 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:35.729285  8973 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:35.514850 13169 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:35.569996  9121 rpcz_store.cc:276] 0925 16:44:34.224856 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.277655 (+ 52799us) service_pool.cc:227] Handling call
0925 16:44:34.277924 (+   269us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:34.760386 (+482462us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.760427 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:34.806181 (+ 45754us) log.cc:842] Serialized 26 byte log entry
0925 16:44:35.399081 (+592900us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:35.399113 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.399168 (+    55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:35.569289 (+170121us) raft_consensus.cc:1671] finished
0925 16:44:35.569317 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:35.569454 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":613,"raft.queue_time_us":61380,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":8555,"thread_start_us":1049104,"threads_started":2,"wal-append.queue_time_us":658241}
I20260925 16:44:35.487254 13326 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:35.742695  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:35.745615  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:35.767951  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.773532  9698 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:35.710239 13159 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260925 16:44:35.823300  9120 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:35.826170  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:35.828464  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:35.829203  9043 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
I20260925 16:44:35.779810  9123 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260925 16:44:35.830880  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2291) took 2502 ms. Trace:
I20260925 16:44:35.831359  8966 rpcz_store.cc:276] 0925 16:44:33.328129 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.624552 (+1296423us) service_pool.cc:227] Handling call
0925 16:44:34.663891 (+ 39339us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:34.664184 (+   293us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.664225 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:34.688559 (+ 24334us) log.cc:842] Serialized 26 byte log entry
0925 16:44:35.398760 (+710201us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:35.781907 (+383147us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.830581 (+ 48674us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.830645 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:35.830699 (+    54us) raft_consensus.cc:1671] finished
0925 16:44:35.830716 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:35.830820 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":36396,"thread_start_us":1021269,"threads_started":2,"wal-append.queue_time_us":868382}
W20260925 16:44:35.780927  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56076.7us
I20260925 16:44:35.719973  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2502) took 1855 ms. Trace:
I20260925 16:44:35.792726  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:35.834858  9696 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:35.723361 13153 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:44:35.795070  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 274704us
W20260925 16:44:35.802909  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.557s	user 0.050s	sys 0.042s
I20260925 16:44:35.829111  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:35.837702  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.051s	sys 0.042s
I20260925 16:44:35.831099  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.725103 13068 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:35.805233  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 84825.3us
I20260925 16:44:35.576890 13047 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.195s
I20260925 16:44:35.852136  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:35.791499 13278 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:35.793915 13272 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:35.833894  9117 rpcz_store.cc:276] 0925 16:44:33.853533 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.175396 (+321863us) service_pool.cc:227] Handling call
0925 16:44:34.175753 (+   357us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:34.322442 (+146689us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:35.253326 (+930884us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.708240 (+454914us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.708575 (+   335us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:35.708622 (+    47us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:35.708676 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.709233 (+   557us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540010c554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:35.709271 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:35.709377 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41638,"prepare.queue_time_us":177060,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":60,"raft.queue_time_us":174,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":44289,"spinlock_wait_cycles":356110080,"thread_start_us":1254831,"threads_started":2}
W20260925 16:44:35.877713  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 109857us
W20260925 16:44:35.877900  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46882.9us
I20260925 16:44:35.860713  8870 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 8, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:35.834110 13092 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:35.834542 13021 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:35.893764  9044 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:35.843340 13340 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:35.897372  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:35.844807 13153 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:35.815860 13299 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.080s
I20260925 16:44:35.905853  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:35.903672  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.905383  8870 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 7, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 7 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:44:35.876397 13385 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:35.816717 13265 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:35.911904  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:35.912633  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60630.4us
I20260925 16:44:35.912688  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:35.887455 13397 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260925 16:44:35.889271 13095 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:35.887203 12903 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:35.931746  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 102712us
I20260925 16:44:35.933519  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 808) took 2362 ms. Trace:
I20260925 16:44:35.935386  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:35.932850  8870 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 10 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:35.951747  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.933658  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:36.044394  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:35.917093 13153 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:35.921636 13169 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:35.912197 13047 consensus_queue.cc:1225] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 8.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:44:35.920562 13159 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:35.865888 13068 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.887487 13278 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:35.921994 13385 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:35.926524 13340 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:36.062429  8870 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 10, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:44:36.092355  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 190632us
I20260925 16:44:36.095963 13301 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260925 16:44:36.097015 13318 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:36.099594 13271 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:36.100251 13426 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:36.099867 13021 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.073848 13169 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.074153 13159 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:36.054147 12666 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:36.104009  8872 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 218) took 41501 ms (client timeout 15000 ms). Trace:
I20260925 16:44:36.104533 13068 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.106482 13278 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.109529 13272 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:35.934372  8971 rpcz_store.cc:276] 0925 16:44:33.571602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.726118 (+1154516us) service_pool.cc:227] Handling call
0925 16:44:34.726368 (+   250us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:34.755880 (+ 29512us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.755910 (+    30us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:34.761781 (+  5871us) log.cc:842] Serialized 52 byte log entry
0925 16:44:34.845825 (+ 84044us) spinlock_profiling.cc:243] Waited 7.74 ms on lock 0x7b480024c258. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:35.534108 (+688283us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:35.921224 (+387116us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.921547 (+   323us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.921641 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:35.921680 (+    39us) raft_consensus.cc:1671] finished
0925 16:44:35.933291 (+ 11611us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:35.933464 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15110,"raft.queue_time_us":22714,"raft.run_cpu_time_us":2569,"raft.run_wall_time_us":93546,"spinlock_wait_cycles":17811200,"thread_start_us":959406,"threads_started":2,"wal-append.queue_time_us":971666}
I20260925 16:44:36.115682  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:36.117576 13385 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:36.166167  8870 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:36.044930 13095 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.128996  9118 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:36.164726 13408 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.167724 13159 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:36.162233 13426 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:36.276089  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 324420us
I20260925 16:44:36.168234 13169 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:36.166111 13390 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.253706  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:36.084944 13087 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.175s
I20260925 16:44:36.255107 13278 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.105072 13039 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.282888  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:36.283052  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 167466us
I20260925 16:44:36.308925  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:36.220592 13189 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.229283 13272 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.118239 13299 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
W20260925 16:44:36.294914  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 362218us
I20260925 16:44:36.257068 13388 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:36.284312 13167 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.735s	user 0.011s	sys 0.000s
I20260925 16:44:36.310376  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:36.260198 13271 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:36.276872 13150 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:36.275493 12666 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260925 16:44:36.319757  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 438211us
I20260925 16:44:36.274340 13157 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:36.304337 13377 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.004s
I20260925 16:44:36.282413 13426 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:36.303071 13155 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:36.301684 13407 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:36.307960 13326 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:36.355666  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 102052us
I20260925 16:44:36.319271 13272 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:36.319350 13299 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:36.366812  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:36.293467  8870 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 6. New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:44:36.377614  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.002s	sys 0.024s
W20260925 16:44:36.379470  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.002s	sys 0.025s
I20260925 16:44:36.380084  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:36.385308  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:36.296002 13408 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.355295 13131 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:36.313436 13278 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.362440 13155 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:36.377137 13267 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.376s	user 0.011s	sys 0.001s
I20260925 16:44:36.404206  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.376502 13326 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.309996 13390 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.407075  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:36.379561 13298 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.406766  8870 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:44:36.410146  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53555.4us
I20260925 16:44:36.482663  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:36.354384 13150 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260925 16:44:36.399778 13265 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:36.383251 13377 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260925 16:44:36.492046  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79478.2us
I20260925 16:44:36.410144  9697 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 5: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:36.471550  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 71195.6us
I20260925 16:44:36.351975 13157 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.396888 13266 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:36.471117  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 160791us
I20260925 16:44:36.335492 13189 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.359753 13340 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.532006 13266 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.513752 13278 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:36.533198 13410 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.369s	user 0.000s	sys 0.001s
I20260925 16:44:36.525763 12887 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:36.490259 13277 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.918s	user 0.004s	sys 0.007s
I20260925 16:44:36.534232  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:36.534550  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 965) took 1461 ms. Trace:
I20260925 16:44:36.482194 13068 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:36.535192 13068 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.534750 13277 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.535372  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:36.535605 13068 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:36.535933 13408 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:36.536509  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:36.536916 13277 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.537456 13277 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:36.538513 13389 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.481966 13298 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.538537  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:36.481045  9701 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.702s	user 0.009s	sys 0.000s
I20260925 16:44:36.473160 13167 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:36.541121  9701 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:36.521508  8870 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:36.497414  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.531288  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1038) took 1614 ms. Trace:
I20260925 16:44:36.365803 13407 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:36.553134  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 231407us
I20260925 16:44:36.406509 13413 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:36.341651 13388 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.490283 13318 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:36.569739  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:36.482353 13112 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:36.547542 13167 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.548027 13092 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:36.530718 13301 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.520303 13039 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:36.513114 13427 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
W20260925 16:44:36.521028 13420 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260925 16:44:36.551314 13298 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:36.202487  8872 rpcz_store.cc:269] 0925 16:43:54.434099 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:43:54.434244 (+   145us) service_pool.cc:227] Handling call
0925 16:43:55.244754 (+810510us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:44:35.927930 (+40683176us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:44:24.282982 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:44:24.283549 (+   567us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:44:24.283596 (+    47us) write_op.cc:435] Acquired schema lock
0925 16:44:24.283614 (+    18us) tablet.cc:660] Decoding operations
0925 16:44:24.284515 (+   901us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:44:24.284601 (+    86us) write_op.cc:641] Partition lock acquired for write op
0925 16:44:24.284640 (+    39us) tablet.cc:683] Acquiring locks for 8 operations
0925 16:44:24.285321 (+   681us) tablet.cc:699] Row locks acquired
0925 16:44:24.285356 (+    35us) write_op.cc:260] PREPARE: finished
0925 16:44:24.285542 (+   186us) write_op.cc:270] Start()
0925 16:44:24.285670 (+   128us) write_op.cc:276] Timestamp: P: 1790354664285448 usec, L: 0
0925 16:44:24.285705 (+    35us) op_driver.cc:331] REPLICATION: starting
0925 16:44:24.374631 (+ 88926us) log.cc:842] Serialized 3281 byte log entry
0925 16:44:25.322196 (+947565us) op_driver.cc:444] REPLICATION: finished
0925 16:44:25.720834 (+398638us) write_op.cc:301] APPLY: starting
0925 16:44:25.720936 (+   102us) tablet.cc:1365] starting BulkCheckPresence
0925 16:44:25.721580 (+   644us) tablet.cc:1368] finished BulkCheckPresence
0925 16:44:25.721696 (+   116us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:44:25.722382 (+   686us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:44:25.722690 (+   308us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=16
0925 16:44:25.722735 (+    45us) write_op.cc:312] APPLY: finished
0925 16:44:25.723087 (+   352us) log.cc:842] Serialized 65 byte log entry
0925 16:44:25.723237 (+   150us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:25.723354 (+   117us) write_op.cc:454] Released schema lock
0925 16:44:25.723396 (+    42us) write_op.cc:341] FINISH: Updating metrics
0925 16:44:25.723969 (+   573us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:25.724000 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":13308,"mutex_wait_us":2481944,"reported_tablets":37,"spinlock_wait_cycles":436371200,"child_traces":[["op",{"apply.queue_time_us":398315,"apply.run_cpu_time_us":3254,"apply.run_wall_time_us":3533,"num_ops":8,"prepare.queue_time_us":675300,"prepare.run_cpu_time_us":17045,"prepare.run_wall_time_us":167266,"raft.queue_time_us":537932,"raft.run_cpu_time_us":21739,"raft.run_wall_time_us":235889,"replication_time_us":1036400,"thread_start_us":880379,"threads_started":4,"wal-append.queue_time_us":144232,"wal-append.run_cpu_time_us":41351,"wal-append.run_wall_time_us":2214144}]]}
I20260925 16:44:36.539953  9041 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:36.552232  9045 raft_consensus.cc:1203] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Deduplicated request from leader. Original: 5.5->[7.6-7.6]   Dedup: 7.6->[]
I20260925 16:44:36.556908  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:36.534897  9116 rpcz_store.cc:276] 0925 16:44:35.073078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:35.249945 (+176867us) service_pool.cc:227] Handling call
0925 16:44:35.250300 (+   355us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:35.250539 (+   239us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:35.250581 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:35.251038 (+   457us) log.cc:842] Serialized 26 byte log entry
0925 16:44:35.529026 (+277988us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:35.529058 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.529124 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:36.534379 (+1005255us) raft_consensus.cc:1671] finished
0925 16:44:36.534398 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:36.534502 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":224304,"threads_started":1,"wal-append.queue_time_us":655902}
I20260925 16:44:36.531577  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2627) took 1815 ms. Trace:
I20260925 16:44:36.539012 13389 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.566455  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:36.532096 12787 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.534147 13266 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.537868 13277 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.576058  9050 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:36.613867  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57069.9us
I20260925 16:44:36.471390 13412 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:36.575495  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:36.480852 13095 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.579824  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.620700  9701 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:36.620769  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.534732 12887 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:36.543257  9695 rpcz_store.cc:276] 0925 16:44:34.916558 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.916684 (+   126us) service_pool.cc:227] Handling call
0925 16:44:34.916985 (+   301us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:34.920106 (+  3121us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.920147 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:34.963423 (+ 43276us) log.cc:842] Serialized 52 byte log entry
0925 16:44:35.435609 (+472186us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:35.887050 (+451441us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.888555 (+  1505us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.889277 (+   722us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:36.531082 (+641805us) raft_consensus.cc:1671] finished
0925 16:44:36.531102 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:36.531235 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2708,"prepare.queue_time_us":905557,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":5612,"raft.queue_time_us":4250,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":20004,"thread_start_us":873069,"threads_started":2,"wal-append.queue_time_us":1371263}
I20260925 16:44:36.533236 13278 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:36.564965 13418 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260925 16:44:36.529094 13157 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.512460 13155 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:36.591202  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:36.558315 13377 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.588696 13092 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:36.635936  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 153341us
I20260925 16:44:36.487223 13271 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.593554  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:36.574496 13318 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:36.594257 13301 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.559559 13390 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:36.470649 13267 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.604365  9045 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: [7.6-7.6]
I20260925 16:44:36.596172  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 961) took 1756 ms. Trace:
I20260925 16:44:36.601052 13441 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:36.608035  8870 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 10, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:36.612438  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.618053  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:36.619596  9048 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:36.625749  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:36.622087  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.600585  9047 rpcz_store.cc:276] 0925 16:44:34.716474 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.719247 (+  2773us) service_pool.cc:227] Handling call
0925 16:44:34.728009 (+  8762us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:34.736690 (+  8681us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.736716 (+    26us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:34.950114 (+213398us) spinlock_profiling.cc:243] Waited 7.32 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:34.966718 (+ 16604us) log.cc:842] Serialized 52 byte log entry
0925 16:44:35.529807 (+563089us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:35.846256 (+316449us) log.cc:842] Serialized 14 byte log entry
0925 16:44:35.846419 (+   163us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.846505 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:36.410111 (+563606us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b1800374a40. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:36.531322 (+121211us) raft_consensus.cc:1671] finished
0925 16:44:36.531352 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:36.531508 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5087,"prepare.queue_time_us":20704,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":73257,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":18619,"spinlock_wait_cycles":267447808,"thread_start_us":865491,"threads_started":2,"wal-append.queue_time_us":967332}
W20260925 16:44:36.625119  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 58762.7us
I20260925 16:44:36.568810 13413 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:36.636945  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45803.5us
I20260925 16:44:36.653939  9697 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 5.
I20260925 16:44:36.628854  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:36.638044 13412 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:36.620803 13153 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260925 16:44:36.658377  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:36.491420 13299 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.670828  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:36.676615  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:36.677310  9048 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:36.677747  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:36.663602  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:36.626533 13430 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:36.629936 13427 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:36.639344 13265 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:36.635991 13442 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:36.652082  9124 rpcz_store.cc:276] 0925 16:44:34.839641 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:34.884627 (+ 44986us) service_pool.cc:227] Handling call
0925 16:44:34.905186 (+ 20559us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:34.912592 (+  7406us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:34.912633 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:34.913088 (+   455us) log.cc:842] Serialized 26 byte log entry
0925 16:44:35.438803 (+525715us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:35.438945 (+   142us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.439231 (+   286us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:36.595626 (+1156395us) raft_consensus.cc:1671] finished
0925 16:44:36.595660 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:36.596105 (+   445us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27328,"raft.queue_time_us":7095,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5328,"thread_start_us":477619,"threads_started":1,"wal-append.queue_time_us":1344493}
I20260925 16:44:36.642616 13318 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:36.498919 13326 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.617761 12787 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.670212 13157 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:36.640972 13377 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:36.683143  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:36.680068  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.005s	sys 0.011s
I20260925 16:44:36.681540  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:36.743325  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60265.3us
I20260925 16:44:36.743665  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.681937  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:36.743363  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.005s	sys 0.011s
I20260925 16:44:36.745088  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2633) took 1223 ms. Trace:
I20260925 16:44:36.693544 13092 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.748522  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:36.686143 13416 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260925 16:44:36.690532  9043 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:36.644119 13440 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:36.693192  8870 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 14, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:36.696766  9041 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260925 16:44:36.636206 13278 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:36.674690  9666 connection.cc:232] RPC call timeout handler was delayed by -2.216122680999888s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17620000000000002s for a response
I20260925 16:44:36.670202 13434 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.683265  9047 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:36.670279 13095 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:36.682755 13430 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:36.756510  8870 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 9, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 9 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:36.690824 13078 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:36.677974 13437 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.686802  9044 raft_consensus.cc:595] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:36.745460  9049 rpcz_store.cc:276] 0925 16:44:35.521534 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:35.523362 (+  1828us) service_pool.cc:227] Handling call
0925 16:44:35.523803 (+   441us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:35.524067 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:35.524103 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:35.524604 (+   501us) log.cc:842] Serialized 26 byte log entry
0925 16:44:35.884395 (+359791us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:35.884478 (+    83us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.884626 (+   148us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:36.744888 (+860262us) raft_consensus.cc:1671] finished
0925 16:44:36.744908 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:36.745032 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":358723,"threads_started":1,"wal-append.queue_time_us":548727}
I20260925 16:44:36.680408 13153 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.689208  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:36.760468  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.704670 13157 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.702909 13265 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:36.765364  9120 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260925 16:44:36.749204  9050 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:36.771343  9117 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 4.
I20260925 16:44:36.789325  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:36.774914  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 93465.2us
I20260925 16:44:36.760017 13430 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:36.793264 13451 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:36.769354 13268 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:36.775947 13407 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.776400 13167 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:36.804147  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:36.804975  9122 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:36.776553 13301 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.778179  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1041) took 1526 ms. Trace:
I20260925 16:44:36.755959 13087 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:36.778927 13428 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260925 16:44:36.788049  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 98930.6us
I20260925 16:44:36.786793  9698 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:36.781432  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.789587  8870 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 11, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 11 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:44:36.828538  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74425.8us
I20260925 16:44:36.772234 13434 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.791356  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.792436 12903 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260925 16:44:36.793169  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:36.775095 13159 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.751753 13305 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:36.778107 13387 consensus_queue.cc:1159] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 7 status { last_received { term: 7 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 7 index: 5 } }
I20260925 16:44:36.817601 13442 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:36.672057 13441 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.819842  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.821836  9702 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:36.806352  9699 rpcz_store.cc:276] 0925 16:44:35.252384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:35.252508 (+   124us) service_pool.cc:227] Handling call
0925 16:44:35.272048 (+ 19540us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:35.320972 (+ 48924us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:35.321004 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:35.321401 (+   397us) log.cc:842] Serialized 26 byte log entry
0925 16:44:35.814581 (+493180us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:35.814632 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:35.814711 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:36.777955 (+963244us) raft_consensus.cc:1671] finished
0925 16:44:36.777972 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:36.778123 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":439818,"threads_started":1,"wal-append.queue_time_us":1162010}
I20260925 16:44:36.832427  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.845021  9123 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:36.780443 13131 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.789024 13157 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:36.794181 13047 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.787937 13074 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.836846  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.789351 13189 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:36.829780  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:36.837881  8870 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 8, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:44:36.836910  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43840.8us
I20260925 16:44:36.823321 13412 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:36.847854 13407 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:36.856737  9694 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:36.819911 13265 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:36.826145 13436 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.826136 13428 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.835418 12903 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.867722  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.761915 13095 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.844753 13389 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.884436  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.864578 13047 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.788106 13437 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.831823 13268 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.932837  9699 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
W20260925 16:44:36.916988  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 122924us
I20260925 16:44:36.946794  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:36.879678  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.762s (SENT) [suppressed 20 similar messages]
I20260925 16:44:36.943990 13456 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:36.843766 13305 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.834481 13087 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.885865 13267 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:36.883227 13169 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.576s	user 0.006s	sys 0.003s
I20260925 16:44:36.934278 12903 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 5 FOLLOWER]: Advancing to term 6
W20260925 16:44:36.980305  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146256us
I20260925 16:44:36.983799  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.857120 13131 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.993520  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.882896 13407 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:36.876063 13021 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:36.883889 13449 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:36.994582  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.886799 13428 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:36.848961 13450 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.135s
I20260925 16:44:36.937223 13189 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.000481  9699 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:36.976672 13444 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260925 16:44:36.997969  9695 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:36.956699 13271 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.004144  9120 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:36.821035 13427 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.017663  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:36.996753 13301 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:36.937960 13112 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.065s
I20260925 16:44:37.003364 13407 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:36.997771 13446 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:36.996526 12787 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.019969  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:36.999080 13426 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.636s	user 0.006s	sys 0.008s
I20260925 16:44:36.882536 13074 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.026219  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.027164 13159 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:37.027671 13278 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:36.994580 13413 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.029745  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.009431 13326 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.039861 13448 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.048175 13448 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.048751 13439 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:37.016748 13189 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.049295 13439 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.050354 13448 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.017351 13443 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.018273 13377 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:37.051054 13439 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.028610 13153 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:37.051445 13435 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260925 16:44:37.052058 13447 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.203s	user 0.000s	sys 0.001s
I20260925 16:44:37.052289 13435 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.052667 13435 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:37.023759 13301 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.053210 13322 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.053412 13301 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:37.053732 13322 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:37.054935 13385 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.786s	user 0.005s	sys 0.005s
I20260925 16:44:37.056077 13322 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.056433 13078 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:37.056763  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:36.999476 13169 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.020326 13271 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.058346 13305 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.058699 13271 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.059322 13169 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.060087  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.060695  9049 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:37.061834  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:37.062016 13074 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.051520 13189 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.053035 13434 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.067607  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:36.931134 13436 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.064064  9120 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
W20260925 16:44:37.077844  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43662.5us
I20260925 16:44:37.079671  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:37.086253  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.086445  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.086597  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.088060  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.090848  9700 raft_consensus.cc:2396] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260925 16:44:37.088727  9695 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:37.087004 13271 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:37.096799 13095 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.003054 13442 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.101693 13436 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.101492 13301 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.051086 13443 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.103467 13301 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.076102 13153 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.010676 13449 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:36.995229 13456 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.107512  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.119743  9695 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:37.119836  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.121156  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.106921  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.055332 13385 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.014472 13265 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.123339  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.125178  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:37.125626  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 245969us
I20260925 16:44:37.121893  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:37.091461 13440 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:37.117070 13068 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.002s
I20260925 16:44:37.094568 13434 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:37.130805  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:37.042176 13426 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.110567 13443 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.137527  9123 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.150288  9117 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:37.152846  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.154165  8967 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260925 16:44:37.159147  9697 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:37.161314 13385 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.149863 13068 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.164237 13068 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.164949 13047 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.166200 13157 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.168592 13157 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.170476 13131 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:37.173269 13272 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.002s
I20260925 16:44:37.173745 13272 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.176008 13268 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.119208 13153 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.178560 13153 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.128363 13450 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:37.179271 13450 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:37.180481  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58684.3us
I20260925 16:44:37.191510  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.193215  8966 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:37.193408  9046 raft_consensus.cc:2354] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:37.128558 13021 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.195138  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.196565  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.198123  9050 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
W20260925 16:44:37.182906 13406 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:44:37.200150  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:37.200562  9118 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:37.199350  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.234139  9041 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:37.199350  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.202984  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.234900  9699 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:37.232273  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:37.232420  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:37.153004 13389 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:37.188674 13450 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:37.189513 13441 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.194298 13434 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.242301  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.248924  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.249698  9695 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:37.252408  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.253417  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.254096  8973 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:37.240104 13268 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.256762  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.258502  9698 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260925 16:44:37.259187  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.260067  9700 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:37.261652 12903 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.263877 12903 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.267585  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.268527  9693 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.271680  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.272369  9701 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:37.272029 13268 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.274610 13268 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.257822  9119 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:37.280726 13388 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.281148  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:37.274758  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.276926  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.231787 13153 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
W20260925 16:44:37.284199 12887 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.655s	user 0.010s	sys 0.000s
I20260925 16:44:37.285167 13153 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:37.285532 13153 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:37.286432  9699 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:37.286298 13153 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.247998 13440 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.287240  9700 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:37.248632 13389 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.289508 13269 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.289992 13269 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.287532 13153 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.290522 13277 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.292683 13456 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.293349 13021 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.250422 13443 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:37.296301  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.297000  8971 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:37.279054  9693 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:37.297031 13426 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:37.248008 13468 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:37.298123 13468 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.298518 13468 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:37.298857  9701 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
W20260925 16:44:37.300733 13318 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.596s	user 0.002s	sys 0.006s
I20260925 16:44:37.301155 13318 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.303108 13318 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:37.289072 13389 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.277173 13449 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.307340  9116 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.248096 13437 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.247237 13272 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.244539 13087 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.309928 13092 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:37.309297 13431 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:37.310084 13434 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.311271  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.311748  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.312160  9050 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:37.312974  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.312170  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2679) took 1431 ms. Trace:
I20260925 16:44:37.314400  9115 rpcz_store.cc:276] 0925 16:44:35.880871 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:35.881008 (+   137us) service_pool.cc:227] Handling call
0925 16:44:37.311983 (+1430975us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b5400166054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:37.312107 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2815010048}
I20260925 16:44:37.319796  9041 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:37.321596  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.322252  9041 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:37.323774  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.324050  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:37.324687  9701 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:37.324012  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.327248  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.327610  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:37.333096  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:37.333818  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:37.338023  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:37.338852  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:37.342790  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.343396 13301 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:37.344270 13068 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:37.344761 13068 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.345465  9693 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.345566 13068 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.346915 13301 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:37.348151 13131 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:37.337198 13437 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:37.353485  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.357110 13407 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.335625 13442 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:37.337028 13272 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:37.383824  9050 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:37.337003 13436 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:37.389744 13436 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.389537 13318 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:37.390098 13436 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.390563 13318 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:37.390882 13318 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:37.391932 13131 consensus_queue.cc:1225] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 8.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:44:37.391654 13318 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.392422 13131 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:37.392900 13318 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.393810 12787 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:37.394217 12787 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.395942 13272 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:37.394949 12787 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.400924 12787 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.401491  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.402226  9050 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:37.382158 13301 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.403326 13301 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.404409 13301 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.404786 13407 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.392911 13131 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.409430 13131 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.381387 13446 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:37.416699 13446 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:37.417910 13446 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.381263 13449 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:37.420001 13449 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.420460 13449 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.423535  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.376173 13277 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:44:37.429812  9050 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:37.386907 13442 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.440701  9693 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.441174  9041 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:44:37.437573  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.434161  9695 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:37.336915 13150 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.091s
I20260925 16:44:37.426950 13428 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.443929 13442 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:37.454187  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.454701  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.453999  8973 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:37.456449 13159 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:37.463904 13159 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:37.464847 13159 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.466514  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.467022  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.467607  8971 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:37.396895 13272 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.470788  8969 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:37.471467 13450 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:37.476411 13451 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.683s	user 0.006s	sys 0.002s
I20260925 16:44:37.476873 13451 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:37.473711  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.480384  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:37.483071  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.484136 13150 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:37.486272  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.486829  8969 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:37.495913  8969 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:37.509825  8969 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.519106  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.519820  8973 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:37.521148  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.522294  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.522974  8974 raft_consensus.cc:2354] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:44:37.523241  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.523860  8970 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.524207  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.525290  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.525928  8974 raft_consensus.cc:2354] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:44:37.526613  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.527169  8974 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:37.522384  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.528242  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.528926  8971 raft_consensus.cc:2354] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9.
I20260925 16:44:37.528836  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.529735  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.529912  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.530293  8971 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:37.530547  8968 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:37.531049  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.531230  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:37.531534  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2636) took 2000 ms (client timeout 2055 ms). Trace:
W20260925 16:44:37.531965  9042 rpcz_store.cc:269] 0925 16:44:35.531100 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:35.531212 (+   112us) service_pool.cc:227] Handling call
0925 16:44:37.531360 (+2000148us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54000d48d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:37.531483 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2372419328}
I20260925 16:44:37.532537  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.533226  8969 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:37.533077  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.532152  8970 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:37.533845 13468 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.531606  8971 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:37.534976  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.535441  8969 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 6 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260925 16:44:37.535528  8968 raft_consensus.cc:2354] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:44:37.536175  8974 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 9 because replica has last-logged OpId of term: 7 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260925 16:44:37.539208  8973 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:37.539921  8970 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:37.541034 13468 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.541035 13271 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:37.542980  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.543303 13271 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.543635  8971 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:37.550160  8971 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:37.551385  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.552996  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.549963 13271 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.551000  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.556689 13271 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.553721  8974 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:37.557996  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.558599  8974 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:37.554773  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.560678  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.553722  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40140 (request call id 40) took 1689 ms. Trace:
I20260925 16:44:37.561242  9044 rpcz_store.cc:276] 0925 16:44:35.864015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:35.864206 (+   191us) service_pool.cc:227] Handling call
0925 16:44:37.553585 (+1689379us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54000d48d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:37.553666 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1788362112}
I20260925 16:44:37.561983  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:37.562518  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.563678  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.564038  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.565215  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.565310  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.561246  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.567389  8971 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:37.568146  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.568782  8971 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:37.569427  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 3 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.570189  8971 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:37.572398  8971 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260925 16:44:37.573625  8971 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: [7.8-9.9]
I20260925 16:44:37.559396  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.579340  8974 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:37.576437  9044 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:37.566243  8973 raft_consensus.cc:2354] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:44:37.582890  8969 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:37.584177  8974 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:37.584501  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:37.581823  8968 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:37.583600  8973 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260925 16:44:37.586393 13467 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:37.599200 13472 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:37.599867 13472 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.602286  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:37.610639  8973 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.613801  9044 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.615334  9044 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:37.616706 13299 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:37.678658 13442 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.681010 13442 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.711753  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:37.462370 13436 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.738062  9042 raft_consensus.cc:2354] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10.
I20260925 16:44:37.739632  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:37.740477 13098 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:37.741390 13436 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.798934  9042 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:37.803604  9042 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:37.813578  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:37.814338  9124 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:37.821589  9124 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:37.824147  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.824961 13442 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:37.825660 13442 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:37.826551 13442 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.852005  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.854559 13407 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:37.856909 13467 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:37.856845 13407 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:37.857501 13467 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:37.858315 13467 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.859678 13407 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:37.864738  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:37.856073  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.865934  9697 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 5 FOLLOWER]: Advancing to term 6
I20260925 16:44:37.870034  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2687) took 1086 ms. Trace:
I20260925 16:44:37.870533  9697 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:37.870404  9122 rpcz_store.cc:276] 0925 16:44:36.783335 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:36.806656 (+ 23321us) service_pool.cc:227] Handling call
0925 16:44:37.869756 (+1063100us) spinlock_profiling.cc:243] Waited 383 ms on lock 0x7b540019c3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:37.869981 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":882008448}
I20260925 16:44:37.872546 13437 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:37.880538  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.880864  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:37.881132  9697 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:37.881517  9694 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:37.882319  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.883028 13087 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader election won for term 6
I20260925 16:44:37.883477 13087 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:37.884397 13087 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.890749  9045 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:37.891629  9697 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:37.893101  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.894119 13437 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:37.894608 13437 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:37.895301 13437 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.896238  9701 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:37.896763  9694 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:37.897905  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:37.898726 13271 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:37.899217 13271 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:37.900085 13271 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.927162  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:37.927840  9124 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:37.928742  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.929369  9122 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:37.467157 13021 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.462s
I20260925 16:44:37.930378  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.932304  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.932936  9118 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:37.936059  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:37.936506  9118 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:37.938205  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:37.504827 13451 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:37.953029 13451 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:37.953639 13430 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.161s	user 0.008s	sys 0.002s
I20260925 16:44:37.953946 13430 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:37.954478 13451 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:37.955330 13430 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:37.961937 13269 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:38.499861 13318 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.107s	user 0.008s	sys 0.010s
I20260925 16:44:38.508827  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:38.515074 13450 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:38.546414 12666 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:38.547272 12666 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:38.553042 12666 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:39.371160  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.372238  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2546) took 1444 ms. Trace:
I20260925 16:44:39.372625  9115 rpcz_store.cc:276] 0925 16:44:37.927463 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:39.370758 (+1443295us) service_pool.cc:227] Handling call
0925 16:44:39.372176 (+  1418us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:39.374315  8996 debug-util.cc:398] Leaking SignalData structure 0x7b0800301e20 after lost signal to thread 7803
W20260925 16:44:39.374787  8996 debug-util.cc:398] Leaking SignalData structure 0x7b080002ed60 after lost signal to thread 7806
W20260925 16:44:39.382612  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.89092e+06us
W20260925 16:44:39.456246  9124 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.528s	user 0.008s	sys 0.010s
I20260925 16:44:39.456663  9124 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:44:39.457194  9124 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2543) took 1530 ms (client timeout 1867 ms). Trace:
W20260925 16:44:39.458563  9124 rpcz_store.cc:269] 0925 16:44:37.926654 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.926841 (+   187us) service_pool.cc:227] Handling call
0925 16:44:39.457134 (+1530293us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:39.459522  9050 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.970s	user 0.016s	sys 0.015s
I20260925 16:44:39.459875  9050 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:39.460486  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 802) took 2028 ms (client timeout 1674 ms). Trace:
W20260925 16:44:39.460711  9050 rpcz_store.cc:269] 0925 16:44:37.431912 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.478676 (+ 46764us) service_pool.cc:227] Handling call
0925 16:44:39.460410 (+1981734us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:39.491097  9123 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 8
I20260925 16:44:39.495755  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:39.499603  8972 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Committing config change with OpId 4.5: config changed from index 3 to 5, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:39.508697  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 826) took 2042 ms. Trace:
I20260925 16:44:39.508981  8972 rpcz_store.cc:276] 0925 16:44:37.466420 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.528318 (+ 61898us) service_pool.cc:227] Handling call
0925 16:44:39.495943 (+1967625us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:44:39.496157 (+   214us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:39.496526 (+   369us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:39.496553 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:39.497565 (+  1012us) log.cc:842] Serialized 590 byte log entry
0925 16:44:39.499484 (+  1919us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:39.508086 (+  8602us) log.cc:842] Serialized 14 byte log entry
0925 16:44:39.508287 (+   201us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.508353 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:39.508386 (+    33us) raft_consensus.cc:1671] finished
0925 16:44:39.508472 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:39.508624 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6885376,"thread_start_us":1661,"threads_started":1,"wal-append.queue_time_us":1959}
I20260925 16:44:39.530373 13268 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.530885 13268 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.533384 13268 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:39.538784 13431 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:39.540926  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1756) took 2013 ms. Trace:
I20260925 16:44:39.541321  8970 rpcz_store.cc:276] 0925 16:44:37.527422 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.534251 (+  6829us) service_pool.cc:227] Handling call
0925 16:44:37.539738 (+  5487us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:37.540363 (+   625us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.540731 (+2000368us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b540038d450. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.540870 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11839872}
I20260925 16:44:39.539340 13431 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.545251 13431 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:39.546932 13431 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.547473 13431 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.549693 13431 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:39.554713 13511 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.555927 13511 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.558084 13510 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:39.558207 13511 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.559032 13511 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:39.558717 13510 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.559592 13511 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.562673 13511 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.563764 13510 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:39.564239 13511 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.564859  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 794) took 2177 ms. Trace:
I20260925 16:44:39.565028 13511 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.565227  9041 rpcz_store.cc:276] 0925 16:44:37.387635 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.387777 (+   142us) service_pool.cc:227] Handling call
0925 16:44:37.392041 (+  4264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:37.441697 (+ 49656us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.564624 (+2122927us) spinlock_profiling.cc:243] Waited 48.7 ms on lock 0x7b54002a2e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:39.564809 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112011008}
I20260925 16:44:39.567142 13511 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.567685 13511 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:39.568195 13511 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.568717  9695 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:39.569314  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 893) took 1680 ms. Trace:
I20260925 16:44:39.569599  9695 rpcz_store.cc:276] 0925 16:44:37.889073 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:39.568250 (+1679177us) service_pool.cc:227] Handling call
0925 16:44:39.568540 (+   290us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:39.569102 (+   562us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.569264 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:39.570102 13511 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:39.575361 13511 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.575922 13511 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.578125 13511 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.582580 13510 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:39.583240  9115 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:44:39.583115 13510 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.586990 13510 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:39.588018 13510 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.588546 13510 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.590898 13510 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:39.591424 13510 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:39.591784  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1744) took 3005 ms (client timeout 2044 ms). Trace:
W20260925 16:44:39.592236  9045 rpcz_store.cc:269] 0925 16:44:36.585925 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:36.652177 (+ 66252us) service_pool.cc:227] Handling call
0925 16:44:39.591583 (+2939406us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b54000a73d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.591691 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2635516800}
I20260925 16:44:39.579957 13511 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.593156 13511 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.579416 13512 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.594374 13512 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.592010 13510 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:39.597568  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2642) took 3208 ms (client timeout 1664 ms). Trace:
I20260925 16:44:39.598176 13511 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.598337 13510 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:39.599277  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.130s	user 0.022s	sys 0.022s
I20260925 16:44:39.599041 13512 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:39.599720  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.130s	user 0.022s	sys 0.022s
W20260925 16:44:39.599206  9666 connection.cc:232] RPC call timeout handler was delayed by -1.5532340639999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1501s for a response
W20260925 16:44:39.600199  9666 connection.cc:232] RPC call timeout handler was delayed by -1.5487340639999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1506s for a response
W20260925 16:44:39.600453  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4231886180000402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260925 16:44:39.600582 13431 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:39.600783  9666 connection.cc:232] RPC call timeout handler was delayed by -1.3453340639998714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17320000000000002s for a response
I20260925 16:44:39.600389  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 986) took 2132 ms. Trace:
I20260925 16:44:39.601068 13431 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.601435  9119 rpcz_store.cc:276] 0925 16:44:37.467730 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.467852 (+   122us) service_pool.cc:227] Handling call
0925 16:44:37.468105 (+   253us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:37.468283 (+   178us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:44:37.469053 (+   770us) log.cc:842] Serialized 14 byte log entry
0925 16:44:39.600095 (+2131042us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:39.600140 (+    45us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:39.600181 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.600252 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:39.600346 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1091,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"thread_start_us":2130682,"threads_started":1,"wal-append.queue_time_us":72782,"wal-append.run_cpu_time_us":808,"wal-append.run_wall_time_us":1001151}
W20260925 16:44:39.598047  9043 rpcz_store.cc:269] 0925 16:44:36.388783 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:36.388899 (+   116us) service_pool.cc:227] Handling call
0925 16:44:39.597408 (+3208509us) spinlock_profiling.cc:243] Waited 209 ms on lock 0x7b54002526d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.597502 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":480078592}
W20260925 16:44:39.601071  9666 connection.cc:232] RPC call timeout handler was delayed by -1.2472340639999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260925 16:44:39.603811  9666 connection.cc:232] RPC call timeout handler was delayed by -1.2472340639999402s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
W20260925 16:44:39.604099  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1995340639998631s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1894s for a response
I20260925 16:44:39.610411 13512 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:39.611326 13511 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:39.611711 13511 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:39.613101 13511 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.614926 13511 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:39.616053  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:39.616770  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08001d07e0 after lost signal to thread 8907
I20260925 16:44:39.617139  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:39.617707  9122 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 4 FOLLOWER]: Advancing to term 6
I20260925 16:44:39.620039  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.620817  9115 raft_consensus.cc:2396] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260925 16:44:39.621634  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.622298  9115 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:39.622639  9666 leader_election.cc:398] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10.
I20260925 16:44:39.622912  9666 leader_election.cc:401] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260925 16:44:39.623994  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.624218 13460 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10.
I20260925 16:44:39.624547  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:39.624840  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:39.625330  9120 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:39.624925 13460 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:39.626246  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:39.626509 13460 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:39.627784  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:39.629191 13513 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:39.630393 13513 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260925 16:44:39.630857 13434 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.144s	user 0.014s	sys 0.010s
W20260925 16:44:39.631417 13434 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.145s	user 0.014s	sys 0.010s
I20260925 16:44:39.624552  9124 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:39.616809  9119 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:39.630808 13513 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.637372 13513 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:39.671957  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44259us
I20260925 16:44:39.672751  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:39.673604 13512 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:39.673719 13510 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.674605 13510 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.679126 13510 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:39.688781  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:39.689826  9702 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:39.702272  9120 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:39.704377  9048 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
W20260925 16:44:39.705770  9046 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1742) took 3147 ms (client timeout 1523 ms). Trace:
W20260925 16:44:39.706586  9046 rpcz_store.cc:269] 0925 16:44:36.557807 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:36.575927 (+ 18120us) service_pool.cc:227] Handling call
0925 16:44:39.703870 (+3127943us) spinlock_profiling.cc:243] Waited 540 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.705502 (+  1632us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1243047680}
I20260925 16:44:39.708462 13431 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:39.714054  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08003071a0 after lost signal to thread 8999
W20260925 16:44:39.714397  8996 debug-util.cc:398] Leaking SignalData structure 0x7b0800256020 after lost signal to thread 9000
W20260925 16:44:39.715481  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08000c49a0 after lost signal to thread 9074
I20260925 16:44:39.716311  9121 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
W20260925 16:44:39.716683  8996 debug-util.cc:398] Leaking SignalData structure 0x7b080008f9e0 after lost signal to thread 9148
W20260925 16:44:39.716992  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08002c7de0 after lost signal to thread 9149
I20260925 16:44:39.718427  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 977) took 2770 ms. Trace:
I20260925 16:44:39.718827  9121 rpcz_store.cc:276] 0925 16:44:36.948585 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:36.948705 (+   120us) service_pool.cc:227] Handling call
0925 16:44:39.716091 (+2767386us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:39.716798 (+   707us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.718207 (+  1409us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b5400165150. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.718364 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6251458432}
I20260925 16:44:39.723469 13078 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.724036 13078 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.726420 13078 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.726922 13078 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.730221 13047 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.730435 13317 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.730798 13047 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.734896 13159 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:39.736562  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:39.737363  9117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2688) took 2948 ms (client timeout 2756 ms). Trace:
W20260925 16:44:39.737834  9117 rpcz_store.cc:269] 0925 16:44:36.783644 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:36.791127 (+  7483us) service_pool.cc:227] Handling call
0925 16:44:39.715609 (+2924482us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b5400165154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.732052 (+ 16443us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":734997376}
I20260925 16:44:39.739431 13095 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:39.739921 13047 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.740097 13095 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:39.741169  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:39.742889  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:39.740608 13095 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:39.756240  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.757082  9119 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:39.731019 13317 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.703344  9122 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:39.727415 13078 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:39.764089  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 91425.9us
I20260925 16:44:39.748972 13047 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:39.761722 13408 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:39.767833  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.768929  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:39.764321 13518 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:39.769905  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:39.769162  9121 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 8 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 6.
I20260925 16:44:39.770084 13518 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:39.770941  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:39.772094 13518 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.735550 13159 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.778723 13078 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:39.779488  9115 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:44:39.780170 13159 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.782701 13317 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.783034  9047 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:39.786206  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:39.787189  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.785558 13519 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:39.792233 13519 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:39.792661  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.793668 13078 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:44:39.793942 13408 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:39.794179 13078 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:39.794358 13153 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:39.794756 13153 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:39.795100 13078 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.795774  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.796533 13047 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:39.788937 13460 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:39.789011 13159 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:44:39.789382 13513 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.796675  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:39.798736  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.800935  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.797221 13047 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:39.802215 13511 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.802376 13266 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:39.802943 13266 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:39.802316 13047 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:39.802775 13511 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.804647 13159 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:39.802235 13465 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:39.804872 13511 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.805557 13465 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:39.805881 12666 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.806361 12666 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.806396 13465 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.806941 13428 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.799472 13456 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:39.808365 12666 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.803310 13266 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:39.808743  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1750) took 2723 ms. Trace:
I20260925 16:44:39.794379 13408 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.809168  9049 rpcz_store.cc:276] 0925 16:44:37.084909 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.085058 (+   149us) service_pool.cc:227] Handling call
0925 16:44:37.095269 (+ 10211us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:37.117587 (+ 22318us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:37.117627 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:37.126943 (+  9316us) log.cc:842] Serialized 26 byte log entry
0925 16:44:39.578089 (+2451146us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b1800437bc0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:44:39.585993 (+  7904us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:39.586033 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.808443 (+222410us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54002616d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:39.808492 (+    49us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:39.808534 (+    42us) raft_consensus.cc:1671] finished
0925 16:44:39.808548 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:39.808691 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4117,"raft.queue_time_us":3952,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":8292,"spinlock_wait_cycles":29307264,"thread_start_us":7715,"threads_started":1,"wal-append.queue_time_us":2436595}
I20260925 16:44:39.812199 13408 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:39.800833 13460 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:39.816242 13472 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.813926 13460 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.815922 13047 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.819801 13322 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260925 16:44:39.822099 13272 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.329s	user 0.005s	sys 0.020s
I20260925 16:44:39.822027  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:39.822602 13272 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.330s	user 0.005s	sys 0.020s
I20260925 16:44:39.823109 13408 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.826864  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.827728  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.828511  9117 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:39.829599 13518 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.829540  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.830161 13518 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.830776  9115 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:39.825878 12666 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:39.831844  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.832203 12666 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.833442  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1753) took 2721 ms. Trace:
I20260925 16:44:39.833856 13047 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.834137 12666 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.833824  9048 rpcz_store.cc:276] 0925 16:44:37.112330 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.112446 (+   116us) service_pool.cc:227] Handling call
0925 16:44:39.704071 (+2591625us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:39.705129 (+  1058us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:39.833277 (+128148us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b5400226ad0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.833391 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5959360768}
I20260925 16:44:39.836349  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.836970  9115 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:39.837833  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.838439  9117 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 7.
I20260925 16:44:39.842047 13516 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:39.842372  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.842701  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.843200  9122 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 11 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260925 16:44:39.843427  9115 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:39.842408  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.844841  9121 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:39.842408 13516 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:39.846220 13518 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.846344 13516 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.847857 13516 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:39.818255 13153 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:39.848452  9123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2547) took 1920 ms (client timeout 1520 ms). Trace:
I20260925 16:44:39.848754 13153 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:39.848846  9123 rpcz_store.cc:269] 0925 16:44:37.935215 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.935776 (+   561us) service_pool.cc:227] Handling call
0925 16:44:39.848291 (+1912515us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400041fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:39.848384 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3574823424}
I20260925 16:44:39.851500 13272 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:39.852404 13272 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:39.852689 13272 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:39.853402 13272 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.854496 13272 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:39.856588 13159 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:39.857161  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:39.858127 13159 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:39.859872  8970 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260925 16:44:39.859974 13095 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.860280 13517 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:39.868120 13517 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:39.868417  8996 debug-util.cc:398] Leaking SignalData structure 0x7b0800156c00 after lost signal to thread 9726
I20260925 16:44:39.868495 13517 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:39.868901  8996 debug-util.cc:398] Leaking SignalData structure 0x7b08003ff7a0 after lost signal to thread 9727
W20260925 16:44:39.869445  8996 debug-util.cc:398] Leaking SignalData structure 0x7b0800387560 after lost signal to thread 13155
W20260925 16:44:39.861810  9089 connection.cc:232] RPC call timeout handler was delayed by -2.1517039020000084s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260925 16:44:39.861001  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:39.871093  9089 connection.cc:232] RPC call timeout handler was delayed by -1.963823444000127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1511s for a response
W20260925 16:44:39.871419  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9530234440001095s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1523s for a response
W20260925 16:44:39.871837  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7712234440000429s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17250000000000001s for a response
W20260925 16:44:39.872301  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7460234440000022s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1753s for a response
W20260925 16:44:39.872762  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6938234440001452s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1811s for a response
W20260925 16:44:39.873147  9089 connection.cc:232] RPC call timeout handler was delayed by -1.4841234440000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260925 16:44:39.873570  9089 connection.cc:232] RPC call timeout handler was delayed by -1.4841234440000335s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20440000000000003s for a response
W20260925 16:44:39.874099  9089 connection.cc:232] RPC call timeout handler was delayed by -1.4093887800001994s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
W20260925 16:44:39.874545  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3968234440001197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260925 16:44:39.874976  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3968234440001197s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2141s for a response
W20260925 16:44:39.875402  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3878234440001052s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21509999999999999s for a response
W20260925 16:44:39.875839  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3590234440000586s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2183s for a response
W20260925 16:44:39.876273  9089 connection.cc:232] RPC call timeout handler was delayed by -1.350023444000044s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21930000000000002s for a response
W20260925 16:44:39.876694  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3097887960000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17270000000000002s for a response
I20260925 16:44:39.878470  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.881847  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:39.882608  9121 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 13
I20260925 16:44:39.879112  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.884591  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.885218  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:39.885591  9123 raft_consensus.cc:2396] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260925 16:44:39.887306  8970 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:39.888742  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:39.824642 13456 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:39.793285 13519 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:39.890571  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1858079690000523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.199s for a response
W20260925 16:44:39.909014  9089 connection.cc:232] RPC call timeout handler was delayed by -1.039779105000207s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1694s for a response
I20260925 16:44:39.909135  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:39.909715  9115 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:39.890743  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.894304  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:39.913539  9119 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:39.901160  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.826336 13515 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.925534  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.926183  8975 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:39.901765 13450 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.867511 13322 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:39.902668  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.883845  9117 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:39.928380  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:39.933765  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:39.930130  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 143968us
I20260925 16:44:39.932132  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:39.927667 13435 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 2.875s	user 0.017s	sys 0.011s
I20260925 16:44:39.941370 13456 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:39.943277 13456 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:39.943195 13435 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.943826 13456 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:39.942593 13408 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.903064 13511 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:39.943641 13513 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:39.940764  9119 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:39.949753  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:39.947530  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 77660.9us
I20260925 16:44:39.930325 13047 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:39.951887  8972 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:39.950165  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.953222  8975 raft_consensus.cc:2354] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:39.953717  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.954550  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.954732  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:39.955814  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.957352  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.957468  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:39.957966  8971 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:39.954679  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:39.959685  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.935117 13521 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:39.960525  9693 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:44:39.960675 13521 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:39.960927 13095 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.961139 13521 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:39.903487 13266 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.961284  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:39.936820 13322 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:39.936036 13450 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:39.989395  9145 debug-util.cc:398] Leaking SignalData structure 0x7b080014f040 after lost signal to thread 7803
I20260925 16:44:39.989894  9117 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:39.962111  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:39.962260  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:39.964200  9702 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:39.937270 13153 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:39.949105 13511 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:39.964646  9089 leader_election.cc:398] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:44:39.945845 13159 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:39.993188  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08001afee0 after lost signal to thread 7806
I20260925 16:44:40.002564 13450 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:40.002861  8970 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:39.992519 13431 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260925 16:44:39.991933  9121 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:39.994055 13511 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:39.931845 13515 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.995182  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:40.012239  8971 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:39.995911  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:39.995966  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:39.996798  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:39.997092  9696 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:39.993712  8966 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:39.997475  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:39.997486  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:39.998682  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.000666  9693 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:39.955163 13047 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:40.007535  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.008642  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:40.002569 13266 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:40.010080  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.025931  9123 raft_consensus.cc:2362] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8. Re-sending same reply.
I20260925 16:44:40.026244  9115 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:39.977782 13464 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:40.010640  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.029624  9124 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 10
I20260925 16:44:40.029767 13428 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:40.030323 13428 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.031106 13428 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.031905 13464 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:40.032341 13464 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:40.034605 13435 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:39.961659 13513 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.064s
I20260925 16:44:40.035051  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 793) took 2648 ms. Trace:
I20260925 16:44:40.035446  9047 rpcz_store.cc:276] 0925 16:44:37.387159 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.387284 (+   125us) service_pool.cc:227] Handling call
0925 16:44:37.392389 (+  5105us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:39.790981 (+2398592us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:40.034805 (+243824us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54002b5cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:40.034992 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5497373568}
I20260925 16:44:40.035938 13512 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:40.028100 13047 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:39.982764 13189 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.013234  9694 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:40.015640 13408 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:40.015323  9702 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:40.019121  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:40.021327 13517 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:39.998354 13465 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:40.041260 13465 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:40.042570  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0500 after lost signal to thread 8907
I20260925 16:44:40.042203 13465 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.024125  9695 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.025085 13515 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.045370  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.027433  9089 leader_election.cc:398] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:44:40.001338 13159 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:40.050472  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:40.048431  9089 leader_election.cc:401] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:40.029023  9117 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 7.
W20260925 16:44:40.048969  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8d40 after lost signal to thread 8999
I20260925 16:44:39.993479 13153 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.062036 13153 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.062527 13322 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:40.051474  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08000c8d20 after lost signal to thread 9000
W20260925 16:44:40.052851 13449 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 2.632s	user 0.012s	sys 0.025s
I20260925 16:44:40.069321  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:40.055590  9700 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:40.055871  9699 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260925 16:44:40.056769  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:40.058103  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260925 16:44:40.058501 13456 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.028416 13272 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:40.056769  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:40.059988  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.060804  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:40.061247 13511 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.055461  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 890) took 2617 ms. Trace:
I20260925 16:44:40.067495  9124 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:40.074240  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:40.075603  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003d0900 after lost signal to thread 9074
I20260925 16:44:40.110987  9701 rpcz_store.cc:276] 0925 16:44:37.438432 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.438611 (+   179us) service_pool.cc:227] Handling call
0925 16:44:37.896041 (+457430us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:37.896652 (+   611us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:40.055298 (+2158646us) spinlock_profiling.cc:243] Waited 457 ms on lock 0x7b54004a0e50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:40.055412 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1051180800}
W20260925 16:44:40.113498  9145 debug-util.cc:398] Leaking SignalData structure 0x7b080041caa0 after lost signal to thread 9148
W20260925 16:44:40.114001  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003f2320 after lost signal to thread 9149
W20260925 16:44:40.117534  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49589.2us
I20260925 16:44:40.119956  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:40.115567  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08001e2060 after lost signal to thread 9726
W20260925 16:44:40.123826  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003e1420 after lost signal to thread 9727
I20260925 16:44:40.079412  9695 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
W20260925 16:44:40.125106  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56995us
I20260925 16:44:40.072235 13513 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:40.126700  8970 pending_rounds.cc:76] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 6
I20260925 16:44:40.135927  8970 pending_rounds.cc:97] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260925 16:44:40.136281  8970 raft_consensus.cc:2866] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:40.127220  9697 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:40.064028 13159 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:40.137063  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 109703us
I20260925 16:44:40.068733 13515 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:40.134526 13318 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260925 16:44:40.093425 13516 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.123286 13459 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:44:40.137908  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.128208 13268 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:40.182623  9115 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:40.049837 13189 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.135663 13513 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:40.184231  9701 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:44:40.184789  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:40.192719  9701 raft_consensus.cc:595] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:40.193063  9701 raft_consensus.cc:603] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:40.184957  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.185392  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:40.188386  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:40.188570  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:40.088567 13449 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.194448  8967 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:40.195509  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57692.9us
I20260925 16:44:40.193944  8966 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:40.198807  9089 leader_election.cc:398] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:44:40.199205  9089 leader_election.cc:401] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 5 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:40.128356 13078 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260925 16:44:40.204107  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.125324 13472 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.062s
I20260925 16:44:40.208149  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.186528 13431 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:40.208920  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 126073us
I20260925 16:44:40.215814  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:40.216645  9118 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:40.193706 13513 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:40.189289 13510 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260925 16:44:40.218950  8967 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:40.189121 13268 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.178663 13450 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260925 16:44:40.234524  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:40.240564 13532 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:40.205516 13095 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:40.181661 13516 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.233193 13431 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 5. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 5. Current term is 6.
I20260925 16:44:40.209046 13459 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:40.247241  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.245410 13532 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:40.254436 13527 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
W20260925 16:44:40.255085  9145 debug-util.cc:398] Leaking SignalData structure 0x7b080042d6e0 after lost signal to thread 13246
I20260925 16:44:40.256927 13112 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.264268  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 807) took 2813 ms. Trace:
I20260925 16:44:40.313355  9044 rpcz_store.cc:276] 0925 16:44:37.452551 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:37.616132 (+163581us) service_pool.cc:227] Handling call
0925 16:44:37.616417 (+   285us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:37.616609 (+   192us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:44:37.640833 (+ 24224us) log.cc:842] Serialized 14 byte log entry
0925 16:44:40.263850 (+2623017us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:40.263917 (+    67us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:40.263980 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:40.264057 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:40.264204 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2420580,"prepare.queue_time_us":37929,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":42,"thread_start_us":225942,"threads_started":3,"wal-append.queue_time_us":23509,"wal-append.run_cpu_time_us":1252,"wal-append.run_wall_time_us":1001656}
I20260925 16:44:40.316466  9694 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:40.248157 13322 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:40.321132  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:40.231384 13519 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:40.321295  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105595us
I20260925 16:44:40.320475  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.322396  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:40.322732  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.323431  9115 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:40.326179  9119 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:40.264376 13318 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:40.264891 13428 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.227921 13047 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:40.327740  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 123667us
I20260925 16:44:40.318259 13522 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:40.274914 13459 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.337733  9089 leader_election.cc:398] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9.
I20260925 16:44:40.317545 13431 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:40.341908  9089 leader_election.cc:401] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260925 16:44:40.345016  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.335353 13318 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:40.324936 12666 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:40.356374  8968 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:40.339650 13511 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.343297 13456 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.320611 13112 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.357851 13318 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.430202 13159 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:40.432278 13540 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260925 16:44:40.432502 13159 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.432826 13449 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:40.434229 13189 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:40.340087 13536 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:40.343648 13428 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.436510 13408 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:40.436936 13408 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:40.437237 13428 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:40.438578 13521 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.442703 13153 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:40.366922 13529 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:44:40.344430 13431 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:40.453226 13431 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.454211  9699 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:40.373679 13516 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.381357 13047 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.344386 13459 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:40.419579  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81991.5us
I20260925 16:44:40.459896  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.460942  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.463193  9089 leader_election.cc:398] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:44:40.463454  9089 leader_election.cc:401] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:40.430114 13112 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.341552 13518 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.080s
I20260925 16:44:40.351783 13517 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.329744 13532 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.448748  9698 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:40.328593 13519 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.363804 13450 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9.
I20260925 16:44:40.345161 13510 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
W20260925 16:44:40.464025  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003a56e0 after lost signal to thread 13389
I20260925 16:44:40.344435 13268 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.478551  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:40.488449  8973 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260925 16:44:40.489310  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:40.495210  8971 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:40.501555  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.505903  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:40.509855  9120 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:40.515055  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:40.475873 13389 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.466025 13322 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.493868 13536 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.030s
W20260925 16:44:40.523960  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45506.8us
I20260925 16:44:40.524528 13536 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:40.524732  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:40.515662  8972 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.475809 13047 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.487430 13272 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:44:40.526511  8966 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:40.515622  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.527220  9121 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:40.475729 13539 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:40.486871 13542 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:40.534103  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:40.535477 13516 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:40.497844 13095 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.516814  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:40.533375  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 198581us
I20260925 16:44:40.538673  9123 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:40.522807  9120 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:40.535861 13516 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:40.494659 13522 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:40.542474  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.546078  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.546520  9120 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:40.546906  9124 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260925 16:44:40.547120 13513 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.548166 13446 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.548678 13446 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.549111 13513 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:40.529170 13389 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.550796 13446 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.551277 13446 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.551344 13389 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:40.534106 13153 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.552474 13450 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:40.552837 13450 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:40.542762  9119 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:40.540992  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:40.544045  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.543977  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.555948  9115 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:44:40.556185  9117 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.555967  9123 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.545104  9121 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:40.560176  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.561838 13555 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260925 16:44:40.562112 13317 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:40.563131 13317 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:40.563458 13317 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.564215 13317 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.565284 13317 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.554913 13510 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260925 16:44:40.566423  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:40.532194 13449 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:40.572026  8972 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:40.569376  9117 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260925 16:44:40.536327 13542 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:40.578454  9123 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:40.572319 13539 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:40.584722 13519 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.585727 13521 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:40.542837 13536 raft_consensus.cc:2741] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260925 16:44:40.587492 13318 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.532637 13047 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.599215  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:44:40.596488  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52697.6us
I20260925 16:44:40.601481  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:40.557253 13272 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260925 16:44:40.524019 13322 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.579840 13542 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:40.561167 13446 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.591979 13539 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:40.589740 13449 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:40.599774 13464 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.567s	user 0.013s	sys 0.001s
I20260925 16:44:40.608022  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:40.604310  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.618584  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:40.630093  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:40.614993 13266 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260925 16:44:40.600730 13555 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.018s
I20260925 16:44:40.603868 13515 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.014s
W20260925 16:44:40.644305  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 579288us
I20260925 16:44:40.621551 13318 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:40.613209 13189 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.007s
I20260925 16:44:40.651639  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:40.651873  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.623162  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:40.605370 13554 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260925 16:44:40.603802 13550 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:40.613405 13078 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:40.640054 13539 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.662942  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.631408 13299 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:40.667450  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:40.669950  9121 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:40.665691  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:40.670607  8970 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:40.611227 13450 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.633652 13482 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:40.546078 13522 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.688241  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.664888 13159 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:40.688756  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.714843  8970 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:40.718827  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:40.613582 13095 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.669521 13299 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:40.661688 13021 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260925 16:44:40.603109 13516 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.644210 13408 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.631611 13464 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.713344  9121 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:40.787868  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 124973us
W20260925 16:44:40.834570  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 298573us
W20260925 16:44:40.802609  8870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 342) took 14681 ms (client timeout 15000 ms). Trace:
W20260925 16:44:40.887658  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 149751us
I20260925 16:44:40.883558  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.883742  9089 leader_election.cc:398] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:40.896903  9089 leader_election.cc:401] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
W20260925 16:44:40.901790  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 213103us
I20260925 16:44:40.689857 13513 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:40.707716 13277 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.912060  9696 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:40.913043  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:40.803467 13540 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260925 16:44:40.710397 13550 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.709254 13435 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.801151 13450 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:40.915182  8967 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:40.916082  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.794194 13159 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:40.782481 13473 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:40.920383  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.802281 13389 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:40.945851  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:40.800701 13112 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.716930 13078 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:40.816805 13246 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:40.933317  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.936300  9696 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:40.950119  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:40.959463  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:40.960012  9049 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:40.956679  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:40.960413  9120 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:40.911859 13510 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:40.910593 13554 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:40.911958 13021 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:40.966671  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:40.967607  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:40.994158  9046 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:40.933895 13513 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:40.923236 13530 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:40.924335 13434 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.018316  9696 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:40.798574 13459 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.973109  9120 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:41.031652  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.042665  9045 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:40.971828 13554 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:40.993381 13521 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:40.911664 13431 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.946280 13389 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:40.884982  8870 rpcz_store.cc:269] 0925 16:44:26.112290 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:26.243604 (+131314us) service_pool.cc:227] Handling call
0925 16:44:40.787389 (+14543785us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:44:37.139397 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:44:37.140068 (+   671us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:44:37.140131 (+    63us) write_op.cc:435] Acquired schema lock
0925 16:44:37.140148 (+    17us) tablet.cc:660] Decoding operations
0925 16:44:37.390214 (+250066us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:44:37.390338 (+   124us) write_op.cc:641] Partition lock acquired for write op
0925 16:44:37.390375 (+    37us) tablet.cc:683] Acquiring locks for 20 operations
0925 16:44:37.454487 (+ 64112us) tablet.cc:699] Row locks acquired
0925 16:44:37.460089 (+  5602us) write_op.cc:260] PREPARE: finished
0925 16:44:37.469737 (+  9648us) write_op.cc:270] Start()
0925 16:44:37.469882 (+   145us) write_op.cc:276] Timestamp: P: 1790354677469665 usec, L: 0
0925 16:44:37.469912 (+    30us) op_driver.cc:331] REPLICATION: starting
0925 16:44:37.499266 (+ 29354us) log.cc:842] Serialized 7947 byte log entry
0925 16:44:37.612656 (+113390us) op_driver.cc:444] REPLICATION: finished
0925 16:44:37.647860 (+ 35204us) write_op.cc:301] APPLY: starting
0925 16:44:37.647994 (+   134us) tablet.cc:1365] starting BulkCheckPresence
0925 16:44:37.676941 (+ 28947us) tablet.cc:1368] finished BulkCheckPresence
0925 16:44:37.677029 (+    88us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:44:37.685000 (+  7971us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:44:37.685268 (+   268us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=40,key_file_lookups=40,delta_file_lookups=40,mrs_lookups=0
0925 16:44:37.685296 (+    28us) write_op.cc:312] APPLY: finished
0925 16:44:37.685604 (+   308us) log.cc:842] Serialized 180 byte log entry
0925 16:44:37.685797 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:37.685976 (+   179us) write_op.cc:454] Released schema lock
0925 16:44:37.686067 (+    91us) write_op.cc:341] FINISH: Updating metrics
0925 16:44:37.686399 (+   332us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:37.686417 (+    18us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2129380,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":34818,"apply.run_cpu_time_us":24181,"apply.run_wall_time_us":38887,"cfile_cache_hit":78,"cfile_cache_hit_bytes":81393,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6214,"cfile_init":2,"lbm_read_time_us":1610,"lbm_reads_lt_1ms":12,"num_ops":20,"prepare.queue_time_us":23569,"prepare.run_cpu_time_us":9622,"prepare.run_wall_time_us":378863,"raft.queue_time_us":59153,"raft.run_cpu_time_us":11112,"raft.run_wall_time_us":19683,"replication_time_us":142631,"thread_start_us":106694,"threads_started":4,"wal-append.queue_time_us":21659,"wal-append.run_cpu_time_us":41891,"wal-append.run_wall_time_us":1165402}]]}
I20260925 16:44:40.965840 13318 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:40.796423 13449 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.922950 13277 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:40.710232 13482 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.047122  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:41.047756  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.000844 13446 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:41.029775 13510 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:41.053992  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 133670us
I20260925 16:44:40.932991 13435 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.957476 13473 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:41.064386  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:41.064970  9696 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:41.062433  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:41.063272  9123 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:40.973948 13246 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.045387 13554 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:41.054849 13389 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:41.042928 13047 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:41.063618  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:40.975471 13436 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260925 16:44:40.970108 13112 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:40.957700 13299 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.053573 13318 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:41.069639 13518 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:41.085903  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:41.100489  9047 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:41.088744 13431 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:41.081194  8869 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:41.090099 13435 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:41.093029 13473 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:41.095839 13536 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:41.096223 13513 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.097241 13408 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:41.097747 13464 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:41.122551 13277 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:41.098631  9049 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:44:41.123425 13561 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260925 16:44:41.099479  9046 raft_consensus.cc:595] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:41.102289  9696 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:41.129196  9116 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260925 16:44:41.129346  9046 raft_consensus.cc:603] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:44:41.079449 13268 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.006s	sys 0.011s
W20260925 16:44:41.110656  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47121us
I20260925 16:44:41.065148 13413 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260925 16:44:41.084833 13563 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:41.119477  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44978.5us
W20260925 16:44:41.122660 13557 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.285s	user 0.001s	sys 0.000s
I20260925 16:44:41.124179 13459 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:41.124426  8869 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 6 to 10, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:44:41.110147 13318 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:41.125813 13482 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:41.043241 13434 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.062412 13521 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:41.129576  9116 pending_rounds.cc:76] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 9
W20260925 16:44:41.130080  9117 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.000s	sys 0.003s
I20260925 16:44:41.130019  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:41.097944 13272 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:41.130965  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.040709 13530 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.085918  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:41.130021  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:41.134526  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:41.134654  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:41.117630 13558 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.322s	user 0.000s	sys 0.000s
I20260925 16:44:41.145752  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.146845  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:41.136611 13387 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.016s	sys 0.010s
I20260925 16:44:41.198661  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:41.421644  8967 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
W20260925 16:44:41.200673  9727 heartbeater.cc:644] Failed to heartbeat to 127.7.158.254:39187 (2 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.158.254:39187 timed out after 15.000s (SENT)
I20260925 16:44:41.205124  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.198342 13277 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:41.229616  8869 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:41.128028 13299 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:41.052251 13550 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:41.136583 13268 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.006s	sys 0.011s
I20260925 16:44:41.128852 13518 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:41.128234 13473 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:44:41.277494  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 140404us
I20260925 16:44:41.472015  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.295572  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:41.473294  8966 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:44:41.295890  9694 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.011s	sys 0.023s
W20260925 16:44:41.474126  9694 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.011s	sys 0.023s
W20260925 16:44:41.421404 13387 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.016s	sys 0.010s
W20260925 16:44:41.335938  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 440191us
I20260925 16:44:41.472492  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:41.336465  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.000s	sys 0.006s
I20260925 16:44:41.336843  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:41.478998  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.000s	sys 0.007s
W20260925 16:44:41.419121 13566 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.358s	user 0.003s	sys 0.005s
I20260925 16:44:41.070104 13078 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:41.136346 13456 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.185s
W20260925 16:44:41.343082  9699 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.681s	user 0.002s	sys 0.006s
W20260925 16:44:41.488806  9699 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.002s	sys 0.006s
I20260925 16:44:41.348507  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:41.358943 13575 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260925 16:44:41.361028  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:41.120766 13446 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:41.538286  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:41.364684  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:41.062163 13159 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.367856  9702 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:41.377918  9116 pending_rounds.cc:97] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 10.10
W20260925 16:44:41.378080  9117 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.784s	user 0.000s	sys 0.003s
I20260925 16:44:41.362160 13112 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:41.378481  9050 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:41.417259  9120 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:41.418428  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 283963us
I20260925 16:44:41.412515  9041 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:41.424341  9042 raft_consensus.cc:2396] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
W20260925 16:44:41.371965 13574 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260925 16:44:41.464660  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:41.464784  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:41.157895 13563 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.465737  8869 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 5 to 7, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:41.368741 13459 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.367363 13436 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:41.230834 13536 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:41.476214  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.561151  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:41.485649 13246 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:41.477275  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:41.479162  8969 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:41.340282  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:41.480149  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:41.484465  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:41.489615  9698 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:41.490103  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.431394 13431 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:41.465191 13513 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.594305  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.541808  9116 raft_consensus.cc:2866] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:44:41.596474  9015 connection.cc:232] RPC call timeout handler was delayed by -2.7775183080000261s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16820000000000002s for a response
I20260925 16:44:41.558053  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:41.596946  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:41.537169 13517 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.955s	user 0.042s	sys 0.046s
W20260925 16:44:41.120333 13021 consensus_queue.cc:1159] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 9 status { last_received { term: 9 index: 9 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:44:41.565021  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:41.681830  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.682613  9049 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:44:41.602509  9015 connection.cc:232] RPC call timeout handler was delayed by -2.7541183079999882s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260925 16:44:41.603114  9124 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:41.488534 13511 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:41.683485  9015 connection.cc:232] RPC call timeout handler was delayed by -2.6776183079998646s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17930000000000001s for a response
W20260925 16:44:41.683844  9015 connection.cc:232] RPC call timeout handler was delayed by -2.6056183079999755s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
W20260925 16:44:41.684136  9015 connection.cc:232] RPC call timeout handler was delayed by -2.5444183079998766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19410000000000002s for a response
W20260925 16:44:41.684516  9015 connection.cc:232] RPC call timeout handler was delayed by -2.5435183079998751s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1942s for a response
W20260925 16:44:41.684890  9015 connection.cc:232] RPC call timeout handler was delayed by -2.4239785139998276s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17820000000000003s for a response
W20260925 16:44:41.685258  9015 connection.cc:232] RPC call timeout handler was delayed by -2.4076183079998827s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2093s for a response
W20260925 16:44:41.685611  9015 connection.cc:232] RPC call timeout handler was delayed by -2.40581830799988s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20950000000000002s for a response
W20260925 16:44:41.685959  9015 connection.cc:232] RPC call timeout handler was delayed by -2.1674785139998676s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260925 16:44:41.686328  9015 connection.cc:232] RPC call timeout handler was delayed by -1.970218308000085s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2579s for a response
W20260925 16:44:41.596642  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45018us
I20260925 16:44:41.596182  8869 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 7 to 10, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:41.595952  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.604379  9043 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:41.598273  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:41.596426  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.599213  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:41.767851  9115 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:41.598945  9050 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:41.773460  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:41.558813 13317 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.987s	user 0.007s	sys 0.005s
W20260925 16:44:41.611752  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 134561us
I20260925 16:44:41.681077  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2595) took 1104 ms. Trace:
I20260925 16:44:41.749136  9041 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:41.731815  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:41.688112  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:41.538529 13446 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:41.552842 13562 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.322s
I20260925 16:44:41.593572 13536 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.774067  9050 raft_consensus.cc:2362] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16. Re-sending same reply.
I20260925 16:44:41.804916  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:42.061293 13592 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.001s
I20260925 16:44:42.096021 13530 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:42.114953 13554 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.015s	user 0.004s	sys 0.004s
W20260925 16:44:42.061903 13577 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.224s	user 0.000s	sys 0.000s
I20260925 16:44:42.060178  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 860) took 1010 ms. Trace:
I20260925 16:44:41.853122  9124 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:42.096552 13583 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.665s	user 0.001s	sys 0.000s
I20260925 16:44:42.224604  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2713) took 1256 ms. Trace:
I20260925 16:44:42.108722 13563 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:42.224977  9124 rpcz_store.cc:276] 0925 16:44:40.968081 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.750988 (+782907us) service_pool.cc:227] Handling call
0925 16:44:41.852905 (+101917us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.224356 (+371451us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.224553 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.063051  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:42.178632 13539 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.006s	sys 0.011s
I20260925 16:44:41.836211  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.960363  8969 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:42.227784  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.228329  8972 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
W20260925 16:44:41.679944 13517 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.113s	user 0.044s	sys 0.052s
I20260925 16:44:42.219409 13538 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:42.229130  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.229313 13538 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:41.774786  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:42.206300 13431 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:42.026901  9047 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.909s	user 0.007s	sys 0.000s
I20260925 16:44:41.596812 12787 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.988679 13277 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.679469 13518 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.231204 12787 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.231353 13277 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.232350  9044 raft_consensus.cc:2362] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12. Re-sending same reply.
I20260925 16:44:42.233184  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:42.234263  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.234534 13277 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:42.234164 13446 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:41.678226 13513 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.235539  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:41.560561 13112 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.596988 13435 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:41.804569  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.015734  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2597) took 1187 ms. Trace:
I20260925 16:44:41.561352 13459 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.236958  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:42.237169  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:42.007244  8975 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.009s	sys 0.000s
I20260925 16:44:41.557493 13436 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:42.231912  9120 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
W20260925 16:44:42.226847 13539 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.007s	sys 0.011s
I20260925 16:44:41.836211  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:41.844350  8869 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 5, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 5 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:41.560743 13131 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:42.225900 13563 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:42.233354 12787 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:42.230911 13431 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.237370  8970 rpcz_store.cc:276] 0925 16:44:41.049293 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.061231 (+ 11938us) service_pool.cc:227] Handling call
0925 16:44:41.061550 (+   319us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:44:41.067082 (+  5532us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:41.067111 (+    29us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:44:41.084365 (+ 17254us) log.cc:842] Serialized 78 byte log entry
0925 16:44:41.365476 (+281111us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:41.467923 (+102447us) log.cc:842] Serialized 14 byte log entry
0925 16:44:41.561601 (+ 93678us) log.cc:842] Serialized 14 byte log entry
0925 16:44:41.561823 (+   222us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.561901 (+    78us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:42.059900 (+497999us) raft_consensus.cc:1671] finished
0925 16:44:42.059929 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.060108 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":110972,"prepare.queue_time_us":896108,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":63,"raft.queue_time_us":15484,"raft.run_cpu_time_us":374,"raft.run_wall_time_us":22449,"thread_start_us":314369,"threads_started":2,"wal-append.queue_time_us":501214}
I20260925 16:44:41.599779 13521 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.230710  9047 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:42.292128  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:42.622292  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.000s	sys 0.039s
I20260925 16:44:42.807252  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 2721) took 1443 ms. Trace:
W20260925 16:44:42.807442  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2677) took 1528 ms (client timeout 2024 ms). Trace:
I20260925 16:44:42.236267  9117 rpcz_store.cc:276] 0925 16:44:40.576710 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.577564 (+   854us) service_pool.cc:227] Handling call
0925 16:44:40.577824 (+   260us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:40.578003 (+   179us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:41.542036 (+964033us) log.cc:842] Serialized 14 byte log entry
0925 16:44:41.617907 (+ 75871us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:41.680755 (+ 62848us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:41.680805 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.680868 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:41.680981 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":465610,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":263,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":59890,"thread_start_us":1023003,"threads_started":2}
W20260925 16:44:42.343152  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 855) took 1692 ms (client timeout 2230 ms). Trace:
W20260925 16:44:42.579622  9045 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.207s	user 0.005s	sys 0.030s
W20260925 16:44:42.810350  9045 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.438s	user 0.005s	sys 0.034s
I20260925 16:44:42.811100  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1773) took 1489 ms. Trace:
I20260925 16:44:42.245667  9043 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:42.261052  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:42.812301  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2676) took 1581 ms (client timeout 1676 ms). Trace:
W20260925 16:44:42.812729  9043 rpcz_store.cc:269] 0925 16:44:41.231163 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.339961 (+108798us) service_pool.cc:227] Handling call
0925 16:44:42.812243 (+1472282us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.813148  9701 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:42.807336  9044 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:42.226447  9124 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:42.814298  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 813) took 1064 ms. Trace:
W20260925 16:44:42.222152  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.597s (SENT) [suppressed 15 similar messages]
I20260925 16:44:42.814903  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2715) took 1813 ms. Trace:
W20260925 16:44:42.707019  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.007s	sys 0.006s
W20260925 16:44:42.699877  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.967s	user 0.005s	sys 0.033s
I20260925 16:44:42.221901  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.806300  9048 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:42.816289  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.135s	user 0.005s	sys 0.033s
I20260925 16:44:41.811014  9115 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 12. Ops: []
W20260925 16:44:42.817832  8975 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.020s	sys 0.018s
W20260925 16:44:42.815914  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.789s	user 0.008s	sys 0.006s
W20260925 16:44:42.220527  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.008s	sys 0.009s
W20260925 16:44:42.708258  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.000s	sys 0.011s
W20260925 16:44:42.805131  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2660) took 1736 ms (client timeout 1520 ms). Trace:
W20260925 16:44:42.819147  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.019s	sys 0.020s
W20260925 16:44:42.819270  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.707s	user 0.000s	sys 0.013s
I20260925 16:44:42.819000  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2714) took 1824 ms. Trace:
W20260925 16:44:42.807997  9042 rpcz_store.cc:269] 0925 16:44:41.279071 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.768015 (+488944us) service_pool.cc:227] Handling call
0925 16:44:42.807385 (+1039370us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:42.806339  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.006s	sys 0.039s
W20260925 16:44:42.820602  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.27664e+06us
I20260925 16:44:42.811627  8974 rpcz_store.cc:276] 0925 16:44:41.321575 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.321758 (+   183us) service_pool.cc:227] Handling call
0925 16:44:41.322211 (+   453us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:41.322640 (+   429us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:41.322679 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:41.323266 (+   587us) log.cc:842] Serialized 26 byte log entry
0925 16:44:41.476417 (+153151us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:41.476457 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.476517 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:42.260023 (+783506us) raft_consensus.cc:1671] finished
0925 16:44:42.260040 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.811027 (+550987us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":983,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":6797,"thread_start_us":119279,"threads_started":1,"wal-append.queue_time_us":678451}
I20260925 16:44:42.806334  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:42.820799  9115 rpcz_store.cc:276] 0925 16:44:40.995053 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.810393 (+815340us) service_pool.cc:227] Handling call
0925 16:44:41.810786 (+   393us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.818758 (+1007972us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.818953 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.822157  8970 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:42.813822  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1266) took 1774 ms. Trace:
W20260925 16:44:42.819962  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.13912e+06us
W20260925 16:44:42.823387  9666 connection.cc:232] RPC call timeout handler was delayed by -1.2965365950001342s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2134s for a response
I20260925 16:44:42.814973  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2319) took 1330 ms. Trace:
W20260925 16:44:42.809748  8972 rpcz_store.cc:269] 0925 16:44:40.650926 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.651391 (+   465us) service_pool.cc:227] Handling call
0925 16:44:42.342976 (+1691585us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b5400137254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:42.343089 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3610946944}
W20260925 16:44:42.819471  9047 rpcz_store.cc:269] 0925 16:44:41.068260 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.068435 (+   175us) service_pool.cc:227] Handling call
0925 16:44:42.805058 (+1736623us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.817152  8966 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:42.823349  9701 rpcz_store.cc:276] 0925 16:44:41.039137 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.767970 (+728833us) service_pool.cc:227] Handling call
0925 16:44:42.812829 (+1044859us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.813600 (+   771us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.813772 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.814852  9044 rpcz_store.cc:276] 0925 16:44:41.749858 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.235335 (+485477us) service_pool.cc:227] Handling call
0925 16:44:42.814125 (+578790us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.804903  9122 rpcz_store.cc:276] 0925 16:44:40.828476 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.829030 (+   554us) service_pool.cc:227] Handling call
0925 16:44:40.829423 (+   393us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:40.829840 (+   417us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:40.829878 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:40.894826 (+ 64948us) log.cc:842] Serialized 26 byte log entry
0925 16:44:41.063885 (+169059us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:41.063918 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.066971 (+  3053us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:42.015532 (+948561us) raft_consensus.cc:1671] finished
0925 16:44:42.015551 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.015663 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":57896,"thread_start_us":99028,"threads_started":1,"wal-append.queue_time_us":270553}
I20260925 16:44:42.824815  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:42.815495  9124 rpcz_store.cc:276] 0925 16:44:41.001376 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.225966 (+1224590us) service_pool.cc:227] Handling call
0925 16:44:42.226296 (+   330us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.814573 (+588277us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.814748 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.813745  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.827728  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:42.007899 13322 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.000s	sys 0.009s
I20260925 16:44:42.828953  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 816) took 1078 ms. Trace:
I20260925 16:44:42.834030  9049 rpcz_store.cc:276] 0925 16:44:41.750642 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.221595 (+470953us) service_pool.cc:227] Handling call
0925 16:44:42.828899 (+607304us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.829784  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 812) took 1141 ms. Trace:
I20260925 16:44:42.835120  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1023) took 1815 ms. Trace:
I20260925 16:44:42.835084  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1025) took 1815 ms. Trace:
I20260925 16:44:42.865203  9122 rpcz_store.cc:276] 0925 16:44:41.020056 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.834344 (+1814288us) service_pool.cc:227] Handling call
0925 16:44:42.834618 (+   274us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.834789 (+   171us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:42.834829 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.834865 (+    36us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:42.834898 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.834943 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.835033 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.852396  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1024) took 1832 ms. Trace:
I20260925 16:44:42.836308  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1097) took 1735 ms. Trace:
I20260925 16:44:42.838275  8972 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:42.828955  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2668) took 1682 ms. Trace:
I20260925 16:44:42.867897  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2320) took 1379 ms. Trace:
I20260925 16:44:42.837949  9121 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:42.849329  8869 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 6 to 9, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 9 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:42.868518  8972 rpcz_store.cc:276] 0925 16:44:41.488425 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.837754 (+1349329us) service_pool.cc:227] Handling call
0925 16:44:42.838083 (+   329us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.867614 (+ 29531us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.867847 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.823503  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:42.824537  8967 rpcz_store.cc:276] 0925 16:44:41.484345 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.688239 (+203894us) service_pool.cc:227] Handling call
0925 16:44:42.814910 (+1126671us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.807875  9120 rpcz_store.cc:276] 0925 16:44:41.364117 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.560332 (+196215us) service_pool.cc:227] Handling call
0925 16:44:42.807175 (+1246843us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.825264  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2324) took 1225 ms. Trace:
I20260925 16:44:42.864848  9117 rpcz_store.cc:276] 0925 16:44:41.019624 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.834513 (+1814889us) service_pool.cc:227] Handling call
0925 16:44:42.834730 (+   217us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.834874 (+   144us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:42.834894 (+    20us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.834927 (+    33us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:42.834957 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.834996 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.835076 (+    80us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.866556  9115 rpcz_store.cc:276] 0925 16:44:41.019896 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.851382 (+1831486us) service_pool.cc:227] Handling call
0925 16:44:42.851790 (+   408us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.851993 (+   203us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:42.852029 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.852079 (+    50us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:42.852121 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.852187 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.852327 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:42.260644 13299 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.792s	user 0.009s	sys 0.000s
W20260925 16:44:42.348973 13318 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.053s	user 0.007s	sys 0.003s
W20260925 16:44:42.618537 13449 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.807s	user 0.017s	sys 0.020s
W20260925 16:44:42.628954 13532 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.003s	sys 0.031s
I20260925 16:44:42.863744  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:41.872098 13578 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.395s	user 0.001s	sys 0.000s
I20260925 16:44:42.871722  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:41.688707 13464 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:42.235507 13446 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:42.343600 13519 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:42.743113 13596 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
W20260925 16:44:42.706593 13512 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.832s	user 0.003s	sys 0.008s
W20260925 16:44:42.347283 13389 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.248s	user 0.002s	sys 0.007s
I20260925 16:44:42.345430 13559 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:42.236508 13513 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:42.707466 13551 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.004s	sys 0.007s
I20260925 16:44:42.873111  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2605) took 1796 ms. Trace:
I20260925 16:44:42.880674  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.000133  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2691) took 1511 ms. Trace:
I20260925 16:44:42.835774 13563 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:42.985805 13512 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.111s	user 0.003s	sys 0.011s
I20260925 16:44:42.882139  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2603) took 1814 ms. Trace:
I20260925 16:44:42.522713 13482 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:42.223116 13554 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.703552 13607 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:41.774504 13573 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:42.872560  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.004s	sys 0.008s
W20260925 16:44:42.800854 13609 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260925 16:44:42.870085  8966 rpcz_store.cc:276] 0925 16:44:41.599528 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.236732 (+637204us) service_pool.cc:227] Handling call
0925 16:44:42.825206 (+588474us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:42.881417  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2663) took 1754 ms. Trace:
I20260925 16:44:43.062820 13573 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.833442 13112 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.867851  9044 rpcz_store.cc:276] 0925 16:44:41.147003 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.827397 (+1680394us) service_pool.cc:227] Handling call
0925 16:44:42.828903 (+  1506us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.066731  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:42.687386 13511 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.939s	user 0.006s	sys 0.005s
I20260925 16:44:42.863515  9043 rpcz_store.cc:276] 0925 16:44:41.697441 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.813466 (+1116025us) service_pool.cc:227] Handling call
0925 16:44:42.829735 (+ 16269us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:42.958933  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70197.3us
W20260925 16:44:42.258584 13585 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.438s	user 0.000s	sys 0.001s
I20260925 16:44:42.962621  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.082930  8974 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:41.987231 13272 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.014410 13539 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:42.833662 13322 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.348s	user 0.015s	sys 0.020s
I20260925 16:44:42.964730  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:42.965538  9124 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260925 16:44:42.260905 13542 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.634s	user 0.011s	sys 0.000s
I20260925 16:44:42.966387  9042 raft_consensus.cc:2362] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10. Re-sending same reply.
I20260925 16:44:42.968230  8967 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:42.866771  9700 rpcz_store.cc:276] 0925 16:44:41.100801 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.835411 (+1734610us) service_pool.cc:227] Handling call
0925 16:44:42.835764 (+   353us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.835953 (+   189us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:42.835987 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.836037 (+    50us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:42.836077 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.836138 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.836246 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.021168 13603 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:42.960017 13449 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.186s	user 0.018s	sys 0.026s
I20260925 16:44:43.117859  9047 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:44:42.964774 13532 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.083s	user 0.004s	sys 0.034s
I20260925 16:44:42.870920 13428 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:42.958519 13387 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:42.958992 13473 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:42.909111 13608 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:42.996629  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.004s	sys 0.008s
I20260925 16:44:43.094974 13511 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:42.969636 13464 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:43.002146  9115 rpcz_store.cc:276] 0925 16:44:41.076323 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.872247 (+1795924us) service_pool.cc:227] Handling call
0925 16:44:42.872502 (+   255us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.872797 (+   295us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:42.872827 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.872863 (+    36us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:42.872894 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.872951 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.873049 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:42.906546 13159 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.677s	user 0.003s	sys 0.010s
I20260925 16:44:42.481925 13538 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:42.977669 12787 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260925 16:44:42.835903 13131 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.011199  9117 rpcz_store.cc:276] 0925 16:44:41.067738 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.870308 (+1802570us) service_pool.cc:227] Handling call
0925 16:44:42.881672 (+ 11364us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.881858 (+   186us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:42.881881 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.881925 (+    44us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:42.881965 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.882011 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.882094 (+    83us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:43.002526 13551 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.309s	user 0.008s	sys 0.012s
I20260925 16:44:42.836007 13435 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.018065  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1260) took 2339 ms. Trace:
I20260925 16:44:42.984817 13519 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.983877 13624 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:42.968595 13318 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.016386 13607 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:42.996498 13559 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.015872 13482 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.094188  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2601) took 2047 ms. Trace:
I20260925 16:44:42.223603 13434 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:42.986176 13389 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:43.092760 13518 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.011s	sys 0.029s
W20260925 16:44:43.118062  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 293659us
I20260925 16:44:43.112071 13539 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.117182  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1099) took 1565 ms. Trace:
I20260925 16:44:42.986050 13436 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:43.134119  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.914s	user 0.005s	sys 0.009s
I20260925 16:44:42.965487 13472 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:43.111045 13272 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.115881 13542 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.205035  9696 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:43.190729 13473 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:43.239224 13473 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.239985 13272 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.240468 13435 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.240137 13473 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.242154  9700 rpcz_store.cc:276] 0925 16:44:41.551409 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.116164 (+1564755us) service_pool.cc:227] Handling call
0925 16:44:43.116575 (+   411us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.116783 (+   208us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:43.116821 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.116877 (+    56us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:43.116927 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.116993 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.117121 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.119282 13622 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:43.135900 13159 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.007s	sys 0.011s
W20260925 16:44:43.156038 13597 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.443s	user 0.003s	sys 0.003s
I20260925 16:44:43.135798 13464 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:43.136018 13387 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.240661 13472 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.155836 13538 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:43.121567 13603 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.134181 13604 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.156806 13573 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.269699 13542 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.250056 13624 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:43.270406 13614 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260925 16:44:43.271823 13473 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:43.265859 13436 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:43.272785 13389 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:43.269369 13601 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260925 16:44:43.272202 13624 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.244858 13459 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.272159 13539 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:43.276855 13618 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.165s	user 0.001s	sys 0.000s
I20260925 16:44:43.278203 13519 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.280179 13603 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.281296 13482 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.283499 13482 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:43.284148 13607 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.284402 13472 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.135210 13428 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.295298 13563 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.296825 13554 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.297124 13559 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.261566 13622 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.298815 13428 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.299072 13622 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.282545 13604 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.138468 13608 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.301451 13604 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.302392 13608 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.304430 13464 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.006291  8869 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 5, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 5 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:44:43.340205  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 269258us
I20260925 16:44:43.101019  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2322) took 1556 ms. Trace:
W20260925 16:44:43.062839  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.843s	user 0.005s	sys 0.013s
I20260925 16:44:43.342581  8967 rpcz_store.cc:276] 0925 16:44:41.544556 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.869729 (+1325173us) service_pool.cc:227] Handling call
0925 16:44:42.965671 (+ 95942us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.100807 (+135136us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.100968 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.061408  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:43.347414  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2325) took 1657 ms (client timeout 2121 ms). Trace:
I20260925 16:44:43.093236  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1770) took 1950 ms. Trace:
W20260925 16:44:43.348097  8973 rpcz_store.cc:269] 0925 16:44:41.690332 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.020496 (+1330164us) service_pool.cc:227] Handling call
0925 16:44:43.347110 (+326614us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.350719  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 864) took 2281 ms. Trace:
I20260925 16:44:43.351204  8975 rpcz_store.cc:276] 0925 16:44:41.070283 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.080539 (+ 10256us) service_pool.cc:227] Handling call
0925 16:44:41.101228 (+ 20689us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:41.122249 (+ 21021us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:41.122287 (+    38us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:41.122873 (+   586us) log.cc:842] Serialized 52 byte log entry
0925 16:44:41.431496 (+308623us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:42.818916 (+1387420us) log.cc:842] Serialized 14 byte log entry
0925 16:44:42.865528 (+ 46612us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.865615 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:43.350181 (+484566us) raft_consensus.cc:1671] finished
0925 16:44:43.350212 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.350544 (+   332us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55148,"prepare.queue_time_us":439450,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"raft.queue_time_us":73512,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":44654,"thread_start_us":1642697,"threads_started":2,"wal-append.queue_time_us":414406}
I20260925 16:44:43.348454  8971 rpcz_store.cc:276] 0925 16:44:41.142659 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.142819 (+   160us) service_pool.cc:227] Handling call
0925 16:44:41.143211 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:41.143573 (+   362us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:41.143598 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:41.232475 (+ 88877us) log.cc:842] Serialized 26 byte log entry
0925 16:44:41.681127 (+448652us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:41.681166 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.681236 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:43.093009 (+1411773us) raft_consensus.cc:1671] finished
0925 16:44:43.093036 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.093183 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":688,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":86384,"spinlock_wait_cycles":1332480,"thread_start_us":207526,"threads_started":1,"wal-append.queue_time_us":1221467}
W20260925 16:44:43.130750  9013 service_pool.cc:137] GetConsensusState request on kudu.consensus.ConsensusService from 127.0.0.1:55034 dropped due to backpressure. The service queue is full; it has 50 items.
I20260925 16:44:43.000474  9041 rpcz_store.cc:276] 0925 16:44:41.488446 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.829171 (+1340725us) service_pool.cc:227] Handling call
0925 16:44:43.000077 (+170906us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.361336  9013 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1149) took 1998 ms. Trace:
I20260925 16:44:43.361845  9013 rpcz_store.cc:276] 0925 16:44:41.363204 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.360932 (+1997728us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260925 16:44:43.068476  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:43.364703  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 820) took 1560 ms (client timeout 2022 ms). Trace:
W20260925 16:44:42.880779  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 821055us
W20260925 16:44:43.365159  9043 rpcz_store.cc:269] 0925 16:44:41.804490 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.068242 (+1263752us) service_pool.cc:227] Handling call
0925 16:44:43.364492 (+296250us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.366535  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:43.366714  9044 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:43.063616  9045 rpcz_store.cc:276] 0925 16:44:41.126969 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.128475 (+  1506us) service_pool.cc:227] Handling call
0925 16:44:41.358560 (+230085us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:41.363192 (+  4632us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:41.371689 (+  8497us) log.cc:842] Serialized 14 byte log entry
0925 16:44:42.881081 (+1509392us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:42.881136 (+    55us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:42.881189 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:42.881254 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:42.881362 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70268,"prepare.queue_time_us":649,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":97939,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":10397,"thread_start_us":1438106,"threads_started":1}
I20260925 16:44:43.100982  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 823) took 1047 ms. Trace:
I20260925 16:44:43.368690  9042 rpcz_store.cc:276] 0925 16:44:42.053239 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.821319 (+768080us) service_pool.cc:227] Handling call
0925 16:44:43.100929 (+279610us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.363442  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.371321  9041 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:43.372370  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 829) took 1313 ms. Trace:
I20260925 16:44:43.373250  9041 rpcz_store.cc:276] 0925 16:44:42.059407 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.362617 (+1303210us) service_pool.cc:227] Handling call
0925 16:44:43.372301 (+  9684us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.381238  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:43.093641  9049 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:43.356923  8869 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 3 to 7, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:44:43.385170  9089 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.001s	sys 0.001s
W20260925 16:44:43.384531  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 810) took 1696 ms (client timeout 2134 ms). Trace:
W20260925 16:44:43.099967  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 275852us
I20260925 16:44:43.385903  9050 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:43.400105  9049 rpcz_store.cc:269] 0925 16:44:41.687722 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.873033 (+1185311us) service_pool.cc:227] Handling call
0925 16:44:43.384232 (+511199us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.401806  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.402897  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2694) took 1794 ms. Trace:
I20260925 16:44:43.403275  9049 rpcz_store.cc:276] 0925 16:44:41.608032 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.401279 (+1793247us) service_pool.cc:227] Handling call
0925 16:44:43.402816 (+  1537us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.404879  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.406209  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 828) took 1347 ms. Trace:
I20260925 16:44:43.406684  9049 rpcz_store.cc:276] 0925 16:44:42.059090 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.404406 (+1345316us) service_pool.cc:227] Handling call
0925 16:44:43.406133 (+  1727us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.408069  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.409199  9049 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:43.409754  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2669) took 2210 ms. Trace:
I20260925 16:44:43.410625  9049 rpcz_store.cc:276] 0925 16:44:41.199399 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.407606 (+2208207us) service_pool.cc:227] Handling call
0925 16:44:43.409659 (+  2053us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:43.410300  9089 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.004s	sys 0.004s
I20260925 16:44:43.362855  9013 service_pool.cc:140] GetConsensusState request on kudu.consensus.ConsensusService from 127.0.0.1:55034 dropped due to backpressure. The service queue is full; it has 50 items. Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 821)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2698)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 825)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2694)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 828)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2669)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2678)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1767)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1773)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1763)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1779)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1775)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1768)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1781)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 827)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1783)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1780)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1771)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1774)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2703)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2697)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1766)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1770)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2675)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1778)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1762)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2701)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2671)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2681)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2693)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 809)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 814)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 815)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2695)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2699)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2700)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2702)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 822)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 824)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 826)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1764)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1765)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1769)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1772)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1776)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1777)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1782)
I20260925 16:44:43.138895  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2606) took 2038 ms. Trace:
I20260925 16:44:43.427028  9115 rpcz_store.cc:276] 0925 16:44:41.100162 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.138056 (+2037894us) service_pool.cc:227] Handling call
0925 16:44:43.138374 (+   318us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.138545 (+   171us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:43.138581 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.138630 (+    49us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:43.138673 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.138730 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.138841 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.144973  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2607) took 2014 ms. Trace:
I20260925 16:44:43.454502 13482 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:43.412277  9118 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:43.459896  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2598) took 2626 ms. Trace:
I20260925 16:44:43.460501  9119 rpcz_store.cc:276] 0925 16:44:40.828875 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.830311 (+  1436us) service_pool.cc:227] Handling call
0925 16:44:40.830643 (+   332us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:40.836888 (+  6245us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:40.926228 (+ 89340us) log.cc:842] Serialized 14 byte log entry
0925 16:44:41.090894 (+164666us) spinlock_profiling.cc:243] Waited 2.06 ms on lock 0x7b18004787e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:44:41.091074 (+   180us) log.cc:842] Serialized 14 byte log entry
0925 16:44:41.095528 (+  4454us) spinlock_profiling.cc:243] Waited 8.37 ms on lock 0x7b4800250458. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:41.372728 (+277200us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:41.413145 (+ 40417us) log.cc:842] Serialized 26 byte log entry
0925 16:44:41.413352 (+   207us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:41.413396 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.413483 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:43.166495 (+1753012us) spinlock_profiling.cc:243] Waited 8.28 ms on lock 0x7b18004787e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:43.444492 (+277997us) spinlock_profiling.cc:243] Waited 14.4 ms on lock 0x7b18004787e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:43.455308 (+ 10816us) raft_consensus.cc:1671] finished
0925 16:44:43.455337 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.455549 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43613,"prepare.queue_time_us":263183,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2204,"raft.queue_time_us":65187,"raft.run_cpu_time_us":2529,"raft.run_wall_time_us":264088,"spinlock_wait_cycles":76173952,"thread_start_us":406363,"threads_started":3,"wal-append.queue_time_us":145158}
I20260925 16:44:43.413005  9124 rpcz_store.cc:276] 0925 16:44:41.046692 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.836443 (+1789751us) service_pool.cc:227] Handling call
0925 16:44:42.958117 (+121674us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.093801 (+135684us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.094127 (+   326us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.464129 13431 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:43.465320  9124 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:44:43.465075 13431 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.465929  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2608) took 2113 ms. Trace:
I20260925 16:44:43.466280  9124 rpcz_store.cc:276] 0925 16:44:41.352034 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.464150 (+2112116us) service_pool.cc:227] Handling call
0925 16:44:43.464673 (+   523us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.465674 (+  1001us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.465857 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.411965  8869 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:43.396921  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:43.419104  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.395s	user 0.006s	sys 0.007s
I20260925 16:44:43.243656  9698 rpcz_store.cc:276] 0925 16:44:40.678673 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.678780 (+   107us) service_pool.cc:227] Handling call
0925 16:44:40.716075 (+ 37295us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:41.748498 (+1032423us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.017744 (+1269246us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b5400691754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.017991 (+   247us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1778565504}
W20260925 16:44:43.422385  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1097855170000912s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18280000000000002s for a response
I20260925 16:44:43.424665  9697 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:43.425828  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1089) took 2818 ms. Trace:
I20260925 16:44:43.438433 13112 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.440322 13428 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:43.469089  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 88330.5us
I20260925 16:44:43.441255 13538 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:44:43.442858 13446 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:43.446686 13464 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.429915  9115 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:43.438010  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.454315  9117 rpcz_store.cc:276] 0925 16:44:41.130852 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.144046 (+2013194us) service_pool.cc:227] Handling call
0925 16:44:43.144396 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.144601 (+   205us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:43.144638 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.144689 (+    51us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:43.144739 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.144799 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.144916 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.413287  9120 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:43.455662  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:40140 (request call id 41) took 2498 ms. Trace:
I20260925 16:44:43.476794  9049 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:43.476965  9046 rpcz_store.cc:276] 0925 16:44:40.957015 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.957590 (+   575us) service_pool.cc:227] Handling call
0925 16:44:43.455166 (+2497576us) spinlock_profiling.cc:243] Waited 71.6 ms on lock 0x7b54000bf4d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.455382 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":164672384}
I20260925 16:44:43.478571  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:43.482933  9696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1096) took 2382 ms (client timeout 1882 ms). Trace:
I20260925 16:44:43.483013 13446 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:43.484252 13446 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:43.485291 13446 consensus_queue.cc:1225] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 12.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:44:43.484982 13428 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.485844 13446 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:43.486351  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1258) took 2808 ms. Trace:
I20260925 16:44:43.441326 13318 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:43.471077  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.447s	user 0.006s	sys 0.007s
I20260925 16:44:43.479219  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.467408 13431 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.473033  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1018) took 2927 ms. Trace:
I20260925 16:44:43.469388  9694 rpcz_store.cc:276] 0925 16:44:40.606939 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.607053 (+   114us) service_pool.cc:227] Handling call
0925 16:44:40.607347 (+   294us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:40.619796 (+ 12449us) raft_consensus.cc:1520] Early marking committed up to index 6
0925 16:44:41.478212 (+858416us) log.cc:842] Serialized 14 byte log entry
0925 16:44:41.889568 (+411356us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:41.988223 (+ 98655us) log.cc:842] Serialized 26 byte log entry
0925 16:44:41.988387 (+   164us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:41.988431 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.988579 (+   148us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:43.425230 (+1436651us) raft_consensus.cc:1671] finished
0925 16:44:43.425273 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.425585 (+   312us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12361,"prepare.queue_time_us":406126,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":454569,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":18746,"thread_start_us":1158357,"threads_started":2,"wal-append.queue_time_us":1558013}
I20260925 16:44:43.473294  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.491878  9116 rpcz_store.cc:276] 0925 16:44:40.545727 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.555914 (+ 10187us) service_pool.cc:227] Handling call
0925 16:44:40.556188 (+   274us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:41.602377 (+1046189us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.472458 (+1870081us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400166554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.472846 (+   388us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1316977024}
I20260925 16:44:43.492921  9698 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260925 16:44:43.494375  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:43.495121  9698 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:43.474014  9048 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.644s	user 0.008s	sys 0.012s
I20260925 16:44:43.490353  9049 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:43.492730  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:43.473539  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0473264330000802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260925 16:44:43.491102  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2716) took 2340 ms. Trace:
I20260925 16:44:43.497092  9115 rpcz_store.cc:276] 0925 16:44:41.146399 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.428726 (+2282327us) service_pool.cc:227] Handling call
0925 16:44:43.429484 (+   758us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.475203 (+ 45719us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.487129 (+ 11926us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.486775  9702 rpcz_store.cc:276] 0925 16:44:40.677962 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.679584 (+  1622us) service_pool.cc:227] Handling call
0925 16:44:40.888189 (+208605us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:41.541527 (+653338us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.485847 (+1944320us) spinlock_profiling.cc:243] Waited 479 ms on lock 0x7b54006eda54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.486149 (+   302us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1102526720}
W20260925 16:44:43.483600  9696 rpcz_store.cc:269] 0925 16:44:41.100515 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.560909 (+460394us) service_pool.cc:227] Handling call
0925 16:44:43.482458 (+1921549us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b540071e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.482709 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3628200832}
W20260925 16:44:43.497051  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.2748e+06us
I20260925 16:44:43.486263 13446 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.505333 13112 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:43.506496 13112 consensus_queue.cc:1225] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:44:43.505632  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.508792  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.510162  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.511066  9046 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:43.496479 13428 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.512089  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.513592  9048 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:43.520975  9048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2692) took 1974 ms (client timeout 2011 ms). Trace:
W20260925 16:44:43.521458  9048 rpcz_store.cc:269] 0925 16:44:41.546679 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.230030 (+683351us) service_pool.cc:227] Handling call
0925 16:44:43.520854 (+1290824us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.522571  9047 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:43.522783  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.526646  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.523886  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.524063 13516 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:43.531651  9694 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:43.538576 13623 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:43.543962 13623 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.546612  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.547508  8975 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:44:43.547976  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.548658 13623 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.549577  9696 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:43.551795 13318 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.552455 13318 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.554860 13318 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.555944  8970 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:43.555871 13431 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.558166 13431 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.560475 13431 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.560762  9702 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:44:43.555840 13559 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:43.555421 13555 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:43.574139  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 2.01661e+06us
I20260925 16:44:43.576229  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1022) took 2910 ms. Trace:
I20260925 16:44:43.577584  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2707) took 2669 ms. Trace:
I20260925 16:44:43.577783  9119 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 7. Current term is 8. Ops: []
W20260925 16:44:43.578603  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.674s (SENT)
I20260925 16:44:43.578871  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2602) took 2517 ms. Trace:
I20260925 16:44:43.580577  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1264) took 2618 ms. Trace:
W20260925 16:44:43.599152  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 819) took 1797 ms (client timeout 2025 ms). Trace:
I20260925 16:44:43.581477 13112 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:43.600805 13021 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.601755 13112 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:43.602439 13112 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.601810 13021 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.581913  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1026) took 2516 ms. Trace:
I20260925 16:44:43.583244  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.584149  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.561918  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.584522 13387 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:43.584635  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 817) took 1833 ms (client timeout 1698 ms). Trace:
I20260925 16:44:43.555505 13318 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.540132  8869 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 3 to 5, term changed from 4 to 6, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to <none>, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 6 committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:43.588008 13538 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:43.589679  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.591017  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.600970  9697 rpcz_store.cc:276] 0925 16:44:40.962659 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.683158 (+720499us) service_pool.cc:227] Handling call
0925 16:44:41.683503 (+   345us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.472032 (+1788529us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.580282 (+108250us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b54006bce54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.580500 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4002826112}
W20260925 16:44:43.591765  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.007s	sys 0.016s
W20260925 16:44:43.546080  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.012s	sys 0.004s
I20260925 16:44:43.592272  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1098) took 2099 ms. Trace:
I20260925 16:44:43.562341  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.593647  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:43.609274  9050 rpcz_store.cc:269] 0925 16:44:41.750894 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.220761 (+469867us) service_pool.cc:227] Handling call
0925 16:44:43.584425 (+1363664us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400261bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.584549 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1317032832}
I20260925 16:44:43.615036  9701 rpcz_store.cc:276] 0925 16:44:41.492343 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.848173 (+1355830us) service_pool.cc:227] Handling call
0925 16:44:42.895401 (+ 47228us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.420445 (+525044us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:43.420502 (+    57us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.420559 (+    57us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:43.420611 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.591920 (+171309us) spinlock_profiling.cc:243] Waited 524 ms on lock 0x7b5400436054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.591961 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.592111 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1206013184}
I20260925 16:44:43.603935  9120 rpcz_store.cc:276] 0925 16:44:41.065010 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.870077 (+1805067us) service_pool.cc:227] Handling call
0925 16:44:42.963953 (+ 93876us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.476614 (+512661us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.581573 (+104959us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001c9b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.581847 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1031982464}
I20260925 16:44:43.614327  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2718) took 2312 ms. Trace:
W20260925 16:44:43.618336  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.012s	sys 0.004s
I20260925 16:44:43.618273  9119 rpcz_store.cc:276] 0925 16:44:41.296252 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.471547 (+2175295us) service_pool.cc:227] Handling call
0925 16:44:43.516811 (+ 45264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.608845 (+ 92034us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.609022 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:43.618273  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.008s	sys 0.016s
W20260925 16:44:43.619812  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2678) took 2283 ms (client timeout 3030 ms). Trace:
W20260925 16:44:43.620293  9041 rpcz_store.cc:269] 0925 16:44:41.336851 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.593273 (+2256422us) service_pool.cc:227] Handling call
0925 16:44:43.619733 (+ 26460us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:43.561890  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 165269us
I20260925 16:44:43.538277 13446 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.596853  9118 rpcz_store.cc:276] 0925 16:44:40.666208 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.666334 (+   126us) service_pool.cc:227] Handling call
0925 16:44:40.674551 (+  8217us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.459457 (+2784906us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.575924 (+116467us) spinlock_profiling.cc:243] Waited 2.74 s on lock 0x7b540007dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.576175 (+   251us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6294516608}
I20260925 16:44:43.596992  9121 rpcz_store.cc:276] 0925 16:44:40.908395 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.909978 (+  1583us) service_pool.cc:227] Handling call
0925 16:44:40.910458 (+   480us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:42.868837 (+1958379us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.577140 (+708303us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.577424 (+   284us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4432228736}
I20260925 16:44:43.600605  9122 rpcz_store.cc:276] 0925 16:44:41.061239 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.866046 (+1804807us) service_pool.cc:227] Handling call
0925 16:44:42.866274 (+   228us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.065521 (+199247us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:43.065551 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.065596 (+    45us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:43.065635 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.578455 (+512820us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:43.578511 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.578698 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":457756544}
W20260925 16:44:43.601030  9044 rpcz_store.cc:269] 0925 16:44:41.801411 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.066452 (+1265041us) service_pool.cc:227] Handling call
0925 16:44:43.594496 (+528044us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54002b61d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.599080 (+  4584us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":687508224}
I20260925 16:44:43.608047 13555 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.612120 13318 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.591440  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.629364  9048 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:43.638265  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 825) took 1580 ms. Trace:
I20260925 16:44:43.638700  9043 rpcz_store.cc:276] 0925 16:44:42.058142 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.591083 (+1532941us) service_pool.cc:227] Handling call
0925 16:44:43.638206 (+ 47123us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.640960  9045 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
W20260925 16:44:43.641896  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2698) took 1780 ms (client timeout 2115 ms). Trace:
W20260925 16:44:43.642493  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 63973.3us
W20260925 16:44:43.642445  9045 rpcz_store.cc:269] 0925 16:44:41.862026 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.582642 (+1720616us) service_pool.cc:227] Handling call
0925 16:44:43.641825 (+ 59183us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.645107 13590 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:43.646561 13590 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:44:43.647388 13590 consensus_queue.cc:1225] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260925 16:44:43.647891 13387 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:43.648325 13387 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.649667 13387 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.651257 13559 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.652647  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.653518 13559 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.653995  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.654253  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.654860  8972 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:43.655040  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.655864  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.656318 13555 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.656456  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.657951  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:43.659595  9698 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:43.660175  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:43.660903  8975 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:43.661144  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.662093  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:43.664747 13389 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:43.665362 13389 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.666693 13389 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.670818  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.671832  9115 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:43.672003  9119 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:43.672245  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.672927 13464 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.673427 13322 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:43.673594 13464 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.674345 13322 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.669195  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:43.651191 13387 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:43.678383  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:43.651813  9694 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:43.638284  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:43.638796  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 821) took 1799 ms (client timeout 2108 ms). Trace:
W20260925 16:44:43.681324  9042 rpcz_store.cc:269] 0925 16:44:41.840593 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.589328 (+1748735us) service_pool.cc:227] Handling call
0925 16:44:43.638748 (+ 49420us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.635733  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.684449  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:43.685022  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 911) took 2077 ms. Trace:
I20260925 16:44:43.685810  9701 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:43.686175  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:43.686954  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:43.687312 13322 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.687759  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.688297  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.688544  9694 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:43.688819  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:43.689074  9045 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:43.689636  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2703) took 1724 ms. Trace:
I20260925 16:44:43.689841  9697 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:43.690081  9045 rpcz_store.cc:276] 0925 16:44:41.964982 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.677876 (+1712894us) service_pool.cc:227] Handling call
0925 16:44:43.689574 (+ 11698us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.690864  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.691184  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.641908  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.692107  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.692564  9044 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:43.692662  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.693353  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.685879  9117 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260925 16:44:43.694443  9117 pending_rounds.cc:76] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 10
I20260925 16:44:43.694684  9117 pending_rounds.cc:97] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260925 16:44:43.694752  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.694950  9117 raft_consensus.cc:2866] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:43.696542 13318 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.672937  9041 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:43.696965  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:43.697603  9701 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:43.698179  9117 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:43.699326  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:43.700033  9119 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:43.611291 13112 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.700412  9116 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:43.693645  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.693418  9048 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:43.702006  9044 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:43.702600  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2697) took 1844 ms. Trace:
I20260925 16:44:43.702773  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.703008  9044 rpcz_store.cc:276] 0925 16:44:41.859529 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.693351 (+1833822us) service_pool.cc:227] Handling call
0925 16:44:43.702543 (+  9192us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:43.703986  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 52972.2us
I20260925 16:44:43.704139  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.704682  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.705219  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.705519  9043 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:43.705909  9042 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:43.706481  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.706827  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.707062  9043 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:43.707372  9042 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:43.678195 13431 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:43.707778  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.686923  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.704160  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.713797  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.691149  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.718789  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.723644  9045 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:43.720510 13612 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.712s	user 0.000s	sys 0.003s
W20260925 16:44:43.722225  8940 connection.cc:232] RPC call timeout handler was delayed by -2.1858661280000433s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1676s for a response
W20260925 16:44:43.639986 13456 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.038s	user 0.032s	sys 0.040s
I20260925 16:44:43.689494  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.716639  9044 raft_consensus.cc:2354] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:43.717777  9695 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
W20260925 16:44:43.725387 13588 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 2.170s	user 0.001s	sys 0.011s
I20260925 16:44:43.708294 13431 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.715174  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.705533  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.729604 12787 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:43.730129 13021 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.743266  9050 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:43.685527  9700 rpcz_store.cc:276] 0925 16:44:41.607563 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.243398 (+1635835us) service_pool.cc:227] Handling call
0925 16:44:43.243769 (+   371us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.243986 (+   217us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:44:43.514504 (+270518us) log.cc:842] Serialized 14 byte log entry
0925 16:44:43.684058 (+169554us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.684199 (+   141us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:43.684430 (+   231us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.684563 (+   133us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.684786 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":291264,"prepare.run_cpu_time_us":132,"prepare.run_wall_time_us":13971,"raft.queue_time_us":1555,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":77227,"thread_start_us":93585,"threads_started":2}
I20260925 16:44:43.733632 13318 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:43.734187 13436 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:43.715094 13464 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:43.729241  8940 connection.cc:232] RPC call timeout handler was delayed by -2.1794130960001894s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1664s for a response
W20260925 16:44:43.735491 13456 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.175s	user 0.033s	sys 0.040s
I20260925 16:44:43.744288  9698 raft_consensus.cc:2362] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12. Re-sending same reply.
I20260925 16:44:43.749996  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:43.750275  8940 connection.cc:232] RPC call timeout handler was delayed by -2.1660661280000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260925 16:44:43.750824  8940 connection.cc:232] RPC call timeout handler was delayed by -2.1585078080001949s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1642s for a response
W20260925 16:44:43.751878  8940 connection.cc:232] RPC call timeout handler was delayed by -2.1269241160000547s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1646s for a response
W20260925 16:44:43.752292  8940 connection.cc:232] RPC call timeout handler was delayed by -2.0436661280000408s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1834s for a response
I20260925 16:44:43.756009  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.739378 13112 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:43.759965  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.765098  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1088) took 3158 ms. Trace:
I20260925 16:44:43.765739 13482 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:43.766554 13482 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.772468  9048 raft_consensus.cc:2396] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 12 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260925 16:44:43.772944  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2675) took 2542 ms. Trace:
I20260925 16:44:43.772976  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.773368  9048 rpcz_store.cc:276] 0925 16:44:41.230884 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.705152 (+2474268us) service_pool.cc:227] Handling call
0925 16:44:43.772890 (+ 67738us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.748221 13436 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:43.777196  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2701) took 1813 ms. Trace:
I20260925 16:44:43.780321  9050 rpcz_store.cc:276] 0925 16:44:41.964274 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.745754 (+1781480us) service_pool.cc:227] Handling call
0925 16:44:43.777138 (+ 31384us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.778949  9700 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260925 16:44:43.740376 13590 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260925 16:44:43.780036  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1027) took 2416 ms. Trace:
I20260925 16:44:43.781785  9698 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:43.775274 13446 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:43.765594  9699 rpcz_store.cc:276] 0925 16:44:40.606675 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.606792 (+   117us) service_pool.cc:227] Handling call
0925 16:44:40.607112 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:40.607421 (+   309us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:40.607450 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:40.613865 (+  6415us) log.cc:842] Serialized 26 byte log entry
0925 16:44:41.489160 (+875295us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:41.489212 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:41.489281 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:43.724442 (+2235161us) spinlock_profiling.cc:243] Waited 74.3 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:43.764555 (+ 40113us) raft_consensus.cc:1671] finished
0925 16:44:43.764582 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.764901 (+   319us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":301,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":15020,"spinlock_wait_cycles":170969984,"thread_start_us":827308,"threads_started":1,"wal-append.queue_time_us":779800}
I20260925 16:44:43.783733  9044 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
W20260925 16:44:43.790932  8940 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.520s (SENT)
I20260925 16:44:43.791983  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.782238  9124 rpcz_store.cc:276] 0925 16:44:41.359145 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.466980 (+2107835us) service_pool.cc:227] Handling call
0925 16:44:43.467473 (+   493us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.476244 (+  8771us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:44:43.588781 (+112537us) log.cc:842] Serialized 14 byte log entry
0925 16:44:43.775566 (+186785us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.775601 (+    35us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:43.775632 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.775670 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.775839 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":55545,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"thread_start_us":181568,"threads_started":1}
I20260925 16:44:43.794625 13564 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:43.795142 13460 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:43.797070  8940 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.601s (SENT)
I20260925 16:44:43.800393  9050 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:43.800848  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:43.775358 13482 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:43.805330  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2318) took 2322 ms (client timeout 2219 ms). Trace:
I20260925 16:44:43.807934 13318 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.809423 13266 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
W20260925 16:44:43.813900 13600 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.025s	user 0.000s	sys 0.005s
I20260925 16:44:43.812937  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:43.816738  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:43.817529 13539 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.818156 13603 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:43.852438  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:43.824615  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:43.781970 13436 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:43.826313 13434 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.040s
I20260925 16:44:43.827736  9701 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:43.831948 13431 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:43.793227 13536 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.003s	sys 0.017s
I20260925 16:44:43.890159  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.891517  9120 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260925 16:44:43.892194 13482 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:43.892742  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:43.894044  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 849) took 3400 ms (client timeout 2240 ms). Trace:
W20260925 16:44:43.894554  8968 rpcz_store.cc:269] 0925 16:44:40.486979 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.487106 (+   127us) service_pool.cc:227] Handling call
0925 16:44:43.887245 (+3400139us) spinlock_profiling.cc:243] Waited 2.61 s on lock 0x7b54003561d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.887535 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5993071360}
I20260925 16:44:43.893689  9120 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:43.833653 13538 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:43.896844 13538 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.898396  9116 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260925 16:44:43.835032  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.900557  9115 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:43.901757 13623 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:43.902168 13623 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:43.902354  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50780 (request call id 3) took 3293 ms. Trace:
I20260925 16:44:43.902567 13623 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:43.836928  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:43.828708  9047 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 808) took 2141 ms (client timeout 2066 ms). Trace:
I20260925 16:44:43.862213 13460 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.909848 13460 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.904219 13413 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:43.859136 13564 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.910590 13413 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:43.911073 13413 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:43.832985  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:43.841090  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50592.2us
W20260925 16:44:43.827420  9695 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1091) took 3219 ms (client timeout 3667 ms). Trace:
I20260925 16:44:43.840691  9044 raft_consensus.cc:595] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:44:43.849794  8969 rpcz_store.cc:269] 0925 16:44:41.482910 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.805013 (+2322103us) service_pool.cc:214] Skipping call since client already timed out
0925 16:44:43.805142 (+   129us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260925 16:44:43.914425  9044 raft_consensus.cc:603] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:43.841871  9046 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:43.862138  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61507.3us
W20260925 16:44:43.870540  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53954.5us
I20260925 16:44:43.916527  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 827) took 1857 ms. Trace:
I20260925 16:44:43.839174 13131 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:43.858870 13266 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:43.872686  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60078.3us
I20260925 16:44:43.872397 13603 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.874435 13318 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:43.875300  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2671) took 2645 ms. Trace:
I20260925 16:44:43.923786  9048 rpcz_store.cc:276] 0925 16:44:41.229499 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.774031 (+2544532us) service_pool.cc:227] Handling call
0925 16:44:43.848620 (+ 74589us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:43.874915 (+ 26295us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:43.874949 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:43.875010 (+    61us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:43.875050 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:43.875111 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:43.875222 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.870600  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:43.876410  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79451.2us
I20260925 16:44:43.877295  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.882368 13268 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:43.926389 13268 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:43.926618  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 140990us
I20260925 16:44:43.927076 13318 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:43.926893 13268 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.884902  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.927619 13446 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:43.927513  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:43.886281 13473 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:43.928531 13473 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:43.929562  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.929450 13473 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.929956 13603 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.930188  9048 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:43.930575 13603 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:43.930841 13473 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:43.931015 13603 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:43.931110  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.932533  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.902732  9693 rpcz_store.cc:276] 0925 16:44:40.608679 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.608790 (+   111us) service_pool.cc:227] Handling call
0925 16:44:43.901893 (+3293103us) spinlock_profiling.cc:243] Waited 3.08 s on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf307c5 00007f719bf28c1a 00007f71a0e6c6d9 00007f719a556184 00007f719a556112 00007f719a556041 00007f719a555fbc 00007f719a555272 00007f719a35494c 00007f719a353d86
0925 16:44:43.902167 (+   274us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7085428608}
I20260925 16:44:43.916904  9046 rpcz_store.cc:276] 0925 16:44:42.058794 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.583818 (+1525024us) service_pool.cc:227] Handling call
0925 16:44:43.916471 (+332653us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:43.864905  9041 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260925 16:44:43.903680  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 119046us
W20260925 16:44:43.903882  9047 rpcz_store.cc:269] 0925 16:44:41.687063 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:42.824611 (+1137548us) service_pool.cc:227] Handling call
0925 16:44:43.828528 (+1003917us) spinlock_profiling.cc:243] Waited 290 ms on lock 0x7b54002a3d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.828645 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":668128000}
I20260925 16:44:43.898607 13538 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.927506 13318 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:43.889777 13579 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:43.963177  9048 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:43.939879  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.935387  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.953305  9042 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:43.932889 13268 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:43.895872 13539 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.942302  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:43.936331 13515 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:43.921110  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.934145  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:43.890224 13536 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.881s	user 0.003s	sys 0.017s
I20260925 16:44:43.941493  9015 leader_election.cc:398] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
W20260925 16:44:43.913703  9695 rpcz_store.cc:269] 0925 16:44:40.607643 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:40.607825 (+   182us) service_pool.cc:227] Handling call
0925 16:44:43.827159 (+3219334us) spinlock_profiling.cc:243] Waited 3.09 s on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:43.827340 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7101734656}
I20260925 16:44:43.989159  9015 leader_election.cc:401] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:43.942770  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.936955 13522 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:43.926519 13266 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:43.945457  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.936085 13636 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260925 16:44:43.962563  8940 connection.cc:232] RPC call timeout handler was delayed by -1.9698661279999214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1916s for a response
W20260925 16:44:44.012161  8940 connection.cc:232] RPC call timeout handler was delayed by -1.9653357439999581s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
W20260925 16:44:44.012573  8940 connection.cc:232] RPC call timeout handler was delayed by -1.9527661279998938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1935s for a response
W20260925 16:44:44.012915  8940 connection.cc:232] RPC call timeout handler was delayed by -1.9448534150001251s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17190000000000003s for a response
W20260925 16:44:44.013236  8940 connection.cc:232] RPC call timeout handler was delayed by -1.9007534150000538s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1768s for a response
W20260925 16:44:44.013514  8940 connection.cc:232] RPC call timeout handler was delayed by -1.8726661279999917s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20240000000000002s for a response
I20260925 16:44:43.961433  9043 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:43.964931  9119 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:43.966293  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:43.968776  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:44.014719  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 72508.3us
I20260925 16:44:43.969281  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:43.969471 13436 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:43.969971  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:43.971437 13538 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:43.971943 13318 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:43.971575 13579 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:43.973095  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:44.028250  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:44.029831  9121 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260925 16:44:44.029966 13515 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:44.030411 13515 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:44.031045  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:43.973349 13647 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.096s	user 0.003s	sys 0.000s
I20260925 16:44:44.033674 13436 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:44.034621  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3a3bc92ca0a4efa913eca1800a1550d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:44.034760 12666 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:43.976933 13564 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:44.035959 13095 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:44.036007 13564 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:44.036659 13095 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:43.984647  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1762) took 1005 ms. Trace:
I20260925 16:44:44.037822 13095 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.038519  9042 rpcz_store.cc:276] 0925 16:44:42.959124 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.706565 (+747441us) service_pool.cc:227] Handling call
0925 16:44:43.964285 (+257720us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.038847 13644 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:44.041015 13539 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.041754  9122 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:44.042749 13413 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:44.046232  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105001us
I20260925 16:44:44.047034  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.048173  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:44.048441 13266 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:44.049063  9119 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:44.049933  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 115970us
W20260925 16:44:44.050336  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 81157.6us
I20260925 16:44:44.050720  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:44.051574 13536 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:44.055303  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:43.958180 12787 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:43.931643 13603 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:43.999145  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:43.990509  9045 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:44.040290  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 815) took 2289 ms. Trace:
W20260925 16:44:43.991236  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66625.5us
I20260925 16:44:44.016350  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1778) took 1050 ms. Trace:
I20260925 16:44:44.059841  9042 rpcz_store.cc:276] 0925 16:44:41.750395 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.039309 (+2288914us) service_pool.cc:227] Handling call
0925 16:44:44.039658 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.039964 (+   306us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:44.039993 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:44.040033 (+    40us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:44.040069 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.040124 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:44.040213 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.019156  9044 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:44:44.021899  9047 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:44.024211 13408 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:44.024644  8940 connection.cc:232] RPC call timeout handler was delayed by -1.78844193000009s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1867s for a response
I20260925 16:44:44.065443  9120 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:44.025378  9123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2604) took 2956 ms (client timeout 1882 ms). Trace:
I20260925 16:44:44.057904  9117 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:44:44.057314  8975 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:44.061843  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2693) took 2502 ms. Trace:
I20260925 16:44:44.061690  9041 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:44.066857  9044 rpcz_store.cc:276] 0925 16:44:41.558976 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.963681 (+2404705us) service_pool.cc:227] Handling call
0925 16:44:44.016986 (+ 53305us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.061598 (+ 44612us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.061776 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.060446  9043 rpcz_store.cc:276] 0925 16:44:42.966239 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.706201 (+739962us) service_pool.cc:227] Handling call
0925 16:44:44.016288 (+310087us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.059170  9700 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:44:44.065382  8940 connection.cc:232] RPC call timeout handler was delayed by -1.6872661279999193s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.223s for a response
W20260925 16:44:44.068496  8940 connection.cc:232] RPC call timeout handler was delayed by -1.6705624920000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.4742s for a response
W20260925 16:44:44.068895  8940 connection.cc:232] RPC call timeout handler was delayed by -1.628320924000036s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260925 16:44:44.069231  8940 connection.cc:232] RPC call timeout handler was delayed by -1.6051781450000817s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20110000000000003s for a response
W20260925 16:44:44.069545  8940 connection.cc:232] RPC call timeout handler was delayed by -1.3721188130000428s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23090000000000002s for a response
I20260925 16:44:44.055276  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:44.069815  8940 connection.cc:232] RPC call timeout handler was delayed by -1.3310717060001025s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21150000000000002s for a response
I20260925 16:44:44.070248  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:44.065807  9123 rpcz_store.cc:269] 0925 16:44:41.069183 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:41.115580 (+ 46397us) service_pool.cc:227] Handling call
0925 16:44:44.025040 (+2909460us) spinlock_profiling.cc:243] Waited 2.6 s on lock 0x7b540010c554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:44.025178 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5991444736}
I20260925 16:44:44.067359  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2681) took 2723 ms. Trace:
I20260925 16:44:44.072018  9041 rpcz_store.cc:276] 0925 16:44:41.343662 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.960487 (+2616825us) service_pool.cc:227] Handling call
0925 16:44:44.014185 (+ 53698us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.067147 (+ 52962us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.067313 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.053608 13522 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:44.073421 13413 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:44.070871  9124 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:44.063643  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.073729 13522 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:44.052778 13450 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:44.055315 13536 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:44.065267 13021 raft_consensus.cc:2741] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260925 16:44:44.081288 13408 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:44.086755 13536 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:44.087306  9043 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:44.088941  9043 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:44.084808  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 814) took 2330 ms. Trace:
I20260925 16:44:44.087384 13563 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:44.069352 13434 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:44:44.093328  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.093721  9045 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260925 16:44:44.089541  9046 rpcz_store.cc:276] 0925 16:44:41.750136 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.016148 (+2266012us) service_pool.cc:227] Handling call
0925 16:44:44.077412 (+ 61264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.079718 (+  2306us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:44.079766 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:44.079813 (+    47us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:44.079858 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.079914 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:44.080005 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.094345  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2695) took 2254 ms. Trace:
I20260925 16:44:44.094763  9045 rpcz_store.cc:276] 0925 16:44:41.842536 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.070473 (+2227937us) service_pool.cc:227] Handling call
0925 16:44:44.080182 (+  9709us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.094064 (+ 13882us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.094267 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.092792  9050 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:44.097651 13522 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.099064  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.099808 12666 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:44.100025 13549 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:44:44.092834 13408 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.101589  9043 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:44.102748  9043 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:44.104068 13590 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:44.104669 13568 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:44:44.105304 13434 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:44.105728 13434 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:44.108286  9044 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:44:44.108918  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 824) took 2051 ms. Trace:
I20260925 16:44:44.109220  9044 rpcz_store.cc:276] 0925 16:44:42.057729 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.082386 (+2024657us) service_pool.cc:227] Handling call
0925 16:44:44.108005 (+ 25619us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.108649 (+   644us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.108866 (+   217us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.110072  9049 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260925 16:44:44.110638  9044 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:44.111260  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1765) took 1151 ms. Trace:
I20260925 16:44:44.106853 13434 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:44.111850  9116 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:44.112802 13434 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:44.099465 13522 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:44.117928  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:44.117986  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51086.1us
I20260925 16:44:44.113824  9047 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260925 16:44:44.119206  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2700) took 2155 ms. Trace:
I20260925 16:44:44.119572  9047 rpcz_store.cc:276] 0925 16:44:41.963919 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.061177 (+2097258us) service_pool.cc:227] Handling call
0925 16:44:44.087656 (+ 26479us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.118930 (+ 31274us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.119148 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.111552  9044 rpcz_store.cc:276] 0925 16:44:42.959958 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.109970 (+1150012us) service_pool.cc:227] Handling call
0925 16:44:44.110300 (+   330us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.111032 (+   732us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.111195 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:44.127948  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46967.1us
I20260925 16:44:44.129259  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:44.135591  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 72086.5us
I20260925 16:44:44.157488  9048 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 12. Ops: []
I20260925 16:44:44.093506 13436 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:44.134666  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.113706 13450 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:44.163968  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50159.1us
I20260925 16:44:44.031394 13515 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.165093  9043 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260925 16:44:44.165871  9043 pending_rounds.cc:76] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 5
I20260925 16:44:44.166476  9043 pending_rounds.cc:97] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260925 16:44:44.134985 13266 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.168016  9041 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:44.166805  9043 raft_consensus.cc:2866] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:44.168694  9047 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:44:44.169458  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1769) took 1208 ms. Trace:
I20260925 16:44:44.173172  9047 rpcz_store.cc:276] 0925 16:44:42.961092 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.120434 (+1159342us) service_pool.cc:227] Handling call
0925 16:44:44.168345 (+ 47911us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.169197 (+   852us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.169403 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:44.174135  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56328.2us
I20260925 16:44:44.177495  9044 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260925 16:44:44.163185 13268 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:44.179368  9045 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
W20260925 16:44:44.185715  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 102392us
I20260925 16:44:44.186339  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1764) took 1226 ms. Trace:
I20260925 16:44:44.186672  9045 rpcz_store.cc:276] 0925 16:44:42.959681 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.114236 (+1154555us) service_pool.cc:227] Handling call
0925 16:44:44.166806 (+ 52570us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.186116 (+ 19310us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.186290 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.179608  9046 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:44.141395 13644 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:44.188649  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 826) took 2130 ms. Trace:
I20260925 16:44:44.188966  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1772) took 1226 ms. Trace:
I20260925 16:44:44.188601  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.189111  9046 rpcz_store.cc:276] 0925 16:44:42.058471 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.119523 (+2061052us) service_pool.cc:227] Handling call
0925 16:44:44.173428 (+ 53905us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.188445 (+ 15017us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.188605 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":161664}
I20260925 16:44:44.189584  9044 rpcz_store.cc:276] 0925 16:44:42.962169 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.120930 (+1158761us) service_pool.cc:227] Handling call
0925 16:44:44.166928 (+ 45998us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.177924 (+ 10996us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.188901 (+ 10977us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:44.158171 12666 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260925 16:44:44.180190  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2702) took 2215 ms. Trace:
I20260925 16:44:44.193711  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.231841  9043 rpcz_store.cc:276] 0925 16:44:41.964597 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.071543 (+2106946us) service_pool.cc:227] Handling call
0925 16:44:44.079810 (+  8267us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.179825 (+100015us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.180117 (+   292us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:44.236466  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76137.5us
I20260925 16:44:44.237866  9042 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260925 16:44:44.241074  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1779) took 1274 ms (client timeout 1678 ms). Trace:
W20260925 16:44:44.241583  9049 rpcz_store.cc:269] 0925 16:44:42.966580 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.516646 (+550066us) service_pool.cc:227] Handling call
0925 16:44:44.205922 (+689276us) spinlock_profiling.cc:243] Waited 494 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:44.241002 (+ 35080us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1135372160}
I20260925 16:44:44.191540 13450 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:44.257831  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 128665us
I20260925 16:44:44.258177  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 822) took 2221 ms. Trace:
I20260925 16:44:44.258874  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.258603  9041 rpcz_store.cc:276] 0925 16:44:42.015645 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.080072 (+2064427us) service_pool.cc:227] Handling call
0925 16:44:44.130680 (+ 50608us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.174024 (+ 43344us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.236655 (+ 62631us) spinlock_profiling.cc:243] Waited 35.4 ms on lock 0x7b5400127354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:44.236806 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":81495808}
W20260925 16:44:44.262763  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69153.3us
I20260925 16:44:44.263283  9045 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:44.267581  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1777) took 1303 ms. Trace:
I20260925 16:44:44.268033  9045 rpcz_store.cc:276] 0925 16:44:42.965858 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.187361 (+1221503us) service_pool.cc:227] Handling call
0925 16:44:44.262973 (+ 75612us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.263633 (+   660us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.267512 (+  3879us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":41728}
I20260925 16:44:44.283874  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.286875  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1782) took 1303 ms. Trace:
I20260925 16:44:44.287365  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 809) took 2576 ms. Trace:
I20260925 16:44:44.287912  9048 rpcz_store.cc:276] 0925 16:44:41.687411 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:43.972267 (+2284856us) service_pool.cc:227] Handling call
0925 16:44:43.972691 (+   424us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.163444 (+190753us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.263947 (+100503us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b540008dc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:44.264121 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":424463616}
I20260925 16:44:44.191648 13642 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:44.286810  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2699) took 2423 ms. Trace:
I20260925 16:44:44.298565  9042 rpcz_store.cc:276] 0925 16:44:41.963416 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.071242 (+2107826us) service_pool.cc:227] Handling call
0925 16:44:44.233161 (+161919us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.238358 (+  5197us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.286583 (+ 48225us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002a2950. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:44.286747 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":274112384}
I20260925 16:44:44.293390  9050 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260925 16:44:44.287515  9046 rpcz_store.cc:276] 0925 16:44:42.983858 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.190289 (+1206431us) service_pool.cc:227] Handling call
0925 16:44:44.262973 (+ 72684us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:44.286399 (+ 23426us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:44.286443 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:44.286514 (+    71us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:44.286564 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.286646 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:44.286808 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":465,"spinlock_wait_cycles":46080}
I20260925 16:44:44.192256 13266 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:44.296032  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.193637 13482 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260925 16:44:44.304556  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:44.306207  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65466.4us
I20260925 16:44:44.307188  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:44.308507  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.309434 13317 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.309808  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.310065 13317 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:44.280238 13644 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.280306 13389 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:44.312466  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.313704  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.316262 13538 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:44.320045 13131 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:44.321024 13112 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:44:44.324115 13317 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:44.327852 13272 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:44.333988 13549 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:44.334523 13549 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:44.335091 13549 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:44.334384 13536 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.348004 13603 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:44.348963  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 160418us
I20260925 16:44:44.350082  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:44.365216  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50131.8us
I20260925 16:44:44.366477  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:44.371603  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 87848.2us
I20260925 16:44:44.374858  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:44.372545  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.387022  9700 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260925 16:44:44.393568 13654 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260925 16:44:44.400345  8969 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:44.400489 13515 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:44.404920 13603 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.405603 13554 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.407186 13268 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.413645 13549 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:44.417806  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.420392 13549 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:44.421149  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.421943 13590 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.422499 13590 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.423573  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.424476 13590 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:44.438897  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 88993.2us
I20260925 16:44:44.435930  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.397666 13318 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.442498  8968 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:44.367879 13536 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.458905  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:44.433226 13436 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:44.426442 13272 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:44.438975 13464 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:44:44.465134  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92689us
I20260925 16:44:44.466349  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.467803  9118 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 8: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:44.470963  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.478261  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.483817  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.486372  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:44.489101  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.489301  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:44.490012 13559 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:44.490626  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:44.483385 13536 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.491559  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.492013 13434 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:44.492388 13436 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:44.493248  9044 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:40140
I20260925 16:44:44.493825  9044 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:44.494143  9044 raft_consensus.cc:603] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:44.494333  9120 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260925 16:44:44.495756  9122 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260925 16:44:44.497218  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.498159 13590 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.499471 13021 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:44.500142  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.500610 13021 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:44.500828  9698 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260925 16:44:44.501080 13021 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:44.504205 13669 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:44.504737 13669 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:44.505601 13669 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.506179  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.506861  9043 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:44.493043 13436 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.509181 13436 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.492447 13434 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:44.511307 13434 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:44.512220  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:44.512702  9118 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:44.512835  8972 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:44.515993  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:44:44.516259 13642 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:44.516194  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.517602  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.518319  8967 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:44.518973  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:44:44.519167  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.520037  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:44.520982  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [10.11-10.11]
I20260925 16:44:44.522207  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:44.522475 13318 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.522228  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:44.524549  9122 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:44.526273 13266 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:44.476143 13547 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:44.528470  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.528674 13547 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:44.529026 13547 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:44.529492 13318 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:44.531246  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:44.532003 13573 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:44.532527 13573 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.535863  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.536641 13515 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:44.537497  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.538148  9046 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:44.538542 13590 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:44.539148 13482 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:44.539263 13590 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:44:44.540140 13482 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:44.540546 13482 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:44.540272 13272 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:44.540977  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.541792 13436 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:44.541402 13482 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.542467 13272 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:44.543252 13482 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:44.543394  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.544289 13473 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:44.544379  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.544978  9048 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:44.546583  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.547317  9045 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:44.480741  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:44.550547  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:44.552868  9117 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:44.549036  8973 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:44.557204  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 117402us
I20260925 16:44:44.557060  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.560197  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:44.535491 13573 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.564983  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:44.548862 13623 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.003s
I20260925 16:44:44.568344  9043 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:44:44.569207  9044 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:44.570247  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.570850  8966 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:44.571549  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.571616  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.572754  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:44.572821  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.573820  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.574301  8966 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:44:44.575096  8969 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:44.575899 13623 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.576704  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:44.577361 13317 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:44.578181 13623 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:44.578492 13266 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:44.578852 13266 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:44.579619 13266 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.581106 13266 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:44.566015 13389 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260925 16:44:44.585757  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:44.566879  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:44.573769  8972 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:44.590958  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:44.593524  9698 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:44.576433 13515 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:44.575493  8966 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:44.602536 13547 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.603561  9041 raft_consensus.cc:2396] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260925 16:44:44.611792  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 357694us
I20260925 16:44:44.624504  8975 raft_consensus.cc:2354] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12.
I20260925 16:44:44.609615 13317 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260925 16:44:44.639353  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:44.691401 13482 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:44.753418 13456 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:44.794384  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:44.795166  9698 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:44.762308 13482 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:44.757817 13095 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.006s	sys 0.032s
W20260925 16:44:44.799357  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 292721us
W20260925 16:44:44.800239  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 162484us
I20260925 16:44:44.787834 13547 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:44.809844 13095 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.007s	sys 0.032s
I20260925 16:44:44.851846  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:44.871711  9123 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:44.834836 13579 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:44.854071 13522 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.704s	user 0.014s	sys 0.000s
W20260925 16:44:44.883201 13678 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
W20260925 16:44:44.900666 13677 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260925 16:44:44.902195 13680 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:44:44.906076  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:44.943125  9698 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
W20260925 16:44:44.929836 13675 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.298s	user 0.001s	sys 0.000s
I20260925 16:44:44.869336 13434 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:44.959087  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:44.965250  8967 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:44.954285  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:44.972558  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64922.2us
W20260925 16:44:44.975615  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 430179us
I20260925 16:44:44.995380  9120 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:44.995925  9120 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:44.996920  9120 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:44.998755  9120 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:45.030680 13671 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.321s	user 0.003s	sys 0.001s
W20260925 16:44:45.031137  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 57634us
I20260925 16:44:45.032305  8967 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:44:45.033023 13434 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:45.034238 13434 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:45.034494  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1776) took 2071 ms. Trace:
I20260925 16:44:45.034670 13434 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:45.034998  9047 rpcz_store.cc:276] 0925 16:44:42.963446 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.174009 (+1210563us) service_pool.cc:227] Handling call
0925 16:44:44.182426 (+  8417us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:44.182800 (+   374us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:44.182828 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:44.198882 (+ 16054us) log.cc:842] Serialized 26 byte log entry
0925 16:44:44.455203 (+256321us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:44.455256 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.455330 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:45.034220 (+578890us) raft_consensus.cc:1671] finished
0925 16:44:45.034248 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:45.034401 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":3255,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":15983,"thread_start_us":195770,"threads_started":1,"wal-append.queue_time_us":328680}
I20260925 16:44:45.037590  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:45.040458 13434 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:44.984834  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:45.027349 13627 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:45.054275  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60180.6us
I20260925 16:44:45.051664  9123 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:45.058763  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:45.058931  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74189.9us
W20260925 16:44:45.063764  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44874.2us
I20260925 16:44:45.064851 13627 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:45.065433  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:45.065812 13627 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:45.066936 13698 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260925 16:44:45.068771 13522 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:45.069190 13522 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:45.069553 13522 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:45.072758  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.073086 13674 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:45.077976  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:45.091814  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:45.092424  9115 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:45.093139 13686 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260925 16:44:45.090286 13266 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:45.094098 13266 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:45.094501 13266 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:45.095271 13697 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260925 16:44:45.097782 13692 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260925 16:44:45.098871  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:45.058102 13482 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:45.099614  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:45.100340 13687 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260925 16:44:45.090945  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:45.113876  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.123075  9696 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
W20260925 16:44:45.165518  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48570.4us
I20260925 16:44:45.121026  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:45.186770  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 100446us
I20260925 16:44:45.187776  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:45.117580 13317 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:45.123145 13564 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:45.190284  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:45.170583 13389 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:45.193596 13669 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:45.122531 13450 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260925 16:44:45.192380  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71465us
I20260925 16:44:45.219928  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:45.221311  9120 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260925 16:44:45.221805  9120 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 9
I20260925 16:44:45.222069  9120 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260925 16:44:45.222352  9120 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:44:45.229885  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52301.9us
I20260925 16:44:45.234342  9123 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:45.218977 13450 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:45.224390 13317 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:45.241768 13021 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.740s	user 0.009s	sys 0.005s
I20260925 16:44:45.230634 13623 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:45.233355 13579 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:45.306207  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:45.307200  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 358369us
I20260925 16:44:45.270030 13450 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:45.318241  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:45.318266  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 98424.9us
I20260925 16:44:45.322213  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:45.323285  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:45.326766  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:45.327690  8970 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260925 16:44:45.301642 13095 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:45.329931  8968 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:45.301730 13623 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:45.332751  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:45.316999 13579 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:45.337275  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:45.339808  8968 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:45.339959  8971 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:45.334844  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:45.338466  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:45.335521  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:45.345640  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:45.378470 13693 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260925 16:44:45.337344 13623 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:45.379796 13694 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.122s	user 0.000s	sys 0.001s
I20260925 16:44:45.381407  9047 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260925 16:44:45.382879 13689 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.366s	user 0.003s	sys 0.003s
I20260925 16:44:45.336007 13408 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:45.297605 13021 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:45.343873 13579 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:45.398645  9041 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:44:45.403726  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.405221  9042 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:45.391001 13408 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:45.404534  9047 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
W20260925 16:44:45.409988  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85959.7us
I20260925 16:44:45.416023  9041 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:44:45.417558  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.419291  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.420077  9043 raft_consensus.cc:2362] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10. Re-sending same reply.
I20260925 16:44:45.419023 13669 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:45.433291  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:45.437857  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.397311 13522 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:45.438832  9047 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:45.440011  8968 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:45.446487 13703 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260925 16:44:45.447381 13691 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.431s	user 0.011s	sys 0.006s
I20260925 16:44:45.440388  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:45.442349  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.456542 13095 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:45.457039 13095 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:45.438321 13272 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:45.458782 13272 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:45.459127 13272 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:44:45.462176 13700 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.160s	user 0.000s	sys 0.004s
I20260925 16:44:45.463982 13705 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:45.465613  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.466233  9050 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:45.467033  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.467669  9049 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:45.469058 13021 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:45.468890 13095 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:45.475616  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.481083  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:45.484416  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:45.485956  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.487057  9047 raft_consensus.cc:2396] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260925 16:44:45.488729  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:45.489880  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:45.506450 13573 raft_consensus.cc:2741] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
W20260925 16:44:45.506599  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71614us
I20260925 16:44:45.507921  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.512110  9014 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.519989  9115 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:45.520991  9049 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:45.522120  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 334456us
I20260925 16:44:45.526306  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:45.526790  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:45.521776  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:45.531244 13473 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:45.531793 13473 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:45.532151 13095 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:45.532593 13473 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:45.532835 13266 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:45.534680 13266 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:45.526050 13021 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:45.536028  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.536660  9049 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:45.537478  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.538077  9049 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:45.482259 13408 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:45.507907 13674 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:45.540958  9041 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:45.541966  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:45.542553  9041 raft_consensus.cc:2362] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10. Re-sending same reply.
I20260925 16:44:45.543373  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:45.544078  9041 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:45.539005  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.545992  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.547147  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.555074  9048 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:45.554661  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.563014  9666 leader_election.cc:398] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12.
I20260925 16:44:45.546712 13515 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:45.564384  9666 leader_election.cc:401] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260925 16:44:45.565531  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.575107  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:45.570556  9050 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:45.573719  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:45.582358  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.583988  9044 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:45.588766  9050 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:45.592540  9695 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:45.594357  9118 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:45.596976  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:45.597652  9045 raft_consensus.cc:2362] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13. Re-sending same reply.
I20260925 16:44:45.573874 13515 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:45.585775 13021 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:45.586308 13389 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:45.610849  9047 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:45.638115  9043 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260925 16:44:45.642889 13522 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:45.642814 13672 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:45.643613 13522 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12.
I20260925 16:44:45.643841 13272 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:45.646224 13272 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:45.645730  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 377721us
I20260925 16:44:45.643889 13450 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:45.648358  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 98591.3us
I20260925 16:44:45.603912 13515 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:45.657644  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.658150  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.658877  9042 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:45.615485 13266 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260925 16:44:45.662330  9041 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:44:45.689139  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:45.690428  9046 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260925 16:44:45.663481 13699 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.647s	user 0.003s	sys 0.005s
I20260925 16:44:45.652803 13450 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:45.657940 13021 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:45.652050 13389 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.060s
I20260925 16:44:45.740325 13721 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:45.760022  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2741) took 1133 ms. Trace:
I20260925 16:44:45.734082 13021 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:45.765378  9119 rpcz_store.cc:276] 0925 16:44:44.626668 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.977643 (+350975us) service_pool.cc:227] Handling call
0925 16:44:44.983482 (+  5839us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:45.040055 (+ 56573us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:45.040096 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:45.040628 (+   532us) log.cc:842] Serialized 26 byte log entry
0925 16:44:45.506963 (+466335us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:45.507019 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:45.507117 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:45.759785 (+252668us) raft_consensus.cc:1671] finished
0925 16:44:45.759810 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:45.759962 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56097,"raft.queue_time_us":56400,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":130,"thread_start_us":465908,"threads_started":1,"wal-append.queue_time_us":622948}
I20260925 16:44:45.769745 13021 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:45.771132 13021 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:45.771546 13021 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:45.773952 13021 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:45.774652  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1113) took 1314 ms. Trace:
I20260925 16:44:45.792435 13456 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:45.776266  9697 rpcz_store.cc:276] 0925 16:44:44.460045 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.460170 (+   125us) service_pool.cc:227] Handling call
0925 16:44:44.471010 (+ 10840us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:44.471215 (+   205us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:44.471239 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:44.481513 (+ 10274us) log.cc:842] Serialized 26 byte log entry
0925 16:44:44.781065 (+299552us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:44.781108 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:44.781176 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:45.637055 (+855879us) spinlock_profiling.cc:243] Waited 9.17 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:45.765465 (+128410us) raft_consensus.cc:1671] finished
0925 16:44:45.765484 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:45.774589 (+  9105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":21091712,"thread_start_us":190210,"threads_started":1,"wal-append.queue_time_us":459183}
I20260925 16:44:45.749516 13547 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.026s
I20260925 16:44:45.782337 13021 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:45.796568 13690 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.019s	sys 0.013s
I20260925 16:44:45.764770 13268 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260925 16:44:45.836908  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:45.760010 13720 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
W20260925 16:44:45.834245 13690 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.020s	sys 0.014s
I20260925 16:44:45.843801  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:45.862877  9115 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:45.864208  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:45.840723  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 240423us
W20260925 16:44:45.870415  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 282186us
I20260925 16:44:45.871373  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:45.844233 13482 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.023s	sys 0.009s
I20260925 16:44:45.828871 13266 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260925 16:44:45.879637 13473 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:45.833683 13021 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:45.874125 13482 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.024s	sys 0.009s
I20260925 16:44:45.890962  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:45.891862  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 303104us
W20260925 16:44:45.932849  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 183025us
I20260925 16:44:45.937301 13725 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:45.938011 13725 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:45.939440 13722 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:45.882957 13450 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
W20260925 16:44:45.955821  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76120.7us
I20260925 16:44:45.960127  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:45.980655  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:46.000363  9118 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:45.934415 13721 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:45.900461 13669 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
I20260925 16:44:46.011658  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:45.900039 13473 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:46.019752  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48788.3us
W20260925 16:44:46.093518  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 443810us
W20260925 16:44:46.000624 13713 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.252s	user 0.000s	sys 0.001s
I20260925 16:44:46.111656  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:45.979079 13739 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:45.946663 13555 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260925 16:44:46.080992 13686 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260925 16:44:45.980876 13547 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.138s
I20260925 16:44:46.080816 13482 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:46.156175  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44609.3us
W20260925 16:44:46.176234  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 216172us
W20260925 16:44:46.180601  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 211462us
I20260925 16:44:46.185382 13555 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:44:46.194479 13555 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:46.195326 13555 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.016713 13721 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.199396 13721 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.185428 13733 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:46.193101  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:46.200255 13733 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:46.200758 13733 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:46.152798 13720 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:46.156316 13741 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:46.232023  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:46.233561  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57953.2us
W20260925 16:44:46.240772  9666 connection.cc:232] RPC call timeout handler was delayed by -1.201720036000097s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1698s for a response
W20260925 16:44:46.253930  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1963200360000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1704s for a response
I20260925 16:44:46.235867  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 887) took 1281 ms. Trace:
W20260925 16:44:46.229308 13744 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.081s	user 0.001s	sys 0.000s
I20260925 16:44:46.273399  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:46.235599 13579 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.824s	user 0.011s	sys 0.000s
I20260925 16:44:46.278609  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:46.159525 13482 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.225111 13317 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:46.255927  8974 rpcz_store.cc:276] 0925 16:44:44.947914 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.971101 (+ 23187us) service_pool.cc:227] Handling call
0925 16:44:44.972493 (+  1392us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:44.983911 (+ 11418us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:44.983948 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:45.090838 (+106890us) log.cc:842] Serialized 26 byte log entry
0925 16:44:45.482219 (+391381us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:45.482302 (+    83us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:45.482387 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:46.229275 (+746888us) raft_consensus.cc:1671] finished
0925 16:44:46.229294 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:46.229422 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5748,"raft.queue_time_us":54193,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":313914,"threads_started":1,"wal-append.queue_time_us":588450}
I20260925 16:44:46.228830 13751 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260925 16:44:46.322041  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 457863us
W20260925 16:44:46.327868  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 320350us
W20260925 16:44:46.267012 13623 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.887s	user 0.006s	sys 0.006s
I20260925 16:44:46.235731 13725 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:46.321466 13724 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.432s	user 0.001s	sys 0.000s
W20260925 16:44:46.385426  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 124082us
I20260925 16:44:46.397238  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:46.398334  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 143927us
W20260925 16:44:46.402182  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0712200360001134s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18430000000000002s for a response
I20260925 16:44:46.402082  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:46.402522  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0379200360000596s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.188s for a response
I20260925 16:44:46.416074  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.416790  9117 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:44:46.399457 13730 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.465s	user 0.000s	sys 0.001s
I20260925 16:44:46.273096 13674 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.124s
I20260925 16:44:46.333982 13755 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.254309 13741 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.434381  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.445237  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.438657  8967 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:44:46.431512  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 339088us
I20260925 16:44:46.400622 13021 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.315017 13579 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:46.458891  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 281717us
I20260925 16:44:46.273015 13720 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.359800 13762 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:46.327965 13317 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.459669  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:46.462798  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:46.467327  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:46.430279 13434 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.393965 13623 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.452903  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.504366  9047 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:46.508476  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:46.452374 13473 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:46.529924  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 127916us
I20260925 16:44:46.513101  9044 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:46.503750  9043 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:46.452733 13714 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.543484  9699 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
W20260925 16:44:46.473810 13729 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.468s	user 0.001s	sys 0.000s
W20260925 16:44:46.529234 13711 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:44:46.472771 13564 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:46.554260  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83924.1us
I20260925 16:44:46.563427  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.535288  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:46.484467 13700 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:44:46.499473 13272 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:46.530722  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:46.498060 13727 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:46.570441  9046 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:46.460944 13755 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.509341 13434 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.559744 13268 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.558434 13766 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:46.579324  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48695.2us
W20260925 16:44:46.578764 13745 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.375s	user 0.001s	sys 0.000s
I20260925 16:44:46.566759 13674 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.601110 13434 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.601353 13708 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:46.632851  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49235.4us
I20260925 16:44:46.601894 13482 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.607116  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 889) took 1655 ms. Trace:
I20260925 16:44:46.630304  9046 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:46.580874 13272 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.568460 13774 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:44:46.597749 13268 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.550529 13714 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.561751 13564 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.698915  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2640) took 1145 ms. Trace:
I20260925 16:44:46.701174  9697 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260925 16:44:46.598711 13767 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.132s	user 0.001s	sys 0.000s
I20260925 16:44:46.701649 13790 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260925 16:44:46.693897 13708 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:46.695519 13756 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260925 16:44:46.693480  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 90258.3us
I20260925 16:44:46.695618  8975 rpcz_store.cc:276] 0925 16:44:44.951608 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:44.956288 (+  4680us) service_pool.cc:227] Handling call
0925 16:44:44.978255 (+ 21967us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:45.427441 (+449186us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:45.427484 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:45.436329 (+  8845us) log.cc:842] Serialized 26 byte log entry
0925 16:44:45.813474 (+377145us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:45.813532 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:45.813637 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:46.606928 (+793291us) raft_consensus.cc:1671] finished
0925 16:44:46.606948 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:46.607064 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":15315,"raft.queue_time_us":74226,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":7211,"thread_start_us":730187,"threads_started":2,"wal-append.queue_time_us":419649}
W20260925 16:44:46.606932 13752 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.333s	user 0.000s	sys 0.001s
I20260925 16:44:46.734105  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.739574  9047 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
W20260925 16:44:46.695964 13753 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.279s	user 0.000s	sys 0.001s
W20260925 16:44:46.696496 13761 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260925 16:44:46.704036  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2333) took 1385 ms. Trace:
W20260925 16:44:46.694087 13754 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.297s	user 0.001s	sys 0.000s
I20260925 16:44:46.699453 13774 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:46.735373  9123 rpcz_store.cc:276] 0925 16:44:45.553069 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.563514 (+ 10445us) service_pool.cc:227] Handling call
0925 16:44:45.588055 (+ 24541us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:45.591199 (+  3144us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:45.591228 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:45.591601 (+   373us) log.cc:842] Serialized 26 byte log entry
0925 16:44:45.750385 (+158784us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:45.750425 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:45.750500 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:46.698684 (+948184us) raft_consensus.cc:1671] finished
0925 16:44:46.698705 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:46.698830 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2820,"raft.queue_time_us":3674,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":7839,"thread_start_us":158511,"threads_started":1,"wal-append.queue_time_us":1105604}
I20260925 16:44:46.698630 13272 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:46.694620 13741 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.696107 13759 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:46.752709  9693 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 9.
I20260925 16:44:46.776098 13755 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.760568 13774 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:46.776134 13759 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.777962 13759 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:46.781512  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 943) took 1200 ms. Trace:
I20260925 16:44:46.781929  9702 rpcz_store.cc:276] 0925 16:44:45.581451 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.581565 (+   114us) service_pool.cc:227] Handling call
0925 16:44:45.594493 (+ 12928us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:45.888158 (+293665us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:45.888188 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:45.892493 (+  4305us) log.cc:842] Serialized 26 byte log entry
0925 16:44:46.289176 (+396683us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:46.289225 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:46.289305 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:46.781285 (+491980us) raft_consensus.cc:1671] finished
0925 16:44:46.781306 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:46.781447 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5212,"raft.queue_time_us":119469,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":20695,"thread_start_us":641102,"threads_started":2,"wal-append.queue_time_us":655455}
W20260925 16:44:46.785179 13515 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.120s	user 0.009s	sys 0.002s
I20260925 16:44:46.785602 13515 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.749392 13450 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:46.787941 13450 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:46.788703 13450 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.599042 13727 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.790010  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:50780 (request call id 6) took 1232 ms. Trace:
I20260925 16:44:46.790877  9700 rpcz_store.cc:276] 0925 16:44:45.557522 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.557663 (+   141us) service_pool.cc:227] Handling call
0925 16:44:46.789674 (+1232011us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf307c5 00007f719bf28c1a 00007f71a0e6c6d9 00007f719a556184 00007f719a556112 00007f719a556041 00007f719a555fbc 00007f719a555272 00007f719a35494c 00007f719a353d86
0925 16:44:46.789898 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2756218240}
I20260925 16:44:46.791540 13727 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.699263 13317 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.697755 13579 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:46.795859  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 198950us
I20260925 16:44:46.739750  9044 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:46.762979 13720 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.607430 13674 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.800089 13779 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:46.801307 13674 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:46.736991 13717 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260925 16:44:46.801908 13793 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:46.772166 13758 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.774242 13786 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:46.805742 13758 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.807147 13786 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:46.807278 13708 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.807595 13786 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:46.808123 13758 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.809414 13714 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:46.810357  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1293) took 1038 ms. Trace:
I20260925 16:44:46.810477 13623 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:46.810719  9699 rpcz_store.cc:276] 0925 16:44:45.771656 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.771833 (+   177us) service_pool.cc:227] Handling call
0925 16:44:45.772138 (+   305us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:46.543980 (+771842us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:46.810132 (+266152us) spinlock_profiling.cc:243] Waited 771 ms on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:46.810301 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1773430656}
I20260925 16:44:46.754478  8973 rpcz_store.cc:276] 0925 16:44:45.318115 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.318239 (+   124us) service_pool.cc:227] Handling call
0925 16:44:45.328376 (+ 10137us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:45.328628 (+   252us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:45.328663 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:45.448126 (+119463us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:45.448524 (+   398us) log.cc:842] Serialized 26 byte log entry
0925 16:44:45.727243 (+278719us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:45.907991 (+180748us) log.cc:842] Serialized 14 byte log entry
0925 16:44:45.936783 (+ 28792us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:45.936891 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:46.610284 (+673393us) raft_consensus.cc:1671] finished
0925 16:44:46.703808 (+ 93524us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:46.703971 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28512,"prepare.queue_time_us":250908,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":6343,"raft.queue_time_us":30075,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":120,"spinlock_wait_cycles":4337408,"thread_start_us":442178,"threads_started":2,"wal-append.queue_time_us":396257}
I20260925 16:44:46.701360 13268 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.805049 13564 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.774667 13772 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.034s
I20260925 16:44:46.603529 13766 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:46.813724  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.012s	sys 0.053s
W20260925 16:44:46.820447  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.012s	sys 0.053s
W20260925 16:44:46.830480  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 370871us
I20260925 16:44:46.831204  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:46.831718  9123 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
I20260925 16:44:46.832908  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:46.822762 13268 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:46.837307  9118 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:46.841277  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:46.841182  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 300639us
I20260925 16:44:46.848881 13798 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:44:46.849140  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:46.850431  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.850687  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:46.856159 13434 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.856686 13434 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.857357 13762 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:46.857944 13762 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.858315 13762 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.858677 13434 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.859184 13434 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:46.859905 13268 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.861711 13268 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.838274 13473 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.863844 13755 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:46.863656 13473 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.864012  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.864782  9699 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 12 because replica has last-logged OpId of term: 11 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260925 16:44:46.865540 13473 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.865713 13740 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:46.865996 13623 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:46.864343 13755 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.866752  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:46.880106  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.880694  9116 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:46.869030  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.884485  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.887137  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:46.886423 13772 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:46.888291 13800 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:46.888422 13772 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:46.888688 13800 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:46.888834 13772 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:46.889067 13800 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:46.891953  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.892848  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:46.893597  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.893955  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:46.895180  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:46.895869 13755 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.895587 13774 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.896934  9124 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260925 16:44:46.884721  9121 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:46.887521  9116 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:46.898947  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.900450  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.903153  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.917439  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:46.917800  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:46.883298 13785 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:46.902387 13317 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:46.909462 13733 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.708s	user 0.008s	sys 0.006s
I20260925 16:44:46.886852 13564 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:46.903093 13793 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:46.927122  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:46.928419  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:46.928992  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:46.905655 13714 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:46.937469  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:46.938452 13810 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260925 16:44:46.939874 13778 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:46.940265 13778 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:46.940604 13778 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:46.940757 13784 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260925 16:44:46.941772 13762 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.925611 13785 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:46.944408 13785 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.945572 13785 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:46.930344 13564 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.949661 13564 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:46.902568 13800 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.949334 13778 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.951213 13707 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:46.951486 13800 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.951640 13707 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:46.951841 13757 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:46.949328 13784 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:46.952072 13800 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:44:46.952633 13784 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:46.951849 13778 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.953279 13800 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:46.953625 13800 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:46.953485 13784 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.954654 13784 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:46.954384 13800 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:46.952069 13707 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:46.926116 13764 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
I20260925 16:44:46.933382 13751 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:46.958635 13749 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.765s	user 0.007s	sys 0.020s
I20260925 16:44:46.962633 13793 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:46.963047 13793 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:46.963395 13793 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:46.967346  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:46.967978  8967 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:46.969317  9666 leader_election.cc:334] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.704s (SENT)
I20260925 16:44:46.969601  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:46.970301  9121 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:46.936569  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55679.8us
I20260925 16:44:46.923938 13515 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:46.891571 13786 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:46.955505 13800 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:46.987880  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.982488  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:46.985482  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:46.834575 13799 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.104s
I20260925 16:44:46.988736  9124 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:46.949216 13766 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:46.998853  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:46.999431  8975 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:47.000456  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.028893  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.029801  8974 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:47.033562  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.034688  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:47.041949  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72669.7us
W20260925 16:44:47.042603  9666 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.803s (SENT)
I20260925 16:44:47.042690  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.043041  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.051498  8970 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:44:47.043980  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.065860  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
W20260925 16:44:47.069411  9089 connection.cc:232] RPC call timeout handler was delayed by -1.9594263409999257s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16190000000000002s for a response
I20260925 16:44:46.999768 13799 consensus_queue.cc:1225] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
W20260925 16:44:47.069772  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8586263409999901s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17310000000000003s for a response
W20260925 16:44:47.070114  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7335263410000152s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18700000000000003s for a response
I20260925 16:44:46.930712 13733 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.077762  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:46.947477 13772 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:47.080375  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0871508150000864s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15360000000000001s for a response
W20260925 16:44:47.080528  9666 leader_election.cc:334] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.828s (SENT)
W20260925 16:44:47.067639 13692 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260925 16:44:47.088024  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.091223  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:47.091807  8970 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:47.088296  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:47.087724  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0493508150000252s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15780000000000002s for a response
I20260925 16:44:47.095080  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:47.083099  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 251946us
I20260925 16:44:47.084034  8967 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:46.949334 13272 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.087266  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.056268 13515 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:47.102924  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.104259  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 852) took 1559 ms. Trace:
I20260925 16:44:47.104933  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.106575 13776 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:47.107980 13776 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:47.110351  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.111320  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.112210  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.113046  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1294) took 1009 ms. Trace:
I20260925 16:44:47.113634  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.116673  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.081092 13790 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:47.117772  9119 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:47.119843 13748 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:47.119058  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.123620  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.086925 13796 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.124231  9044 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
W20260925 16:44:47.125891  9666 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.022s (SENT)
I20260925 16:44:47.119073  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.127804  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.104739  9048 rpcz_store.cc:276] 0925 16:44:45.533130 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.555882 (+ 22752us) service_pool.cc:227] Handling call
0925 16:44:45.558066 (+  2184us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:45.584926 (+ 26860us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:45.827557 (+242631us) log.cc:842] Serialized 14 byte log entry
0925 16:44:46.285854 (+458297us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:46.334089 (+ 48235us) log.cc:842] Serialized 52 byte log entry
0925 16:44:46.334555 (+   466us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:46.396765 (+ 62210us) log.cc:842] Serialized 14 byte log entry
0925 16:44:46.822436 (+425671us) spinlock_profiling.cc:243] Waited 2.01 ms on lock 0x7b1800369be0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:44:47.070787 (+248351us) log.cc:842] Serialized 14 byte log entry
0925 16:44:47.072975 (+  2188us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:47.092620 (+ 19645us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:47.092679 (+    59us) raft_consensus.cc:1671] finished
0925 16:44:47.092697 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:47.092852 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":444042,"prepare.queue_time_us":325097,"prepare.run_cpu_time_us":120,"prepare.run_wall_time_us":6413,"raft.queue_time_us":905823,"raft.run_cpu_time_us":400,"raft.run_wall_time_us":71871,"spinlock_wait_cycles":10878592,"thread_start_us":883044,"threads_started":4,"wal-append.queue_time_us":319096}
I20260925 16:44:47.129722 13787 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:47.130405  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.099102 13798 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:47.132725  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.140616  9047 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 11 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260925 16:44:47.141558  9050 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:47.130298 13776 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:47.154522 13748 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.155663 13272 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.156716 13579 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:47.155465 13748 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.101914 13759 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.118340 13774 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.115558 13758 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:47.114904 13717 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:47.173516  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.160066  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.158547  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.125142 13740 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.217957  8972 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:47.160801  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.160460  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.121627 13547 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:47.168500  9044 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:44:47.157891  9121 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
W20260925 16:44:47.191922  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72907.5us
I20260925 16:44:47.121424 13434 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:47.179358  8971 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:47.226187  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:47.249080  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.264144  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.264431  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.264933  9045 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 8: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:47.265750  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.267319  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.268937  9042 raft_consensus.cc:2354] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9.
I20260925 16:44:47.269129  9115 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:47.270533  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.179445 13450 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.137450 13268 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:47.271677  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45579.9us
I20260925 16:44:47.305173  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.159248 13706 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
W20260925 16:44:47.312331  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 186449us
I20260925 16:44:47.168322 13786 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.306181  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.308019  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.217854 13758 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:47.318871  9050 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:47.318567  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:47.319948  9666 leader_election.cc:334] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.025s (SENT)
I20260925 16:44:47.314108  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.271124  9043 raft_consensus.cc:2354] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:47.310194  9047 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
W20260925 16:44:47.280186  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54695.7us
I20260925 16:44:47.175133 13739 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:47.185587 13776 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:47.312457  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:47.306545  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.269630 13408 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:47.140166 13787 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:47.181579 13772 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:47.314941  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.343034  8970 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:47.157943 13564 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.315493  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.316807  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.347038  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.164115 13733 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:47.328547  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.329161  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.250461 13674 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:47.334446  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.334769  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.306762  9048 raft_consensus.cc:2362] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14. Re-sending same reply.
I20260925 16:44:47.269016 13807 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:47.179857 13802 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:47.128326 13790 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.347121  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.361027  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.361565  9043 raft_consensus.cc:2362] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13. Re-sending same reply.
I20260925 16:44:47.340235 13785 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:47.327987 13268 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.330037 13706 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.342625 13787 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.372226  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.330397 13758 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:47.373147  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59914us
W20260925 16:44:47.373719  9666 leader_election.cc:334] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.066s (SENT)
I20260925 16:44:47.180543 13707 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.332340 13739 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:47.172295 13798 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.355233  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.321879  9044 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:47.362655  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.270044 13434 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.364491  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.387257  8974 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:47.271005 13740 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.366014  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:47.261155 13547 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:47.369012  9050 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:47.358224 13272 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:47.376076  9045 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:47.377112  9048 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:44:47.381820  8969 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:47.337150 13793 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.364084 13733 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.366672 13772 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:47.164515 13796 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.384205  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.366797 13806 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:47.403141  8974 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260925 16:44:47.402508  8972 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260925 16:44:47.385447 13714 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:47.405373  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.363680 13786 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260925 16:44:47.406235  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.366631 13807 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.407294  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.389325 13755 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:44:47.410869  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.108s (SENT) [suppressed 38 similar messages]
I20260925 16:44:47.409003 13810 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:47.406538 13778 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:44:47.414039  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.037s	sys 0.074s
W20260925 16:44:47.414376  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.708s	user 0.037s	sys 0.075s
W20260925 16:44:47.414646  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 719622us
I20260925 16:44:47.397775 13547 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.415596 13564 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.416244 13769 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:47.419983  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.400041 13672 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:47.428017  9666 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.110s (SENT)
I20260925 16:44:47.427078  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:47.436380  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3a3bc92ca0a4efa913eca1800a1550d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 11 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:47.437712  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.437824  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:47.438666  9117 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:47.438925  9115 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:47.448439  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:47.454773  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.440812 13672 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:47.417061 13769 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.434358 13778 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:47.440130 13785 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.442278 13777 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.446307 13389 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:47.464675 13672 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:47.472680  9699 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:47.472616  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:47.449651 13759 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.474007  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:47.476287  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48315.2us
I20260925 16:44:47.473248  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.481725  9115 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:47.410084 13733 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.459038 13810 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:47.485579  9666 leader_election.cc:334] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 8 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.186s (SENT)
I20260925 16:44:47.485574  9700 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:47.458611 13564 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:47.495621  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:47.468935 13778 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:47.501297  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:47.467510 13482 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:47.511309  8975 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:47.464946 13784 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.037s
I20260925 16:44:47.442495 13789 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.188s
I20260925 16:44:47.516611  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.517807  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.521133  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.506745 13564 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.523520  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.449190 13268 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:47.535056  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49506.8us
I20260925 16:44:47.530978  9700 raft_consensus.cc:2396] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260925 16:44:47.536327  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.507946 13778 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:47.531754  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.533190  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.409255 13776 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:47.539988 13824 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:44:47.514633 13759 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:47.538820  9122 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:47.539222  9115 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:47.479221 13785 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:47.545118 13816 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.138s	user 0.000s	sys 0.001s
I20260925 16:44:47.546206 13785 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.547348 13434 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:47.548509 13817 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:44:47.549338  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:47.549871 13819 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260925 16:44:47.550570  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.550875 13740 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.551106  9048 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:47.553607  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.531844 13769 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.555814 13803 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:47.556358 13803 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:47.557271 13803 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.555810 13784 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:47.558738 13784 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.441246 13706 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.559507 13784 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.560672 13784 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.562999 13733 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.565042  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2720) took 1090 ms. Trace:
I20260925 16:44:47.565903  9697 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:47.508142 13482 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:47.565526  9041 rpcz_store.cc:276] 0925 16:44:46.475045 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:46.503216 (+ 28171us) service_pool.cc:227] Handling call
0925 16:44:46.543113 (+ 39897us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:46.977712 (+434599us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:46.977756 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:46.988605 (+ 10849us) log.cc:842] Serialized 26 byte log entry
0925 16:44:47.129567 (+140962us) spinlock_profiling.cc:243] Waited 25.5 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:47.344578 (+215011us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:47.564454 (+219876us) spinlock_profiling.cc:243] Waited 4.16 ms on lock 0x7b18004af920. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f
0925 16:44:47.564570 (+   116us) log.cc:842] Serialized 14 byte log entry
0925 16:44:47.564743 (+   173us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:47.564813 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:47.564853 (+    40us) raft_consensus.cc:1671] finished
0925 16:44:47.564866 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:47.564984 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":383709,"prepare.queue_time_us":141293,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":308816,"raft.run_cpu_time_us":1085,"raft.run_wall_time_us":268789,"spinlock_wait_cycles":68313216,"thread_start_us":451089,"threads_started":3,"wal-append.queue_time_us":395255}
I20260925 16:44:47.570065  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.542171  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:47.542837 13822 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.077s	user 0.001s	sys 0.000s
I20260925 16:44:47.516552 13805 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:47.488395 13389 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.567034  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:47.579365  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:47.574549  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:47.571179  9699 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:47.580019  9694 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:47.534266 13707 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.593787  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.593873  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:47.590837  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146145us
I20260925 16:44:47.565366 13759 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:47.541558 13790 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.605209  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.615592  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.573813 13021 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:47.488714 13777 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.623477  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.622164  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.624224  9043 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:47.624889  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 100499us
I20260925 16:44:47.626173  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.575048 13482 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:47.578368 13573 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260925 16:44:47.626112  8970 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:47.639782  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.639947  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.638450  9048 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:44:47.643265  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.644599  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.574378 13798 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.612854 13759 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:47.645558  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.647523  9048 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:47.594573 13793 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.645020  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.653718  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.662427 13734 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:47.662834 13734 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:47.663154 13734 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.665505  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 892) took 1412 ms. Trace:
I20260925 16:44:47.665866  8968 rpcz_store.cc:276] 0925 16:44:46.253219 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:46.253553 (+   334us) service_pool.cc:227] Handling call
0925 16:44:46.253841 (+   288us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:46.528419 (+274578us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:46.528465 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:46.528522 (+    57us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:46.528576 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:47.665288 (+1136712us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400135e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:47.665332 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:47.665452 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":630862592}
I20260925 16:44:47.666857 13775 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.667337 13775 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.669328 13775 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:47.669772 13825 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:44:47.672375 13786 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:47.672724 13786 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:47.673483 13786 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.674651 13786 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:47.654112  9047 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:47.678423  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 161945us
I20260925 16:44:47.656402  9089 leader_election.cc:398] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9.
I20260925 16:44:47.604499 13839 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:47.679772  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.684207  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.659752  9702 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:47.684860  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.682345  9694 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
W20260925 16:44:47.686152  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 119204us
I20260925 16:44:47.640763 13789 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:47.687857  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:47.694437  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.695582  9015 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:47.697745  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.699133  9123 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:44:47.700196  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.701411 13809 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.023s
I20260925 16:44:47.612437 13547 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.710971 13796 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.641325 13790 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.054s
I20260925 16:44:47.713744 13787 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.705392 13793 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:47.716046 13564 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:47.702498 13740 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:44:47.687898 13839 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:47.683357 13807 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:47.720274  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70297.2us
I20260925 16:44:47.760602  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.762151  9089 leader_election.cc:398] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8.
I20260925 16:44:47.722368 13777 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.722393  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2722) took 1246 ms. Trace:
I20260925 16:44:47.744143 13790 consensus_queue.cc:1225] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:44:47.728920  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:47.730094  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:47.720084 13785 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:47.735498  9043 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:47.770287  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:47.727803  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46104.2us
I20260925 16:44:47.742624  9041 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260925 16:44:47.702231 13757 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:47.754074 13787 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.755556  9118 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:47.755657  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.764587  9049 rpcz_store.cc:276] 0925 16:44:46.475584 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:46.540898 (+ 65314us) service_pool.cc:227] Handling call
0925 16:44:46.556175 (+ 15277us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:44:46.927481 (+371306us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:46.927852 (+   371us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:44:46.975919 (+ 48067us) log.cc:842] Serialized 78 byte log entry
0925 16:44:47.344410 (+368491us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:47.377934 (+ 33524us) log.cc:842] Serialized 14 byte log entry
0925 16:44:47.401111 (+ 23177us) log.cc:842] Serialized 14 byte log entry
0925 16:44:47.401443 (+   332us) log.cc:842] Serialized 14 byte log entry
0925 16:44:47.445169 (+ 43726us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:47.446397 (+  1228us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:47.547447 (+101050us) spinlock_profiling.cc:243] Waited 6.35 ms on lock 0x7b18004af0e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11
0925 16:44:47.722180 (+174733us) raft_consensus.cc:1671] finished
0925 16:44:47.722200 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:47.722340 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":353589,"prepare.queue_time_us":54468,"raft.queue_time_us":353739,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":15566,"spinlock_wait_cycles":92490880,"thread_start_us":378563,"threads_started":2,"wal-append.queue_time_us":407122}
I20260925 16:44:47.727269  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:47.777145  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.782986  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:47.783674  9123 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.788508  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:47.789011  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 368087us
I20260925 16:44:47.789155  9043 raft_consensus.cc:2362] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11. Re-sending same reply.
I20260925 16:44:47.791061  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.757781 13793 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:47.792184  9043 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:47.759328 13839 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:47.767978 13450 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:44:47.795210  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.797257  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:47.799263  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:47.804312  9043 raft_consensus.cc:2362] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10. Re-sending same reply.
I20260925 16:44:47.794307  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.772675 13564 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.800418  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.807399  8969 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:47.744976 13739 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.816999  8968 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:44:47.815169  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:47.820494  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58511.1us
I20260925 16:44:47.775630 13408 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260925 16:44:47.831385  9041 pending_rounds.cc:76] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 9
I20260925 16:44:47.831501  9049 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:47.831864  9123 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:47.779093 13758 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.835211  9121 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:47.833461  9124 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:47.834151  9041 pending_rounds.cc:97] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260925 16:44:47.835755  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:47.836169  9041 raft_consensus.cc:2866] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:47.798059 13791 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260925 16:44:47.840916  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:47.811004 13787 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:47.849571  8966 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:47.857343  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.886960  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:47.888238  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:47.906224  9049 pending_rounds.cc:76] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 9
I20260925 16:44:47.906553  9049 pending_rounds.cc:97] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260925 16:44:47.906832  9049 raft_consensus.cc:2866] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:47.907138  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:47.845218 13515 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
I20260925 16:44:47.909679 13758 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.813822 13564 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.913204  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:47.932446 13776 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:47.934226 13758 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:47.884181 13095 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.934774 13758 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:47.935021 13095 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:47.914808 13408 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:44:47.906701 13450 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:44:47.833917 13549 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.080s
I20260925 16:44:47.913537 13796 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:44:47.850447 13847 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:48.042932  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 85241.9us
I20260925 16:44:47.907050 13835 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:47.936414 13317 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:47.937119 13564 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:47.952543 13739 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:47.945076 13408 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.948318 13796 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:47.941097 13706 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:48.072201  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 140727us
I20260925 16:44:48.041370 13547 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:47.905982 13787 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.049605 13835 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:47.946714 13482 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:47.945359 13734 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:48.106424 13816 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:44:47.886525 13793 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.066566 13781 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:47.935667 13758 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.181110  9043 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260925 16:44:48.179248 13781 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.185025 13781 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.206204 13800 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.206874 13800 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.209335 13787 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:48.228005  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 461388us
I20260925 16:44:48.052184 13847 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.105360 13759 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:48.177562 13778 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.000s
I20260925 16:44:48.108527 13790 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260925 16:44:48.254449  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1806) took 1176 ms. Trace:
I20260925 16:44:48.254913  8971 rpcz_store.cc:276] 0925 16:44:47.068774 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.068931 (+   157us) service_pool.cc:227] Handling call
0925 16:44:48.244549 (+1175618us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b5400137754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:48.244691 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":148994304}
I20260925 16:44:48.209331 13800 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.269513  9120 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:48.272022  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 210152us
W20260925 16:44:48.275302  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.064s	sys 0.099s
W20260925 16:44:48.276842  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.064s	sys 0.100s
W20260925 16:44:48.277245  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 701446us
W20260925 16:44:48.277357  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.022s
W20260925 16:44:48.278185  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.007s	sys 0.022s
I20260925 16:44:48.277329  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.272861  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:48.279573  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:48.171255 13706 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.280853  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:48.252997 13739 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.269124 13833 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:48.283228 13672 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.785s	user 0.010s	sys 0.000s
I20260925 16:44:48.290838  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.367599  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:48.383812  8971 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:48.385322  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 655227us
I20260925 16:44:48.386737  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:48.383443  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 868) took 1162 ms. Trace:
I20260925 16:44:48.414676  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:48.260835 13778 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.454432  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:48.522379  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:48.501828  9115 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
W20260925 16:44:48.501654  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 217624us
I20260925 16:44:48.287482 13793 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
W20260925 16:44:48.544103  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 250299us
W20260925 16:44:48.439827 13786 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.765s	user 0.011s	sys 0.001s
I20260925 16:44:48.288205 13846 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:48.382714 13776 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:48.563197  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:48.264469 13408 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.380618 13317 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:48.518997 13775 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:48.542455 13808 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.520467 13777 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:48.519254 13672 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:48.601462  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2663) took 1629 ms (client timeout 1861 ms). Trace:
W20260925 16:44:48.601892  9118 rpcz_store.cc:269] 0925 16:44:46.967994 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:46.982187 (+ 14193us) service_pool.cc:227] Handling call
0925 16:44:48.597022 (+1614835us) spinlock_profiling.cc:243] Waited 767 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:48.597142 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1763307264}
I20260925 16:44:48.593564 13755 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.596041  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1158) took 1463 ms. Trace:
I20260925 16:44:48.382550 13739 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.603758  9046 rpcz_store.cc:276] 0925 16:44:47.132551 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.132737 (+   186us) service_pool.cc:227] Handling call
0925 16:44:48.595181 (+1462444us) spinlock_profiling.cc:243] Waited 48.8 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:48.595920 (+   739us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":112293248}
I20260925 16:44:48.274452 13796 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.546108 13810 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:48.272392 13852 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.281s
W20260925 16:44:48.599536 13784 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.038s	user 0.010s	sys 0.003s
I20260925 16:44:48.558617 13846 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:48.557931 13737 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.048s
I20260925 16:44:48.598120 13776 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:48.626438  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2674) took 1262 ms. Trace:
W20260925 16:44:48.622488 13856 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260925 16:44:48.623291 13854 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260925 16:44:48.634853  8966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1800) took 1650 ms (client timeout 1727 ms). Trace:
I20260925 16:44:48.627063  9124 rpcz_store.cc:276] 0925 16:44:47.363880 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.364015 (+   135us) service_pool.cc:227] Handling call
0925 16:44:47.376811 (+ 12796us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:47.839097 (+462286us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.626162 (+787065us) spinlock_profiling.cc:243] Waited 455 ms on lock 0x7b5400164254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:48.626375 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1046177536}
I20260925 16:44:48.631844 13785 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:48.611918  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 810821us
I20260925 16:44:48.539350 13833 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:48.635347  8966 rpcz_store.cc:269] 0925 16:44:46.984378 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:46.984991 (+   613us) service_pool.cc:227] Handling call
0925 16:44:48.634671 (+1649680us) spinlock_profiling.cc:243] Waited 693 ms on lock 0x7b540036f954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:48.634789 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1593169280}
I20260925 16:44:48.636904  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1824) took 1190 ms. Trace:
I20260925 16:44:48.608495 13740 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:48.649591  9041 rpcz_store.cc:276] 0925 16:44:47.446714 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.814083 (+367369us) service_pool.cc:227] Handling call
0925 16:44:47.831204 (+ 17121us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:47.840142 (+  8938us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:47.912672 (+ 72530us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.628238 (+715566us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:48.628668 (+   430us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.628811 (+   143us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:48.629032 (+   221us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.636596 (+  7564us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.636673 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.636719 (+    46us) raft_consensus.cc:1671] finished
0925 16:44:48.636734 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.636851 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":297528,"prepare.queue_time_us":72998,"prepare.run_cpu_time_us":77,"prepare.run_wall_time_us":84,"raft.queue_time_us":365956,"raft.run_cpu_time_us":78,"raft.run_wall_time_us":1976,"thread_start_us":390826,"threads_started":2,"wal-append.queue_time_us":344339}
I20260925 16:44:48.655395 13793 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:48.609747 13482 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.603186 13755 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.613552 13734 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.620831 13846 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:48.664981  9041 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:48.669061  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2724) took 1213 ms. Trace:
I20260925 16:44:48.670382  9041 rpcz_store.cc:276] 0925 16:44:47.452746 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.659042 (+1206296us) service_pool.cc:227] Handling call
0925 16:44:48.664815 (+  5773us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:48.665964 (+  1149us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.666136 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:48.660112 13759 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:48.680572 13807 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:48.702654 13807 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.676318 13482 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:48.704648 13807 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.704376 13482 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.705353  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1815) took 1216 ms. Trace:
I20260925 16:44:48.705725  8973 rpcz_store.cc:276] 0925 16:44:47.489229 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.489400 (+   171us) service_pool.cc:227] Handling call
0925 16:44:47.507256 (+ 17856us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:47.789881 (+282625us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:47.789908 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:47.805454 (+ 15546us) log.cc:842] Serialized 52 byte log entry
0925 16:44:48.248201 (+442747us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:48.248253 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.248337 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.705151 (+456814us) raft_consensus.cc:1671] finished
0925 16:44:48.705170 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.705301 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":26594,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":3668,"thread_start_us":691361,"threads_started":2,"wal-append.queue_time_us":462450}
I20260925 16:44:48.680784 13778 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.680987 13740 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:48.678648 13862 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260925 16:44:48.707944 13740 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.708355 13785 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.676364 13734 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:48.709830 13740 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.709578 13734 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.661432 13847 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.683089 13776 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.684036 13706 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:48.708242 13815 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 1.358s	user 0.003s	sys 0.026s
I20260925 16:44:48.690009  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1819) took 1337 ms. Trace:
I20260925 16:44:48.691185 13755 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.692453 13672 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.694129  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2680) took 1014 ms. Trace:
I20260925 16:44:48.726519  9120 rpcz_store.cc:276] 0925 16:44:47.680069 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.680976 (+   907us) service_pool.cc:227] Handling call
0925 16:44:47.706436 (+ 25460us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:48.276907 (+570471us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.693868 (+416961us) spinlock_profiling.cc:243] Waited 560 ms on lock 0x7b5400041fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:48.694067 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1287531904}
W20260925 16:44:48.710798 13830 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.061s	user 0.002s	sys 0.026s
I20260925 16:44:48.659509 13757 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:48.688796 13850 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.752s	user 0.008s	sys 0.023s
I20260925 16:44:48.606220 13808 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.706759 13389 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.666965 13788 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:48.676812 13857 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260925 16:44:48.732163  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:48.723560  9048 rpcz_store.cc:276] 0925 16:44:47.352834 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.692061 (+339227us) service_pool.cc:227] Handling call
0925 16:44:47.692450 (+   389us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:47.706111 (+ 13661us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:47.706170 (+    59us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:47.732738 (+ 26568us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.279061 (+546323us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:48.488944 (+209883us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.660776 (+171832us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.661427 (+   651us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.689830 (+ 28403us) raft_consensus.cc:1671] finished
0925 16:44:48.689849 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.689961 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70884,"prepare.queue_time_us":160162,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":137125,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":6166,"thread_start_us":614259,"threads_started":2,"wal-append.queue_time_us":936175}
W20260925 16:44:48.733204  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 345460us
I20260925 16:44:48.706849 13482 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.763212  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.763988  9699 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:48.735312 13871 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.764721 13867 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:48.764438 13871 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.738431 13793 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.744616  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.711464 13734 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.752218 13755 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:48.768275  8921 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet c694676902c54ad8bfe8e7fd5a725e33
W20260925 16:44:48.768807  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet c694676902c54ad8bfe8e7fd5a725e33
I20260925 16:44:48.768723 13755 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.770875 13755 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.771900  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.772642  9123 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:48.773916 13871 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.775309  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.736944  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:48.759027 13872 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:48.765196 13867 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.755045  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.737289  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.395493  9050 rpcz_store.cc:276] 0925 16:44:47.221360 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.396025 (+174665us) service_pool.cc:227] Handling call
0925 16:44:47.396380 (+   355us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:47.398236 (+  1856us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:47.398262 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:47.405152 (+  6890us) log.cc:842] Serialized 26 byte log entry
0925 16:44:47.744299 (+339147us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:47.762628 (+ 18329us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.382788 (+620160us) spinlock_profiling.cc:243] Waited 1.95 ms on lock 0x7b18004ac9e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:44:48.382990 (+   202us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.383083 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.383138 (+    55us) raft_consensus.cc:1671] finished
0925 16:44:48.383237 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.383377 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5331,"prepare.queue_time_us":14596,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":3610,"raft.queue_time_us":622058,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":5706,"spinlock_wait_cycles":4489984,"thread_start_us":291181,"threads_started":1,"wal-append.queue_time_us":412010}
I20260925 16:44:48.797924  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 859) took 1579 ms. Trace:
I20260925 16:44:48.818177  9047 rpcz_store.cc:276] 0925 16:44:47.218628 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.335629 (+117001us) service_pool.cc:227] Handling call
0925 16:44:47.352393 (+ 16764us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:47.686529 (+334136us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.797703 (+1111174us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:48.797860 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":693394816}
I20260925 16:44:48.663242 13317 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.822799  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.780506  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.819531  9123 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:48.825714 13867 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.827473  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1135) took 1328 ms. Trace:
I20260925 16:44:48.831152  9700 rpcz_store.cc:276] 0925 16:44:47.499287 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.503893 (+  4606us) service_pool.cc:227] Handling call
0925 16:44:48.827314 (+1323421us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:48.827427 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":28307328}
I20260925 16:44:48.834205  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2723) took 1381 ms. Trace:
W20260925 16:44:48.834299  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 279074us
I20260925 16:44:48.835098  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:48.835530  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 93933.1us
I20260925 16:44:48.834673  9046 rpcz_store.cc:276] 0925 16:44:47.452483 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.605250 (+1152767us) service_pool.cc:227] Handling call
0925 16:44:48.619685 (+ 14435us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:48.620152 (+   467us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:48.620191 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:48.635048 (+ 14857us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.832494 (+197446us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:48.832763 (+   269us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.833224 (+   461us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.833291 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.834007 (+   716us) raft_consensus.cc:1671] finished
0925 16:44:48.834037 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.834152 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40,"prepare.queue_time_us":2032,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":6760,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":16527,"thread_start_us":166394,"threads_started":1,"wal-append.queue_time_us":177226}
W20260925 16:44:48.761266 13834 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.753s	user 0.005s	sys 0.024s
I20260925 16:44:48.838222  9050 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:48.838411  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:48.781723 13845 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.847s	user 0.000s	sys 0.024s
I20260925 16:44:48.840826  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:48.844064  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2728) took 1390 ms. Trace:
W20260925 16:44:48.840066  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 158044us
I20260925 16:44:48.849221  9050 rpcz_store.cc:276] 0925 16:44:47.453736 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.819738 (+1366002us) service_pool.cc:227] Handling call
0925 16:44:48.837976 (+ 18238us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:48.843748 (+  5772us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.844003 (+   255us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:48.850620  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:48.782080 13808 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.858628  9046 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:48.870018  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2731) took 1415 ms. Trace:
I20260925 16:44:48.870666  9046 rpcz_store.cc:276] 0925 16:44:47.454519 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.839368 (+1384849us) service_pool.cc:227] Handling call
0925 16:44:48.858413 (+ 19045us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:48.869674 (+ 11261us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.869949 (+   275us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:48.847815 13706 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.876277  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:48.879323  9050 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:48.855625 13878 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:48.854147 13867 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:48.849098 13886 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:48.854717 13564 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:48.888881  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:48.880610  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 323456us
I20260925 16:44:48.855739 13879 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.867501 13796 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.901866  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:48.898298  9123 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:44:48.898814  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.855579 13875 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260925 16:44:48.758195 13757 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.905660  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:48.910346  9046 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:48.872071 13627 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:48.910799  9119 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:48.796118 13788 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.915162  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:48.878582 13739 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.882100 13878 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:48.899472  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:48.914489  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.919835  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:48.920090  9119 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:44:48.886781 13867 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:48.925616  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:48.927222  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1813) took 1474 ms. Trace:
I20260925 16:44:48.928335  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:48.928217  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.929242  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:48.929525  9119 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:48.899452 13737 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:48.930884  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.930584  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.938862  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:48.939670  9046 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:48.883488 13717 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260925 16:44:48.912369 13722 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:48.912550 13780 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:48.944604  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:48.830808 13872 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.928740  8972 rpcz_store.cc:276] 0925 16:44:47.453167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.453276 (+   109us) service_pool.cc:227] Handling call
0925 16:44:47.473306 (+ 20030us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:47.473498 (+   192us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:47.473520 (+    22us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:47.482100 (+  8580us) log.cc:842] Serialized 26 byte log entry
0925 16:44:47.727428 (+245328us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:47.727480 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:47.727552 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.687132 (+959580us) spinlock_profiling.cc:243] Waited 14.3 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:48.912763 (+225631us) raft_consensus.cc:1671] finished
0925 16:44:48.912783 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.927163 (+ 14380us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":32907648,"thread_start_us":220418,"threads_started":1,"wal-append.queue_time_us":349607}
I20260925 16:44:48.918193 13627 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.881551 13706 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.968621  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:48.969249  9046 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:48.949735  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 869) took 1728 ms. Trace:
I20260925 16:44:48.951538  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.916181 13808 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.958915  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.959967  9701 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:48.913563 12666 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:48.970395  9045 rpcz_store.cc:276] 0925 16:44:47.221691 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.397963 (+176272us) service_pool.cc:227] Handling call
0925 16:44:47.398235 (+   272us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:47.518529 (+120294us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:47.518572 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:47.529742 (+ 11170us) log.cc:842] Serialized 26 byte log entry
0925 16:44:47.789624 (+259882us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:47.794541 (+  4917us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.443161 (+648620us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.780992 (+337831us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:48.789005 (+  8013us) spinlock_profiling.cc:243] Waited 116 ms on lock 0x7b54000df554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:48.789050 (+    45us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.949512 (+160462us) raft_consensus.cc:1671] finished
0925 16:44:48.949532 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.949664 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":652070,"prepare.queue_time_us":10480,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":758348,"raft.run_cpu_time_us":276,"raft.run_wall_time_us":23526,"spinlock_wait_cycles":301137920,"thread_start_us":210536,"threads_started":1,"wal-append.queue_time_us":342667}
I20260925 16:44:48.928218 13674 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:48.943780 13883 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.994755 13883 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.931468 13867 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:48.922806 13672 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.922825 13878 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:48.976573  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.977778  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:48.978348 13627 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.979193  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2727) took 1525 ms. Trace:
I20260925 16:44:48.980218  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:48.969156  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
W20260925 16:44:49.014219  8860 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45107.3us
I20260925 16:44:49.013299  9048 rpcz_store.cc:276] 0925 16:44:47.453464 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.760131 (+1306667us) service_pool.cc:227] Handling call
0925 16:44:48.760440 (+   309us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:48.762968 (+  2528us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:48.762998 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:48.763729 (+   731us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.882131 (+118402us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:48.927882 (+ 45751us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.928069 (+   187us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.928157 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:48.979009 (+ 50852us) raft_consensus.cc:1671] finished
0925 16:44:48.979029 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:48.979142 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24206,"prepare.queue_time_us":79600,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":2915,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":12809,"thread_start_us":117906,"threads_started":1,"wal-append.queue_time_us":213202}
I20260925 16:44:49.015323  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.016772  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:48.983326 13706 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.980039 13722 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:48.983785 13808 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.988517  9090 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:48.989684 13450 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.990692  9046 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:49.020368  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:49.021248  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:48.948876 13786 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.948978 13852 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:48.945750 13737 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.992625 13865 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260925 16:44:48.946508 13864 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:48.993160 13717 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:48.993687 13788 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.993628 12666 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:48.994242 13757 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:48.967254  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.935176 13776 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:48.997974  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.944391 13793 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260925 16:44:48.999718 13672 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.000365 13883 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.006120 13866 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260925 16:44:48.907477 13879 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.093348 13672 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.094245 13879 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:48.913690 13795 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.064s
I20260925 16:44:49.095008 12666 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.009116  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2726) took 1555 ms. Trace:
I20260925 16:44:49.096481 13759 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:49.095628  9041 rpcz_store.cc:276] 0925 16:44:47.453179 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.671365 (+1218186us) service_pool.cc:227] Handling call
0925 16:44:48.671784 (+   419us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:48.672033 (+   249us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:48.672068 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:48.677593 (+  5525us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.776171 (+ 98578us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:48.776467 (+   296us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.776649 (+   182us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:48.776711 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:49.008843 (+232132us) raft_consensus.cc:1671] finished
0925 16:44:49.008870 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.009036 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":164,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":218,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":75,"thread_start_us":82418,"threads_started":1,"wal-append.queue_time_us":155163}
I20260925 16:44:49.096979 13759 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.097950  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2734) took 1418 ms. Trace:
I20260925 16:44:49.098282  9041 rpcz_store.cc:276] 0925 16:44:47.679817 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.097237 (+1417420us) service_pool.cc:227] Handling call
0925 16:44:49.097514 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.097670 (+   156us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:49.097693 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:49.097728 (+    35us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:44:49.097761 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.097807 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.097903 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:49.013563  9693 raft_consensus.cc:2362] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12. Re-sending same reply.
I20260925 16:44:48.912128 13796 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.100718  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2735) took 1396 ms. Trace:
I20260925 16:44:49.101253 13796 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.101068  9041 rpcz_store.cc:276] 0925 16:44:47.704163 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.099103 (+1394940us) service_pool.cc:227] Handling call
0925 16:44:49.099355 (+   252us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.099507 (+   152us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:49.099530 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:49.099563 (+    33us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:49.099600 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.099647 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.100675 (+  1028us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:49.019379  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.028252  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.102555  9048 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:44:49.102703  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 877) took 1356 ms. Trace:
W20260925 16:44:49.066351  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83537.7us
I20260925 16:44:49.103667  9048 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:49.104182  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2737) took 1190 ms. Trace:
I20260925 16:44:49.104759 13880 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:44:49.105620 13880 consensus_queue.cc:1225] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260925 16:44:49.106211 13734 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:49.106837 13853 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:44:49.106724 13734 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.107225 13853 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:49.033181 13717 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:49.108135 13853 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.108700 13734 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.108475 13717 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.110069 13717 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:49.107760 13759 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.111538 13095 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.032761 13450 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.114219 13450 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.081504  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 863) took 1861 ms. Trace:
I20260925 16:44:49.089154 13722 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.066372  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:49.090975  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.118266  9118 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:49.120270  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.090005 13872 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.035001  9699 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:49.107311  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.121603  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:49.091082 13846 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.129917  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:49.113087 13793 consensus_queue.cc:1225] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 10.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260925 16:44:49.104442  9048 rpcz_store.cc:276] 0925 16:44:47.913499 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.103149 (+1189650us) service_pool.cc:227] Handling call
0925 16:44:49.103381 (+   232us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.103995 (+   614us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.104138 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:49.104557  9041 rpcz_store.cc:276] 0925 16:44:47.746309 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.102039 (+1355730us) service_pool.cc:227] Handling call
0925 16:44:49.102274 (+   235us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.102431 (+   157us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:49.102452 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:49.102485 (+    33us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:49.102518 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.102566 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.102662 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:44:49.031162 13839 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.221s	user 0.012s	sys 0.000s
I20260925 16:44:49.116101  9042 rpcz_store.cc:276] 0925 16:44:47.219888 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.370230 (+150342us) service_pool.cc:227] Handling call
0925 16:44:47.384479 (+ 14249us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:47.391779 (+  7300us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:47.391813 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:47.678106 (+286293us) spinlock_profiling.cc:243] Waited 4.19 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:48.799528 (+1121422us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:44:48.800081 (+   553us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.884787 (+ 84706us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:49.080755 (+195968us) log.cc:842] Serialized 14 byte log entry
0925 16:44:49.081154 (+   399us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.081248 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:49.081307 (+    59us) raft_consensus.cc:1671] finished
0925 16:44:49.081324 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.081456 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43024,"prepare.queue_time_us":91805,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":25,"raft.queue_time_us":12779,"raft.run_cpu_time_us":2332,"raft.run_wall_time_us":285110,"spinlock_wait_cycles":16273536,"thread_start_us":206006,"threads_started":2,"wal-append.queue_time_us":137809}
I20260925 16:44:49.032634 13790 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:49.143296  9041 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:49.141883  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.148617  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.152019  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.152580  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2738) took 1213 ms. Trace:
I20260925 16:44:49.152983  9042 rpcz_store.cc:276] 0925 16:44:47.939609 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.141591 (+1201982us) service_pool.cc:227] Handling call
0925 16:44:49.152091 (+ 10500us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.152264 (+   173us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:49.152292 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:49.152334 (+    42us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:49.152375 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.152436 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.152530 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":12544}
I20260925 16:44:49.030953 13786 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.154458  9042 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260925 16:44:49.157891 13835 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.158650 13808 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.134845 13864 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.152611  9045 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:49.159511 13864 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.160742  9045 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:49.161618 13864 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.135120 13776 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.164397  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:44:49.174821  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:49.168076  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:49.251066  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.140378 13722 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.255115 13905 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:49.273636 13905 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:49.274072 13905 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:49.255115  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.272987  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2729) took 1819 ms. Trace:
I20260925 16:44:49.279584  9047 rpcz_store.cc:276] 0925 16:44:47.453995 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.822478 (+1368483us) service_pool.cc:227] Handling call
0925 16:44:48.826081 (+  3603us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:48.827145 (+  1064us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:48.827174 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:48.827559 (+   385us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.997975 (+170416us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:49.034819 (+ 36844us) log.cc:842] Serialized 14 byte log entry
0925 16:44:49.035003 (+   184us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.035072 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:49.272732 (+237660us) raft_consensus.cc:1671] finished
0925 16:44:49.272760 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.272920 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":844,"prepare.queue_time_us":36692,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":46528,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":51790,"thread_start_us":170030,"threads_started":1,"wal-append.queue_time_us":207635}
I20260925 16:44:49.287550  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.176375 13872 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:49.297710  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 328039us
I20260925 16:44:49.179354 13789 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:49.300392  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.179579 13883 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:49.304239  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:49.249717 13450 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:49.249550 13835 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:49.270593 13894 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260925 16:44:49.170985 13839 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.309934  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.285715 13790 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:49.301445 13872 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:49.322631  9047 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:49.301998  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:49.306550 13627 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:49.311571 13450 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.323915 13779 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:49.305976 13789 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:49.362072  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:49.300881 13095 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
W20260925 16:44:49.361491  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59604.2us
I20260925 16:44:49.369993  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.371227  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:49.306633 13781 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260925 16:44:49.372977  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:49.374782  9047 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:49.336244 13872 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:49.337498 13785 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:49.299449 13722 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.362479 13725 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:49.389139 13895 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:44:49.362787 13808 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:49.368012 13757 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:49.362346 13450 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:49.378408 13779 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:49.324303 13864 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260925 16:44:49.315997 13883 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.371385 13672 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.366173 13515 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260925 16:44:49.388052  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:49.431754  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.432130  9119 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:49.445657  9119 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:49.363178 13627 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.403934 13878 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.400435 13725 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:49.446604  9119 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.470341  9119 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:49.471426  9048 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:49.438360 13737 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:44:49.445863  9047 raft_consensus.cc:2396] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
W20260925 16:44:49.445848  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58010.4us
I20260925 16:44:49.476497  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:49.449038 13776 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:49.452509 13902 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260925 16:44:49.452847 13759 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.453084  9702 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:49.482513  9702 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:49.482965  9041 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:49.455972 13781 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:49.456101 13515 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:49.457592 13867 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.486299  9702 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.429579 13773 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:49.426576 13779 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:49.439015 13793 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:49.402058 13785 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.406900 13757 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.406517 13808 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.485526  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:49.497781  9118 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:49.472201 13725 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:49.486830 13759 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.493553 13776 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.493798 13835 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:49.494025 13911 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.458492 13272 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.498543  9702 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:47.113497  9696 rpcz_store.cc:276] 0925 16:44:46.103961 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:46.104861 (+   900us) service_pool.cc:227] Handling call
0925 16:44:46.137388 (+ 32527us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:46.137565 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:44:46.963457 (+825892us) log.cc:842] Serialized 14 byte log entry
0925 16:44:47.112715 (+149258us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:47.112777 (+    62us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:47.112819 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:47.112891 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:47.112995 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":834044,"prepare.queue_time_us":845168,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":103,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6996,"thread_start_us":148969,"threads_started":1}
I20260925 16:44:49.486588 13769 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:44:49.464596 13672 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.497195 13779 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:49.441196 13789 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.488323 13515 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:49.492857 13839 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.512080 13722 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.512422 13272 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.519048  9119 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260925 16:44:49.503925 13913 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:49.524406  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 151518us
I20260925 16:44:49.527416  9119 pending_rounds.cc:76] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 5
I20260925 16:44:49.464165 13905 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.529255  9119 pending_rounds.cc:97] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260925 16:44:49.529664  9119 raft_consensus.cc:2866] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:49.517016 13769 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:49.531142  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.536437  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.542001  9115 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:49.542327  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.538727 13272 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.539584  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.540268  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.543169  9698 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 10 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 10.
I20260925 16:44:49.543156  9120 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:49.545315  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.549458  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:49.549701  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.503764 13776 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.553829  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.553912  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.529852 13789 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:49.554814  9699 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:49.554801  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.546552 13769 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:49.558495  9698 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:44:49.559877  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.540597 13909 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:44:49.562634  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1807) took 2488 ms (client timeout 1839 ms). Trace:
W20260925 16:44:49.563011  8975 rpcz_store.cc:269] 0925 16:44:47.074079 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.103986 (+ 29907us) service_pool.cc:227] Handling call
0925 16:44:49.562460 (+2458474us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b54002cb5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:49.562564 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":856663808}
I20260925 16:44:49.507174 13911 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.567246  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:49.568403  9700 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:49.570384 13272 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.570513  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:49.574160 13867 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.581333  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:49.582007  9124 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:49.553855 13839 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260925 16:44:49.545480 13913 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.713078  9118 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:49.714339  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.715916  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:49.716848  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 140512us
I20260925 16:44:49.575266 13883 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:49.718722  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 234496us
I20260925 16:44:49.717556  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:49.576138 13864 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:49.714154 13879 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.583034 13878 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.726092  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.626010 13790 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:49.735785 13773 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:49.736155 13021 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:49.736377 13773 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.736967 13773 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:49.576907 13272 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.740001 13759 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.740518 13759 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.740936 13759 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.742782 13759 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.743196 13759 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.744453  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.714315 13627 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.566053 13909 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.754920  9702 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:49.743482  9700 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:49.558895 13515 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.758914  9045 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:49.753711  9050 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: [8.6-11.7]
I20260925 16:44:49.757453  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:49.584381 13450 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:49.745240 13912 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260925 16:44:49.771173  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.769500 13763 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
I20260925 16:44:49.789599 13672 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.793165 13779 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.796171  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.804729 13672 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:44:49.805418 13672 consensus_queue.cc:1225] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:44:49.805881 13672 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:49.760325 13785 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.806324 13672 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.807982 13779 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.773176  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:49.787565 13808 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.788838 13911 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.809676 13911 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:49.809971 13911 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:49.810954  9124 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:49.774492 13627 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260925 16:44:49.759063 13879 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.813421 13879 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.800259  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.810719 13763 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:49.810725 13911 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.815002 13450 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.815236 13766 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:49.815680 13766 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:49.815984  9045 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:49.816542 13766 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.817058  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.817629 13766 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:49.817860  9045 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:49.775190  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.815007 13763 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:49.818820  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.819916  9045 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:49.797544  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.820868  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.821395  9045 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:49.822161  9042 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:44:49.822429  9045 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260925 16:44:49.819370 13763 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:49.815548 13911 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:49.823643  9045 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260925 16:44:49.827330  9042 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260925 16:44:49.830417  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:49.840152  9696 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:49.769665 13878 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:44:49.728281 13852 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.053s
I20260925 16:44:49.771051 13757 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.743574 13759 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.851449  9050 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:44:49.793135 13515 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:49.800870 13272 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.860304  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:49.792754 13913 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.889319 13759 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:49.892766 13908 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.559s	user 0.004s	sys 0.002s
I20260925 16:44:49.894166  9050 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:49.896466 13846 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:49.897275  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2733) took 2397 ms. Trace:
I20260925 16:44:49.897640  9046 rpcz_store.cc:276] 0925 16:44:47.500098 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.022327 (+1522229us) service_pool.cc:227] Handling call
0925 16:44:49.037259 (+ 14932us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:49.037553 (+   294us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:44:49.037588 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:49.080514 (+ 42926us) log.cc:842] Serialized 26 byte log entry
0925 16:44:49.142948 (+ 62434us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:44:49.142994 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.143106 (+   112us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:49.892250 (+749144us) spinlock_profiling.cc:243] Waited 2.66 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:49.896998 (+  4748us) raft_consensus.cc:1671] finished
0925 16:44:49.897020 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:49.897220 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6112000,"thread_start_us":33266,"threads_started":1,"wal-append.queue_time_us":214423}
I20260925 16:44:49.899910 13905 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.843993 13450 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:44:49.903983 13450 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:49.904361 13450 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:49.904922 13909 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:49.905244  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2766) took 2481 ms. Trace:
I20260925 16:44:49.905619  9121 rpcz_store.cc:276] 0925 16:44:47.423881 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.424088 (+   207us) service_pool.cc:227] Handling call
0925 16:44:47.424314 (+   226us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:47.841344 (+417030us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.905047 (+2063703us) spinlock_profiling.cc:243] Waited 411 ms on lock 0x7b54001c8c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:49.905195 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":944526208}
I20260925 16:44:49.866032 13879 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.908015 13879 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.879098  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1823) took 2456 ms. Trace:
I20260925 16:44:49.909277  9043 rpcz_store.cc:276] 0925 16:44:47.422510 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.811208 (+388698us) service_pool.cc:227] Handling call
0925 16:44:47.811572 (+   364us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:48.181619 (+370047us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.878840 (+1697221us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54001707d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:49.879039 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":849157376}
I20260925 16:44:49.824388 13779 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260925 16:44:49.884443 13272 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260925 16:44:49.885227 13866 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 10 current term: 10 is higher.
I20260925 16:44:49.885550  9045 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260925 16:44:49.917659  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2343) took 2759 ms (client timeout 2772 ms). Trace:
W20260925 16:44:49.918099  8967 rpcz_store.cc:269] 0925 16:44:47.158438 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.173241 (+ 14803us) service_pool.cc:227] Handling call
0925 16:44:49.917490 (+2744249us) spinlock_profiling.cc:243] Waited 435 ms on lock 0x7b540020e754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:49.917609 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1000283904}
I20260925 16:44:49.918596  8974 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:49.919402 13739 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:49.920264 13739 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:49.920336 13672 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.920490  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1814) took 2453 ms. Trace:
I20260925 16:44:49.921073  8974 rpcz_store.cc:276] 0925 16:44:47.467294 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.467406 (+   112us) service_pool.cc:227] Handling call
0925 16:44:49.918377 (+2450971us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.919145 (+   768us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:49.920275 (+  1130us) spinlock_profiling.cc:243] Waited 2.44 s on lock 0x7b540020e750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:49.920423 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5616256768}
I20260925 16:44:49.921211 13739 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.922485 13739 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:49.922935 13095 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:49.923322 13095 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:49.871975 13790 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.925227 13095 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:49.926242 13095 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:49.928056  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:49.928709 13839 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.929317  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:49.929231 13839 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.861198 13878 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:49.932026  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.931933 13878 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.933748  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:49.899542  9046 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:49.934460  9701 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:49.941181  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.950855  9121 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:49.857650 13706 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:49.951749  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:49.954550  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:49.960001  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:49.955658  8974 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:49.960922  9702 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:49.956966  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:49.957538  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:49.958104  9043 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260925 16:44:49.958418  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:49.959061  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:49.962802  8966 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:49.931588 13839 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:49.985163  9700 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260925 16:44:49.985930  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:49.993566  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45254.9us
I20260925 16:44:49.994124  9693 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
W20260925 16:44:49.947242 13872 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.001s
I20260925 16:44:49.940711 13708 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.921090 13776 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:50.001286  8973 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260925 16:44:50.003844  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.004426  8975 raft_consensus.cc:2362] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8. Re-sending same reply.
I20260925 16:44:50.004561 13769 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.005331  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.005903  8974 raft_consensus.cc:2362] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11. Re-sending same reply.
I20260925 16:44:50.010082 13833 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.010596 13833 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:49.948091 13788 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:50.013765  9043 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:50.006654  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.023000  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.027133  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.027849  8966 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:44:49.950879 13919 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:50.018426  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 285792us
I20260925 16:44:50.006654 13769 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.033464  9090 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.034116  9121 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:50.036118  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.036248  9046 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260925 16:44:49.999173 13021 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:49.995558 13883 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.040056  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:50.042423  8966 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:49.952250 13846 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.076s
I20260925 16:44:50.047107  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:50.047649  9119 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:50.022543 13708 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.057335 13708 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.062201 13763 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.064700 13871 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:50.065338  8974 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:50.066016 13871 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:50.012691 13866 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260925 16:44:50.066425 13871 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:50.068199 13763 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.070510  9119 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:50.071429  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.073186  9120 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:50.074146  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.078004  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2742) took 1234 ms. Trace:
I20260925 16:44:50.078358  9041 rpcz_store.cc:276] 0925 16:44:48.843387 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.145787 (+302400us) service_pool.cc:227] Handling call
0925 16:44:49.146106 (+   319us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.487037 (+340931us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:50.077794 (+590757us) spinlock_profiling.cc:243] Waited 336 ms on lock 0x7b54002c0454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:50.077937 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":773807872}
I20260925 16:44:50.079413  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.082263  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.083211  9123 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:50.084120  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.084854  9117 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:50.049441  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:49.947213 13773 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.046751 13762 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:50.053627 13739 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:50.012153 13788 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:49.991808 13706 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.048532 13021 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.087406  8972 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:50.092175  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:50.091228  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:48.382494  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:50.101492  9121 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260925 16:44:50.096885  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 954) took 1187 ms. Trace:
W20260925 16:44:50.102763  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 252509us
I20260925 16:44:50.109227  9124 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:50.108906  9694 rpcz_store.cc:276] 0925 16:44:48.909016 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:48.909117 (+   101us) service_pool.cc:227] Handling call
0925 16:44:48.909361 (+   244us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.099943 (+190582us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:49.099974 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:49.100015 (+    41us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:49.100048 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:50.096690 (+996642us) spinlock_profiling.cc:243] Waited 190 ms on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:50.096727 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:50.096836 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":437867392}
I20260925 16:44:50.112668  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:50.088189 13918 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260925 16:44:50.113998  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 162043us
I20260925 16:44:50.012887 13872 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.119997  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:50.121924  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.122836  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:50.128093  9043 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:50.106819  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.125597  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.131090  9117 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:50.139329  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.141232  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.143646  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.147019  9043 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:50.148305  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:50.148506  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.149653  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:50.149809  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.150812  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.157832  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.067384 13871 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.039220 13919 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.048640 13883 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.158399  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.166181  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.185276  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.179060  8972 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
W20260925 16:44:50.181080  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 229408us
I20260925 16:44:50.182220  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.136834 13762 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:50.187359  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.188833  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.189950  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:50.187399  8939 connection.cc:232] RPC call timeout handler was delayed by -1.5599686380001003s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18610000000000002s for a response
I20260925 16:44:50.193301  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.223250  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.148875 13842 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.075s
I20260925 16:44:50.226164  8973 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:50.155923 13835 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:50.164608 13779 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:50.227348  9116 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:50.236033 13842 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.228652  8969 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:50.237375  9121 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:50.237735  9119 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:50.238507 13450 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.239792  9117 raft_consensus.cc:2354] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:50.237468 13842 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.222785 13763 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:50.244372  8973 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:50.246078  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:50.247385  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.144322 13456 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.081s
I20260925 16:44:50.233515 13706 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.192221  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.191846 13515 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:50.234134 13779 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:50.160302 13789 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.088s
I20260925 16:44:50.232308 13926 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:50.236003 13095 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:50.235898  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.236266 13835 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:50.224907 13776 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260925 16:44:50.164860 13886 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:44:50.241848 13721 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.178092 13878 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:50.248006  8971 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
W20260925 16:44:50.233318 13922 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.188s	user 0.000s	sys 0.000s
I20260925 16:44:50.251897  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.253387  8974 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:44:50.255765  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.255832  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.257089  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.183219 13674 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.048s
W20260925 16:44:50.258438  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 66281.4us
I20260925 16:44:50.260165  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.259126 13739 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.234396 13773 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.230723 13871 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:50.304350 13931 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260925 16:44:50.304126 13835 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.305017 13450 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:50.233394 13021 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:50.262333 13725 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.756s	user 0.007s	sys 0.004s
I20260925 16:44:50.258989 13627 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:50.313567  8966 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:50.297606  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.297930  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.277711 13926 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:50.290746 13878 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:50.299109  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.300064  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.300959  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.301402  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.301818  8968 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:50.302456 13674 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:50.302243 13739 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.322156  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.322579  9047 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:50.287806  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.306393  8974 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260925 16:44:50.299021 13911 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:50.285199 13095 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:50.320923  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.322093  8970 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:50.322248  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.304283 13883 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.323612  9046 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:50.329255  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:50.306699 13736 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 2.637s	user 0.044s	sys 0.030s
I20260925 16:44:50.321009 13926 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:44:50.331825 13736 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 2.670s	user 0.044s	sys 0.030s
I20260925 16:44:50.333541 13924 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:50.328064 13796 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:50.327848 13674 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:50.335789 13865 raft_consensus.cc:2741] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260925 16:44:50.336529 13911 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:50.336333 13674 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.336923 13911 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:50.337359 13911 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:50.337559 13674 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:50.294032 13842 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.339880 13779 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.340512 13788 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.319582 13450 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260925 16:44:50.342084 13919 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.342284 13450 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:44:50.342653 13450 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:50.311789 13762 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.325631  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:50.345506 13853 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:50.294806 13721 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.346215 13763 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:50.346619 13763 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:50.346961 13763 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:50.347258 13721 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.327384 13095 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.330559  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.348690  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.355826  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.356549  8971 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:50.356870  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.358232  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.361953  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.362608  9047 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:50.321383 13878 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:50.316332 13930 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:50.380403 13935 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:50.381510 13935 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:50.381821 13935 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:50.382612 13935 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.383174  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.385310  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.387420  8970 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:50.362905  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.316885 13725 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.388490  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.365933 13739 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.343420 13450 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.362339 13789 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:50.369899 13719 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:50.370244 13759 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:50.342669 13872 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.363831 13790 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:50.396987  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.401103 13776 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:44:50.438453  8971 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260925 16:44:50.531778  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.545001  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.534770  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.546080  9693 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:50.423885  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.546592  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.548041  9697 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:50.476123  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.483207  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.401331  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.536791  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:50.471228  8974 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:50.547719  8966 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:50.562613  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.555964  9694 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:50.556124  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.565078  9700 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 6.
I20260925 16:44:50.557014  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.557467  9702 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260925 16:44:50.456436  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 93625us
W20260925 16:44:50.599512  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 60683.1us
I20260925 16:44:50.662864  9047 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:50.380004 13095 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:50.403000 13926 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.544214 13719 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:50.716621 13719 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.717300 13926 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.717581 13719 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:50.717856 13879 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:50.691789  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 104540us
I20260925 16:44:50.718073 13842 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:50.409017 13911 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.545158 13759 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:50.720041 13759 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:50.720304 13911 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.715247 13450 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:50.409144 13763 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.458948 13935 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:50.715359  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.722604 13763 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:50.718742  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.723240  8966 raft_consensus.cc:2354] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
W20260925 16:44:50.451891 13849 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.515s	user 0.005s	sys 0.017s
I20260925 16:44:50.723547  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.724433 13763 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:50.724718  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.725750  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.726737 13788 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:50.727221 13788 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.724727  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.728294  8966 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:50.729012  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.728888 13763 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:50.729974 13547 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:50.470482 13786 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.731633 13547 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:50.732024 13547 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:50.732750 13547 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.729373 13788 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.401149 13913 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:50.734004  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.734014 13547 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:50.734838  9702 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:50.732708 13872 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:50.735284 13759 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.737287 13872 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.692113 13733 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.738408 13865 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:50.738799 13865 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:50.739552  9117 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:44:50.726543  8971 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:50.731508  9050 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260925 16:44:50.554929  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.750667  9119 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:50.755235  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.763479  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:50.743659  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 143117us
W20260925 16:44:50.758200  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.022s	sys 0.063s
W20260925 16:44:50.767447  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.022s	sys 0.063s
I20260925 16:44:50.477110 13919 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:50.768144  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 624536us
I20260925 16:44:50.768380 13789 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:50.453347 13878 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.792732 13789 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.793871 13878 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.765801  9698 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:44:50.419101 13785 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:50.770187  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.775573  8966 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:50.776436 13725 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.796254  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.796404  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:50.796857  8968 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:50.797222 13839 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:44:50.797654  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:50.798245  8968 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 11
I20260925 16:44:50.798448  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:50.799631  9700 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:44:50.800050 13759 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:50.800768 13674 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.801119 13879 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:50.801210 13674 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.803179 13674 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:50.738698 13733 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.805960  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.784615  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.423158 13773 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:50.813333  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:50.814404  9116 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:50.423127 13883 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:50.768822  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 371881us
I20260925 16:44:50.824922  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.795583  8971 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:50.807925  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.807087  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:50.420662 13522 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:50.812217  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.797622 13839 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:50.817036  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.818254  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:50.808183  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.833976  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:50.834437  9014 leader_election.cc:398] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:50.834767  9014 leader_election.cc:401] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:50.828336  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:50.815878  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.830495  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:50.814574 13871 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.503s	user 0.008s	sys 0.000s
I20260925 16:44:50.814204 13776 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:44:50.842361  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:50.859315  9050 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:50.867040  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.875061  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.869524  8974 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 14 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260925 16:44:50.877121  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 124490us
I20260925 16:44:50.835223  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.835459  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.813972 13788 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:50.897683  9048 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:50.898584  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:50.899964  8968 raft_consensus.cc:2396] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260925 16:44:50.900130  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:50.901373  9701 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:50.834002  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:50.903296  9701 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
W20260925 16:44:50.892097  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.015s	sys 0.051s
I20260925 16:44:50.904925  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:50.904951  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.015s	sys 0.051s
I20260925 16:44:50.905576  9701 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:50.905534  8967 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.016s	sys 0.018s
W20260925 16:44:50.906816  8967 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.017s	sys 0.018s
I20260925 16:44:50.908300  9122 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260925 16:44:50.909888  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 74762us
I20260925 16:44:50.910715  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.912093  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:50.915906  9697 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:50.909076  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:50.891886 13779 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.523s	user 0.015s	sys 0.053s
W20260925 16:44:50.973467  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61445.3us
I20260925 16:44:50.973304  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:50.832612 13872 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:50.976363  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 67365.3us
I20260925 16:44:50.869649 13806 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:44:51.003027  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.977859  8968 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260925 16:44:50.977905  9050 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:51.006915  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:50.814410 13842 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260925 16:44:50.835446 13839 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:44:50.978820  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1822) took 1022 ms. Trace:
I20260925 16:44:50.858672 13879 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:50.848793 13547 raft_consensus.cc:2741] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260925 16:44:50.869215 13450 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260925 16:44:50.989651  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.866137 13924 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:50.989504  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:50.796299 13865 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:50.995836  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:50.987553  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:50.976197  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71489.4us
I20260925 16:44:50.988876  9122 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:50.869113 13272 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:51.007932  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 109410us
I20260925 16:44:51.048377  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.909822 13878 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:50.832440 13935 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.159s
W20260925 16:44:50.983510 13779 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.015s	sys 0.053s
I20260925 16:44:51.100309  9116 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:50.828236 13883 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:50.991595 13762 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.016s	sys 0.065s
I20260925 16:44:50.976501 13739 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:50.946231 13915 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:51.115043 13883 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.104578 13783 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:51.115866 13783 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:51.116262 13783 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.012785  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1821) took 3612 ms. Trace:
I20260925 16:44:51.028267  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:51.121188  9045 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:50.989424  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:50.992602 13776 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260925 16:44:50.828977 13773 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.036612  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:50.834961 13522 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:50.972522 13904 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.035972  8971 raft_consensus.cc:2362] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11. Re-sending same reply.
I20260925 16:44:51.050668  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:50.944608 13919 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.090s
I20260925 16:44:51.051084 13272 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:51.053272  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:51.055538 13408 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:51.036021 13719 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260925 16:44:50.981316 13853 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260925 16:44:51.012526 13456 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:51.045574 13781 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260925 16:44:51.042073 13924 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:51.073845 13865 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:51.031468 13941 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:51.013907 13790 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.061s
I20260925 16:44:51.076843  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 899) took 1008 ms. Trace:
I20260925 16:44:51.159736 13272 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:51.013706 13911 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.016059 13847 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.082907  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:50.934120  9118 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
W20260925 16:44:51.189133  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106311us
I20260925 16:44:50.971994 13795 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260925 16:44:50.982692 13873 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260925 16:44:50.945392 13788 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:50.984777 13835 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.640s	user 0.015s	sys 0.027s
I20260925 16:44:51.109505 13808 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.002s
I20260925 16:44:51.113221 13913 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:44:51.142650  9015 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.005s	sys 0.034s
I20260925 16:44:51.157567 13904 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.170605  9702 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:51.113221 13806 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:51.122058 13776 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:51.176671  9666 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.722s	user 0.014s	sys 0.038s
I20260925 16:44:51.180591  9047 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260925 16:44:51.182958  9042 rpcz_store.cc:276] 0925 16:44:50.068062 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.091805 (+ 23743us) service_pool.cc:227] Handling call
0925 16:44:50.118427 (+ 26622us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:44:50.137134 (+ 18707us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:50.137176 (+    42us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:44:50.155961 (+ 18785us) log.cc:842] Serialized 78 byte log entry
0925 16:44:50.549518 (+393557us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:50.549572 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:50.549654 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:51.076632 (+526978us) raft_consensus.cc:1671] finished
0925 16:44:51.076650 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:51.076788 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":257804,"raft.queue_time_us":30147,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":24108,"thread_start_us":322557,"threads_started":1,"wal-append.queue_time_us":871521}
W20260925 16:44:51.224686  9666 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.015s	sys 0.038s
I20260925 16:44:51.186079  8970 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
W20260925 16:44:51.225097  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 771110us
I20260925 16:44:51.190845  9118 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:44:51.149777 13852 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260925 16:44:51.120796  9044 rpcz_store.cc:276] 0925 16:44:47.385338 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.706366 (+321028us) service_pool.cc:227] Handling call
0925 16:44:47.706657 (+   291us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:48.442761 (+736104us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:48.442802 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:48.545096 (+102294us) log.cc:842] Serialized 26 byte log entry
0925 16:44:48.877501 (+332405us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:48.913438 (+ 35937us) log.cc:842] Serialized 14 byte log entry
0925 16:44:48.913727 (+   289us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:50.064392 (+1150665us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b18003642a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:50.997755 (+933363us) spinlock_profiling.cc:243] Waited 79.7 ms on lock 0x7b54002b61d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:50.997827 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:50.997887 (+    60us) raft_consensus.cc:1671] finished
0925 16:44:50.997904 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:50.998065 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":655996,"prepare.queue_time_us":50241,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":40,"raft.queue_time_us":756505,"raft.run_cpu_time_us":237,"raft.run_wall_time_us":19449,"spinlock_wait_cycles":190363264,"thread_start_us":270666,"threads_started":1,"wal-append.queue_time_us":338968,"wal-append.run_cpu_time_us":2026,"wal-append.run_wall_time_us":1087753}
I20260925 16:44:51.193178  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:51.177845 13924 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:51.192022 13842 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:51.193620 13847 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.193933 13706 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260925 16:44:51.202975 13095 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:51.205605 13911 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260925 16:44:51.213654  9015 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.006s	sys 0.034s
W20260925 16:44:51.265791  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 842746us
W20260925 16:44:51.108239 13762 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.017s	sys 0.068s
W20260925 16:44:51.209939 13835 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.015s	sys 0.028s
I20260925 16:44:51.078612  8941 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:51.228930  8973 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.827s	user 0.025s	sys 0.059s
I20260925 16:44:51.231904  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.237504  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.277726  9116 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:51.277915  9118 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:51.237782  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:51.238231  9043 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.816s	user 0.023s	sys 0.064s
W20260925 16:44:51.279115  9043 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.023s	sys 0.064s
I20260925 16:44:51.238503  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.250123  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:51.228258 13776 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:51.271786  9042 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260925 16:44:51.285548  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 207016us
I20260925 16:44:51.287949  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.244563 13935 raft_consensus.cc:2741] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260925 16:44:51.255579  9050 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:51.290356  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2765) took 1055 ms. Trace:
I20260925 16:44:51.307085  9048 rpcz_store.cc:276] 0925 16:44:50.235462 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.235613 (+   151us) service_pool.cc:227] Handling call
0925 16:44:51.290198 (+1054585us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54000a78d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:51.290305 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1407790976}
I20260925 16:44:51.290717  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.309891  9015 leader_election.cc:398] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:44:51.292210  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1827) took 1334 ms. Trace:
I20260925 16:44:51.310339  9015 leader_election.cc:401] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:51.310415  8969 rpcz_store.cc:276] 0925 16:44:49.957881 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.958910 (+  1029us) service_pool.cc:227] Handling call
0925 16:44:51.292033 (+1333123us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54003570d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:51.292147 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":490983168}
W20260925 16:44:51.277330  8973 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.025s	sys 0.059s
I20260925 16:44:51.311887  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.213689 13268 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260925 16:44:51.315850  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.316156  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.316411  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.299989 13704 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:51.339200  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.340167  9124 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:51.340586  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.341007 13934 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.341470  8968 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:51.341589 13934 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:51.342466  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.343870  8975 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:44:51.344183  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.345175  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1837) took 1221 ms. Trace:
I20260925 16:44:51.345598  8975 rpcz_store.cc:276] 0925 16:44:50.124124 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.124268 (+   144us) service_pool.cc:227] Handling call
0925 16:44:51.344995 (+1220727us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b54002ffb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:51.345112 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2747530496}
I20260925 16:44:51.346109 13783 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.325593 13773 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:51.271556 13853 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.084s
W20260925 16:44:51.347617 13946 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260925 16:44:51.349058 13773 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:51.350728  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:51.351207  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:51.324134 13948 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260925 16:44:51.324889 13739 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:51.353629 13873 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:51.354019 13873 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:51.351838  9124 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:51.354782 13873 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.336436 13522 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.355976  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.355897  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:51.356603 13522 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.357029 13522 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.358780  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:51.359018 13522 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:51.369994 13522 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:51.370339 13522 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:51.359490 13763 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.371858 13763 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:51.359565 13935 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:51.315068 13806 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:44:51.360270  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:51.314942 13021 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:51.365404  8971 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:51.291895 13762 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:51.299566 13733 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.338178 13847 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.363121 13904 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:51.335810 13941 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.363987  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.402853  8969 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:51.403882  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.365459  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:51.373467  9700 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.019s	sys 0.042s
I20260925 16:44:51.375519 13935 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:51.022675  8967 rpcz_store.cc:276] 0925 16:44:49.956316 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.956459 (+   143us) service_pool.cc:227] Handling call
0925 16:44:49.956766 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:49.956936 (+   170us) raft_consensus.cc:1520] Early marking committed up to index 7
0925 16:44:50.278138 (+321202us) log.cc:842] Serialized 14 byte log entry
0925 16:44:50.978400 (+700262us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:50.978466 (+    66us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:44:50.978531 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:50.978625 (+    94us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:50.978759 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71020,"prepare.queue_time_us":423747,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":82143,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":14716,"thread_start_us":942615,"threads_started":2}
I20260925 16:44:51.316871  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.302107 13835 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:44:51.407462  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90663.8us
I20260925 16:44:51.392138 13714 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:51.394471  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1096) took 1020 ms. Trace:
W20260925 16:44:51.409119  9700 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.019s	sys 0.042s
W20260925 16:44:51.328451 13953 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260925 16:44:51.329695 13788 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.390201  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.408908  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:51.402278 13789 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.607s	user 0.013s	sys 0.019s
I20260925 16:44:51.408495  9117 rpcz_store.cc:276] 0925 16:44:50.373884 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.374432 (+   548us) service_pool.cc:227] Handling call
0925 16:44:50.374745 (+   313us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:50.765110 (+390365us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.394197 (+629087us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b5400144454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:51.394394 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":838528768}
I20260925 16:44:51.406759 13873 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.409955  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.408344 13714 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:51.406220 13935 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:51.337585 13949 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260925 16:44:51.425765  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.409663 13762 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:51.429044  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.429931  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.430683  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.428925  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.408567 13904 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:51.432018  9116 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:44:51.434762  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:51.434026  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.438123  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.439028  9117 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:51.432729 13733 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:51.439939 13785 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:51.440500 13785 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:51.441432 13785 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:51.443490 13733 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:51.432991 13762 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:51.444087 13762 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:51.436501 13806 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260925 16:44:51.444218  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:51.423105 13789 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.626s	user 0.013s	sys 0.019s
I20260925 16:44:51.411290 13763 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.449188  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.450089  9115 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:44:51.427965 13788 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:51.424517 13852 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:51.453770 13852 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:51.454135 13852 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:51.454411  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1856) took 1211 ms. Trace:
I20260925 16:44:51.454773  9046 rpcz_store.cc:276] 0925 16:44:50.242854 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.340721 (+ 97867us) service_pool.cc:227] Handling call
0925 16:44:50.341017 (+   296us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:50.423434 (+ 82417us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:50.423463 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:50.423974 (+   511us) log.cc:842] Serialized 52 byte log entry
0925 16:44:50.865820 (+441846us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:50.979737 (+113917us) log.cc:842] Serialized 14 byte log entry
0925 16:44:50.979954 (+   217us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:50.980039 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:51.369941 (+389902us) spinlock_profiling.cc:243] Waited 3.45 ms on lock 0x7b18002bc360. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:51.454141 (+ 84200us) raft_consensus.cc:1671] finished
0925 16:44:51.454240 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:51.454360 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":82065,"prepare.queue_time_us":114190,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":133994,"raft.run_cpu_time_us":176,"raft.run_wall_time_us":11472,"spinlock_wait_cycles":7935872,"thread_start_us":440902,"threads_started":1,"wal-append.queue_time_us":748717}
I20260925 16:44:51.456771 13806 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:51.457382 13936 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:51.457759 13936 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:51.458564 13936 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:51.436496 13904 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:51.447611 13883 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:51.446834 13940 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:51.468020  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.422592 13835 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:51.474373 13627 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.695s	user 0.010s	sys 0.032s
I20260925 16:44:51.410207 13522 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.474026 13808 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:51.459671 13936 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.512255  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:51.531253  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:44:51.539357  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71410.1us
I20260925 16:44:51.547448 13783 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.547952 13788 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:51.550741  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 900) took 1370 ms. Trace:
I20260925 16:44:51.551129  9043 rpcz_store.cc:276] 0925 16:44:50.180037 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.180170 (+   133us) service_pool.cc:227] Handling call
0925 16:44:50.223758 (+ 43588us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:50.421232 (+197474us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:50.421275 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:50.421785 (+   510us) log.cc:842] Serialized 26 byte log entry
0925 16:44:51.279599 (+857814us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:51.279654 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.279783 (+   129us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:51.550555 (+270772us) raft_consensus.cc:1671] finished
0925 16:44:51.550574 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:51.550691 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":197085,"raft.queue_time_us":198235,"raft.run_cpu_time_us":82,"raft.run_wall_time_us":83,"thread_start_us":857473,"threads_started":1,"wal-append.queue_time_us":1125612}
I20260925 16:44:51.552294 13806 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:51.552853  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2764) took 1428 ms. Trace:
I20260925 16:44:51.553241  9041 rpcz_store.cc:276] 0925 16:44:50.124092 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.127920 (+  3828us) service_pool.cc:227] Handling call
0925 16:44:50.128296 (+   376us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:50.499083 (+370787us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:50.499124 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:50.526922 (+ 27798us) log.cc:842] Serialized 26 byte log entry
0925 16:44:51.129249 (+602327us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:51.129313 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.129405 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:51.552672 (+423267us) raft_consensus.cc:1671] finished
0925 16:44:51.552690 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:51.552805 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":263274,"raft.queue_time_us":28045,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":2035,"thread_start_us":708244,"threads_started":2,"wal-append.queue_time_us":797337}
I20260925 16:44:51.555868 13879 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:44:51.555958  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.501360 13883 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:51.557657 13751 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:51.558089 13883 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:51.558123 13751 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:51.558653 13751 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.465648 13839 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.497344 13272 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.536813 13940 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:51.564036  9045 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260925 16:44:51.564533 13940 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.565343 13272 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.565995  9123 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260925 16:44:51.566650 13839 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.566720  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:51.570681 13751 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:51.577286  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1824) took 1620 ms (client timeout 1573 ms). Trace:
W20260925 16:44:51.577731  8972 rpcz_store.cc:269] 0925 16:44:49.956973 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.957247 (+   274us) service_pool.cc:227] Handling call
0925 16:44:51.577109 (+1619862us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400355cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:51.577218 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":287556352}
I20260925 16:44:51.578784  9118 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 5. (term mismatch)
I20260925 16:44:51.579141  9118 pending_rounds.cc:76] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 4
I20260925 16:44:51.579360  9118 pending_rounds.cc:97] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 7.5
I20260925 16:44:51.579586  9118 raft_consensus.cc:2866] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:51.580812 13839 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:51.576639 13883 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:51.526608 13627 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.748s	user 0.010s	sys 0.033s
I20260925 16:44:51.581504 13839 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.579730 13751 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.585373 13839 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.586405  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.586750 13842 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:51.587169 13842 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:51.588018 13842 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:51.590072 13842 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.590745 13883 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.595217  9118 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:51.596740 13734 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:51.597235 13734 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:51.598120 13734 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.599135 13734 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:51.500983 13714 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.600548  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2369) took 1216 ms. Trace:
I20260925 16:44:51.600785 13714 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.600894  8970 rpcz_store.cc:276] 0925 16:44:50.384232 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.388206 (+  3974us) service_pool.cc:227] Handling call
0925 16:44:51.600361 (+1212155us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54003c50d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:51.600496 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1831632128}
I20260925 16:44:51.466593 13847 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.130s
W20260925 16:44:51.610912 13947 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.340s	user 0.000s	sys 0.002s
I20260925 16:44:51.614307 13721 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:51.614698 13721 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:51.615409 13721 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.616539 13721 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.620036 13456 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:51.620458 13456 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:51.621249 13456 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.622632 13456 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:51.624100 13549 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:51.624490 13549 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:51.625029 13934 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.625262 13549 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.626559 13549 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.628724 13852 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.630596 13852 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.634169  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2362) took 1252 ms. Trace:
I20260925 16:44:51.634387 13776 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.635447  9122 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 6. Current term is 7. Ops: []
W20260925 16:44:51.636154  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 250006us
I20260925 16:44:51.636766  8975 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:51.638152 13766 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260925 16:44:51.638373  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.639686  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.639871 13883 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:51.642232  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 276828us
I20260925 16:44:51.643136  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.640892 13808 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:51.645296 13801 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:51.645709  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:51.646064  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.645844 13801 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:44:51.646934  9116 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:51.648450 13707 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.648447  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.649406 13766 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:51.649066 13707 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.649808  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.646399  9118 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.652763  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.654274  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.656597  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.657493  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.658042  8972 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.658821  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.573796 13935 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.634562  8973 rpcz_store.cc:276] 0925 16:44:50.381603 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.383800 (+  2197us) service_pool.cc:227] Handling call
0925 16:44:50.384144 (+   344us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:50.384568 (+   424us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:50.384608 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:50.401567 (+ 16959us) log.cc:842] Serialized 52 byte log entry
0925 16:44:51.311323 (+909756us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:51.374924 (+ 63601us) log.cc:842] Serialized 14 byte log entry
0925 16:44:51.633269 (+258345us) spinlock_profiling.cc:243] Waited 9.19 ms on lock 0x7b1800364d80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:44:51.633619 (+   350us) log.cc:842] Serialized 14 byte log entry
0925 16:44:51.633788 (+   169us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.633857 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:51.633985 (+   128us) raft_consensus.cc:1671] finished
0925 16:44:51.633999 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:51.634115 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61675,"prepare.queue_time_us":67752,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":349,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":5215,"spinlock_wait_cycles":21131008,"thread_start_us":909387,"threads_started":1,"wal-append.queue_time_us":1166240}
I20260925 16:44:51.666810  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.667310  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.550858 13941 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:51.674022  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:51.675668  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:51.693405  9123 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:51.677685  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.680161  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.683812  9116 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260925 16:44:51.698012  8972 raft_consensus.cc:2396] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260925 16:44:51.497695 13904 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:51.699331  9702 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:51.700330  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.744668  8971 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:51.699386  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.702414  9046 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:51.703275  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:51.749025  8975 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:51.705590  9118 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 12 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260925 16:44:51.705292 13930 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:51.706010 13547 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:51.703332 13925 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:44:51.671900 13766 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:51.678269 13808 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:51.708642 13707 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.708712 13835 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.709066 13934 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:51.711452  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:51.678609 13865 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.719485  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:51.720152  8969 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:51.720602 13883 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:51.723392  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:51.723690  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:51.723920  9049 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.698s	user 0.028s	sys 0.029s
I20260925 16:44:51.724032  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.727100  8970 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:51.807363  9041 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:51.643399 13924 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:51.807509  9049 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.782s	user 0.028s	sys 0.029s
I20260925 16:44:51.753877  8971 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:51.760651  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:51.761456  9123 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:51.810863  9045 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:51.812736  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:51.814785  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:51.804256  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:51.748939 13905 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.032s	sys 0.030s
I20260925 16:44:51.763046 13547 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:51.676839 13762 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:51.843268  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 119344us
I20260925 16:44:51.844831 13762 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:51.845628  9124 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:51.846474 13725 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:51.846694 13924 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:51.780355 13947 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260925 16:44:51.781498 13951 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:44:51.757023 13736 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.748049  8967 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
W20260925 16:44:51.856912  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.011s	sys 0.016s
W20260925 16:44:51.857656  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.503s	user 0.011s	sys 0.016s
W20260925 16:44:51.799398  9089 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.957s	user 0.028s	sys 0.030s
I20260925 16:44:51.836961 13779 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:51.837131 13766 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:51.841631 13934 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
W20260925 16:44:51.860496  9089 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.018s	user 0.028s	sys 0.030s
I20260925 16:44:51.830667 13757 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:51.852921  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:51.853003  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:51.802453 13733 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:44:51.834815 13905 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.032s	sys 0.030s
W20260925 16:44:51.842427  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 131036us
W20260925 16:44:51.861047  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.01866e+06us
I20260925 16:44:51.869557  9123 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:51.851676 13547 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.876389  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.881366  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:51.881721  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.878219  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:51.877997  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:51.882038  9123 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:51.875929  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.883817  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.885066  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:51.886166  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1829) took 4434 ms. Trace:
I20260925 16:44:51.886456  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:51.854044 13935 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.886621  9049 rpcz_store.cc:276] 0925 16:44:47.451569 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:47.842006 (+390437us) service_pool.cc:227] Handling call
0925 16:44:47.906034 (+ 64028us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:50.316013 (+2409979us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b180043b7c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf22f6b 00007f719bf2d78b
0925 16:44:50.316132 (+   119us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:50.316157 (+    25us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:50.324385 (+  8228us) log.cc:842] Serialized 52 byte log entry
0925 16:44:50.905743 (+581358us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:51.014172 (+108429us) log.cc:842] Serialized 14 byte log entry
0925 16:44:51.610242 (+596070us) spinlock_profiling.cc:243] Waited 2.68 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:51.810324 (+200082us) log.cc:842] Serialized 14 byte log entry
0925 16:44:51.810524 (+   200us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.810687 (+   163us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:51.885930 (+ 75243us) raft_consensus.cc:1671] finished
0925 16:44:51.885957 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:51.886102 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":652635,"prepare.queue_time_us":162228,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":96,"raft.queue_time_us":725609,"raft.run_cpu_time_us":404,"raft.run_wall_time_us":37226,"spinlock_wait_cycles":14968704,"thread_start_us":1417723,"threads_started":3,"wal-append.queue_time_us":857407}
I20260925 16:44:51.895020  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:51.856909 13964 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:51.861905 13934 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:51.914533  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.004s	sys 0.019s
W20260925 16:44:51.914832  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.628s	user 0.004s	sys 0.019s
I20260925 16:44:51.912066  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:51.832023 13865 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.905440  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:51.918236  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:51.922031  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.661s	user 0.004s	sys 0.021s
W20260925 16:44:51.922328  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.004s	sys 0.021s
W20260925 16:44:51.922657  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 661479us
I20260925 16:44:51.906421  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:51.908545  9693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.004s	sys 0.019s
W20260925 16:44:51.927228  9698 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.007s	sys 0.028s
I20260925 16:44:51.879345 13779 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:51.956779  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44804.8us
W20260925 16:44:51.959105  8974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.012s	sys 0.027s
W20260925 16:44:51.959427  8974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.012s	sys 0.027s
I20260925 16:44:51.901844 13739 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:51.915210 13846 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
W20260925 16:44:51.967185  9120 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.013s	sys 0.009s
W20260925 16:44:51.967553  9120 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.507s	user 0.013s	sys 0.009s
I20260925 16:44:51.959486  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:51.901595 13789 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:44:51.960505  9693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.004s	sys 0.019s
I20260925 16:44:51.902001 13925 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:51.901096 13883 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:51.900856 13707 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:51.907503 13941 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
W20260925 16:44:51.958649  9698 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.009s	sys 0.029s
I20260925 16:44:51.914305 13801 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:51.920398  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:51.968242  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260925 16:44:51.974618  8967 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:52.012178  8860 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43977.7us
I20260925 16:44:51.873515 13757 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:51.922860 13776 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:51.922080 13751 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:51.921478 13839 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:51.996346  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:51.871574 13736 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.014140  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 93832.6us
I20260925 16:44:52.013871  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1158) took 2082 ms. Trace:
W20260925 16:44:52.014937  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55629.4us
I20260925 16:44:51.964553 13268 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:52.021401  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:44:52.027647  9115 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.006s	sys 0.012s
W20260925 16:44:52.029162  9115 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.006s	sys 0.012s
I20260925 16:44:51.979794 13789 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:51.967289 13846 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:52.017331 13947 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:44:52.019099  9696 rpcz_store.cc:276] 0925 16:44:49.931581 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:49.934759 (+  3178us) service_pool.cc:227] Handling call
0925 16:44:49.935100 (+   341us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:44:49.998908 (+ 63808us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:49.998938 (+    30us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:44:50.011988 (+ 13050us) log.cc:842] Serialized 78 byte log entry
0925 16:44:50.264516 (+252528us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:50.286653 (+ 22137us) log.cc:842] Serialized 14 byte log entry
0925 16:44:51.460403 (+1173750us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b18002a81a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:44:51.460620 (+   217us) log.cc:842] Serialized 14 byte log entry
0925 16:44:51.592017 (+131397us) spinlock_profiling.cc:243] Waited 2.9 ms on lock 0x7b18002a81a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:51.958070 (+366053us) log.cc:842] Serialized 14 byte log entry
0925 16:44:52.013524 (+ 55454us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:52.013612 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:52.013676 (+    64us) raft_consensus.cc:1671] finished
0925 16:44:52.013686 (+    10us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:52.013815 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1366906,"prepare.queue_time_us":1208371,"prepare.run_cpu_time_us":124,"prepare.run_wall_time_us":29231,"raft.queue_time_us":102759,"raft.run_cpu_time_us":293,"raft.run_wall_time_us":24028,"spinlock_wait_cycles":26042880,"thread_start_us":748186,"threads_started":2,"wal-append.queue_time_us":363732,"wal-append.run_cpu_time_us":2136,"wal-append.run_wall_time_us":1013232}
I20260925 16:44:51.965552 13762 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:44:52.035841  9123 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:52.033183  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:52.017339  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.561s	user 0.005s	sys 0.032s
I20260925 16:44:52.013463 13925 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:52.040652  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.005s	sys 0.032s
I20260925 16:44:52.022461 13879 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:52.041678  8967 pending_rounds.cc:76] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 9
I20260925 16:44:52.017506 13806 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:52.027956 13776 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.023311 13941 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:52.042819  8967 pending_rounds.cc:97] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260925 16:44:52.046013  8967 raft_consensus.cc:2866] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:51.967319 13936 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260925 16:44:52.031030 13924 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:44:51.979933 13739 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.035426 13847 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:44:52.037761 13789 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:52.009991 13766 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.042418 13966 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:52.035787 13751 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:52.015640 13707 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.037314 13788 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:52.042037 13762 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:52.024456 13839 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.049377 13959 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.217s	user 0.000s	sys 0.001s
I20260925 16:44:52.043437 13925 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:52.016327 13934 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.076463  9697 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.011s	sys 0.027s
W20260925 16:44:52.054250 13623 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.005s	sys 0.028s
W20260925 16:44:52.102964  9697 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.012s	sys 0.027s
W20260925 16:44:52.103063 13623 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.637s	user 0.005s	sys 0.029s
I20260925 16:44:52.047204 13714 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260925 16:44:52.070583 13762 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:44:52.078764 13021 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.012s	sys 0.025s
W20260925 16:44:52.113669 13021 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.668s	user 0.012s	sys 0.025s
I20260925 16:44:52.046481 13806 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.099280  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.010s	sys 0.020s
W20260925 16:44:52.114637  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.011s	sys 0.020s
I20260925 16:44:52.055687  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:52.087142  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.007s	sys 0.020s
W20260925 16:44:52.115311  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.007s	sys 0.020s
I20260925 16:44:52.047964 13776 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.116947  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.117491 13776 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:52.117892  8969 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:52.119937 13806 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.042701 13879 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:52.126791 13879 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:52.077431 13788 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:52.132279  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:52.134299  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1326) took 1331 ms. Trace:
I20260925 16:44:52.106523 13865 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:52.136386  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 107235us
I20260925 16:44:52.134680  9700 rpcz_store.cc:276] 0925 16:44:50.803028 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.803170 (+   142us) service_pool.cc:227] Handling call
0925 16:44:50.803480 (+   310us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:50.803823 (+   343us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:50.803851 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:50.804257 (+   406us) log.cc:842] Serialized 26 byte log entry
0925 16:44:51.411356 (+607099us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:51.411395 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.411462 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:52.134072 (+722610us) raft_consensus.cc:1671] finished
0925 16:44:52.134096 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:52.134221 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":884,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":17139,"thread_start_us":606833,"threads_started":1,"wal-append.queue_time_us":959628}
I20260925 16:44:52.146493  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:52.054018 13963 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.077s
I20260925 16:44:52.046572 13779 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.156931  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 101353us
I20260925 16:44:52.106632 13934 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:52.054953 13846 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.172770  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.173213 13739 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:52.173380 13846 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:52.174396 13739 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:44:52.174494  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:52.174911 13739 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:52.175174  9119 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:52.130486 13941 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.162964 13549 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.536s	user 0.012s	sys 0.000s
I20260925 16:44:52.164171 13788 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.167176 13966 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:52.210638 13966 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:44:52.210991 13966 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:52.159627 13967 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260925 16:44:52.168284 13981 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:44:52.168457 13707 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.207089 13904 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.168835 13751 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.106529 13853 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:52.171923  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1171) took 1251 ms. Trace:
I20260925 16:44:52.226128  9698 rpcz_store.cc:276] 0925 16:44:50.921005 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.922313 (+  1308us) service_pool.cc:227] Handling call
0925 16:44:50.922680 (+   367us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:51.217735 (+295055us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:51.217779 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:51.238237 (+ 20458us) log.cc:842] Serialized 26 byte log entry
0925 16:44:52.012823 (+774586us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:52.012868 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:52.012935 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:52.171747 (+158812us) raft_consensus.cc:1671] finished
0925 16:44:52.171765 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:52.171876 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30231,"raft.queue_time_us":118332,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":5472,"thread_start_us":963393,"threads_started":2,"wal-append.queue_time_us":866768}
I20260925 16:44:52.226145 13853 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.228819  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.229983  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.230661 13853 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.185622  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:52.232017  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46504.7us
I20260925 16:44:52.233040  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:52.189612  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:52.233592  9122 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:52.194636  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.183920  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1172) took 1211 ms. Trace:
I20260925 16:44:52.234588  9697 rpcz_store.cc:276] 0925 16:44:50.973000 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:50.973913 (+   913us) service_pool.cc:227] Handling call
0925 16:44:50.982197 (+  8284us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:51.496323 (+514126us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:44:51.496351 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:51.496770 (+   419us) log.cc:842] Serialized 26 byte log entry
0925 16:44:52.103434 (+606664us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:52.103501 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:52.103591 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:52.183677 (+ 80086us) raft_consensus.cc:1671] finished
0925 16:44:52.183731 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:52.183861 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":23267,"raft.queue_time_us":69073,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":26126,"thread_start_us":1096719,"threads_started":2,"wal-append.queue_time_us":684884}
I20260925 16:44:52.198503  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:52.204411  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:52.237198  9698 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:52.237397  9701 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:52.237267  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:52.204622 13839 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.207806 13739 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.209621 13865 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:44:52.212000  9120 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:52.219225  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:52.132397 13924 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.038s
I20260925 16:44:52.211808 13966 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.212215 13773 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260925 16:44:52.223115 13904 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.236850  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:52.241284  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 265803us
W20260925 16:44:52.241891  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52296.8us
W20260925 16:44:52.258414  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 97463.1us
I20260925 16:44:52.259305  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:52.255095  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.260121  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.260632  9702 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:52.258435  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:52.240782 13021 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:52.262434  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.241163 13873 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:52.265204  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:52.249528 13853 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:52.247746 13967 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:52.268725 13785 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:52.262185 13734 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.663s	user 0.012s	sys 0.000s
I20260925 16:44:52.279651 13734 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:52.281488 13734 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:52.281800 13734 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:52.270689  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2279178080000293s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21400000000000002s for a response
I20260925 16:44:52.272235  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.278096 13623 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:44:52.286326  9042 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:52.289309  9122 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:52.291383  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:52.294435 13734 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.263806 13883 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:52.287287 13967 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.298391 13963 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:44:52.296006  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.313002  9045 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:52.300822  9119 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:52.301398  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.264029 13021 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:52.314955 13021 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:52.303373  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.304584  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.275635 13966 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:52.296077 13965 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:44:52.254884 13762 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.300379 13905 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.334419 13905 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.276350 13873 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.315932  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.315555  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.317524  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:52.315626  9043 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:52.316084 13996 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
W20260925 16:44:52.332854 13982 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:44:52.333415  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:52.333911 13762 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:52.337291  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0176622989997668s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16000000000000003s for a response
I20260925 16:44:52.338550  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:52.359947  9122 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:52.360826  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:52.339115  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 70708.7us
I20260925 16:44:52.317258 13773 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:52.366291  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83441.1us
I20260925 16:44:52.338519 13965 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:52.356551 13456 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.732s	user 0.013s	sys 0.000s
I20260925 16:44:52.371629  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:52.378319  9699 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:52.382218  8921 placement_policy_util.cc:244] tablet c694676902c54ad8bfe8e7fd5a725e33: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260925 16:44:52.363195 13919 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Stepping down as leader of term 6
I20260925 16:44:52.362152 13806 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
W20260925 16:44:52.377945 13721 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.761s	user 0.015s	sys 0.000s
I20260925 16:44:52.375056 13999 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:52.394375 13997 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260925 16:44:52.394133  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 6 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:52.379245 13965 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.389288 13919 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:52.378090 14006 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.450027  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.450887  9047 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
W20260925 16:44:52.453518  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48726.6us
W20260925 16:44:52.456151  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84580.9us
I20260925 16:44:52.457593  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:52.390467 13994 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:52.390457 13806 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:52.466048  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:52.467464  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:52.467870  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 92172.3us
I20260925 16:44:52.404899 13781 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:52.405328 13773 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:52.449076 13935 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:52.507895  9696 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
W20260925 16:44:52.469242 13959 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260925 16:44:52.558527  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62354.3us
I20260925 16:44:52.501542 13766 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.490077 13994 raft_consensus.cc:2741] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260925 16:44:52.474184 13995 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:52.585148  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:52.495994 13725 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.590164  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.513823 13785 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:52.442502 13999 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.463219 14006 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.799846  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.709810  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:52.775362  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.892637  8968 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:52.895090  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:52.895381  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:52.710858  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 243477us
I20260925 16:44:52.897667  8970 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: [9.9-10.10]
I20260925 16:44:52.688656  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:52.898685  8972 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260925 16:44:52.896190  8971 raft_consensus.cc:2362] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9. Re-sending same reply.
I20260925 16:44:52.901711  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:52.804129 13734 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:52.905043  8971 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
W20260925 16:44:52.884927 13789 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.815s	user 0.007s	sys 0.005s
I20260925 16:44:52.906628  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.911276  8968 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:44:52.916920  8968 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260925 16:44:52.919914  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:52.805047 14012 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
W20260925 16:44:52.591805 13547 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.679s	user 0.000s	sys 0.015s
W20260925 16:44:52.810045 14000 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.409s	user 0.001s	sys 0.001s
W20260925 16:44:52.696369 13975 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260925 16:44:52.963440 13993 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:44:52.831734 14013 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260925 16:44:52.763092 14001 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.321s	user 0.000s	sys 0.000s
I20260925 16:44:52.963979 13993 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:52.928201  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.763561 13623 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:52.929293  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.967146  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:52.828504 13879 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.701s	user 0.011s	sys 0.000s
W20260925 16:44:52.690349 13925 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.607s	user 0.006s	sys 0.006s
I20260925 16:44:52.986191  9115 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:44:52.591334 13904 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:52.583055 14003 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:52.869958 13979 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.665s	user 0.000s	sys 0.010s
W20260925 16:44:52.859874 13974 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.348s	user 0.000s	sys 0.001s
W20260925 16:44:52.868104 13934 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.695s	user 0.013s	sys 0.001s
I20260925 16:44:52.588809 13995 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:52.946420  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:52.947731 14039 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:52.687845 13842 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.761528 13522 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:52.737759 14019 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:52.948446  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:52.591707 13865 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:52.949492  8967 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:52.804430 13965 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.594586 14011 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:53.009624  9119 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
W20260925 16:44:52.988547 13940 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.007s	sys 0.021s
I20260925 16:44:52.591939 13996 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:52.705138 13905 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.704588 13873 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.798745 13757 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.698459 13783 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:52.742388 13763 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:53.034515 13783 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.034654 13763 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.036480 13763 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.856446 14022 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.037262 14022 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.039330 14022 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.684795 13967 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:52.958910 14006 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:52.963100 13966 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.633s	user 0.003s	sys 0.003s
I20260925 16:44:52.905719 14018 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:52.763517 13549 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:53.041915 13865 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.041623 13549 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.042660 13865 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:52.965966 13993 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:52.908457  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:52.985693  9043 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:53.043970  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2809) took 1595 ms. Trace:
W20260925 16:44:52.932803  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 443159us
I20260925 16:44:53.044833 13993 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260925 16:44:53.044361  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 135983us
I20260925 16:44:53.044335  9117 rpcz_store.cc:276] 0925 16:44:51.448142 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:51.448261 (+   119us) service_pool.cc:227] Handling call
0925 16:44:51.448575 (+   314us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:51.448927 (+   352us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:51.448968 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:51.450721 (+  1753us) log.cc:842] Serialized 52 byte log entry
0925 16:44:52.041616 (+590895us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:52.041651 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:52.041715 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:53.043771 (+1002056us) raft_consensus.cc:1671] finished
0925 16:44:53.043791 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:53.043917 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1544,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":1246,"thread_start_us":585399,"threads_started":1,"wal-append.queue_time_us":950475}
I20260925 16:44:52.590410 13766 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.047256 13766 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:52.963100 13021 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.633s	user 0.004s	sys 0.004s
I20260925 16:44:52.988756  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.047847 13021 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.048210  9120 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:44:53.049774 13021 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.991252  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:53.050493  9041 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
W20260925 16:44:53.050911 13972 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.767s	user 0.000s	sys 0.001s
I20260925 16:44:52.593532 13725 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.052269  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1848) took 1735 ms. Trace:
I20260925 16:44:53.053092  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.053509 13725 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.054469  9048 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260925 16:44:53.055336  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.055545  9044 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260925 16:44:52.998901  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:53.056782  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57992us
I20260925 16:44:53.010825  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1110) took 1058 ms. Trace:
I20260925 16:44:53.057595  9123 rpcz_store.cc:276] 0925 16:44:51.952498 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:51.952754 (+   256us) service_pool.cc:227] Handling call
0925 16:44:51.953102 (+   348us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:52.039606 (+ 86504us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:53.010563 (+970957us) spinlock_profiling.cc:243] Waited 82.5 ms on lock 0x7b54001ef0d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:53.010762 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":189837696}
I20260925 16:44:52.584177 13919 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.052629  8974 rpcz_store.cc:276] 0925 16:44:51.316979 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:51.317109 (+   130us) service_pool.cc:227] Handling call
0925 16:44:51.317443 (+   334us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:51.358523 (+ 41080us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:51.358552 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:51.358939 (+   387us) log.cc:842] Serialized 26 byte log entry
0925 16:44:51.959770 (+600831us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:51.959805 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:51.959879 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:53.050332 (+1090453us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:53.051993 (+  1661us) raft_consensus.cc:1671] finished
0925 16:44:53.052016 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:53.052217 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40739,"raft.queue_time_us":41632,"raft.run_cpu_time_us":66,"raft.run_wall_time_us":67,"spinlock_wait_cycles":6058752,"thread_start_us":600549,"threads_started":1,"wal-append.queue_time_us":893193}
I20260925 16:44:53.012379  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:52.952580  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:52.952992 13736 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:52.739837 13773 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:52.988806 13883 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.676s	user 0.008s	sys 0.002s
I20260925 16:44:52.994390 13904 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.076810  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.078097  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.078917  8974 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:53.019788  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:52.989853 13623 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.021620 14021 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.004850 14039 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.036513 13783 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:52.956812 13964 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.029s	user 0.009s	sys 0.006s
I20260925 16:44:53.086860  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:52.999365  8969 raft_consensus.cc:2354] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11.
I20260925 16:44:52.584022 13806 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.093078  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.005580 13961 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.050s
I20260925 16:44:53.069247  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:52.941745 13789 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.016247 13808 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:53.018649 13940 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.009s	sys 0.021s
I20260925 16:44:53.061615 14011 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.071866  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.016065 14019 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.069720 13968 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:53.074312 13999 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:53.075522  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 84367.4us
I20260925 16:44:53.112658 13789 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.109194 13808 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.075735  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:53.114487 13549 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.115175 13808 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.115454  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:53.118696 14010 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:53.119159 14010 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.119552 14010 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:53.107460 14026 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.019s
I20260925 16:44:53.121910 14026 consensus_queue.cc:1225] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260925 16:44:53.122524 14022 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.122430 14026 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:53.123292 14026 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:53.080231  8967 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11. Re-sending same reply.
I20260925 16:44:52.966467 13547 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.087106 14021 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.092944 13964 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:44:53.082521  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:53.132570  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50124.5us
I20260925 16:44:53.126457  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:52.993372 14028 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:52.989337 13879 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.087559  9695 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:53.013893 13842 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:53.177508  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 168506us
I20260925 16:44:53.094026  9117 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260925 16:44:53.044624 13865 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.090875  8871 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 12, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 12 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:53.089708  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.096707 14038 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.097137 13021 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.097872  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.098822  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.081779 13883 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:53.103245  8970 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:53.083271 13725 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:44:53.104384  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:53.102299  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.123046 14022 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.125020  9041 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:52.995579 13995 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:53.082564 13904 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:52.992779 13925 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.021916 13996 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.167707  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.167915  8974 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260925 16:44:52.996307 14003 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.171291  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.171545  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.171904  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.176522  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.176730  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.188289 14014 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:53.091943 13623 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.086503 13993 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260925 16:44:53.179219  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:53.185602 13547 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:53.188800  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 90995.2us
I20260925 16:44:53.123313 14019 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.200963  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.229641  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.134424 14026 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:53.204591  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.233302  9695 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:53.207769  9049 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:53.208073  8871 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 7 to 8, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:53.235412  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.236070  9695 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:53.187654 13842 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.169705 13999 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:53.212261  8869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 338) took 35327 ms (client timeout 15000 ms). Trace:
I20260925 16:44:53.243458  9694 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260925 16:44:53.132386 14011 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.106190 13751 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.089s
I20260925 16:44:53.183593 13779 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260925 16:44:53.222692  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48315.4us
I20260925 16:44:53.223261  9698 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:53.226840  8972 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
W20260925 16:44:53.223484  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47165.2us
W20260925 16:44:53.227466  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48363.2us
I20260925 16:44:53.228060  8968 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:53.229172  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:53.193614 13964 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.230826  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.223241  8967 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:44:53.232338  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.216733 13883 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260925 16:44:53.212404 14045 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:53.188258 13021 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.287038  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.270714  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:53.288295  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56043.9us
I20260925 16:44:53.288544  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:53.212651 13725 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:53.212873  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.287268  8871 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:44:53.297633  8972 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:44:53.250017  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:53.227197 14014 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.233180 13930 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:53.268989  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:53.271373 13788 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.006s	sys 0.013s
I20260925 16:44:53.269289  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:53.267678  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 88603.6us
I20260925 16:44:53.304690  9044 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:53.272447 13736 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:44:53.273851  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.277463 14009 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:44:53.243438  8869 rpcz_store.cc:269] 0925 16:44:17.868480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:17.872722 (+  4242us) service_pool.cc:227] Handling call
0925 16:44:53.196050 (+35323328us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:44:44.040469 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:44:44.041032 (+   563us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:44:44.041134 (+   102us) write_op.cc:435] Acquired schema lock
0925 16:44:44.041160 (+    26us) tablet.cc:660] Decoding operations
0925 16:44:44.042253 (+  1093us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:44:44.042345 (+    92us) write_op.cc:641] Partition lock acquired for write op
0925 16:44:44.042371 (+    26us) tablet.cc:683] Acquiring locks for 11 operations
0925 16:44:44.043458 (+  1087us) tablet.cc:699] Row locks acquired
0925 16:44:44.043491 (+    33us) write_op.cc:260] PREPARE: finished
0925 16:44:44.043668 (+   177us) write_op.cc:270] Start()
0925 16:44:44.078406 (+ 34738us) write_op.cc:276] Timestamp: P: 1790354684043604 usec, L: 0
0925 16:44:44.084117 (+  5711us) op_driver.cc:331] REPLICATION: starting
0925 16:44:44.107214 (+ 23097us) log.cc:842] Serialized 4417 byte log entry
0925 16:44:45.018958 (+911744us) op_driver.cc:444] REPLICATION: finished
0925 16:44:45.477643 (+458685us) spinlock_profiling.cc:243] Waited 6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f7198fe45fe 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719f93a410
0925 16:44:46.741117 (+1263474us) write_op.cc:301] APPLY: starting
0925 16:44:46.752391 (+ 11274us) tablet.cc:1365] starting BulkCheckPresence
0925 16:44:46.854205 (+101814us) tablet.cc:1368] finished BulkCheckPresence
0925 16:44:46.854254 (+    49us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:44:46.964254 (+110000us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:44:46.964579 (+   325us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0925 16:44:46.964624 (+    45us) write_op.cc:312] APPLY: finished
0925 16:44:46.964942 (+   318us) log.cc:842] Serialized 105 byte log entry
0925 16:44:47.264424 (+299482us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:47.314467 (+ 50043us) write_op.cc:454] Released schema lock
0925 16:44:47.335458 (+ 20991us) write_op.cc:341] FINISH: Updating metrics
0925 16:44:47.363520 (+ 28062us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:47.367678 (+  4158us) write_op.cc:454] Released schema lock
0925 16:44:48.707482 (+1339804us) spinlock_profiling.cc:243] Waited 4.27 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
Metrics: {"mutex_wait_us":1326646,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1580507,"apply.run_cpu_time_us":48177,"apply.run_wall_time_us":698051,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50041,"num_ops":11,"prepare.queue_time_us":212401,"prepare.run_cpu_time_us":67299,"prepare.run_wall_time_us":345596,"raft.queue_time_us":471336,"raft.run_cpu_time_us":34160,"raft.run_wall_time_us":846564,"replication_time_us":930675,"spinlock_wait_cycles":23633024,"thread_start_us":1658463,"threads_started":5,"wal-append.queue_time_us":720103,"wal-append.run_cpu_time_us":110896,"wal-append.run_wall_time_us":3822726}]]}
I20260925 16:44:53.184727 14028 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.250829 14021 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:53.294355 14042 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260925 16:44:53.300720  9119 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:53.300788  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.300870  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:53.243299 13623 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:53.298656  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48734.1us
I20260925 16:44:53.328334  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:53.304307 13788 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.097s	user 0.006s	sys 0.013s
I20260925 16:44:53.309401  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.337042 14003 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.336755 13623 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.332367  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.301636 13757 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:53.301944 14014 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:53.299446 13967 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:53.341681  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:53.343029  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.343762  9701 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:53.344939 13783 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:53.345428 13783 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.345852 13783 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:53.346436  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:53.347292  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:53.339926 13934 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.249396 13999 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.348644 13934 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.350241 13999 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.350975  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.351121 13934 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.351605  9042 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:53.339790 13549 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:53.352252 13549 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.352692 13549 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:53.353256 14003 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.353741 14003 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.355940 14003 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.357367 14004 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:44:53.357429  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.357906 14004 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:53.358739 14004 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.359202 13522 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:53.359687 13522 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.361462 13522 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.361909 14021 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.362458 14021 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.371785  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.373126  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.373886  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:53.374810  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.314250 14011 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.377076 14021 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.377485  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.378086  9124 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:53.378167  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.378754  9042 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:53.380688 14039 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.381625  9119 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:53.382791  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:53.384169  8968 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:53.385099  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.386327  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.387257  9115 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:53.319545 13842 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:53.339493 13623 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.334156 13789 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:44:53.421146 13879 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.422381 13789 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.422889 13789 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:53.422626 13725 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.323935 14045 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260925 16:44:53.365924 13967 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.425212 13967 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:53.427316 13021 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.407107 13842 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:53.428126 14022 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.340528 13993 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:53.318130 13873 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260925 16:44:53.434103 13996 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.329344 14009 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.436210 14010 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.437534 14009 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.438759 14010 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.439378  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.322412  8975 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:44:53.188033 14038 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.325096  8967 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260925 16:44:53.441787  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59100.2us
I20260925 16:44:53.330030  9048 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:53.308594  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.442616  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:53.442896  9122 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:53.302601 13930 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:53.325707  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51976.7us
I20260925 16:44:53.332690  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:53.299949 13909 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:44:53.403577  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56353.9us
I20260925 16:44:53.404208 13801 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:53.405804 13779 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.340039 13802 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:53.406579  9016 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.683s (SENT) [suppressed 17 similar messages]
I20260925 16:44:53.386987  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1849) took 2069 ms. Trace:
I20260925 16:44:53.462301 13802 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.286123 13739 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260925 16:44:53.449841 13934 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:53.295905 13968 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.046s
I20260925 16:44:53.409899  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.464157 14014 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.464169  9702 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:53.375470  9118 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:53.466058  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.466213 14014 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.466244 13779 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:53.466631  9118 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:53.468183  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2723) took 2211 ms. Trace:
I20260925 16:44:53.468617  9121 rpcz_store.cc:276] 0925 16:44:51.256782 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:51.256945 (+   163us) service_pool.cc:227] Handling call
0925 16:44:51.275772 (+ 18827us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:51.276367 (+   595us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:51.276415 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:51.286131 (+  9716us) log.cc:842] Serialized 26 byte log entry
0925 16:44:51.915252 (+629121us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:52.125382 (+210130us) log.cc:842] Serialized 14 byte log entry
0925 16:44:52.133302 (+  7920us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:52.133387 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:53.456476 (+1323089us) spinlock_profiling.cc:243] Waited 2.87 ms on lock 0x7b1800529120. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:53.467842 (+ 11366us) raft_consensus.cc:1671] finished
0925 16:44:53.467965 (+   123us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:53.468121 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7465,"prepare.queue_time_us":258038,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":23435,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":2529,"spinlock_wait_cycles":6609152,"thread_start_us":838596,"threads_started":2,"wal-append.queue_time_us":862117}
I20260925 16:44:53.453925 13801 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:53.462765  8966 rpcz_store.cc:276] 0925 16:44:51.317467 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:51.345089 (+ 27622us) service_pool.cc:227] Handling call
0925 16:44:51.345367 (+   278us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:51.576373 (+231006us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:44:51.576651 (+   278us) log.cc:842] Serialized 14 byte log entry
0925 16:44:52.445179 (+868528us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:52.445250 (+    71us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:52.445340 (+    90us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:53.386710 (+941370us) spinlock_profiling.cc:243] Waited 231 ms on lock 0x7b54002ff654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:53.386769 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:53.386920 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":554172,"prepare.queue_time_us":5332,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":345812,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":85,"spinlock_wait_cycles":530771328,"thread_start_us":538105,"threads_started":1,"wal-append.queue_time_us":669895,"wal-append.run_cpu_time_us":1693,"wal-append.run_wall_time_us":1104070}
I20260925 16:44:53.472729 13801 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.412945  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.474301  9115 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:44:53.324532 14036 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:53.309430  8871 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 6 to 8, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:53.417791 13925 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:53.418932 13984 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.214s	user 0.015s	sys 0.006s
I20260925 16:44:53.419387 13936 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:53.419468 14028 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.295393 13964 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.313433 14026 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.444223  9043 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260925 16:44:53.448912  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.449002  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.524506  9045 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:53.451232  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.524771  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.525563  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:53.454905  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.526784  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:53.461093 13549 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.464603  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:53.312320  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.474347 14038 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:53.475503  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67484.9us
I20260925 16:44:53.415898  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:53.583676  9124 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:53.408639 13847 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:44:53.477777  9118 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
W20260925 16:44:53.478410  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 303861us
I20260925 16:44:53.428154 13842 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:53.478457  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.586743  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.450894 13930 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:53.454169 13993 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.464139 13934 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:53.524605  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 75765.1us
I20260925 16:44:53.453033  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:53.589094  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.610750  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:53.610834  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:53.611438  9115 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:53.590688  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.596634  9124 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:53.605814  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:53.481241 13781 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.657938  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:53.666494  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:53.668294  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.483068 13095 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.615543  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:53.660313  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:53.663304  9124 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:53.602605 13935 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.593786 13847 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:53.763279  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2733) took 2098 ms. Trace:
I20260925 16:44:53.659793 13934 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:53.658715  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.483385 13936 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:53.530727 13853 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.693779  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:53.672124  9115 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
W20260925 16:44:53.782858  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89190.3us
I20260925 16:44:53.783123  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:53.783812  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:53.672772  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:53.774916  9116 rpcz_store.cc:276] 0925 16:44:51.665167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:51.700494 (+ 35327us) service_pool.cc:227] Handling call
0925 16:44:51.700755 (+   261us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:51.701147 (+   392us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:51.701172 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:51.701536 (+   364us) log.cc:842] Serialized 26 byte log entry
0925 16:44:52.131776 (+430240us) raft_consensus.cc:1631] Marking committed up to 4
0925 16:44:52.131810 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:52.131866 (+    56us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:53.418277 (+1286411us) spinlock_profiling.cc:243] Waited 7.81 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:53.757915 (+339638us) raft_consensus.cc:1671] finished
0925 16:44:53.757942 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:53.763203 (+  5261us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":103,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":14887,"spinlock_wait_cycles":17958656,"thread_start_us":429983,"threads_started":1,"wal-append.queue_time_us":503473}
W20260925 16:44:53.658466  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47786.2us
I20260925 16:44:53.749027  9122 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:53.788132  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:53.788653  8967 raft_consensus.cc:595] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:53.788962  8967 raft_consensus.cc:603] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:53.523182 13766 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:53.747785  9124 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:53.480461 14036 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.790620  9119 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 9: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:53.694653 13739 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:53.851953  9117 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.521s	user 0.022s	sys 0.036s
I20260925 16:44:53.851958  9122 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:53.760058 14011 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:44:53.854172  9117 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.524s	user 0.022s	sys 0.036s
I20260925 16:44:53.614104 13773 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.168s
I20260925 16:44:53.617295  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:53.774324 13925 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:44:53.861089  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44898.9us
I20260925 16:44:53.691921 14028 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.163s
I20260925 16:44:53.781785 13268 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:53.660933 14046 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.261s
I20260925 16:44:53.659363 13993 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:53.916426  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.589s	user 0.025s	sys 0.040s
W20260925 16:44:53.916736  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.025s	sys 0.040s
I20260925 16:44:53.580449 14014 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:53.791230 13936 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:53.867440 13925 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.899266 13847 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.864848 13739 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:53.856850 14020 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.021s	sys 0.038s
I20260925 16:44:53.794107 13733 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:53.853344 14045 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:53.904652 13268 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:53.916193 14010 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:53.908511 13961 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:53.856021 13853 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:53.908203 13714 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.023s	sys 0.040s
I20260925 16:44:53.761795 13095 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.757143 13781 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:53.762697 13935 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:53.963738 13974 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260925 16:44:53.952490 13925 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:53.962471 14020 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.022s	sys 0.038s
W20260925 16:44:53.940690 13783 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.594s	user 0.011s	sys 0.000s
I20260925 16:44:53.993652 13998 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:44:54.033571 13998 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:54.033859 13739 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.034454 13998 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.035427 13998 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:44:53.986685 13714 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.023s	sys 0.041s
I20260925 16:44:54.004308 13964 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:53.856909 13865 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.125s
I20260925 16:44:53.977600 14010 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:53.974929 13268 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:53.998082 14056 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.204s	user 0.000s	sys 0.000s
W20260925 16:44:54.049114  9699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1333) took 1833 ms (client timeout 1683 ms). Trace:
W20260925 16:44:54.051929  9699 rpcz_store.cc:269] 0925 16:44:52.216067 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:52.216201 (+   134us) service_pool.cc:227] Handling call
0925 16:44:54.048869 (+1832668us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400670554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.049013 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":339768704}
I20260925 16:44:54.039517 13783 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.060330 13783 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.061985 13936 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.064136 13936 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:54.072939 14029 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.998s	user 0.004s	sys 0.011s
W20260925 16:44:54.088169 14044 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.825s	user 0.000s	sys 0.003s
I20260925 16:44:54.089982 13802 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:53.980669 13961 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.037613 13549 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.079416 13806 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:54.125340 13781 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.126677 13935 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.134807 13714 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:54.135190 13714 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:54.135951 13714 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.137049 13801 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:54.138540 13095 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.140611 13847 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:44:54.145135 13919 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 6 FOLLOWER]: Advancing to term 7
I20260925 16:44:54.137130 13714 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:54.148612 14026 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:54.056836 14010 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:53.856707 13766 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.099913 13865 consensus_queue.cc:1225] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 12.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260925 16:44:53.914747 13883 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.251s
I20260925 16:44:54.168682 13993 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:54.191457 13779 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.724s	user 0.010s	sys 0.001s
W20260925 16:44:54.200548 14065 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260925 16:44:54.189195 14036 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:54.169502 13995 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.930s	user 0.009s	sys 0.000s
W20260925 16:44:54.209735 13904 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.983s	user 0.011s	sys 0.001s
I20260925 16:44:54.206689 13853 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:54.207203 13779 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.268959 13779 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:54.243760 14058 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260925 16:44:54.259892 13961 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:54.242996 14066 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260925 16:44:54.215991 13995 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.299017 13995 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:54.223898 13904 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.301524 13904 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:54.280099 13766 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.284744 13934 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.304260 13934 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:54.289695 13930 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.631s	user 0.005s	sys 0.005s
I20260925 16:44:54.304992 13930 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.306877 13930 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:54.285516 13967 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.860s	user 0.011s	sys 0.002s
I20260925 16:44:54.307582 13967 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.309552 13967 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:54.309957 13842 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.702s	user 0.003s	sys 0.007s
I20260925 16:44:54.310420 13842 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.311992 13842 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.314208 14010 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.315577 14010 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:53.692114  8871 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:44:54.346207  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 934) took 1451 ms (client timeout 1580 ms). Trace:
W20260925 16:44:54.346976  8969 rpcz_store.cc:269] 0925 16:44:52.894636 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:52.894774 (+   138us) service_pool.cc:227] Handling call
0925 16:44:54.345407 (+1450633us) spinlock_profiling.cc:243] Waited 101 ms on lock 0x7b540021a554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.345909 (+   502us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":233124096}
W20260925 16:44:54.350282  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.679s	user 0.001s	sys 0.007s
I20260925 16:44:54.352428  8966 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:54.350976  8871 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 3 to 8. New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:44:54.351002  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.002s	sys 0.007s
I20260925 16:44:54.354743  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1862) took 1261 ms. Trace:
I20260925 16:44:54.355533  8871 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:54.355290  8974 rpcz_store.cc:276] 0925 16:44:53.093161 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.093275 (+   114us) service_pool.cc:227] Handling call
0925 16:44:53.093543 (+   268us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:53.229590 (+136047us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.354074 (+1124484us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b54002ffb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:54.354456 (+   382us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":170169728}
I20260925 16:44:54.356437  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 939) took 1458 ms. Trace:
I20260925 16:44:54.359954  8975 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:54.359198  8973 rpcz_store.cc:276] 0925 16:44:52.897754 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:52.897881 (+   127us) service_pool.cc:227] Handling call
0925 16:44:52.929487 (+ 31606us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:52.929707 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:52.929743 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:52.948451 (+ 18708us) log.cc:842] Serialized 26 byte log entry
0925 16:44:53.095869 (+147418us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:53.227117 (+131248us) log.cc:842] Serialized 14 byte log entry
0925 16:44:53.227379 (+   262us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:53.227456 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:54.087111 (+859655us) spinlock_profiling.cc:243] Waited 10.4 ms on lock 0x7b18003877c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511
0925 16:44:54.087638 (+   527us) spinlock_profiling.cc:243] Waited 5.61 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:54.355917 (+268279us) raft_consensus.cc:1671] finished
0925 16:44:54.355963 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:54.356264 (+   301us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20400,"prepare.queue_time_us":168069,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":70,"raft.run_cpu_time_us":135,"raft.run_wall_time_us":12845,"spinlock_wait_cycles":36753408,"thread_start_us":160322,"threads_started":2,"wal-append.queue_time_us":240036}
W20260925 16:44:54.372458  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 494191us
W20260925 16:44:54.373929  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 504592us
W20260925 16:44:54.377235  9016 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.915s	user 0.018s	sys 0.033s
W20260925 16:44:54.377632  9016 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.915s	user 0.018s	sys 0.033s
W20260925 16:44:54.378118  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 971482us
I20260925 16:44:54.383401  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:53.903924  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 286704us
W20260925 16:44:53.917232  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 616385us
W20260925 16:44:53.932543  9693 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.024s	sys 0.067s
I20260925 16:44:54.405836  8971 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 7.
I20260925 16:44:54.436484 13934 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.436580 13021 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:54.437604 13934 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.440588  9699 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260925 16:44:54.441396  9697 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260925 16:44:54.440397  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1876) took 1378 ms (client timeout 1586 ms). Trace:
W20260925 16:44:54.442607  9041 rpcz_store.cc:269] 0925 16:44:53.051870 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.052853 (+   983us) service_pool.cc:227] Handling call
0925 16:44:54.416068 (+1363215us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b54000a78d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.429746 (+ 13678us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":163842944}
I20260925 16:44:54.443288 14010 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:54.443969  9118 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:54.444372 14010 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.447268 14010 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:44:54.447546 14072 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.448426 14072 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.448706  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:54.449733  9702 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:54.451149 14072 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:54.453302  9121 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.941s	user 0.025s	sys 0.056s
W20260925 16:44:54.453763  9121 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.025s	sys 0.056s
I20260925 16:44:54.453544  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49c7db4b3fda45159275230bc247b929"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:54.454097 13925 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.454710  8973 raft_consensus.cc:595] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:54.455062  9124 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:54.456620 13934 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.457186 13934 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:54.458145  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 919) took 1483 ms. Trace:
I20260925 16:44:54.457937 13934 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:54.434795  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.005s	sys 0.008s
W20260925 16:44:54.459896  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.820s	user 0.005s	sys 0.009s
I20260925 16:44:54.458491  9047 rpcz_store.cc:276] 0925 16:44:52.974367 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:52.974726 (+   359us) service_pool.cc:227] Handling call
0925 16:44:52.998264 (+ 23538us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:53.237367 (+239103us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:53.248838 (+ 11471us) log.cc:842] Serialized 14 byte log entry
0925 16:44:53.608441 (+359603us) log.cc:842] Serialized 14 byte log entry
0925 16:44:53.608789 (+   348us) log.cc:842] Serialized 14 byte log entry
0925 16:44:53.608954 (+   165us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:53.609002 (+    48us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:53.609060 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:53.993169 (+384109us) spinlock_profiling.cc:243] Waited 65.7 ms on lock 0x7b18004c0960. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:54.081073 (+ 87904us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b18004c0960. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:54.125284 (+ 44211us) spinlock_profiling.cc:243] Waited 6.65 ms on lock 0x7b18004c0960. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:54.128875 (+  3591us) spinlock_profiling.cc:243] Waited 9.76 ms on lock 0x7b18004c0960. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:44:54.456636 (+327761us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b18004c0960. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9
0925 16:44:54.457620 (+   984us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400127354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:54.457656 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:54.457946 (+   290us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":108950,"prepare.queue_time_us":528446,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":94,"raft.queue_time_us":332719,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":35352,"spinlock_wait_cycles":865672064,"thread_start_us":234998,"threads_started":1,"wal-append.queue_time_us":524293}
I20260925 16:44:54.461130 13940 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.462193 13940 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:54.473292  9693 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.224s	user 0.024s	sys 0.068s
I20260925 16:44:54.473392 13965 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.474444 13965 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:54.474987 13789 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.051s	user 0.009s	sys 0.004s
I20260925 16:44:54.475770 13789 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.478384 13996 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.478807 14004 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.479550  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1123) took 1238 ms. Trace:
I20260925 16:44:54.479424 13996 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:54.479987  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.005s	sys 0.015s
I20260925 16:44:54.440385  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.481168  9701 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:54.482484 13925 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.482100 14004 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.485579  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.485912 14004 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.486661  9047 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 14
I20260925 16:44:54.480054 14036 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:54.489394 13789 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.490264  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6030f186a664452b127609fadec766b"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:54.491092  8973 raft_consensus.cc:595] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:54.491633  8973 raft_consensus.cc:603] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:44:54.480517  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.005s	sys 0.015s
I20260925 16:44:54.493996  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.496968 13965 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.497018  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.499943 13789 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.500599 13779 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:54.500828 13789 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.502154 13779 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:54.503568  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1858) took 1507 ms (client timeout 1674 ms). Trace:
I20260925 16:44:54.505034  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.443475  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1341) took 1215 ms. Trace:
I20260925 16:44:54.505451 13789 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.508009  9041 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:54.509398 13940 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:54.511376  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 911) took 2208 ms (client timeout 1685 ms). Trace:
I20260925 16:44:54.512146  9050 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:54.512957  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 2799) took 1246 ms. Trace:
I20260925 16:44:54.513301  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.514047 13934 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:54.515156  8971 rpcz_store.cc:269] 0925 16:44:52.995772 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.004959 (+  9187us) service_pool.cc:227] Handling call
0925 16:44:54.503348 (+1498389us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b54002fe754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.503497 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2966938368}
W20260925 16:44:54.516593  9049 rpcz_store.cc:269] 0925 16:44:52.302481 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:52.302678 (+   197us) service_pool.cc:227] Handling call
0925 16:44:54.510986 (+2208308us) spinlock_profiling.cc:243] Waited 871 ms on lock 0x7b54000df554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.511174 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2004194176}
W20260925 16:44:54.520040  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.006s	sys 0.022s
I20260925 16:44:54.516904  9048 rpcz_store.cc:276] 0925 16:44:53.266434 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.268761 (+  2327us) service_pool.cc:227] Handling call
0925 16:44:54.512662 (+1243901us) spinlock_profiling.cc:243] Waited 27 ms on lock 0x7b5400251cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.512818 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":62171008}
W20260925 16:44:54.523663  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.006s	sys 0.022s
I20260925 16:44:54.515758  9697 rpcz_store.cc:276] 0925 16:44:53.228533 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.228662 (+   129us) service_pool.cc:227] Handling call
0925 16:44:53.230342 (+  1680us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:54.441924 (+1211582us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.443127 (+  1203us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:54.443395 (+   268us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2727790464}
W20260925 16:44:54.534750  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.800s	user 0.006s	sys 0.021s
W20260925 16:44:54.535184  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.006s	sys 0.021s
I20260925 16:44:54.535861  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:54.536547  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 930747us
I20260925 16:44:54.536768  9701 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:54.537927  9122 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:44:54.539014  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2748) took 1127 ms. Trace:
I20260925 16:44:54.539361  9044 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:54.525942  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 752663us
I20260925 16:44:54.480106  9123 rpcz_store.cc:276] 0925 16:44:53.240922 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.241082 (+   160us) service_pool.cc:227] Handling call
0925 16:44:53.241361 (+   279us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:53.244202 (+  2841us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:53.244256 (+    54us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:53.244727 (+   471us) log.cc:842] Serialized 26 byte log entry
0925 16:44:53.603778 (+359051us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:53.603818 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:53.603873 (+    55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:54.429298 (+825425us) raft_consensus.cc:1671] finished
0925 16:44:54.430819 (+  1521us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:54.479242 (+ 48423us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2474,"raft.queue_time_us":4343,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":20214,"thread_start_us":358713,"threads_started":1,"wal-append.queue_time_us":910888}
I20260925 16:44:54.551141  9047 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
W20260925 16:44:54.548923  9116 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.005s	sys 0.008s
I20260925 16:44:54.551164  9118 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
W20260925 16:44:54.555760  9116 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.008s
I20260925 16:44:54.540041  9121 rpcz_store.cc:276] 0925 16:44:53.411535 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.470823 (+ 59288us) service_pool.cc:227] Handling call
0925 16:44:53.471166 (+   343us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:53.471391 (+   225us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:44:54.454492 (+983101us) log.cc:842] Serialized 14 byte log entry
0925 16:44:54.538395 (+ 83903us) log.cc:842] Serialized 14 byte log entry
0925 16:44:54.538596 (+   201us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:54.538675 (+    79us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:54.538775 (+   100us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.538855 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:54.538966 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":585345,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":93,"raft.queue_time_us":6637,"raft.run_cpu_time_us":192,"raft.run_wall_time_us":191,"thread_start_us":1045778,"threads_started":2}
W20260925 16:44:54.554585  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.001s	sys 0.021s
I20260925 16:44:54.503595 13779 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:54.562268  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.882s	user 0.001s	sys 0.022s
W20260925 16:44:54.563266  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 50166.2us
I20260925 16:44:54.558656  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:54.561769  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.567601  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.566838  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.569340 13783 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:54.569777 13783 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.569908 14077 raft_consensus.cc:979] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:44:54.570137  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.572690  9119 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:54.574290  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:54.575344  9699 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:44:54.571485 14010 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.575663  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.575909 14031 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.576555  9044 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:54.576673 14031 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.578100  8971 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:54.578542  8971 raft_consensus.cc:603] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:54.579281 14031 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.580214 13967 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.576227  9042 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:54.581779 13967 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.582826  9120 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:54.570163 13783 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:54.583523  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2825) took 1494 ms. Trace:
I20260925 16:44:54.584178  9120 rpcz_store.cc:276] 0925 16:44:53.089593 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.089696 (+   103us) service_pool.cc:227] Handling call
0925 16:44:54.439182 (+1349486us) spinlock_profiling.cc:243] Waited 1.13 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:44:54.439655 (+   473us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:54.583259 (+143604us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.583475 (+   216us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2590464}
I20260925 16:44:54.584896 13967 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:54.586033 14031 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:44:54.587311 14031 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:44:54.576114 14010 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.583494 13883 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.588342 13883 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.587821 13839 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.589833 14010 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:54.589674 13839 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.590443 14031 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:54.590904  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.592152 13839 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.592605  9045 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260925 16:44:54.573374 14077 raft_consensus.cc:1067] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:44:54.592737 14031 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.594323 14031 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:54.597517  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.598260  9048 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:54.600626  9120 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:54.590272  9043 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:54.611187  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.611783  9041 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:54.613032  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:54.610247 14010 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:54.616014  9047 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:54.617888 14010 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.617164  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.621662  9121 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:54.620409  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.625634  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.627928  9041 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:54.617906  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:54.631897  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.640654 14031 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:54.642055 14031 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:54.642568 14031 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:54.644004 14010 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.646740  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.650537  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:44:54.634871 13967 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.651957  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.653558  9699 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:44:54.648077  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:54.659212  9047 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:54.665638 13934 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.666289 13934 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.668511 13934 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.670858 14032 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:54.671480 14032 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.665660 13919 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.672974 13919 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.673660 14032 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.674919 13919 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.675724  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.676530 14081 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:54.676607 13904 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.677266 14081 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.677766 14081 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:54.677497 13904 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.680114 13904 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.681010  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.681941  9047 raft_consensus.cc:2396] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 15 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260925 16:44:54.659565 13996 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.683406 14031 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.684882 14031 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:54.688781  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.689479  9701 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:44:54.691582  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.691665  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:54.694404 13883 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:54.700291  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 93697us
I20260925 16:44:54.701339  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:54.703287 13919 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.703855 13919 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.704185  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.704775  9697 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:44:54.659628  9117 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.745s	user 0.003s	sys 0.016s
I20260925 16:44:54.699380  9702 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:54.659994  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 105466us
I20260925 16:44:54.711944  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.715268  9115 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:54.715770  9117 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.856s	user 0.004s	sys 0.017s
I20260925 16:44:54.656023 14010 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:54.720858  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67333.5us
I20260925 16:44:54.722537  9118 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:54.721311  9119 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:54.724618  9050 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:44:54.724699  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.651531 13967 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.723259  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.720887  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:54.718338  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.730181  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.731974  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.719305 13919 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.736845  9048 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:54.737704  9123 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260925 16:44:54.719383  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:44:54.736351 13095 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:54.744391 13905 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:54.745275  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:54.746660  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:54.736379 13268 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.610s	user 0.015s	sys 0.003s
I20260925 16:44:54.740944  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1189) took 1524 ms. Trace:
I20260925 16:44:54.751184  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:54.742205  9697 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:54.754416  9701 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:54.754855  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:54.753973 13268 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.754112 13996 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:54.757798 13967 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:54.758688  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.739127 13930 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.764747  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.763054 14074 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:54.758324 13996 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:54.769484 13268 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.775811  9043 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:54.782821  9124 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260925 16:44:54.782392  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 920) took 1793 ms. Trace:
I20260925 16:44:54.768877  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.759039 13883 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:54.781925  9115 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
W20260925 16:44:54.784817  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55222.6us
I20260925 16:44:54.784077  9050 rpcz_store.cc:276] 0925 16:44:52.975123 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:52.975257 (+   134us) service_pool.cc:227] Handling call
0925 16:44:54.511836 (+1536579us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:54.725055 (+213219us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.768261 (+ 43206us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54000df550. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:54.768422 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3532785024}
I20260925 16:44:54.785429 14074 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.786352 13268 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:54.787958  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.739276 14010 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.783257  9124 pending_rounds.cc:76] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 8
W20260925 16:44:54.789003  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58559.3us
I20260925 16:44:54.751364  9693 rpcz_store.cc:276] 0925 16:44:53.216505 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.216930 (+   425us) service_pool.cc:227] Handling call
0925 16:44:53.237649 (+ 20719us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:53.237848 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:44:54.474076 (+1236228us) log.cc:842] Serialized 14 byte log entry
0925 16:44:54.655725 (+181649us) log.cc:842] Serialized 14 byte log entry
0925 16:44:54.710529 (+ 54804us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:54.715056 (+  4527us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:54.727286 (+ 12230us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.733389 (+  6103us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:54.740880 (+  7491us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":49762,"prepare.queue_time_us":95121,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":103,"raft.queue_time_us":58364,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":2519,"thread_start_us":1357899,"threads_started":2,"wal-append.queue_time_us":255560}
I20260925 16:44:54.794193 13268 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.796757 13268 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:54.792392 13789 raft_consensus.cc:2741] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260925 16:44:54.751068 13095 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.800791  9016 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.801815  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.802208 13095 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.793004  9698 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:54.803159 13965 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:54.804343 13965 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:54.804548 14074 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.804809 13965 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.805299 13965 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:54.806059 13996 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.807118 14036 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:54.807603 14036 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:54.807639  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.808130 14036 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:54.808959  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:54.809746  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.809949 13925 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:54.810329 13925 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:54.810429  9700 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:54.794940  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:54.815203  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:54.804358  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.795807  9124 pending_rounds.cc:97] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 11.9
I20260925 16:44:54.820740  9124 raft_consensus.cc:2866] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:54.820102  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:54.824280  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.827780  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:54.829655  9043 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:54.830634  9698 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:54.814867 13930 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.831761  9699 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:54.831874  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:54.829523  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:54.815459 13883 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:54.836609 13919 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:44:54.836709 13967 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.837266 13919 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:54.837646 13967 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.838315 13919 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.839238 13095 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:54.840956  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.842983  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:54.835326  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43654.3us
I20260925 16:44:54.843811  9701 raft_consensus.cc:2396] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:44:54.832587  9695 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:54.807142 13940 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260925 16:44:54.852023  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2831) took 1545 ms. Trace:
I20260925 16:44:54.832545 13806 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.858381  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:54.860734 14018 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260925 16:44:54.859994  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2750) took 1272 ms. Trace:
I20260925 16:44:54.862730  9124 rpcz_store.cc:276] 0925 16:44:53.587280 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.589238 (+  1958us) service_pool.cc:227] Handling call
0925 16:44:53.596498 (+  7260us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:54.453052 (+856554us) spinlock_profiling.cc:243] Waited 574 ms on lock 0x7b5800859db0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:44:54.852899 (+399847us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.859930 (+  7031us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1320719104}
I20260925 16:44:54.867424 13905 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:44:54.867684  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 147492us
I20260925 16:44:54.839772 13095 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.870085  9697 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:44:54.870625  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 137067us
I20260925 16:44:54.859483  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:54.878381  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:54.885174  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.886112 14077 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:54.888806 14077 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.889163  9122 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:54.889264 14077 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:54.891360  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.829245 13925 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.895340 13934 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:54.895387 14075 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:54.894709  9701 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:44:54.898034  9701 raft_consensus.cc:595] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:54.898339  9701 raft_consensus.cc:603] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:54.898945  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:54.854096  9117 rpcz_store.cc:276] 0925 16:44:53.306858 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.307558 (+   700us) service_pool.cc:227] Handling call
0925 16:44:53.307916 (+   358us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:53.308130 (+   214us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:44:53.859713 (+551583us) log.cc:842] Serialized 14 byte log entry
0925 16:44:54.765403 (+905690us) log.cc:842] Serialized 14 byte log entry
0925 16:44:54.812855 (+ 47452us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:54.818648 (+  5793us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:54.834021 (+ 15373us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.847625 (+ 13604us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:54.851960 (+  4335us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":387,"prepare.queue_time_us":737859,"prepare.run_cpu_time_us":74,"prepare.run_wall_time_us":76,"raft.queue_time_us":83071,"raft.run_cpu_time_us":304,"raft.run_wall_time_us":11005,"thread_start_us":1385122,"threads_started":2}
W20260925 16:44:54.900331  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 68510.3us
I20260925 16:44:54.891124 13839 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:54.859436 13806 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:54.900626  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55878us
I20260925 16:44:54.912227  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.912979 14010 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.914538 13766 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:54.914958 13766 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.915287 13883 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.914856 14074 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:44:54.919160 14074 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.899454 13967 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.910976 13268 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.919575 14074 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:54.915561 13766 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:54.925591  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:54.902802 13839 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:54.927556  9702 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:54.929177  9694 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:54.932250 14071 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.939067  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:54.902974 13934 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.941514  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.942241  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.926822 14075 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.938174 13789 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.935817 13839 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:44:54.947300  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106306us
I20260925 16:44:54.936125 13925 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:54.943312  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:54.949340  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:54.953604  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:54.956538 13785 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:44:54.950114 13789 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.958724  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.940521 13965 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.962987  9698 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:44:54.963297  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:54.959877 13725 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:54.964042  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:54.964466 13736 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:54.966163 13725 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.957029 13785 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.968983 14040 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:54.945746 14071 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:54.968353  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:54.981153 14072 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:54.981676  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:54.977115 14043 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:54.982515 14032 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:44:54.982532 14043 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:54.983170 14043 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:54.984249  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.969187 13842 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260925 16:44:54.980188 13808 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:54.965103 13940 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:54.964749 13021 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:54.980574 14038 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:54.969183 13095 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:54.989089 14073 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:54.989624 13904 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:54.977432 13785 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:54.968004 13930 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.993469 14010 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:54.977948 13725 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:54.977452 13736 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:55.000327 13268 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.001116  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.004287  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:54.997745 13095 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:54.993325 14073 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.005211 13095 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.005332 14010 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:55.006276 14010 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.006865 14073 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:54.994817 13021 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:55.012331  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 112182us
I20260925 16:44:55.006134 13095 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.016072  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.018230 13806 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.044852 14077 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.018186 13783 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.024928 13021 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:55.025123 14084 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260925 16:44:55.046921 14077 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.026578 14036 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.032289  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.065299  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.032761 14071 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.033252 13934 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.035240  9700 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:55.036515 14075 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.036971 13965 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.037544  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2840) took 1424 ms. Trace:
I20260925 16:44:55.039484  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.040343 13268 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:55.060613  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.025974  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:55.004216 13736 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.067801  9121 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
W20260925 16:44:55.067152  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62966.5us
I20260925 16:44:55.070844  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.066708  9116 rpcz_store.cc:276] 0925 16:44:53.613480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:53.786186 (+172706us) service_pool.cc:227] Handling call
0925 16:44:53.786554 (+   368us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:54.623933 (+837379us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:54.625996 (+  2063us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:54.649581 (+ 23585us) log.cc:842] Serialized 26 byte log entry
0925 16:44:54.920085 (+270504us) raft_consensus.cc:1631] Marking committed up to 3
0925 16:44:54.920123 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:54.928145 (+  8022us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:55.037345 (+109200us) raft_consensus.cc:1671] finished
0925 16:44:55.037363 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:55.037488 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":84558,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":4686,"thread_start_us":997056,"threads_started":2,"wal-append.queue_time_us":318999}
W20260925 16:44:55.089775 14085 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260925 16:44:55.091784 14081 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.091840 14043 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.068223 13268 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:55.097806  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 130946us
W20260925 16:44:55.094024  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 117089us
I20260925 16:44:55.096539  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.070369 13904 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:55.071777 14032 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:44:55.083720 13967 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:55.109376  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.104218  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.097541 13934 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:55.110198  9702 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:55.099223 13268 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:55.114002  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:55.096048 14075 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:55.102595 13904 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:55.118767  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92923.5us
I20260925 16:44:55.107897 13967 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:55.120189  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 131901us
I20260925 16:44:55.113418 13905 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:55.120823 14075 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:55.126008 13905 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:55.126216 14075 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.126493 13905 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:55.134874  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.133802  9090 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.116422 14081 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.138402 13808 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:55.141415 13934 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.144034 13808 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.144219 13934 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.142464 14073 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:55.148730 14073 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.151356 14073 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.124233 13904 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:55.153692  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:55.157318  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.157728  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.110657 13839 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.132489 13967 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:55.132081 14018 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:55.154759  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.161777 14073 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:55.163488 14077 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
W20260925 16:44:55.166224  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46089.1us
I20260925 16:44:55.166682 13919 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260925 16:44:55.168478 14087 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260925 16:44:55.152499 13930 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260925 16:44:55.162304  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.192116  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.179977  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:55.182250  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47091.2us
I20260925 16:44:55.182511  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.122541 13785 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.154587 13925 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.158120 13779 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:44:55.188205  9702 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:55.192623  9700 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
W20260925 16:44:55.163921  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50019.4us
I20260925 16:44:55.195358  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:55.170728 14018 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:55.196863  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78090.2us
I20260925 16:44:55.198712  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.201018 13779 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:44:55.178066 13789 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.181020 14073 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:55.207101  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.208052  9702 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.211172  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.211310  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:55.215229  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52547.3us
I20260925 16:44:55.216694 14074 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.210947 14081 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:55.220149 14081 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:55.220573 14081 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.221928 13725 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.222569  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.223354  9045 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:55.223963  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.224150  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.224826  9700 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:55.224895  9045 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:55.225694 13919 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:55.225906  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.226263 13919 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.226912  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.227824  9049 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:55.227385 13919 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.228572 14043 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.228698  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.202056 14077 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.229471  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.230020  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.230515 14077 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.231302  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.230123  9043 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:55.232120  9042 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:55.233029  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.233862  9046 raft_consensus.cc:2396] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260925 16:44:55.234354 14092 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:55.234797  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.193212 13783 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.197964 14031 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:55.249760  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 70121.9us
I20260925 16:44:55.219383 14074 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.203193 14018 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:55.256314  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.262229  9700 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:44:55.259932  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.263036  9121 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:44:55.207904 14073 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.265842  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.209278 13930 consensus_queue.cc:1225] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 13.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:44:55.265267 13808 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:55.273939  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.275380 13095 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.283358 13839 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.283910 14093 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:55.199781 13766 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.284472 14093 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:55.284961 14093 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:55.285957 13766 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.281757 13779 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:44:55.282263 14027 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:55.282806  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.288932  9047 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.281809  9121 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:55.292893 13785 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.294704 14036 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.203734 13925 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.301604 13925 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:55.302452 14097 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.087s	user 0.003s	sys 0.000s
I20260925 16:44:55.266417 13934 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.305213  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.305708 14072 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:55.306121  9117 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260925 16:44:55.306546 13842 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:55.306932 13842 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.311276  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.311972  9695 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:55.306231 14072 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.325217  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.325960  9121 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
W20260925 16:44:55.329249  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61744.9us
I20260925 16:44:55.328781  9700 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:55.330571  9702 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:55.199294 13905 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.333976  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:44:55.334968  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72273.2us
I20260925 16:44:55.334565  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.337090  9014 leader_election.cc:398] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:55.334143  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.337602  9014 leader_election.cc:401] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:44:55.338233  9698 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:55.340592  9699 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260925 16:44:55.340695  9016 leader_election.cc:398] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:55.303194 13934 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.341220  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.328863 13725 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.257699 14031 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:55.364931  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 98680.1us
I20260925 16:44:55.353940  9047 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:55.359300  9695 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:44:55.349735  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.348040  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.324950 13842 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.365345 13905 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.345513 14036 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:44:55.376166  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 205762us
I20260925 16:44:55.368134  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:55.385903  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48625.9us
I20260925 16:44:55.334681 13766 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.033s
I20260925 16:44:55.333705 14075 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.364665 13919 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:44:55.394263  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44685us
I20260925 16:44:55.395419  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.399394  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.401912 13905 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:55.402494 13905 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:55.403460 13905 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.405458 13842 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.405793  9048 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260925 16:44:55.406118  9048 pending_rounds.cc:76] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 9
I20260925 16:44:55.406344  9048 pending_rounds.cc:97] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260925 16:44:55.406554  9048 raft_consensus.cc:2866] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:55.407629  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.407879 14072 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.408896  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.409775  9042 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 16: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:55.410634  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.411365  9050 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:44:55.412110  9116 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:55.412997 14075 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.413935  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.376166 14031 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.419637  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.422449  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.422791 14092 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.423924 14092 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.426347  9047 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:44:55.428922  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.429638  9050 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:55.432365  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.433144  9048 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:44:55.392272 13930 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.395030 14074 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:44:55.364100 13736 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.445241  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:55.445832  8971 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:55.446183  8971 raft_consensus.cc:603] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:55.443274  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.446878  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.447631  9702 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:55.441900 13930 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.450138 13930 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.453678  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:44:55.454854 14081 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.456801 14093 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.456956 13967 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.458906 14093 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.458947 13967 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.459857 14103 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:55.459934  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.460466 14103 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.461102 13736 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.461397 14103 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.462518 13268 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.464421 13268 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.415419 13095 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:44:55.468181  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.580s (SENT)
I20260925 16:44:55.468643  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:55.469487 14036 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:44:55.470148 13934 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.470268  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.470927  9042 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:55.417121 13783 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.471673 13783 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:55.472450  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 133291us
I20260925 16:44:55.473656 13783 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.474014  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.475220  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.475324  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.475762 13725 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.476502  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.463461  9701 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:55.480273  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.486413  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.441470 14072 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:55.490504  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:55.491000  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50669us
I20260925 16:44:55.486831  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:55.489017  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45856.8us
I20260925 16:44:55.491549  9048 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:55.492429  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.489511  9050 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:55.495172  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:55.495249  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60778us
I20260925 16:44:55.496502  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.497193  9042 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:55.497320  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.485821 14036 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:44:55.523521  9050 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:55.523658  9695 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:44:55.513573  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.476220 13725 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.527021  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.490399 13785 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:55.487999 14031 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:44:55.491632 13783 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.490190 14072 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:55.528138  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.529246  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.540318  9042 raft_consensus.cc:2396] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
W20260925 16:44:55.530553  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 223085us
I20260925 16:44:55.530936  9701 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.512123 13934 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:55.546563  9698 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:55.527899 13736 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.498972 13839 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:55.531831 14075 raft_consensus.cc:2741] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260925 16:44:55.582561  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:44:55.491792 14018 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.538237 14027 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:55.544852 14072 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:55.589465  9121 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:55.527601 13095 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260925 16:44:55.495065 14073 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.592329  9699 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:44:55.578357 13934 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.602200 13725 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.587263 14074 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:55.602792 13934 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.604175 14074 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.606976 13919 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:44:55.607791  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 139668us
I20260925 16:44:55.610093 13905 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:55.601838  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:44:55.611805 13736 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.612371  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:55.613276 13905 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:55.613679 13905 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:55.614050 13905 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:55.614986 13736 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.616500  9117 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:44:55.580470 13789 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.617776 14092 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:44:55.612452  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:55.620659 14073 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.622838 13905 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.624753  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:55.623579 13789 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:55.629346 14027 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:55.630196 14113 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.631304 13789 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.631738  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:55.626631 13905 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:55.634768  9699 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:55.635650 14027 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:55.635747 14115 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:55.636154 14027 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:55.636722 14027 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.637254 13904 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.639428 14032 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:55.636299  9701 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:55.644536  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.667623  9118 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:55.653650  9123 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:55.646661  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.646337  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:55.651026  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125433us
I20260925 16:44:55.670495  9124 raft_consensus.cc:2354] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:44:55.640100  9694 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:55.646209  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.585527 13268 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:44:55.692710  9119 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:55.586954 14031 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:55.640442 14110 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:44:55.708356  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:55.708626  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.709246  9701 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.593250 14075 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:55.701438  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 97077.5us
I20260925 16:44:55.707638  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.575816 13783 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.709022  9699 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:55.712605  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:44:55.715848  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.716374  9050 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:55.717849  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 187610us
I20260925 16:44:55.718672  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:55.721755  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.723474  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.723272  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.724607  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.725673  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:55.694011 13268 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:55.639648 13904 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:55.683457 13839 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:55.730125  9047 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:44:55.745520  9701 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:55.747932  9119 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:55.737002 13919 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:55.750892 13919 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:55.752090 13919 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.753618  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:55.754364  9124 raft_consensus.cc:2354] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:44:55.757953  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:55.759008  9122 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.645320 14027 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.759239  9090 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.734766 13268 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:55.766137  9701 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:55.765345  9050 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:55.767225  9699 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:55.779510  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:55.780210  9047 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
W20260925 16:44:55.846225  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 87153.9us
I20260925 16:44:55.861760  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:55.747619 14081 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.746780 13934 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:44:55.738847 14074 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:55.721011 14075 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:55.906888  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 200873us
I20260925 16:44:55.914480  9047 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:44:55.888590 13736 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
W20260925 16:44:55.895948 14102 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.124s	user 0.001s	sys 0.000s
I20260925 16:44:55.893463 13934 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:55.936175  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55695.3us
I20260925 16:44:55.948004  9122 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:55.888106 13785 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:44:55.910612 14114 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.178s	user 0.000s	sys 0.001s
W20260925 16:44:55.930371 14097 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260925 16:44:55.911259 14081 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.916394 13965 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:55.970301  9117 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260925 16:44:55.964890  9701 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:55.975935  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:55.944245 14074 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:55.952656 13934 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:55.979836  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:55.774897 13839 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.989430  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.995464  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.023916  9122 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:44:56.039352  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 177665us
I20260925 16:44:55.972157 13736 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:55.983395 13842 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.577s	user 0.013s	sys 0.000s
W20260925 16:44:55.983438 14077 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.749s	user 0.005s	sys 0.010s
I20260925 16:44:55.913610 14031 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.950766 14073 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260925 16:44:56.059397  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:56.040230 14114 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:44:55.983234 14018 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:55.984622 14118 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:55.988754 14075 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.062616  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:55.978570 13785 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:56.059463 14077 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.005s	sys 0.010s
I20260925 16:44:55.974363 14081 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:55.976871 13965 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:56.089498  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 116047us
I20260925 16:44:56.066820 14118 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:56.068936 14032 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:56.121894  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.125285  9050 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:56.120970  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.127998  9117 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:56.108796  9119 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "49c7db4b3fda45159275230bc247b929"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
W20260925 16:44:56.149538 14116 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.246s	user 0.001s	sys 0.000s
W20260925 16:44:56.150380 14125 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.172s	user 0.000s	sys 0.000s
I20260925 16:44:56.121775 14118 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:56.217705  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.198120  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:56.218335  9121 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:44:56.154847 14130 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260925 16:44:56.138692 14132 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:44:56.155368  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:56.157151  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:56.158438 14040 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:56.158324 14074 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.221336  9119 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:44:56.254361  9119 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:56.106518 13783 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.169835  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1365) took 1031 ms. Trace:
I20260925 16:44:56.106842 14018 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
W20260925 16:44:56.175417 14135 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260925 16:44:56.148787 13736 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:56.188620  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 147046us
I20260925 16:44:56.190141  9050 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:56.055644 13883 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260925 16:44:56.193614  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.214303  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:56.200481  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 224648us
I20260925 16:44:56.105844 14027 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:56.191742 14103 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.608s	user 0.010s	sys 0.015s
W20260925 16:44:56.195034 14113 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.004s
I20260925 16:44:56.167193  9122 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260925 16:44:56.091866 13806 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.122s
I20260925 16:44:56.258646  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:56.259717  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 132717us
I20260925 16:44:56.261337 14081 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.192045 14032 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:56.262638  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 107351us
I20260925 16:44:56.288662  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:56.262312  9694 rpcz_store.cc:276] 0925 16:44:55.138066 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:55.138193 (+   127us) service_pool.cc:227] Handling call
0925 16:44:56.169652 (+1031459us) spinlock_profiling.cc:243] Waited 448 ms on lock 0x7b540062f2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:56.169762 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1030197504}
I20260925 16:44:56.275869  9117 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:44:56.293632  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 189094us
I20260925 16:44:56.276921  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:56.276013  9115 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.007s	sys 0.000s
W20260925 16:44:56.278439 14103 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.011s	sys 0.015s
W20260925 16:44:56.294610  9115 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.007s	sys 0.000s
I20260925 16:44:56.296443  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:56.299594  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:56.276027 14018 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:56.283453 14113 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:56.308265  9702 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260925 16:44:56.309810  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.262982 14040 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.321398  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:56.322293  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.381474  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:56.382673  8971 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
W20260925 16:44:56.381601  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 78392.8us
I20260925 16:44:56.382619  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:56.387137  9047 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:56.302815 13766 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:56.389968 14138 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:56.390524 14138 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:56.390527 13785 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:56.391084 14138 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:56.392318  9046 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
W20260925 16:44:56.393123 14128 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260925 16:44:56.393217 14142 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.071s
I20260925 16:44:56.390019 14136 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:56.394408 14134 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:56.394944 14134 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.397718 13766 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.398744 14018 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.398801 14134 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.402245 14134 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:56.405610 13934 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.407415  9120 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:56.407509 13934 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:56.387281  9124 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:44:56.411408  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.412423  9121 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:56.382544  9119 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:56.414283  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72693.5us
I20260925 16:44:56.416421  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:56.416448  9117 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:56.318374 14117 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:56.410950 13268 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.519s	user 0.009s	sys 0.000s
I20260925 16:44:56.450716 13268 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:56.449608  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 145903us
I20260925 16:44:56.453338  9119 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:56.457641  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:56.462245  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.399607 13766 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.323874 14147 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:56.388338 14027 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
W20260925 16:44:56.504148  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87825.4us
I20260925 16:44:56.505724  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:56.466988  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.507031  9044 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 10
I20260925 16:44:56.468259  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:56.462185  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46006.8us
I20260925 16:44:56.507870  9702 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:56.509238  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.509997  9699 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
W20260925 16:44:56.500072  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50420.5us
I20260925 16:44:56.514940  8975 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:44:56.516521  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.517092  9695 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:44:56.459419 13965 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:56.495970 14135 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260925 16:44:56.520923  8974 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:56.509289  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.468871 14117 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:56.525951  9694 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:56.531147  9047 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:44:56.512218 14151 raft_consensus.cc:2741] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260925 16:44:56.497097 14134 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:56.540215 14094 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:44:56.540625 14094 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:56.540939 14094 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:56.543744  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:56.544402 14137 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260925 16:44:56.544579  8975 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:56.537130 13934 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:56.544440 14141 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:44:56.545853 13934 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.543936  9698 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:44:56.557045  8966 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: [11.9-11.9]
I20260925 16:44:56.558993  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.520219 14043 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:56.534658 14072 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.895s	user 0.010s	sys 0.001s
I20260925 16:44:56.562858  9044 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:44:56.522722 14027 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:44:56.566620  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.568028  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:56.569674  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.569841  9124 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:56.570516  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:56.511415 13883 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260925 16:44:56.571376  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.496636 14032 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.561107 14136 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:56.575582 14072 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.556689 14134 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.581952 14072 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:56.583810  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58408.5us
I20260925 16:44:56.584537  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.589529  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.589200 14145 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:56.568756 13934 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.596022  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:56.596520  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83151.6us
I20260925 16:44:56.596623  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.597836  9042 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:56.598174  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.599049  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:56.599128  9118 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:56.593782  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:56.588923 14134 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.589883 14040 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.513108 14147 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:56.609635  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 42b301336d224f89acb2543ae4e24a12, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:56.609949  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 42b301336d224f89acb2543ae4e24a12, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.610496  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:56.605746  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:56.618435 14138 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.576172 14043 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.602939 14072 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:44:56.609364 14031 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:56.648262  9124 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:56.650030  9702 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:56.623843  8973 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:56.626878  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.627600  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.625335  9695 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:56.632699 13905 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:56.636449  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.653467  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.636729  9700 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:44:56.654084  9044 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:56.637007 14140 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.106s
I20260925 16:44:56.638101  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:56.657397  8971 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:56.652845  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:56.658380  9695 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 6.
I20260925 16:44:56.626537 14073 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:44:56.652002  9042 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:56.655831  9122 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:56.656975  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:56.661490  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:56.655138  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:56.664227  9697 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 11 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 8.
I20260925 16:44:56.666311  8974 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 7: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:56.649168 13268 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:56.667196 14143 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:44:56.669557  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:56.678366 14164 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.107s	user 0.001s	sys 0.000s
I20260925 16:44:56.598150 14145 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.663357 14073 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:56.657516 14072 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:56.689483  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.698210  8971 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:44:56.683931  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:56.692349  8975 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:56.608896 14117 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.656468 13905 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.657891 14027 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.672461 14134 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:56.696928  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:56.690232  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 74345.6us
I20260925 16:44:56.749447  9042 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:56.668656 14151 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:56.750746  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.751442  9044 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:44:56.823222  9050 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260925 16:44:56.823359  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.807473  9045 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260925 16:44:56.751717  8969 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
W20260925 16:44:56.813563  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 118069us
I20260925 16:44:56.698956 14073 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:44:56.819080  8973 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:44:56.822463  9041 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:56.830406  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:56.836843  8971 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:44:56.839772  9042 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:56.838294  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.699113 13268 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.132s
I20260925 16:44:56.699255 14141 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.133s
I20260925 16:44:56.837790  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:56.825604 14151 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:56.845291  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.844264  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.847551  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.848489  9042 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:56.850299  9118 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:56.853533  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.831517 14134 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:44:56.858625  9015 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.243s (SENT)
I20260925 16:44:56.859238  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:56.817860 14136 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260925 16:44:56.863581  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.865535  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.870661  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:56.872705  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:56.858217 14156 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260925 16:44:56.880848  9694 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:44:56.893251  9701 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:44:56.850158 14151 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:44:56.875135  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 215088us
I20260925 16:44:56.898599  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:56.911196  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:56.913269  9118 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:56.868506 14147 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:56.915781  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:56.875452 13268 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:56.860873 14094 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:56.873713 14040 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.066s
I20260925 16:44:56.874869 13808 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:44:56.987543  8971 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:44:56.988778 14071 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:56.937376 14132 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260925 16:44:56.969508  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.896276 14072 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.990249  9042 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:44:56.990339 14094 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:56.990973  9044 raft_consensus.cc:2354] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:44:56.914444 14138 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:56.937503  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:56.989523  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 73876.4us
I20260925 16:44:56.917549  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:56.990926 14132 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:44:56.939486  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 88086.3us
I20260925 16:44:56.995038  8973 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
W20260925 16:44:56.937448  9089 connection.cc:232] RPC call timeout handler was delayed by -2.8738398240002425s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1674s for a response
I20260925 16:44:56.914943 14043 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:56.949386 14152 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
W20260925 16:44:57.008869  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.530s (SENT)
W20260925 16:44:57.012001  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet e7e6790e980f40f8aeb12986a2ac7ed6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:57.012336  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet e7e6790e980f40f8aeb12986a2ac7ed6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:56.918494  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:57.018285  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:57.018908  9046 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:57.003571 14160 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:57.023483  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.024120  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.026901  9694 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:57.002903 14132 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
W20260925 16:44:57.018832  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7398631030000615s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16160000000000002s for a response
W20260925 16:44:57.027841  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7101631030002409s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16490000000000002s for a response
W20260925 16:44:57.028102  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6435631030001332s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1723s for a response
W20260925 16:44:57.028258  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6066631030000735s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1764s for a response
W20260925 16:44:57.028391  9089 connection.cc:232] RPC call timeout handler was delayed by -1.4932631030001176s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.189s for a response
I20260925 16:44:57.005331 14092 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.028856  8973 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:57.052017  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:57.052882  9696 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:56.913198 14143 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.110s
W20260925 16:44:56.968322  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3a3bc92ca0a4efa913eca1800a1550d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:44:57.080809  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:57.079582  8860 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 226524us
I20260925 16:44:57.016129 14145 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:57.091512  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:57.087913  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.094151  8971 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:57.017198 14094 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.074s
W20260925 16:44:57.097208 14146 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260925 16:44:57.099509 13095 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:44:57.100061 13095 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:57.087585 13905 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:57.101254  8966 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:44:57.100894 13095 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:57.101938 14170 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260925 16:44:57.102195 14107 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:57.102723 14107 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.104575 14107 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:57.106031  8973 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:44:57.026530 14160 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:57.114545  9696 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:44:57.125252  8973 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260925 16:44:57.122400  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 179781us
I20260925 16:44:56.984189 14134 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:57.139902 14167 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.390s	user 0.001s	sys 0.000s
I20260925 16:44:57.079990 14092 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.131469 14122 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260925 16:44:57.142741 14118 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.881s	user 0.010s	sys 0.000s
I20260925 16:44:57.155139  8973 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260925 16:44:57.163836  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.668s (SENT)
I20260925 16:44:57.164274  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.164752  9696 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:57.165517  9695 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260925 16:44:57.166121  9696 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260925 16:44:57.166237 14143 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:57.168483  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:57.169236  9118 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:44:57.158259 14158 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.340s	user 0.000s	sys 0.001s
I20260925 16:44:57.186805  9045 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:44:57.190276  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:57.198179  9041 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:44:57.198653  9696 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:44:57.201663  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.202257  8973 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12. Re-sending same reply.
I20260925 16:44:57.204649  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:57.205487  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:57.206338  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:57.198012 14094 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:57.212100 13736 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260925 16:44:57.213635 14177 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260925 16:44:57.214481 14169 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260925 16:44:57.214983 14142 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:57.215487 14142 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.216589 14092 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.217490 14142 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.218941  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:57.191366 14072 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260925 16:44:57.193092 14136 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.027s
I20260925 16:44:57.222675  9043 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260925 16:44:57.223599  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:57.199327 14168 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260925 16:44:57.223568  9118 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:44:57.226711  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:57.229809  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 138403us
W20260925 16:44:57.230497  9047 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.001s	sys 0.026s
I20260925 16:44:57.227721 14094 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:57.231670 14094 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:57.232009 14094 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:57.232452  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 68636.7us
I20260925 16:44:57.232862 14075 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:57.233320 14075 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:57.233762  9015 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.712s (SENT)
I20260925 16:44:57.234151  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:44:57.235116  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.726s (SENT)
I20260925 16:44:57.235200 14075 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:57.237502  9047 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.001s	sys 0.026s
I20260925 16:44:57.237994  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:57.238539  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.756s (SENT)
I20260925 16:44:57.238915  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:57.197733 14032 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.006s	sys 0.010s
I20260925 16:44:57.169414 14118 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:57.243968 14108 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:57.242892  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:57.255442  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.246276  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.241071 14179 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:57.248063 13930 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:57.250533  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.250638  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.169131 14160 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.264253  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.265308  8973 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:57.251830  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.252020  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.252571 14118 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:57.252729  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.253880  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.253979 14092 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.258311  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:57.254792  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.266505  8966 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12. Re-sending same reply.
I20260925 16:44:57.267445  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:44:57.244693 14032 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.006s	sys 0.011s
I20260925 16:44:57.266356  8967 raft_consensus.cc:2362] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10. Re-sending same reply.
I20260925 16:44:57.273090  9043 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:57.273427  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.273290 14092 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:57.273984  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.274552  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.273994  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.275092  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.275391  8968 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:57.275635 14179 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:44:57.245038 14043 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:57.275640  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.277339  8972 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:57.276142  8970 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:44:57.278729  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.279341  9700 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:57.268862  8974 raft_consensus.cc:2362] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13. Re-sending same reply.
I20260925 16:44:57.262897 14143 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:57.263489 13930 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:57.273124 14190 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:57.263281 14108 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:57.538154 14189 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.198s	user 0.000s	sys 0.000s
I20260925 16:44:57.285243  8973 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:57.540218 14093 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:57.340718  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.336815  9118 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:57.549404  8967 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260925 16:44:57.496764  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.284538  8968 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:44:57.320530  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.539083  9117 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:57.303607  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.484668  8972 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:57.553886  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:57.554556  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:57.426657  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2753) took 1781 ms. Trace:
I20260925 16:44:57.275300 14092 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:57.555732  9120 rpcz_store.cc:276] 0925 16:44:55.644752 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:55.644862 (+   110us) service_pool.cc:227] Handling call
0925 16:44:56.407267 (+762405us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:56.407865 (+   598us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:57.426473 (+1018608us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540010c550. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:57.426592 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1752615296}
W20260925 16:44:57.556579  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 314577us
W20260925 16:44:57.556825  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 239500us
I20260925 16:44:57.427492  9046 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:57.563916  9042 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:57.565912  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:57.494933 14165 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.670s	user 0.004s	sys 0.006s
I20260925 16:44:57.495900 14127 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:57.559744  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 142402us
I20260925 16:44:57.540686 14093 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:57.303462 14161 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:57.569890  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.547432 14160 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:57.578524 13965 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:57.578687 14040 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:44:57.579151  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:57.558794 14141 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:57.566777 14179 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:44:57.585069 14182 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.206s	user 0.000s	sys 0.000s
I20260925 16:44:57.586951  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 2773) took 1300 ms. Trace:
I20260925 16:44:57.556118 14190 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.317790 14073 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.588217 14093 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:57.640836  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.641449  8973 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:44:57.588739  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.589388 14142 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:44:57.589901  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:57.590713  8967 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: [9.8-9.8]
I20260925 16:44:57.592293  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 954) took 1283 ms. Trace:
I20260925 16:44:57.601580 14140 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.404807 14094 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:57.606048  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.579790 14143 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:57.604818  9118 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:57.676893  9118 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:57.677647  9118 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.606918  8968 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []
I20260925 16:44:57.610396  9124 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:44:57.612591  9043 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:44:57.678834  9124 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:57.621028  9042 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:44:57.679174  9695 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260925 16:44:57.558025 14145 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.626206  9702 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:44:57.425235 14151 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.340118 14132 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.694698 14132 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.631987  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1219) took 1004 ms. Trace:
I20260925 16:44:57.695255  9697 rpcz_store.cc:276] 0925 16:44:56.627208 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:56.627346 (+   138us) service_pool.cc:227] Handling call
0925 16:44:57.625652 (+998306us) spinlock_profiling.cc:243] Waited 11.2 ms on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:57.631923 (+  6271us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25772416}
W20260925 16:44:57.695942  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 106129us
I20260925 16:44:57.697141  8971 raft_consensus.cc:2354] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8.
I20260925 16:44:57.697952  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.623162 14040 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:57.698745 14075 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:44:57.626288 13965 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:57.649106  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60427.6us
I20260925 16:44:57.700135 14075 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Leader election won for term 7
I20260925 16:44:57.660346 14149 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:57.700608 14075 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:57.701037 13965 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.700980  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.668715  8969 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:57.703949  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.703873 14179 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.673025 14190 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.674836 14094 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:57.675279 14113 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.675213 14140 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.665741  9048 rpcz_store.cc:276] 0925 16:44:56.309299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:56.309511 (+   212us) service_pool.cc:227] Handling call
0925 16:44:56.383092 (+ 73581us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:56.452394 (+ 69302us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:56.452439 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:56.508929 (+ 56490us) log.cc:842] Serialized 26 byte log entry
0925 16:44:56.608770 (+ 99841us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:44:56.627725 (+ 18955us) log.cc:842] Serialized 14 byte log entry
0925 16:44:56.627893 (+   168us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:56.627956 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:57.282395 (+654439us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:44:57.494252 (+211857us) spinlock_profiling.cc:243] Waited 6.84 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:57.592102 (+ 97850us) raft_consensus.cc:1671] finished
0925 16:44:57.592123 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:57.592240 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71148,"prepare.queue_time_us":18483,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":125907,"raft.run_cpu_time_us":3355,"raft.run_wall_time_us":783516,"spinlock_wait_cycles":42527872,"thread_start_us":59331,"threads_started":1,"wal-append.queue_time_us":154077}
I20260925 16:44:57.677639  9696 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:44:57.580765 14127 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:57.712728  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:57.690471  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.616879 13930 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.691900  9118 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:57.689369  9124 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.692019 14092 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:44:57.715268  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:57.717355  9117 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:57.688982 14145 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.698938 14040 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:57.691025 14108 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:57.666276  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.707755  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.709304  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:57.724610  9695 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 6 FOLLOWER]: Advancing to term 8
I20260925 16:44:57.680512 13904 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.678516 14018 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:57.720173  8969 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:57.692709 14151 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:57.665819 13925 consensus_queue.cc:1159] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:44:57.629433  9122 rpcz_store.cc:276] 0925 16:44:56.286535 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:56.286778 (+   243us) service_pool.cc:227] Handling call
0925 16:44:57.586754 (+1299976us) spinlock_profiling.cc:243] Waited 352 ms on lock 0x7b540019cdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:57.586874 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":808753920}
I20260925 16:44:57.723270  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:57.726635  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.679953 13919 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260925 16:44:57.731854 13904 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.736690  9048 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:57.710194 14141 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260925 16:44:57.743644  9697 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260925 16:44:57.736021  9695 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 8.
I20260925 16:44:57.766454  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.768570 13965 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:57.733059 14132 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:57.773981  9117 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:57.719556 14113 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.724304 14118 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260925 16:44:57.776966 14127 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:57.701445 14075 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.784286  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.785229  8969 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:57.778205 14132 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.792920  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.794579  8969 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:57.803598 14113 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.806953  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.808962 14094 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:57.809429 14094 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.784761 13095 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260925 16:44:57.824401  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.827013  8969 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:57.827075  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.834820  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:57.835402  9694 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 14
I20260925 16:44:57.812325 14073 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.794284 14132 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:57.824681 14140 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:57.857715 14134 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.022s	sys 0.029s
I20260925 16:44:57.888995  9694 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
W20260925 16:44:57.863655  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 130231us
I20260925 16:44:57.864830  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:44:57.888662 14134 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.640s	user 0.022s	sys 0.029s
I20260925 16:44:57.898370  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.898478  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:57.899031  9694 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:57.899897  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:57.909199  8973 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:44:57.896813  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:57.926718  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:57.926712 14204 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260925 16:44:57.927661 14071 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:57.927830 14115 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:44:57.928243 14115 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:57.928210 14071 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:57.894474 14145 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:57.895588 14094 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:57.932417  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:57.928738 14115 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:57.929932 14027 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.020s	sys 0.032s
I20260925 16:44:58.006079  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:58.009193 14210 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:44:58.013154  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.014384  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.015084  8971 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:58.016038  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.016593  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.017190  8968 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:58.017374  8966 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260925 16:44:58.018358  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.016635  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.021546  8967 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 10 because replica has last-logged OpId of term: 9 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260925 16:44:58.019397  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:58.003733 14027 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.020s	sys 0.032s
I20260925 16:44:58.016598  8971 raft_consensus.cc:2362] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10. Re-sending same reply.
I20260925 16:44:58.049106  9695 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:44:58.063149  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.063943  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.064744  8973 raft_consensus.cc:2362] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10. Re-sending same reply.
I20260925 16:44:58.066895  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.045308 14092 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:58.088440  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.089114  8974 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:44:58.090572  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.091749  8971 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:44:58.092777  8973 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:58.112589  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.118326  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.120280  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.119767  8967 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:44:58.131075  8973 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 7. (term mismatch)
I20260925 16:44:58.132501  8973 pending_rounds.cc:76] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 6
I20260925 16:44:58.133158  8973 pending_rounds.cc:97] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 9.7
W20260925 16:44:58.127566 14176 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.965s	user 0.002s	sys 0.002s
I20260925 16:44:58.123068 14160 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:58.089883 14092 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.133409  8973 raft_consensus.cc:2866] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:58.137195  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.142923  8968 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:58.131569 13785 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:58.143934 14215 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260925 16:44:58.144330  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.146229  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.067032 14071 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.152894  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.153652  8968 raft_consensus.cc:2362] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11. Re-sending same reply.
I20260925 16:44:58.132409 14132 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.156009  8966 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:58.157248 14092 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:58.162050 14194 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.605s	user 0.001s	sys 0.000s
I20260925 16:44:58.151774 13785 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.164007 13785 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.164302  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1217) took 1537 ms. Trace:
I20260925 16:44:58.164625  9699 rpcz_store.cc:276] 0925 16:44:56.626655 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:56.626770 (+   115us) service_pool.cc:227] Handling call
0925 16:44:56.637593 (+ 10823us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:57.140690 (+503097us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:57.140731 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:57.147660 (+  6929us) log.cc:842] Serialized 26 byte log entry
0925 16:44:57.243714 (+ 96054us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:57.243753 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:57.244697 (+   944us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:58.161542 (+916845us) spinlock_profiling.cc:243] Waited 20.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:44:58.164027 (+  2485us) raft_consensus.cc:1671] finished
0925 16:44:58.164048 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:58.164251 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":28003,"raft.queue_time_us":111543,"raft.run_cpu_time_us":4659,"raft.run_wall_time_us":65722,"spinlock_wait_cycles":47080832,"thread_start_us":523383,"threads_started":2,"wal-append.queue_time_us":198998}
W20260925 16:44:58.166211  9666 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.537s (SENT)
I20260925 16:44:58.166512  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.175262  9117 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:44:58.189721  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.190970  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.192243  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:58.192965  9122 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:58.193737  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.202008  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.150157 14160 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.212466  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.213256  9699 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:44:58.217566  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:58.221370  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.225152 14188 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
W20260925 16:44:58.228916 14225 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260925 16:44:58.233419 14093 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:44:58.227952 14040 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.506s	user 0.008s	sys 0.002s
I20260925 16:44:58.245922  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.225597 14166 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:58.248446  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:44:58.251469  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 80611.3us
I20260925 16:44:58.266683  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:58.250200 14166 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:44:58.263921  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:58.270862  9122 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:58.265558 14117 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:58.254160 14108 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:58.249140 14040 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.278203  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:58.279958  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:58.255981 14043 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:58.253177 14027 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260925 16:44:58.272929 14166 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:58.256201 14173 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.022s
I20260925 16:44:58.252285 14115 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.275197 14108 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:44:58.287591  9694 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:44:58.273840 13883 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260925 16:44:58.292092  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:44:58.271500 13806 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.016s
I20260925 16:44:58.281517 13785 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:44:58.294687  8969 raft_consensus.cc:2354] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:44:58.326930 14027 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:58.327502 14040 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.328114  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.329209  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.330484  9122 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:44:58.331215 14149 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:44:58.330442 13904 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:58.331599  9122 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:44:58.335894  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:58.334437  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:58.342254  9122 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:58.342618  9699 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:58.325304  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82781.6us
W20260925 16:44:58.336076  8939 connection.cc:232] RPC call timeout handler was delayed by -1.1619189309999456s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15180000000000002s for a response
W20260925 16:44:58.343818  8939 connection.cc:232] RPC call timeout handler was delayed by -1.1583189309999398s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1522s for a response
W20260925 16:44:58.344319  8939 connection.cc:232] RPC call timeout handler was delayed by -1.1160189309998714s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1569s for a response
W20260925 16:44:58.344698  8939 connection.cc:232] RPC call timeout handler was delayed by -1.0989189309998437s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15880000000000002s for a response
W20260925 16:44:58.344954  8939 connection.cc:232] RPC call timeout handler was delayed by -1.0944189309998364s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1593s for a response
I20260925 16:44:58.331552 14149 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:58.284463 14043 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.350507  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.279408 14117 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.354092 14115 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.355593 14117 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.355932 14160 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:44:58.357611 14224 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260925 16:44:58.358104 14043 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.358906  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.360013  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.344027 14179 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260925 16:44:58.361521  9699 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:58.361907  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.362947  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.363385  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.363768  8967 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:58.364307  8968 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:44:58.364862  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.365258  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.365958  8966 raft_consensus.cc:2354] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:44:58.341368 13925 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:58.366727  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.367149 13925 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.369095 13925 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.370033 14149 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.371215 14149 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:58.371959  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.372635  8971 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 13: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:44:58.349498 14108 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.380070 14108 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:58.293190 14094 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.057s
I20260925 16:44:58.372309 13785 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:58.390761 14103 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:44:58.391191 14103 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:58.392000 14103 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.327445 14027 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.394124 14103 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:58.393211  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1023) took 1762 ms. Trace:
I20260925 16:44:58.395843  9700 rpcz_store.cc:276] 0925 16:44:56.631196 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:56.654553 (+ 23357us) service_pool.cc:227] Handling call
0925 16:44:56.664328 (+  9775us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:57.279763 (+615435us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:58.392990 (+1113227us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:58.393159 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1413972352}
I20260925 16:44:58.396654  9123 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
W20260925 16:44:58.397872  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47470.9us
I20260925 16:44:58.398068  9123 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:44:58.398533  9123 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:58.399252  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.400555 13925 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:44:58.401582  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 667477us
I20260925 16:44:58.402242  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:57.500880  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:44:58.410000  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.416524  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:58.417543  9699 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:44:58.418430  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73153.7us
W20260925 16:44:58.424757  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 628733us
I20260925 16:44:58.425740  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:58.433434 14073 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:58.399420  9123 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.439610  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.426575  9122 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.445173  9123 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:44:58.447634  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 104681us
I20260925 16:44:58.455953  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.456784  8971 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:44:58.459136  9122 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:44:58.460641  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.414882 14093 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:58.415006 14027 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:58.470728  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:58.470247  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.444198 13925 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:44:58.474442  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.443946 14179 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:44:58.479722  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43572.5us
I20260925 16:44:58.480396  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:58.481441  9699 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:58.482191  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.478106  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:58.491926  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:58.489923  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:58.466367 14142 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:58.444108 14043 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260925 16:44:58.496192  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:58.500578  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 61080.7us
I20260925 16:44:58.501297  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.502478  8971 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:58.476719 13925 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:58.490685 14094 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:44:58.483460 14027 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:58.519819  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.521421  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.498427 14179 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:58.501222 14093 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:58.527881  8971 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:44:58.502310 14227 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:44:58.505517 14232 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:58.507843 13925 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:58.521343 13785 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:44:58.518481 14230 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:44:58.543617  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.545253  8971 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:44:58.545490  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.545811  8971 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:58.546144  8973 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:44:58.548743  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:58.500010 14142 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.548264  8971 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.568347 14179 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.571913 13806 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:44:58.581172 14142 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:58.536900 14093 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:58.590133  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.590133  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.587555  8971 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:44:58.530949 14094 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260925 16:44:58.535851 14227 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:44:58.551986 14075 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:44:58.603040  9117 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:44:58.603832  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "088ac48c62d34a40b53987746a70b871"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:58.612128  8975 raft_consensus.cc:595] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.612634  8975 raft_consensus.cc:603] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:58.604707  8968 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:44:58.604772 13806 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:44:58.605235 13930 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:44:58.606977  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 103378us
I20260925 16:44:58.591522  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:44:58.623160  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.618258  9122 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
W20260925 16:44:58.619462  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 127616us
I20260925 16:44:58.616341  8939 leader_election.cc:398] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:44:58.624581  9122 pending_rounds.cc:76] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 9
I20260925 16:44:58.625554  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:58.625525  9122 pending_rounds.cc:97] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260925 16:44:58.628355  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.626456  9122 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:44:58.634869  8971 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:44:58.531327 14234 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.070s
I20260925 16:44:58.636268  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:44:58.641745  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 239580us
I20260925 16:44:58.640515  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:44:58.642421  8967 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:44:58.591370 14238 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:58.643579  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:44:58.645967 14244 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:58.651731 14244 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.653782 14244 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:58.654965  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1166) took 1389 ms. Trace:
I20260925 16:44:58.655333  9121 rpcz_store.cc:276] 0925 16:44:57.265365 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.265510 (+   145us) service_pool.cc:227] Handling call
0925 16:44:57.265794 (+   284us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:57.668191 (+402397us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:44:57.699686 (+ 31495us) log.cc:842] Serialized 14 byte log entry
0925 16:44:58.498926 (+799240us) log.cc:842] Serialized 14 byte log entry
0925 16:44:58.531007 (+ 32081us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:58.531064 (+    57us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:58.531116 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:58.654729 (+123613us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540010bb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:58.654777 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:58.654901 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":529465,"prepare.queue_time_us":67448,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":63,"raft.queue_time_us":599595,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":19287,"spinlock_wait_cycles":962697984,"thread_start_us":300559,"threads_started":3,"wal-append.queue_time_us":310559}
I20260925 16:44:58.658880  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.649565  9666 leader_election.cc:398] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8.
I20260925 16:44:58.649940  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:58.648244  8975 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:58.648324  8939 leader_election.cc:398] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:44:58.664548  9666 leader_election.cc:401] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:44:58.678447  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:58.641053 14115 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:58.681880  9124 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:58.537169 14232 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.683987  9701 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:44:58.687430  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.687839  9701 raft_consensus.cc:595] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.685046  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1389) took 1440 ms. Trace:
I20260925 16:44:58.688381  9121 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 15 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260925 16:44:58.645185 14075 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:44:58.688365  9702 rpcz_store.cc:276] 0925 16:44:57.244876 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.245001 (+   125us) service_pool.cc:227] Handling call
0925 16:44:57.625832 (+380831us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:57.680135 (+ 54303us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:58.684865 (+1004730us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b54006667d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:58.684993 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":819456384}
I20260925 16:44:58.702636  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:58.732481  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:58.751833  9124 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260925 16:44:58.752640  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1168) took 1151 ms. Trace:
I20260925 16:44:58.753000  9124 rpcz_store.cc:276] 0925 16:44:57.601254 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.607979 (+  6725us) service_pool.cc:227] Handling call
0925 16:44:57.609554 (+  1575us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:58.681248 (+1071694us) spinlock_profiling.cc:243] Waited 631 ms on lock 0x7b5800a1deb0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:44:58.752360 (+ 71112us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:58.752583 (+   223us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1450184960}
I20260925 16:44:58.758826  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:58.760264  9694 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:44:58.769282  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:58.774348  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48497us
I20260925 16:44:58.784667  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.785678  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:58.787484  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:58.695009 14140 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 7. Current term is 8.
W20260925 16:44:58.784170 14123 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 12 current term: 12 is higher.
I20260925 16:44:58.651116 14166 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.807003  9700 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:58.806288  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:58.815174  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 122678us
I20260925 16:44:58.823943 14244 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:58.824641 14244 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.826977 14244 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:58.827190  9694 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:44:58.787568 14115 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:58.784404 14092 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:58.783761 14127 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:58.662146 14238 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.793584 14072 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:58.689728 14093 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:58.785933 14234 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260925 16:44:58.854813  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.856698  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:58.863972  8975 raft_consensus.cc:595] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.809506 14142 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:58.854787  8966 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:44:58.809645 14043 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:58.918738  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 95798.1us
W20260925 16:44:58.941747 14108 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.561s	user 0.009s	sys 0.000s
I20260925 16:44:58.948820  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.950768  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:58.980767  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:58.856622 14103 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:44:58.997200  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:44:58.999751  9123 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.554s	user 0.010s	sys 0.000s
I20260925 16:44:58.793220 13806 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.017987  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:59.048411  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:58.974545 14244 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:59.093093  9042 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:44:59.049240  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:59.094666  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:44:59.101547  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 250124us
I20260925 16:44:58.767467 14227 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.115967  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:59.116739  8975 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:58.993417 13904 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
I20260925 16:44:59.092563 14103 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:58.993463 14043 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.111116 14241 raft_consensus.cc:2741] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260925 16:44:59.126668  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:58.976008 14142 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:58.862920 14127 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.070528 14246 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:44:58.859751 14075 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:59.424248  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.008s	sys 0.011s
W20260925 16:44:59.429167  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.008s	sys 0.011s
W20260925 16:44:59.406575 14143 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.573s	user 0.021s	sys 0.025s
W20260925 16:44:59.429755  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 623725us
W20260925 16:44:59.377595 14122 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.011s	sys 0.034s
I20260925 16:44:59.120231 14244 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:59.430214  9088 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.004s	sys 0.031s
I20260925 16:44:59.506115  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2899) took 1802 ms. Trace:
I20260925 16:44:59.512532  9042 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:44:59.513481  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:44:59.430735  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:59.513834  9088 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.678s	user 0.005s	sys 0.031s
I20260925 16:44:59.513885  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:59.430346 14143 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.021s	sys 0.025s
I20260925 16:44:59.515055  9045 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:44:59.409929 14094 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:59.517745  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ee9de086f49c4026931c128637888218"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:59.541885  8975 raft_consensus.cc:595] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:44:59.542292  8975 raft_consensus.cc:603] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:44:59.522909  9042 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 7. Current term is 8. Ops: []
I20260925 16:44:59.512660  9115 rpcz_store.cc:276] 0925 16:44:57.703428 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.705802 (+  2374us) service_pool.cc:227] Handling call
0925 16:44:57.706045 (+   243us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:57.740363 (+ 34318us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:57.740408 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:57.740463 (+    55us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:44:57.740506 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.505874 (+1765368us) spinlock_profiling.cc:243] Waited 34.1 ms on lock 0x7b54000113d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:59.505923 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:59.506062 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":78403968}
W20260925 16:44:59.531575  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 100925us
W20260925 16:44:59.451993 14122 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.011s	sys 0.036s
W20260925 16:44:59.430886 14237 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260925 16:44:59.389732 14232 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:59.543926  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:59.516139 14224 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260925 16:44:59.376111 14103 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:59.553586  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 387871us
I20260925 16:44:59.564028  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:59.570254  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:59.571669  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:59.550041 14249 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.712s	user 0.000s	sys 0.001s
I20260925 16:44:59.534474 14166 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:59.535522 14241 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:59.583993 14232 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:59.586746  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:44:59.547999 14234 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:59.588229 13095 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:59.589458  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:59.593391  9665 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:59.596815  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.088s (SENT)
I20260925 16:44:59.604065  8975 raft_consensus.cc:595] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:59.610390  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:59.593801 14243 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.789s	user 0.000s	sys 0.001s
I20260925 16:44:59.566126 14235 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:59.620688  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260925 16:44:59.608207 14245 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.757s	user 0.001s	sys 0.001s
I20260925 16:44:59.604138 14071 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:44:59.562649 14094 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:59.626734  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.800s (SENT)
I20260925 16:44:59.613821 13904 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:44:59.630900  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:44:59.637596  8967 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.990s	user 0.010s	sys 0.000s
I20260925 16:44:59.639389 13095 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:59.638016  8967 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:44:59.641287  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1897) took 1025 ms. Trace:
I20260925 16:44:59.621471 14238 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:59.630247 14259 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:59.641749  8967 rpcz_store.cc:276] 0925 16:44:58.615944 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.637791 (+ 21847us) service_pool.cc:227] Handling call
0925 16:44:59.641216 (+1003425us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:59.639328 14071 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:44:59.641732 14269 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:59.642385 14140 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:44:59.656966  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:59.680141  9115 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:44:59.680141 13785 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:44:59.611783 14241 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.682708 14140 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.685770 14140 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:59.686230  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1886) took 1210 ms. Trace:
I20260925 16:44:59.686635  8966 rpcz_store.cc:276] 0925 16:44:58.475554 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.475677 (+   123us) service_pool.cc:227] Handling call
0925 16:44:59.686049 (+1210372us) spinlock_profiling.cc:243] Waited 369 ms on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:59.686174 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":848509696}
I20260925 16:44:59.688649 14263 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:59.689126 14263 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:59.689594 14143 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:59.690126 14143 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:59.690865  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2438) took 1771 ms (client timeout 1530 ms). Trace:
W20260925 16:44:59.691229  8969 rpcz_store.cc:269] 0925 16:44:57.919781 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.920078 (+   297us) service_pool.cc:227] Handling call
0925 16:44:59.690666 (+1770588us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54003e8354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:44:59.690780 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":828842752}
I20260925 16:44:59.691599  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:59.692727  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1040) took 1028 ms. Trace:
I20260925 16:44:59.693091  9700 rpcz_store.cc:276] 0925 16:44:58.664133 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.679509 (+ 15376us) service_pool.cc:227] Handling call
0925 16:44:58.728922 (+ 49413us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:58.810832 (+ 81910us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.692521 (+881689us) spinlock_profiling.cc:243] Waited 76.6 ms on lock 0x7b540068ae54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:59.692675 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":176187136}
I20260925 16:44:59.623458 14234 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:59.643810 14121 raft_consensus.cc:2741] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260925 16:44:59.645501 14268 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:44:59.657383 14255 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.380s	user 0.000s	sys 0.001s
I20260925 16:44:59.651707 14043 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:44:59.675081 14250 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260925 16:44:59.675396  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1029) took 1895 ms. Trace:
I20260925 16:44:59.726186  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1405) took 1264 ms. Trace:
I20260925 16:44:59.658046 14259 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:59.676717 14141 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
W20260925 16:44:59.676931 13930 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.048s	user 0.009s	sys 0.001s
I20260925 16:44:59.678227 14258 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:44:59.665484 14270 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:44:59.665377 13925 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.119s	user 0.010s	sys 0.001s
W20260925 16:44:59.650179 14257 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.533s	user 0.001s	sys 0.000s
I20260925 16:44:59.642843 14266 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:59.772461  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:59.679375  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52681.5us
W20260925 16:44:59.773824  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.940s (SENT)
I20260925 16:44:59.774369  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:44:59.708009 14122 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
W20260925 16:44:59.707000 14254 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.368s	user 0.001s	sys 0.000s
I20260925 16:44:59.705006 14142 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:59.735798  9693 rpcz_store.cc:276] 0925 16:44:58.462215 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.462663 (+   448us) service_pool.cc:227] Handling call
0925 16:44:58.478718 (+ 16055us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:44:58.491309 (+ 12591us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:58.491337 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:44:58.521029 (+ 29692us) log.cc:842] Serialized 52 byte log entry
0925 16:44:58.586067 (+ 65038us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:58.586119 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:58.586202 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:59.725926 (+1139724us) raft_consensus.cc:1671] finished
0925 16:44:59.725948 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:59.726123 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2660,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":15664,"thread_start_us":59968,"threads_started":1,"wal-append.queue_time_us":232080}
I20260925 16:44:59.735261  9695 rpcz_store.cc:276] 0925 16:44:57.779929 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.780095 (+   166us) service_pool.cc:227] Handling call
0925 16:44:57.780378 (+   283us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:58.049533 (+269155us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.675143 (+1625610us) spinlock_profiling.cc:243] Waited 269 ms on lock 0x7b540079f754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:44:59.675332 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":617587072}
W20260925 16:44:59.742000  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46156.4us
I20260925 16:44:59.719758 14244 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:59.769488  8972 raft_consensus.cc:2396] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:44:59.740899 14103 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:59.777354  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2783) took 1596 ms. Trace:
W20260925 16:44:59.785869  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 175800us
I20260925 16:44:59.810279  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:59.810936  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.870s (SENT) [suppressed 36 similar messages]
I20260925 16:44:59.811447  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:59.812074  9693 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:44:59.806937  9119 rpcz_store.cc:276] 0925 16:44:58.180844 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.181614 (+   770us) service_pool.cc:227] Handling call
0925 16:44:58.182001 (+   387us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:58.450203 (+268202us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:58.450240 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:58.467041 (+ 16801us) log.cc:842] Serialized 26 byte log entry
0925 16:44:58.622447 (+155406us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:58.685993 (+ 63546us) log.cc:842] Serialized 14 byte log entry
0925 16:44:59.128524 (+442531us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.128607 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:59.777163 (+648556us) raft_consensus.cc:1671] finished
0925 16:44:59.777183 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:44:59.777300 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":938697,"prepare.queue_time_us":54819,"raft.queue_time_us":677557,"raft.run_cpu_time_us":317,"raft.run_wall_time_us":587671,"spinlock_wait_cycles":15352576,"thread_start_us":455472,"threads_started":2,"wal-append.queue_time_us":205458}
I20260925 16:44:59.768953 14278 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:59.706360 14269 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.771520 14143 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:59.814133  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:59.818697  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:44:59.794555 14145 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:44:59.806735 14250 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:44:59.791169 14043 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:44:59.805160 14258 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:44:59.827250  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:44:59.827804  9044 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:44:59.820993 14122 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:44:59.772921 13925 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:59.795660 14270 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.834990  8974 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:44:59.835747  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2455) took 1820 ms. Trace:
I20260925 16:44:59.836109  8974 rpcz_store.cc:276] 0925 16:44:58.015435 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:59.834236 (+1818801us) service_pool.cc:227] Handling call
0925 16:44:59.834613 (+   377us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:59.835442 (+   829us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.835672 (+   230us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:44:59.836580 14270 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:44:59.727763 14268 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:44:59.839059  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.427s (SENT)
I20260925 16:44:59.842271  9044 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:44:59.813301 14241 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:59.819881 14263 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:44:59.829710  9043 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.064s	user 0.000s	sys 0.031s
W20260925 16:44:59.850548  9043 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.094s	user 0.000s	sys 0.032s
W20260925 16:44:59.845427  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.052s	user 0.011s	sys 0.043s
I20260925 16:44:59.850145  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:44:59.851548  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.897s	user 0.007s	sys 0.006s
W20260925 16:44:59.851487  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.011s	sys 0.043s
I20260925 16:44:59.831591 14122 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:44:59.854612  9044 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
W20260925 16:44:59.853868  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 204553us
W20260925 16:44:59.855279  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.17659e+06us
W20260925 16:44:59.856012  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.007s	sys 0.006s
I20260925 16:44:59.838094 14094 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:59.859490 14122 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:44:59.791468 14266 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:59.873798  9044 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:44:59.878064  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:44:59.854732  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 265366us
I20260925 16:44:59.879745  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:59.832453 14043 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.899168  9089 leader_election.cc:398] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:44:59.899472  9089 leader_election.cc:401] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260925 16:44:59.900152  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:59.820582 14278 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:59.908288  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:44:59.909116  9699 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
W20260925 16:44:59.874377  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.873s	user 0.013s	sys 0.013s
W20260925 16:44:59.917922  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.917s	user 0.014s	sys 0.014s
I20260925 16:44:59.917490  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:44:59.920717  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:44:59.924028  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:44:59.919803  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 918845us
I20260925 16:44:59.924896  9699 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:44:59.881948 14246 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:44:59.907029 14264 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.202s	user 0.000s	sys 0.001s
W20260925 16:44:59.933517  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 122605us
I20260925 16:44:59.837592 14258 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:44:59.897270 14094 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:44:59.899037 14103 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:44:59.900388 13789 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:44:59.920457 14143 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:44:59.940498  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:59.938277  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:44:59.940841  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:44:59.948742 14234 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:44:59.938030 14290 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader election won for term 8
I20260925 16:44:59.954711 14094 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:44:59.960208 14246 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:44:59.995097  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54738.7us
I20260925 16:44:59.931443 14263 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
W20260925 16:44:59.999095  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58348.4us
W20260925 16:45:00.000113  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61919.6us
I20260925 16:45:00.002581  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.005265  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.007449  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:00.011735  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.013073  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:44:59.956002 14259 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:44:59.997809 13789 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:00.022461  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.208s (SENT)
I20260925 16:45:00.022924  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.022697 13789 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.024443 14108 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:00.024773 13789 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:00.025040  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1030) took 2244 ms. Trace:
I20260925 16:45:00.021874 14094 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.025421  9696 rpcz_store.cc:276] 0925 16:44:57.780222 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.780325 (+   103us) service_pool.cc:227] Handling call
0925 16:44:58.683777 (+903452us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:58.684136 (+   359us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:58.684164 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:58.765988 (+ 81824us) log.cc:842] Serialized 26 byte log entry
0925 16:44:59.101128 (+335140us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:59.101195 (+    67us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.101282 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:00.023785 (+922503us) raft_consensus.cc:1671] finished
0925 16:45:00.023805 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:00.024755 (+   950us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540062e150. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:00.024966 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":261,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":37146,"spinlock_wait_cycles":2057933568,"thread_start_us":245860,"threads_started":1,"wal-append.queue_time_us":847149}
I20260925 16:45:00.001953 14103 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:00.027526 14103 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:00.027899 14075 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.013916 14287 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:00.013975  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2902) took 2285 ms. Trace:
I20260925 16:45:00.030030  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1186) took 1083 ms. Trace:
I20260925 16:45:00.029547 14075 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.030431  9117 rpcz_store.cc:276] 0925 16:44:58.946855 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.952796 (+  5941us) service_pool.cc:227] Handling call
0925 16:44:58.953119 (+   323us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:58.953370 (+   251us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:58.953404 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:58.953931 (+   527us) log.cc:842] Serialized 26 byte log entry
0925 16:44:59.860623 (+906692us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:59.860675 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.860881 (+   206us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:00.029838 (+168957us) raft_consensus.cc:1671] finished
0925 16:45:00.029860 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:00.029978 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":906242,"threads_started":1,"wal-append.queue_time_us":984072}
I20260925 16:45:00.020372 14043 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:00.003149 14247 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.463s	user 0.003s	sys 0.000s
I20260925 16:45:00.021881 14268 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.014439 14280 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.032457 14075 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:00.032527  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20260925 16:45:00.033136  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1037) took 1403 ms (client timeout 1767 ms). Trace:
I20260925 16:45:00.032655 14280 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.033450  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:45:00.033499  9694 rpcz_store.cc:269] 0925 16:44:58.629854 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.630512 (+   658us) service_pool.cc:227] Handling call
0925 16:45:00.032973 (+1402461us) spinlock_profiling.cc:243] Waited 96.2 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:00.033062 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":221208960}
I20260925 16:45:00.034130  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 976) took 1073 ms. Trace:
I20260925 16:44:59.953874 14283 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.086s
I20260925 16:45:00.034502  9048 rpcz_store.cc:276] 0925 16:44:58.961177 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.961285 (+   108us) service_pool.cc:227] Handling call
0925 16:44:58.961521 (+   236us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:44:59.425541 (+464020us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:59.425585 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:44:59.425639 (+    54us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:59.425700 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:00.033934 (+608234us) spinlock_profiling.cc:243] Waited 464 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:00.033971 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:00.034080 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1066635520}
I20260925 16:45:00.035130 14280 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.008641 14241 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:00.036444 14241 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:00.036813 14241 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:00.037739  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:00.038532 13789 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:00.009529 14234 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:00.039582 14234 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.039948 14234 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.036860 13806 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.042904  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.016767 14278 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.008531 14290 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:00.054940 14290 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.057199 14071 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:00.051666 14270 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.006s
I20260925 16:45:00.059464 13789 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:00.016990 14266 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.060451 13789 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.061980 14258 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.028877  9116 rpcz_store.cc:276] 0925 16:44:57.721423 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:57.721569 (+   146us) service_pool.cc:227] Handling call
0925 16:44:57.732036 (+ 10467us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:58.400979 (+668943us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:44:58.401314 (+   335us) log.cc:842] Serialized 14 byte log entry
0925 16:44:58.772828 (+371514us) log.cc:842] Serialized 14 byte log entry
0925 16:44:58.773175 (+   347us) log.cc:842] Serialized 14 byte log entry
0925 16:44:58.773301 (+   126us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:58.773819 (+   518us) log.cc:842] Serialized 26 byte log entry
0925 16:44:58.773970 (+   151us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:44:58.774014 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:58.774103 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:44:59.681252 (+907149us) spinlock_profiling.cc:243] Waited 2.22 ms on lock 0x7b180032bf00. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f71a0dd1088 00007f71a0dc86b1 00007f71a0dc8657 00007f71a0ebc978 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8
0925 16:45:00.006692 (+325440us) raft_consensus.cc:1671] finished
0925 16:45:00.006724 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:00.006843 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":777796,"prepare.queue_time_us":11656,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":810529,"raft.run_cpu_time_us":29876,"raft.run_wall_time_us":920707,"spinlock_wait_cycles":70001536,"thread_start_us":234319,"threads_started":1,"wal-append.queue_time_us":972772}
W20260925 16:45:00.073077  9089 connection.cc:232] RPC call timeout handler was delayed by -1.905484229999729s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16080000000000003s for a response
W20260925 16:45:00.073678  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8604842299998836s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1658s for a response
W20260925 16:45:00.074065  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8514842299998691s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1668s for a response
W20260925 16:45:00.074429  9089 connection.cc:232] RPC call timeout handler was delayed by -1.8397842299998501s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16810000000000003s for a response
W20260925 16:45:00.074798  9089 connection.cc:232] RPC call timeout handler was delayed by -1.7209842299998854s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
W20260925 16:45:00.075166  9089 connection.cc:232] RPC call timeout handler was delayed by -1.6795842299998185s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1859s for a response
W20260925 16:45:00.075520  9089 connection.cc:232] RPC call timeout handler was delayed by -1.5166842299997825s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20400000000000001s for a response
W20260925 16:45:00.075935  9089 connection.cc:232] RPC call timeout handler was delayed by -1.4725842299997112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2089s for a response
W20260925 16:45:00.076375  9089 connection.cc:232] RPC call timeout handler was delayed by -1.3348842299997159s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2242s for a response
I20260925 16:45:00.076947  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:00.077267  9089 connection.cc:232] RPC call timeout handler was delayed by -1.2052842299997337s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.23860000000000003s for a response
W20260925 16:45:00.077732  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0153842299998814s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2597s for a response
I20260925 16:45:00.078370 14248 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.078893 14248 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.081138 14248 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:00.084899  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.076609 14266 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:00.088449  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:00.090435  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83058.2us
I20260925 16:45:00.052975 13925 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.051128 14227 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.106927 14018 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:00.107916 14018 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.076838 14269 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.109916 14018 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:00.107138  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.111732  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.112416 14258 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:00.114415  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.116261  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.118290  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.121526  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.122237  9045 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:00.123590  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.124353  9045 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
I20260925 16:45:00.127130  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.129048  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:00.133468  9015 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 3.125s (SENT)
I20260925 16:45:00.134210  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:00.113380 14149 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:45:00.136117  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 123099us
I20260925 16:45:00.133739  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.134963  9041 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:00.136780  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.141631  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.139791  9117 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260925 16:45:00.142210  9119 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:00.141863  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.142891  9123 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:45:00.144856  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.145159  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.145650  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.145853  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:00.147418 14300 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260925 16:45:00.148159  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.140051  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.148825  9122 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:00.141116  9048 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:00.114735 14093 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:00.150585  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.151531  9124 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:00.151945  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.152139  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:00.132375 14284 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.119s	user 0.000s	sys 0.001s
I20260925 16:45:00.152523  9048 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:00.152793  9118 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:45:00.153924  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 971) took 1462 ms. Trace:
I20260925 16:45:00.154263  9043 rpcz_store.cc:276] 0925 16:44:58.691684 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.692266 (+   582us) service_pool.cc:227] Handling call
0925 16:44:58.692550 (+   284us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:58.692819 (+   269us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:58.692857 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:58.693351 (+   494us) log.cc:842] Serialized 26 byte log entry
0925 16:44:59.851089 (+1157738us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:59.851143 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.851226 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:00.153754 (+302528us) raft_consensus.cc:1671] finished
0925 16:45:00.153771 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:00.153878 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":1094729,"threads_started":1,"wal-append.queue_time_us":1195931}
I20260925 16:45:00.148567 14149 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:00.155761 14149 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.158291 14234 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.159823 14283 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.134080 14071 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260925 16:45:00.161684  9693 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:45:00.129554 14179 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:00.136019 14018 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:00.163156 14179 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.163679 14018 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.164047  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:00.163686 14179 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:00.165702 14018 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.167357  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.169516  9050 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:00.174604  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.148051 14269 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:00.181383  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.181473  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.182047  8967 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:00.183929  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.184700  8969 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 16: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:00.166386 14241 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.192291  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.193120  8969 raft_consensus.cc:2396] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260925 16:45:00.189343  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.190349 14287 raft_consensus.cc:979] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:00.190905  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.196662  8967 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:00.195227  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1881) took 1832 ms. Trace:
I20260925 16:45:00.197006  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.199282  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:00.197121  8972 rpcz_store.cc:276] 0925 16:44:58.363023 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.363171 (+   148us) service_pool.cc:227] Handling call
0925 16:45:00.195041 (+1831870us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:00.195166 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3231216000}
I20260925 16:45:00.197607  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.202764  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:00.203047  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.150840 13930 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260925 16:45:00.208359  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.209249  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.209316  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.211190  8969 raft_consensus.cc:2362] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10. Re-sending same reply.
I20260925 16:45:00.216226  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.204048 13925 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:00.217335 13925 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.219856 14188 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:00.208891 14040 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:00.211171  8967 raft_consensus.cc:2362] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14. Re-sending same reply.
I20260925 16:45:00.222302  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.220499 14040 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.226046 14040 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:00.226110 14302 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260925 16:45:00.223989  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.172353 14071 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260925 16:45:00.224900  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.228410  8972 raft_consensus.cc:2354] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:00.195303 14241 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.226127  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.203986 14093 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.229916  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.229936  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.230463  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.204499 14268 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.209565 14287 raft_consensus.cc:1067] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:00.209380 14278 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:45:00.243865 14278 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.244277 14278 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:00.238607  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.250092  8974 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:00.238806  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:00.219561 13925 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.223847 14288 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.089s
I20260925 16:45:00.187220 14269 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.240639 14093 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.241813 14268 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.250890  9693 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.261509  9694 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260925 16:45:00.264101  9694 pending_rounds.cc:76] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 9
I20260925 16:45:00.264443  9694 pending_rounds.cc:97] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260925 16:45:00.264752  9694 raft_consensus.cc:2866] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:00.265194  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.260658  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.266664  8969 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:00.255098  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.259932  9695 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260925 16:45:00.268813  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.233s (SENT)
I20260925 16:45:00.269464  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.252736  9696 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260925 16:45:00.268476  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.271612  8975 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:45:00.260391  9041 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:00.221122 14103 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.038s
W20260925 16:45:00.276057 14223 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.091s	user 0.020s	sys 0.018s
I20260925 16:45:00.258759 14227 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.267846  8970 raft_consensus.cc:2362] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13. Re-sending same reply.
I20260925 16:45:00.282961  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2459) took 2214 ms. Trace:
I20260925 16:45:00.247299 14234 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.276948  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.258272 14244 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:00.282053  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.291225  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.291385  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.281543  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.292585  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.293581  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.294342  8968 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:00.295866  8972 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:00.279054  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.292918  8969 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:45:00.284907  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74624.1us
I20260925 16:45:00.257915 14261 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:00.289206  8966 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:00.283864  8970 rpcz_store.cc:276] 0925 16:44:58.068629 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.229575 (+2160946us) service_pool.cc:227] Handling call
0925 16:45:00.282890 (+ 53315us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:00.298110  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68254.5us
I20260925 16:45:00.299468  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.301271  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.282202 14241 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:00.304219  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.305486  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.307224  8973 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.305972  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.308377  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.305352  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.314494  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.318645  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.319232  8972 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:00.319945  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.320030  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.320569  8970 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:00.323079  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.296880 14143 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:45:00.323943  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.327816  9696 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:45:00.330999  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.334496  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.334807  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.335767  8972 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:00.303987 13789 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.340219  9050 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:45:00.336946  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.338451  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.313230 14248 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:00.306303 14244 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:00.349560  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:00.353147 14304 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260925 16:45:00.353422  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.353925 14122 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.355849 14289 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.027s
I20260925 16:45:00.293783 14227 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.358906 14227 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.360352 14093 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.326028 14190 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260925 16:45:00.361599 14190 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:00.296057 14151 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260925 16:45:00.361918 14190 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:00.325868 14263 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.362680 14190 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.364406 14266 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:00.313591 14075 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260925 16:45:00.366829 14244 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.367211 14244 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:00.346058  8968 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:00.374818  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.347957  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:45:00.291369 13925 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260925 16:45:00.344691  9041 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260925 16:45:00.378886  8973 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:00.381748  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.384997  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.389372 14312 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:00.389853 14312 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:00.390159 14312 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.390486 14149 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.328558 14233 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.337579 14134 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:00.330435 14143 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:00.394351  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.383512  9693 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:00.326781 14291 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:00.372123 14248 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.397214  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.397287  9119 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Stepping down as leader of term 7
I20260925 16:45:00.413041  8968 raft_consensus.cc:2362] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12. Re-sending same reply.
I20260925 16:45:00.413165  9119 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:00.397979  9118 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
W20260925 16:45:00.399303  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46526us
I20260925 16:45:00.400110  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.401898  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:00.305817 14261 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.404709  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:00.418555  9119 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.421564  9693 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:00.422040  9119 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 7 FOLLOWER]: Advancing to term 8
I20260925 16:45:00.406172  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:00.395740 14190 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:00.411064  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.349743 14094 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:00.415974  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:00.395314  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.402618  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:00.443957  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.444185  9666 leader_election.cc:398] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:00.445295  9666 leader_election.cc:401] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:00.445235  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.445788  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.445875  9124 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:00.411042 14291 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:00.454499 14291 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:00.455225 14301 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260925 16:45:00.443248 14094 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:00.456491 14094 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.457106  8968 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260925 16:45:00.458284  8968 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260925 16:45:00.411247 14143 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:00.460089  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:00.452282  9693 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:00.475387  9700 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:00.475557  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:00.443393  8973 raft_consensus.cc:2362] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16. Re-sending same reply.
I20260925 16:45:00.462635  9042 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260925 16:45:00.470904  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.472678  8972 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260925 16:45:00.477267  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:00.416285 14248 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:00.481719  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.389004 14278 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.414518 14122 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.494776  9042 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260925 16:45:00.497488  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77088.2us
I20260925 16:45:00.498733  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:00.480362 14308 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260925 16:45:00.513521  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:00.515142  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55129.8us
I20260925 16:45:00.469378 13806 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.497188 14018 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:00.477025 14258 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.586663  9693 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260925 16:45:00.559427  9119 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260925 16:45:00.402297 14233 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.588294  9119 pending_rounds.cc:76] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:45:00.515376 14268 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:00.614975  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 137779us
I20260925 16:45:00.492750 14227 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260925 16:45:00.559005 14140 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:00.505908 14113 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260925 16:45:00.641736  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 128243us
I20260925 16:45:00.595755  9119 pending_rounds.cc:97] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260925 16:45:00.627427  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:00.642882  9119 raft_consensus.cc:2866] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:00.643610  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:00.631244  8972 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260925 16:45:00.644256  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.633013  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.584508 14269 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:00.559921 14040 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.612416 14241 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.618607 14141 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.617655 14043 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:00.570736 14234 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.058s
I20260925 16:45:00.665815  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.675549  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.680271  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.683450  8972 raft_consensus.cc:2396] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260925 16:45:00.672204 14043 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:00.684326 14317 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:00.684644 14043 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.690711  9043 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:00.726814  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.621618 13930 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.056s
I20260925 16:45:00.727850  8968 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:00.662329 14266 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:00.673522 14149 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:00.727849 14315 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:45:00.768172  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.728677 14018 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:00.789768 14216 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.234s
I20260925 16:45:00.790174 14332 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:45:00.790896 14332 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:00.791278 14332 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:00.774191 14277 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:00.792263 14277 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:00.793102 14277 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.679461 14141 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.796164 14217 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:00.796708 14217 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.797564 14141 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.797760 14040 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.798660 14217 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.799852  8973 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
W20260925 16:45:00.799993 14324 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260925 16:45:00.800212  8973 pending_rounds.cc:76] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 10
I20260925 16:45:00.800460  8973 pending_rounds.cc:97] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260925 16:45:00.800694  8973 raft_consensus.cc:2866] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:45:00.801826 14316 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260925 16:45:00.736397 14241 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:00.791767 14318 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.208s	user 0.000s	sys 0.001s
I20260925 16:45:00.774621  8972 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8.
W20260925 16:45:00.774545 14314 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:45:00.816493  9693 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:45:00.782271  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.818692  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.822016 14258 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:00.824338  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.825006  8972 raft_consensus.cc:2362] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 8. Re-sending same reply.
W20260925 16:45:00.825763  8970 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.503s	user 0.006s	sys 0.001s
W20260925 16:45:00.810250 14320 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260925 16:45:00.827090 14043 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.825711 14278 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:00.825750  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.826086  8970 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:00.829285  8972 raft_consensus.cc:2362] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10. Re-sending same reply.
I20260925 16:45:00.829663  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.831573  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:00.809548 14179 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.644s	user 0.009s	sys 0.000s
I20260925 16:45:00.833972  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:00.836741  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:00.841914  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:00.842324  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 198804us
I20260925 16:45:00.843847  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:00.820951  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.839875  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.854744  9701 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:00.854682  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.856297  8972 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 13: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:00.861004  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.876257  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.876166  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.877350  8970 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:00.810405 14127 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.832374 14261 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.808225 14244 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.803661 14094 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.887200  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.812271 14248 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.893324  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.889191  8968 raft_consensus.cc:2362] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14. Re-sending same reply.
I20260925 16:45:00.820046 14241 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:00.939096  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.939536  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.940026 14241 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:00.940348  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.940878  8968 raft_consensus.cc:2362] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14. Re-sending same reply.
I20260925 16:45:00.880180 14302 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:00.940987 14241 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:00.941716  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:00.941881 14241 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:00.942277 14241 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:00.942752  8968 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:00.940361  8970 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:00.943456  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.947069  8968 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:00.951587  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.840574 14179 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.958226  9050 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:00.958719  9050 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:00.944840  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:00.961045  8972 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 11. (term mismatch)
I20260925 16:45:00.961634  8972 pending_rounds.cc:76] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 10
I20260925 16:45:00.886819 14233 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:00.893143 14317 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:00.951860 14241 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:00.962405  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62438.6us
I20260925 16:45:00.961872  8972 pending_rounds.cc:97] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260925 16:45:00.974300  8972 raft_consensus.cc:2866] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:45:00.992959  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 304458us
I20260925 16:45:00.973815  9050 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:00.893219 14288 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260925 16:45:00.888753 14071 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.078s
I20260925 16:45:01.010294  9121 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:01.010955  9048 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:01.008913  8970 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:01.010327  9042 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 15. Ops: []
I20260925 16:45:01.023113  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:01.023792  9123 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:01.026762  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:01.027869  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 184139us
I20260925 16:45:01.029106  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:00.966125 14188 raft_consensus.cc:2741] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260925 16:45:00.968532 14043 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:01.036568  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 182248us
W20260925 16:45:01.027232 14315 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260925 16:45:01.040992  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 154901us
I20260925 16:45:01.043231  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:01.050472  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:00.895591 14018 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:01.064462  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 177567us
I20260925 16:45:01.035655 14313 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:01.131934  9701 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
W20260925 16:45:01.132670  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 100193us
I20260925 16:45:01.171272 14179 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.107896 14093 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:01.174264  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.055297 14288 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:01.052182 13930 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.094s
W20260925 16:45:01.164395 14334 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.235s	user 0.000s	sys 0.001s
I20260925 16:45:01.168555  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1188) took 1511 ms. Trace:
I20260925 16:45:01.172470  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.196298  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:01.154021  9123 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:01.154412 14244 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.199672  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:01.184137  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:01.155791 14318 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260925 16:45:01.186988  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:01.160120  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 102769us
I20260925 16:45:01.194047  9115 rpcz_store.cc:276] 0925 16:44:59.686709 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:59.686828 (+   119us) service_pool.cc:227] Handling call
0925 16:44:59.687182 (+   354us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:59.831451 (+144269us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:59.831493 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:59.834203 (+  2710us) log.cc:842] Serialized 26 byte log entry
0925 16:44:59.938386 (+104183us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:44:59.938458 (+    72us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:01.164841 (+1226383us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b5400166054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:01.168084 (+  3243us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:01.168142 (+    58us) raft_consensus.cc:1671] finished
0925 16:45:01.168155 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:01.168464 (+   309us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":545,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"spinlock_wait_cycles":332830336,"thread_start_us":102776,"threads_started":1,"wal-append.queue_time_us":280845}
I20260925 16:45:01.204439  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:01.204607  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:01.186425 14288 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:01.211419 14344 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
I20260925 16:45:01.193379 13925 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:45:01.243811  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:01.218324 14326 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260925 16:45:01.223862 14179 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:01.172165 14317 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.222882 14349 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:01.294147 14349 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:01.295219 14349 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:01.291582 14347 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260925 16:45:01.300761  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:01.301656  9041 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:01.303247  9041 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:45:01.253260 14288 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:01.267628 14248 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:01.188051 14313 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.314037 14313 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:01.315721 14332 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.524s	user 0.009s	sys 0.000s
I20260925 16:45:01.316250 14332 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.318643 14332 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.320261 14241 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:01.282557 14291 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.828s	user 0.011s	sys 0.000s
I20260925 16:45:01.322299 14291 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:01.323487  9122 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260925 16:45:01.325340  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:01.254055 13925 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:01.290655 13806 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260925 16:45:01.291334 14353 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260925 16:45:01.292258 14338 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.145s	user 0.000s	sys 0.001s
I20260925 16:45:01.255077 14232 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:01.293074 14351 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260925 16:45:01.292963 14352 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:01.262306 14142 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:01.244200 14287 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:01.339685  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:01.323583 14312 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.912s	user 0.007s	sys 0.003s
W20260925 16:45:01.344379  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146685us
I20260925 16:45:01.349864  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:01.361409  9123 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:01.278697 14277 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:01.341223 13925 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:01.366094  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2473) took 1069 ms. Trace:
I20260925 16:45:01.363624  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:01.346750 14094 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.379869  9123 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:01.385324  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:01.384580  8966 rpcz_store.cc:276] 0925 16:45:00.296433 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.397096 (+100663us) service_pool.cc:227] Handling call
0925 16:45:00.418842 (+ 21746us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:00.510998 (+ 92156us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:45:00.873608 (+362610us) log.cc:842] Serialized 14 byte log entry
0925 16:45:01.191676 (+318068us) log.cc:842] Serialized 14 byte log entry
0925 16:45:01.198824 (+  7148us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:01.199512 (+   688us) log.cc:842] Serialized 52 byte log entry
0925 16:45:01.199717 (+   205us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:01.199944 (+   227us) log.cc:842] Serialized 14 byte log entry
0925 16:45:01.365664 (+165720us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:01.365781 (+   117us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:01.365828 (+    47us) raft_consensus.cc:1671] finished
0925 16:45:01.365849 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:01.366026 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":347380,"prepare.queue_time_us":553427,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":11461,"raft.queue_time_us":122889,"raft.run_cpu_time_us":303,"raft.run_wall_time_us":300,"spinlock_wait_cycles":1408,"thread_start_us":449366,"threads_started":3,"wal-append.queue_time_us":411223}
I20260925 16:45:01.368237 14283 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:01.530788 14364 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.182s
I20260925 16:45:01.349141 14288 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.533967 14288 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:01.538335  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:01.539345  9695 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:01.524295 14094 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:01.554929  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2937) took 1110 ms. Trace:
I20260925 16:45:01.555379  9124 rpcz_store.cc:276] 0925 16:45:00.444560 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.494899 (+ 50339us) service_pool.cc:227] Handling call
0925 16:45:00.495307 (+   408us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:00.514716 (+ 19409us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.558658 (+ 43942us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:00.583938 (+ 25280us) log.cc:842] Serialized 52 byte log entry
0925 16:45:00.857248 (+273310us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:00.857302 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:00.857388 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:01.554710 (+697322us) raft_consensus.cc:1671] finished
0925 16:45:01.554728 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:01.554873 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17422,"raft.queue_time_us":8213,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":42215,"thread_start_us":236918,"threads_started":1,"wal-append.queue_time_us":416100}
I20260925 16:45:01.368207 14312 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:01.520872 14142 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:01.545315 14143 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.031s	user 0.008s	sys 0.004s
W20260925 16:45:01.565729  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 361351us
I20260925 16:45:01.553153 14027 raft_consensus.cc:979] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:01.570274  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:01.571058  8966 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:01.572647  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.573361  8969 raft_consensus.cc:2354] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:45:01.578154  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:01.579070  8974 raft_consensus.cc:2396] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 14 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260925 16:45:01.582332  9695 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:01.585346  9045 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:01.586174  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.586519  8966 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:45:01.588271  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.589651  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.590591  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:01.590966  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.577476 14232 raft_consensus.cc:1067] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:01.591943  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.575361 14094 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:01.596920  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.630074  9124 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:01.571623 14143 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:01.607439  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:01.608175  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.591677  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.588177 14291 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:01.573346 14142 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.646876  9124 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260925 16:45:01.637362  9015 leader_election.cc:398] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:45:01.637861  8974 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:01.637846  9123 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:01.647830  9015 leader_election.cc:401] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260925 16:45:01.609143  8966 raft_consensus.cc:2362] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14. Re-sending same reply.
I20260925 16:45:01.638736  8968 raft_consensus.cc:2362] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11. Re-sending same reply.
I20260925 16:45:01.649326  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:01.649514  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:01.651556  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.652218  8966 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:01.652112  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.653534  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:01.628799 14373 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:01.658648  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.645032 14372 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.669497  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.669461  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:01.670677  8971 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:01.672298  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2474) took 1375 ms. Trace:
I20260925 16:45:01.677479  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.672745  8967 rpcz_store.cc:276] 0925 16:45:00.296739 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.418242 (+121503us) service_pool.cc:227] Handling call
0925 16:45:00.421324 (+  3082us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:00.424264 (+  2940us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.424291 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:00.424646 (+   355us) log.cc:842] Serialized 26 byte log entry
0925 16:45:00.641110 (+216464us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:01.205295 (+564185us) log.cc:842] Serialized 14 byte log entry
0925 16:45:01.671994 (+466699us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:01.672069 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:01.672111 (+    42us) raft_consensus.cc:1671] finished
0925 16:45:01.672124 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:01.672248 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":275887,"prepare.queue_time_us":492997,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":8247,"raft.queue_time_us":19648,"raft.run_cpu_time_us":264,"raft.run_wall_time_us":55081,"thread_start_us":854134,"threads_started":3,"wal-append.queue_time_us":356899}
I20260925 16:45:01.681614 14280 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:01.657563 14027 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:01.657426 14317 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:01.666110 14369 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
I20260925 16:45:01.655071 14241 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:01.796638  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 139655us
W20260925 16:45:01.797477  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125864us
I20260925 16:45:01.798460  8971 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:01.803409  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:01.671689 14043 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:01.803057  8966 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:01.671582 14343 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260925 16:45:01.745898 14321 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260925 16:45:01.740300 13806 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:45:01.808833  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.814510 14376 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:01.815726 14302 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260925 16:45:01.831427  8974 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:01.819063 14360 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:01.821414 14362 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.816864 14381 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:01.840744  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.678784 14244 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.132s
I20260925 16:45:01.842128  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:01.802659 14288 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:01.846815  9118 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:01.850883  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:01.832563 14375 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260925 16:45:01.861253  8974 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:01.740353 14094 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:01.866006 14288 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.874058 14288 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:01.836889 14349 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:01.874837 14349 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:01.827121 14232 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.875347 14349 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.875686 14232 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.843495 14381 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:01.872341 14027 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.854135 14343 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:01.844762 14312 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.864498 14376 consensus_queue.cc:1225] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 13.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260925 16:45:01.804226 14241 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.672813 14372 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.879431  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:01.871057 14370 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.310s	user 0.000s	sys 0.001s
I20260925 16:45:01.658170 14373 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.863538 14364 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.881099 14349 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:01.868323  9118 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:01.880831 14027 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.890668 14343 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:01.897949  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1261) took 1065 ms. Trace:
I20260925 16:45:01.899279  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:01.846840 14360 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.845137 14362 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:01.901948  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:01.882833 14381 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:01.901356  9702 rpcz_store.cc:276] 0925 16:45:00.832976 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.833155 (+   179us) service_pool.cc:227] Handling call
0925 16:45:00.869713 (+ 36558us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:00.893435 (+ 23722us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.893471 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:00.893913 (+   442us) log.cc:842] Serialized 26 byte log entry
0925 16:45:01.251915 (+358002us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:01.251957 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:01.252028 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:01.897736 (+645708us) raft_consensus.cc:1671] finished
0925 16:45:01.897770 (+    34us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:01.897893 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5112,"raft.queue_time_us":273872,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":31713,"thread_start_us":247454,"threads_started":1,"wal-append.queue_time_us":423546}
I20260925 16:45:01.905910  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:01.893996 14143 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:01.909559 13806 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
W20260925 16:45:01.889430 14371 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260925 16:45:01.916394  8974 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:01.919581  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:01.908420 14142 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:01.900547 14364 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:01.928599 14378 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260925 16:45:01.930207 14288 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.931047 14288 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.935077 14027 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.936555 14373 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:01.938694 14258 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.939369 14258 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:01.940387 14380 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260925 16:45:01.945290 14134 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:01.946226 14134 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:01.948122 14343 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:01.930310 14377 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260925 16:45:01.914868 14302 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:01.964648 14302 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.975989 14232 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:01.978197 14216 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:01.977263 14134 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:01.980633 14311 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:01.980962  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2805) took 1600 ms. Trace:
I20260925 16:45:01.981992  9122 rpcz_store.cc:276] 0925 16:45:00.380719 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.382558 (+  1839us) service_pool.cc:227] Handling call
0925 16:45:00.386177 (+  3619us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:01.323908 (+937731us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:01.980724 (+656816us) spinlock_profiling.cc:243] Waited 937 ms on lock 0x7b54001c9154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:01.980911 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2154970496}
I20260925 16:45:01.920997 13806 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:01.978603 14216 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:01.990906  9695 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:01.992223  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:01.979525 14134 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:01.993280  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:01.992707  9122 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:02.003888  9046 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:01.984959 13785 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:02.012708 13785 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.014875 13785 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.017966  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.018699  9118 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:01.990486 14132 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:02.020814 14132 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.024005 14132 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.024273 14302 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:01.985301 14373 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:02.028915  9697 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
I20260925 16:45:02.026554  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.028162  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:01.994581 14364 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:01.990105 14027 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:02.030196  9696 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:02.002746 14230 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:02.043025  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.041388  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.046846  9701 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:02.045838  9693 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:45:02.030704 14138 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.992s	user 0.024s	sys 0.006s
I20260925 16:45:02.058998  9702 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:02.058902  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:01.985118 14311 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.037132 14372 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.036628 14043 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:02.036405 14094 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260925 16:45:02.056773 14216 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:02.061685 14138 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 2.021s	user 0.025s	sys 0.006s
W20260925 16:45:02.075251  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 155778us
W20260925 16:45:02.061158 13925 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.683s	user 0.011s	sys 0.002s
I20260925 16:45:02.057006 14217 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:02.081399  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:02.079339  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74149.7us
I20260925 16:45:02.037366 14373 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.081679  8974 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260925 16:45:02.068364 13806 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.087153  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.084513 14388 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:45:02.063361 14230 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:02.065442 14360 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.097805  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.057307 14027 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.088508 13925 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.074466 14362 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.085059 14389 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:02.100565  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.091383 14216 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:02.113837  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.096168 14173 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:02.077721 14043 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.103446 14388 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:02.106006 14241 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.110301 14389 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:02.124109  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1913) took 1991 ms. Trace:
I20260925 16:45:02.120855  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.129626  9116 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:02.087870 14217 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.130450  9044 rpcz_store.cc:276] 0925 16:45:00.132755 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.132853 (+    98us) service_pool.cc:227] Handling call
0925 16:45:00.133117 (+   264us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:00.133416 (+   299us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.133442 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:01.981291 (+1847849us) spinlock_profiling.cc:243] Waited 2.33 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:45:01.989815 (+  8524us) log.cc:842] Serialized 26 byte log entry
0925 16:45:02.052774 (+ 62959us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:02.116390 (+ 63616us) log.cc:842] Serialized 14 byte log entry
0925 16:45:02.116586 (+   196us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.116668 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:02.116712 (+    44us) raft_consensus.cc:1671] finished
0925 16:45:02.123834 (+  7122us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.123967 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9248,"raft.queue_time_us":346,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":20040,"spinlock_wait_cycles":7343104,"thread_start_us":104989,"threads_started":2,"wal-append.queue_time_us":40119}
I20260925 16:45:02.125113 13883 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:02.139261  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:02.140328  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49002.6us
I20260925 16:45:02.144155  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.116765 14286 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:02.148772 14027 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.149242 14043 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.112963 14362 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260925 16:45:02.124475 14173 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.153821 14230 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.137645 14389 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.157547  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.159725  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.119817 14288 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.152782 14311 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.168672 14373 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.172989  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.171518  9702 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:02.174362 13925 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.142143 13883 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.180503  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1899) took 1565 ms. Trace:
I20260925 16:45:02.177457  9118 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:45:02.188084  8973 rpcz_store.cc:276] 0925 16:45:00.615748 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.620415 (+  4667us) service_pool.cc:227] Handling call
0925 16:45:00.657622 (+ 37207us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:00.801061 (+143439us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.180234 (+1379173us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.180454 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":326196480}
I20260925 16:45:02.188774  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.191030  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:02.182351  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:02.183749  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.156392 14388 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.194224 14311 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260925 16:45:02.201812 14311 consensus_queue.cc:1225] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 11.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260925 16:45:02.176635 14233 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:02.180648 14108 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:02.205804  8966 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:02.207103  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.208781 14108 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.210891 14108 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.214277 14287 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:02.214680 14287 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.215592 14287 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.195079 13883 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.216868  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2471) took 1922 ms. Trace:
I20260925 16:45:02.217211 13883 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.217247  8975 rpcz_store.cc:276] 0925 16:45:00.294846 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.352466 (+ 57620us) service_pool.cc:227] Handling call
0925 16:45:00.352729 (+   263us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:00.412911 (+ 60182us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:01.020789 (+607878us) log.cc:842] Serialized 14 byte log entry
0925 16:45:01.361278 (+340489us) log.cc:842] Serialized 14 byte log entry
0925 16:45:01.361522 (+   244us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:01.361566 (+    44us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:01.361609 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:01.614207 (+252598us) spinlock_profiling.cc:243] Waited 4.57 ms on lock 0x7b1800153a00. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:02.216167 (+601960us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b1800153a00. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9
0925 16:45:02.216589 (+   422us) spinlock_profiling.cc:243] Waited 59.9 ms on lock 0x7b54003c46d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.216636 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.216802 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":578949,"prepare.queue_time_us":627526,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":2614,"raft.queue_time_us":1949,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":17477,"spinlock_wait_cycles":156406784,"thread_start_us":519227,"threads_started":2,"wal-append.queue_time_us":563568}
I20260925 16:45:02.220037  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.220834  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2809) took 1824 ms. Trace:
I20260925 16:45:02.221189  9121 rpcz_store.cc:276] 0925 16:45:00.395961 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.396105 (+   144us) service_pool.cc:227] Handling call
0925 16:45:00.396511 (+   406us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.018420 (+621909us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.220609 (+1202189us) spinlock_profiling.cc:243] Waited 614 ms on lock 0x7b54001eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.220777 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1411130112}
I20260925 16:45:02.222895  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1257) took 1639 ms. Trace:
I20260925 16:45:02.223258  9698 rpcz_store.cc:276] 0925 16:45:00.583359 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.583495 (+   136us) service_pool.cc:227] Handling call
0925 16:45:00.594418 (+ 10923us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:00.615336 (+ 20918us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.615367 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:00.615409 (+    42us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:00.615440 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.222700 (+1607260us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b5400532354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.222741 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.222848 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":47624576}
I20260925 16:45:02.226052 14317 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:45:02.198392 14173 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.205394 14233 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.228037 14233 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.229130 14233 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.196211 14258 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:02.233120 14271 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 2.460s	user 0.002s	sys 0.009s
I20260925 16:45:02.234261 14258 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:02.235313  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:02.236436  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45519.6us
I20260925 16:45:02.236649  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.252223  9049 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:02.249527  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:45:02.253756  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 975) took 3284 ms. Trace:
I20260925 16:45:02.254117  9047 rpcz_store.cc:276] 0925 16:44:58.960315 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:58.960437 (+   122us) service_pool.cc:227] Handling call
0925 16:44:59.025444 (+ 65007us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:44:59.025694 (+   250us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:44:59.025728 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:44:59.026240 (+   512us) log.cc:842] Serialized 26 byte log entry
0925 16:44:59.562549 (+536309us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:44:59.562598 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:44:59.562698 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:02.232438 (+2669740us) spinlock_profiling.cc:243] Waited 15.1 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:02.236412 (+  3974us) raft_consensus.cc:1671] finished
0925 16:45:02.236432 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.244370 (+  7938us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34740480,"thread_start_us":290007,"threads_started":1,"wal-append.queue_time_us":614317}
I20260925 16:45:02.244138 14390 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260925 16:45:02.263497  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91405.4us
I20260925 16:45:02.267166  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.208330 14381 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.272464  8967 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:02.273450 14381 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.252333 14160 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:02.274595 14160 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.276880  8973 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:45:02.280851  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.276973 14160 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.284588  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:02.284797  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.286957  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.280602 14390 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:02.289870 14390 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:02.293170  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2800) took 1917 ms. Trace:
I20260925 16:45:02.293678  9116 rpcz_store.cc:276] 0925 16:45:00.375325 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.376701 (+  1376us) service_pool.cc:227] Handling call
0925 16:45:00.377050 (+   349us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:02.136628 (+1759578us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.292887 (+156259us) spinlock_profiling.cc:243] Waited 1.75 s on lock 0x7b540007e254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.293099 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4030146432}
I20260925 16:45:02.295373  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.297672 14317 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:02.288662 14216 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:02.304091  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.310268  9044 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:02.314884  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:02.315586  9047 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 8. Current term is 9. Ops: []
I20260925 16:45:02.314738 14216 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.319866 14216 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.300699 14389 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.321934 14389 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.323599  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.323462  9046 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:02.324201  9116 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.317201 14272 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:02.298203 14317 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.327556  9695 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:02.327008 14272 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:02.330720 14103 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:45:02.331236 14272 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:02.335680 14390 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.339109  9050 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.338639  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.340226  9047 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:02.340021  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:02.341146  8966 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:02.341518  8966 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.343951  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:55054 (request call id 2914) took 2006 ms. Trace:
I20260925 16:45:02.344393  9050 rpcz_store.cc:276] 0925 16:45:00.339955 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.340108 (+   153us) service_pool.cc:227] Handling call
0925 16:45:02.337999 (+1997891us) spinlock_profiling.cc:243] Waited 617 ms on lock 0x7b54001707d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf21da7 00007f71a0e6dee0 00007f719a55f784 00007f719a55f712 00007f719a55f641 00007f719a55f5bc 00007f719a55e872 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:02.339505 (+  1506us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1419952384}
I20260925 16:45:02.345537  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.346355  9121 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:02.346953  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:02.342453  8966 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:02.337150 14141 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.407s	user 0.011s	sys 0.020s
W20260925 16:45:02.349720 14141 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.449s	user 0.011s	sys 0.020s
I20260925 16:45:02.350596  8966 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:02.354552  9041 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260925 16:45:02.326769 14349 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:02.356518 13930 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:02.364542 13930 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:02.369796  8968 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:02.369123  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.360755 14349 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.369845 13930 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:02.371533  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.372660 14349 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.363932  9121 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:02.365607 14317 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.376824  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.378369  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:02.379942 14103 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:02.380579 14103 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.381697 14103 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.383458  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:02.376073  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.393318  9118 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:02.394187  9118 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:43572
I20260925 16:45:02.394430  9116 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:02.394836  9118 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:02.395328  9118 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:02.397217 14317 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:02.397771 14317 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.398981 14317 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.400472 14402 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:45:02.400868 14402 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.401574 14402 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.403789 14390 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.389825  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.408756  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2923) took 1590 ms. Trace:
I20260925 16:45:02.409045 14267 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:02.409505 14267 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:02.409149  9048 rpcz_store.cc:276] 0925 16:45:00.817954 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.818065 (+   111us) service_pool.cc:227] Handling call
0925 16:45:00.818356 (+   291us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.026914 (+208558us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.408538 (+1381624us) spinlock_profiling.cc:243] Waited 192 ms on lock 0x7b54002a3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.408698 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":442556800}
I20260925 16:45:02.410010 14267 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.410593  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2922) took 1593 ms. Trace:
I20260925 16:45:02.410946  9042 rpcz_store.cc:276] 0925 16:45:00.817197 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.817320 (+   123us) service_pool.cc:227] Handling call
0925 16:45:00.817596 (+   276us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.019505 (+201909us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.410392 (+1390887us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54001707d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.410541 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":442877824}
I20260925 16:45:02.413198  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:02.414783 14149 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:02.415122 14149 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:02.415457 14149 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.415865 14368 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:02.416450 14368 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.419422 14368 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.426192  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.431563  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.432339  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1255) took 1962 ms. Trace:
I20260925 16:45:02.434119  9044 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:02.434026  9700 rpcz_store.cc:276] 0925 16:45:00.469728 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.469866 (+   138us) service_pool.cc:227] Handling call
0925 16:45:00.475150 (+  5284us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:00.480530 (+  5380us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.432052 (+1951522us) spinlock_profiling.cc:243] Waited 4.9 ms on lock 0x7b540066dd50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:02.432265 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":11261696}
I20260925 16:45:02.428684  8966 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:02.420094  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:02.429168  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.430253  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.422914  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1252) took 2125 ms. Trace:
I20260925 16:45:02.441481  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:02.441247  9694 rpcz_store.cc:276] 0925 16:45:00.297578 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.297712 (+   134us) service_pool.cc:227] Handling call
0925 16:45:00.299576 (+  1864us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:00.329850 (+ 30274us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.329896 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:00.372913 (+ 43017us) log.cc:842] Serialized 26 byte log entry
0925 16:45:00.887455 (+514542us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:00.887509 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.422534 (+1535025us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b540062f2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.422581 (+    47us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:02.422642 (+    61us) raft_consensus.cc:1671] finished
0925 16:45:02.422655 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.422859 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4793,"raft.queue_time_us":5527,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":9489,"spinlock_wait_cycles":46587136,"thread_start_us":475503,"threads_started":1,"wal-append.queue_time_us":638681}
I20260925 16:45:02.438176  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.443584  9700 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:02.444307  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.445075 14386 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260925 16:45:02.446799  8970 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260925 16:45:02.447441 14342 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:02.447968 14342 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:02.448355 14342 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:02.453193 14381 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:02.439373  9118 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.464213  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.466817  9121 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:02.468990  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.472121  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.483374  9118 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.483806  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.381879 13930 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.501322  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.484864  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.419642 14217 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.462051 14270 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
W20260925 16:45:02.500953  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88458.2us
I20260925 16:45:02.487653  9665 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.514544  9116 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:02.519032  9121 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:45:02.520251  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.524194 14230 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:02.524669 14368 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:02.525239 14270 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.526266 14270 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.528082  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.530370  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.528927 14368 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:02.532943 14368 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:02.533479 14368 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:02.544386 14140 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:02.545765 14388 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:45:02.546113 14388 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:02.546008 13930 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.548250  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.549333 14368 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.549729 14149 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.551180 14410 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:02.551589 14410 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:02.551940 14410 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.552330 14368 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.552453  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.553982 14267 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.591598  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.592427  9042 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:02.593940  9121 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260925 16:45:02.547226 14388 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.555804  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.596074 14388 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:02.559878 14410 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.598235 14410 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.565793 14287 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:02.600775 14093 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:02.566676 14230 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:02.575794  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2924) took 1757 ms. Trace:
I20260925 16:45:02.603827  9045 rpcz_store.cc:276] 0925 16:45:00.818717 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.818827 (+   110us) service_pool.cc:227] Handling call
0925 16:45:00.819066 (+   239us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.588608 (+769542us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.575512 (+986904us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b54001bfdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.575730 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1761860992}
I20260925 16:45:02.530220 14349 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260925 16:45:02.589494 14374 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:02.605158 14374 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.605973  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:02.606608  9702 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.606038 14374 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.590843  9046 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 8. Current term is 9. Ops: []
I20260925 16:45:02.608114  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.611542  9046 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:02.616117  9042 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:02.619371  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:02.614202  8921 placement_policy_util.cc:244] tablet c694676902c54ad8bfe8e7fd5a725e33: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260925 16:45:02.622843  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:02.623824  9700 raft_consensus.cc:2354] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:45:02.620782 14342 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.621650  9702 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:02.626883  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.628341  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:02.622223  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:02.629966  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.631605  9042 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:02.607386 14374 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.637159  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2911) took 2433 ms. Trace:
I20260925 16:45:02.637887  9043 rpcz_store.cc:276] 0925 16:45:00.204630 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.204742 (+   112us) service_pool.cc:227] Handling call
0925 16:45:00.205000 (+   258us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:00.691209 (+486209us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.636913 (+1945704us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b54000bf9d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:02.637086 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1116478848}
I20260925 16:45:02.620787 14358 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:02.635421 14372 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:02.635900 14387 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:02.648273  9700 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:02.570375 14272 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.639438 14103 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:02.639206 14227 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:02.649973 14372 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.661999  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:02.657379  9042 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:02.652254 14387 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.670229  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:02.660619 14372 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:02.671820  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.673008  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.632479 14132 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260925 16:45:02.677559 14145 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:02.678194 14145 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:02.679426 14387 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.679126 14145 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.681008  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.681632  9043 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:02.684530  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:02.632961 14230 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260925 16:45:02.688321  9044 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:02.690485  9695 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:45:02.666146 14149 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.693292  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.670444 14342 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.728197  8974 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:02.652771 14311 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260925 16:45:02.731488  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.733793  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.734436  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:02.690315 14258 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:02.736698  9699 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:02.755131  8973 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:02.758286  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:02.768410 14277 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:02.769004 14277 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:02.776427  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.80691e+06us
I20260925 16:45:02.778595  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.781126  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.745410 14258 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:02.777741 14248 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260925 16:45:02.793346  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:02.794613 14269 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:02.797876  9694 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:02.800362  9702 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:02.802702  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2820) took 1166 ms. Trace:
I20260925 16:45:02.803078  9119 rpcz_store.cc:276] 0925 16:45:01.636427 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:01.636668 (+   241us) service_pool.cc:227] Handling call
0925 16:45:01.639912 (+  3244us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.640064 (+   152us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:45:01.642366 (+  2302us) log.cc:842] Serialized 14 byte log entry
0925 16:45:02.802408 (+1160042us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:02.802457 (+    49us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:02.802495 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.802555 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.802653 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1159726,"prepare.queue_time_us":64462,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54}
I20260925 16:45:02.804450  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.807212  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.808284  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.809931  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2826) took 1037 ms. Trace:
I20260925 16:45:02.810262  9124 rpcz_store.cc:276] 0925 16:45:01.772226 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:01.801895 (+ 29669us) service_pool.cc:227] Handling call
0925 16:45:01.802208 (+   313us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.802440 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:01.828144 (+ 25704us) log.cc:842] Serialized 14 byte log entry
0925 16:45:02.809633 (+981489us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:02.809678 (+    45us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:02.809719 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.809776 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.809884 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":981243,"prepare.queue_time_us":29654,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43}
I20260925 16:45:02.809801  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:02.812337  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.821123  9698 raft_consensus.cc:2354] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:45:02.821426  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.822001  9119 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.838251  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.805254 14258 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.847498  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.856457  9119 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:02.859388  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:02.859579  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45562.5us
I20260925 16:45:02.860394 14272 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:02.860682  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.861658 14151 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:02.862099  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.862540  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:02.863056 14151 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.864249  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:02.864382 14149 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:02.822726 14341 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:02.865304 13883 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:02.864589 14270 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:02.863456  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:02.867623  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.868904  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:02.869210  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:02.859675  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.831089 14075 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:02.871393  9124 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 10: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:02.823796 14267 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:02.872267  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.873050  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.873562  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:02.882699  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:02.883471 14149 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:02.883512 13883 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260925 16:45:02.883004 14422 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
I20260925 16:45:02.884593 14149 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:02.884648 13883 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:02.885082 14149 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.885169 13883 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.886015 14149 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.886924  9124 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:02.887279 14149 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.882105 14313 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260925 16:45:02.886188 13883 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.889815 13883 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:02.888886 14313 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:45:02.883224  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:02.897987  9124 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [10.6-10.6]
I20260925 16:45:02.899212  9016 leader_election.cc:398] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12.
I20260925 16:45:02.871304 14261 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:02.871136 14341 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:02.900883 14018 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:02.880235 14263 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:02.905512  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.909217  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.911403  9124 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:02.912322  9041 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:02.914170 14286 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.917490  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.871788 14142 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:02.929818  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:02.936076  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.938314  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:02.939499  9042 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:02.940267  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2810) took 2544 ms. Trace:
I20260925 16:45:02.916386 14018 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260925 16:45:02.926928 14335 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.017s
I20260925 16:45:02.934177 14402 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:02.954342 14332 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:45:02.954849 14332 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:02.931844 14142 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.957837 14142 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.963322 14277 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.965217 14277 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:02.907732 14270 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.030s
I20260925 16:45:02.972500 14270 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:02.972976 14270 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:02.973793 14270 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.975625 14270 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:02.976904 14227 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.978258 14151 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:02.978727 14311 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:02.979080 14132 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:02.979578 14132 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:02.980885 14360 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:02.981745 14360 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:02.981280 14132 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.982064 14360 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:02.975627  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 326640us
W20260925 16:45:02.980074  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 199710us
I20260925 16:45:02.985364 14118 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:02.986111  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:02.987322 14118 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:02.978178 14227 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.983192 14360 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:02.999636 14360 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:03.001937  9043 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:02.988233  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:02.977058  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 305284us
I20260925 16:45:03.004885  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:03.005640  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2815) took 2191 ms. Trace:
I20260925 16:45:03.006009  9117 rpcz_store.cc:276] 0925 16:45:00.814468 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.814628 (+   160us) service_pool.cc:227] Handling call
0925 16:45:00.815022 (+   394us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:02.756289 (+1941267us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:02.756316 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:02.783642 (+ 27326us) log.cc:842] Serialized 26 byte log entry
0925 16:45:03.005327 (+221685us) raft_consensus.cc:1631] Marking committed up to 5
0925 16:45:03.005363 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.005426 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:03.005465 (+    39us) raft_consensus.cc:1671] finished
0925 16:45:03.005474 (+     9us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:03.005588 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1986356,"raft.queue_time_us":1941783,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":18297,"thread_start_us":162712,"threads_started":1,"wal-append.queue_time_us":191178}
I20260925 16:45:02.975746 14103 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:03.010087 14103 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:02.979101 14311 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:03.013736 14311 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.015156 14311 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:02.995949  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:03.017910  9116 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:02.974253 14332 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.024197  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.025791  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2824) took 1352 ms. Trace:
I20260925 16:45:02.983300 14132 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:03.045531  9122 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:45:03.046581  9122 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:03.046949  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:03.051966  9122 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.033502  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.036427  9044 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:45:03.038215  9043 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:03.042032 14281 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 8 current term: 8 is higher.
I20260925 16:45:03.040346  9123 rpcz_store.cc:276] 0925 16:45:01.673306 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:01.673484 (+   178us) service_pool.cc:227] Handling call
0925 16:45:01.680060 (+  6576us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:02.778000 (+1097940us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:02.778030 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:02.778437 (+   407us) log.cc:842] Serialized 26 byte log entry
0925 16:45:03.025344 (+246907us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:03.025395 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.025541 (+   146us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:03.025595 (+    54us) raft_consensus.cc:1671] finished
0925 16:45:03.025611 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:03.025734 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1147640,"raft.queue_time_us":1099048,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":8606,"thread_start_us":246624,"threads_started":1,"wal-append.queue_time_us":228613}
I20260925 16:45:03.052781  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:03.030658  9117 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:03.028077 14341 raft_consensus.cc:2741] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election decision vote started in defunct term 10: won
I20260925 16:45:03.077039  9117 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:03.028153 14233 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:03.063321  9122 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:03.082053  9116 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:45:03.093997  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:03.094591  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:03.099395  9043 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:03.103780  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 57643.2us
W20260925 16:45:03.108381  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49547.9us
I20260925 16:45:03.111336 13842 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:03.112001  9123 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260925 16:45:03.111876 13842 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.113891 13842 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:03.114050 14093 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:03.095369 14018 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260925 16:45:03.117384 14018 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:03.117731 14018 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:03.118561 14018 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.120051 14141 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:03.123179  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:03.058225 14388 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:03.092243 14263 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:03.091857 14138 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:03.123744  9702 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:03.092849 14410 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:03.058350 14140 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260925 16:45:03.131239  9122 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260925 16:45:03.101001 14217 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:03.131198  9117 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.150753  9117 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:03.123978 14388 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.170018  9043 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:03.099118 14291 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260925 16:45:03.106091 14075 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.051s
I20260925 16:45:03.139931 14018 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:03.200269  9117 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:45:02.941011  9120 rpcz_store.cc:276] 0925 16:45:00.396303 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:00.399812 (+  3509us) service_pool.cc:227] Handling call
0925 16:45:00.400114 (+   302us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:00.413748 (+ 13634us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:00.413775 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:00.417679 (+  3904us) log.cc:842] Serialized 52 byte log entry
0925 16:45:00.636989 (+219310us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:00.773133 (+136144us) log.cc:842] Serialized 14 byte log entry
0925 16:45:02.750739 (+1977606us) spinlock_profiling.cc:243] Waited 939 us on lock 0x7b18004b6b80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:02.751230 (+   491us) log.cc:842] Serialized 14 byte log entry
0925 16:45:02.937548 (+186318us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:02.937643 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:02.940074 (+  2431us) raft_consensus.cc:1671] finished
0925 16:45:02.940098 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:02.940217 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":124188,"prepare.queue_time_us":135556,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":84,"raft.queue_time_us":1998653,"raft.run_cpu_time_us":344,"raft.run_wall_time_us":19776,"spinlock_wait_cycles":20852736,"thread_start_us":261186,"threads_started":2,"wal-append.queue_time_us":298585,"wal-append.run_cpu_time_us":2504,"wal-append.run_wall_time_us":1034015}
I20260925 16:45:03.179656 14151 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:03.184919 14286 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:03.143674 14093 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
I20260925 16:45:03.219843 14358 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260925 16:45:03.222716 14258 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.223771 14151 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.225855 14151 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:03.206203 14075 consensus_queue.cc:1225] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:45:03.208647 14339 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:45:03.230654  9041 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:03.232304 14388 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:03.245244  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.145659 14138 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.177557 14368 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
W20260925 16:45:03.255008  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 468917us
I20260925 16:45:03.257277  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.197009 14374 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260925 16:45:03.239542 14332 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:03.241494 14269 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:03.243955 14339 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:03.303716 14395 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.528s	user 0.027s	sys 0.035s
I20260925 16:45:03.290866 14269 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.346494  9699 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:45:03.346696 14258 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:03.320423 14395 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.027s	sys 0.035s
I20260925 16:45:03.348817 14395 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.349283 14395 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.349677 14258 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:03.350148 14258 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.408303  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:03.409086  9700 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:03.410221  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:03.407389 14395 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:03.414389 14132 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:03.340380 14339 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.461028 14132 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:03.483358 14149 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.580s	user 0.008s	sys 0.003s
I20260925 16:45:03.480679 14132 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:03.488576 14258 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:03.483686 14395 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.485677 14339 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:45:03.503113  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 394096us
W20260925 16:45:03.502858  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 408908us
I20260925 16:45:03.506523  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:03.507128  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:03.510944  9044 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260925 16:45:03.510850  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:03.505782 14227 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.025s	sys 0.037s
I20260925 16:45:03.516167  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:03.517849  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.518587  9042 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:03.520572 14277 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260925 16:45:03.516036 14227 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.515s	user 0.025s	sys 0.037s
I20260925 16:45:03.497952 14395 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.502823 14258 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:03.529352  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.514611 14388 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:03.516206 14142 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.541440  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.555964  9043 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:03.533676 14357 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:03.562915  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.563771  9044 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:03.533291 14446 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:03.569957  8974 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260925 16:45:03.570768  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:03.573282  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.574064  8972 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:03.579921  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.577414  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.549904 14388 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:03.598037  8974 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260925 16:45:03.568106 14440 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260925 16:45:03.534847 14258 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.603361 14141 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.603492 14117 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:03.606505 14410 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:03.609548  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:03.617470  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:03.552960 14142 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.600178 14358 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:03.615329 14141 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.629801  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:03.618779 14446 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:03.663867 14258 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:03.660955 14390 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.667273  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.619210 14277 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:03.626683 14357 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:03.632942 14438 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.144s	user 0.000s	sys 0.001s
W20260925 16:45:03.659178 14442 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260925 16:45:03.691576  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2988) took 1087 ms. Trace:
W20260925 16:45:03.701221 14445 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260925 16:45:03.669162 14118 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:03.695351  9121 rpcz_store.cc:276] 0925 16:45:02.603792 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:02.605920 (+  2128us) service_pool.cc:227] Handling call
0925 16:45:02.606182 (+   262us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:02.920326 (+314144us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:02.920374 (+    48us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:02.924215 (+  3841us) log.cc:842] Serialized 26 byte log entry
0925 16:45:03.241310 (+317095us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:03.241365 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.243166 (+  1801us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:03.691376 (+448210us) raft_consensus.cc:1671] finished
0925 16:45:03.691393 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:03.691522 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":179804,"raft.queue_time_us":195387,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":450751,"threads_started":2,"wal-append.queue_time_us":500023}
I20260925 16:45:03.709093  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.690357 14258 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:03.724908  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 192415us
I20260925 16:45:03.673492 14390 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:03.716718 14358 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:03.720880 14357 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:03.740756  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.741425  8972 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
W20260925 16:45:03.734172 14452 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260925 16:45:03.744516  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:03.746845  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:03.749328  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:03.766794  8968 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
W20260925 16:45:03.739598  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 160010us
I20260925 16:45:03.723142 14395 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:03.763827  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.764503  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.770690  8969 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:03.773777  8967 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 8. Current term is 9. Ops: []
I20260925 16:45:03.774844  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:03.776674  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.780608  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:03.782192  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:03.785259  8971 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260925 16:45:03.786909  8970 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:03.788774  8969 raft_consensus.cc:2354] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11.
I20260925 16:45:03.673830 14446 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.797509  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:03.798489 14018 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.592s	user 0.010s	sys 0.000s
I20260925 16:45:03.798673  8967 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:45:03.799350  9117 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 13. (term mismatch)
I20260925 16:45:03.799690  9117 pending_rounds.cc:76] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 12
I20260925 16:45:03.799932  9117 pending_rounds.cc:97] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 18.13
I20260925 16:45:03.800159  9117 raft_consensus.cc:2866] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:03.797526  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:03.801353 14450 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260925 16:45:03.801898  8974 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10. Ops: []
I20260925 16:45:03.803503  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.804888  8969 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:03.697655 14388 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.741024 14117 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.809123  8967 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: [10.8-10.8]
I20260925 16:45:03.813437  8972 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:03.726253 14258 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.718307 14118 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.732481 14335 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260925 16:45:03.822309  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:03.828188 14446 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:03.832242  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:03.836340  9698 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:03.847761  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:03.741250 14358 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:03.857048  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 595489us
I20260925 16:45:03.861317  9089 leader_election.cc:398] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:03.861515  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.862797  9118 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260925 16:45:03.865080  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.866309  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:03.867112  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 107382us
I20260925 16:45:03.858404  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:03.868418  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 145618us
I20260925 16:45:03.869154  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.874274  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.870932  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2989) took 1263 ms. Trace:
I20260925 16:45:03.872532  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 2958) took 2226 ms. Trace:
I20260925 16:45:03.872431  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:03.878492  9698 raft_consensus.cc:2396] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:03.879565  9123 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:03.880885  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:03.875380  9119 rpcz_store.cc:276] 0925 16:45:02.607067 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:02.908918 (+301851us) service_pool.cc:227] Handling call
0925 16:45:02.916619 (+  7701us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:02.917090 (+   471us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:02.917117 (+    27us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:02.933651 (+ 16534us) log.cc:842] Serialized 52 byte log entry
0925 16:45:03.260623 (+326972us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:45:03.290539 (+ 29916us) log.cc:842] Serialized 14 byte log entry
0925 16:45:03.854984 (+564445us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b180049a020. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:03.855367 (+   383us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.855476 (+   109us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:03.855537 (+    61us) raft_consensus.cc:1671] finished
0925 16:45:03.855650 (+   113us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:03.870868 (+ 15218us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1674,"prepare.queue_time_us":31311,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2062,"raft.queue_time_us":565896,"raft.run_cpu_time_us":240,"raft.run_wall_time_us":4318,"spinlock_wait_cycles":3950848,"thread_start_us":320736,"threads_started":1,"wal-append.queue_time_us":523700}
I20260925 16:45:03.888208  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.875484  9115 rpcz_store.cc:276] 0925 16:45:01.646604 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:01.646726 (+   122us) service_pool.cc:227] Handling call
0925 16:45:01.646985 (+   259us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:01.647161 (+   176us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:01.712506 (+ 65345us) log.cc:842] Serialized 14 byte log entry
0925 16:45:02.939893 (+1227387us) log.cc:842] Serialized 14 byte log entry
0925 16:45:03.872231 (+932338us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:03.872274 (+    43us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:03.872329 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.872391 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:03.872487 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1584374,"prepare.queue_time_us":231131,"prepare.run_cpu_time_us":111,"prepare.run_wall_time_us":113,"raft.queue_time_us":1070599,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":14740,"spinlock_wait_cycles":4620672,"thread_start_us":628326,"threads_started":3,"wal-append.queue_time_us":551295}
I20260925 16:45:03.823509 14117 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.851433 14317 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:03.892120 14122 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:03.862037 14142 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:03.892629 14217 consensus_meta.cc:287] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.716s	user 0.008s	sys 0.003s
I20260925 16:45:03.868655 14141 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:03.876852 14248 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:03.893926  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.894996  9089 leader_election.cc:398] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:03.875366 14127 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:03.892464 14313 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.913170  9119 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:03.899793 14122 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:03.871925 14337 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260925 16:45:03.896257 14332 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.002s
I20260925 16:45:03.913074  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:03.907115  9089 leader_election.cc:401] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260925 16:45:03.900717 14455 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.001s
I20260925 16:45:03.901247 14190 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:45:03.917544  8968 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:03.904589 14390 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:03.903843 14217 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:03.986980  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.987033  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.992863  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:03.994971  9043 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:03.996052  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:03.996237 14269 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:03.989085  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 94205us
I20260925 16:45:03.998358  9089 leader_election.cc:398] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11.
I20260925 16:45:03.998649  9089 leader_election.cc:401] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260925 16:45:03.895772 14437 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.099s
I20260925 16:45:04.003957  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:04.004261 14463 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.005144  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.006745 13842 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:04.006876 14118 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.007336 13842 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:03.918413 14141 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.004808 14463 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.008208 14258 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:03.989115 14332 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:04.010242 14018 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:04.009930 14463 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:45:04.011031 14141 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.011530 14358 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.012164 14446 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:03.973711 14376 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.012624 14446 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.012831 14376 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.014770 14376 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.007467 14118 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:03.896137 14132 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:03.916102 14248 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:03.975224  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 205344us
I20260925 16:45:04.016678  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.017482  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:04.017970  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.014820 14446 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.020294  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:04.020790  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:04.026706  8966 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:03.918306 14122 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:03.991775  9046 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:04.030231  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.032418  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:03.996265 14464 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260925 16:45:04.044713  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.051012  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:03.900987 14317 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.011053 14390 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.053259  8973 raft_consensus.cc:2354] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:04.055972  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:04.052510  9046 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:45:03.918999 14313 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.086690  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:04.039179 14281 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:04.031531 14261 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11.
I20260925 16:45:04.036424 14437 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:04.038688 14118 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:04.034186 13883 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:45:04.061359 14142 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:04.135478  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.136441  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.038985 14471 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260925 16:45:04.033241 14217 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:04.139524  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.117991 14459 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:45:04.121327 14473 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260925 16:45:04.149003  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.124400 14376 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:04.174966 14376 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:04.117612 14337 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:04.121292 14395 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:04.144599  9123 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:04.187517  9123 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:04.188401  9123 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.189287  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.189656  9123 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:04.141039 13925 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.014s
I20260925 16:45:04.142177 13883 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:04.148838 13842 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:04.152637 14410 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:04.154081 14339 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.656s	user 0.007s	sys 0.004s
I20260925 16:45:04.116252 14390 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.156762 14317 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.164178 14132 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.167572 14138 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.169322 14141 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.172693 14313 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.173997 14248 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:04.144836 14449 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.175449 14376 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:04.202360  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 333231us
I20260925 16:45:04.257874 14357 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:04.259634 14358 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.181160 14227 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.159495 14018 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:04.283799  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:04.285121  9123 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 8. (term mismatch)
I20260925 16:45:04.288741  9123 pending_rounds.cc:76] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 7
I20260925 16:45:04.289105  9123 pending_rounds.cc:97] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 13.8
I20260925 16:45:04.289546  9123 raft_consensus.cc:2866] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:04.292694  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.293555  9115 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
W20260925 16:45:04.295238  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 258199us
I20260925 16:45:04.300077  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.267598 14117 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.304411  9123 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:04.265398 13842 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.306164 14476 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:04.306701 14476 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:04.307047 14476 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:04.307628 13842 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.308346 14313 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:04.310010  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1922) took 1385 ms. Trace:
I20260925 16:45:04.310341  9041 rpcz_store.cc:276] 0925 16:45:02.924389 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:02.925074 (+   685us) service_pool.cc:227] Handling call
0925 16:45:02.925533 (+   459us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:03.254653 (+329120us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:04.309792 (+1055139us) spinlock_profiling.cc:243] Waited 305 ms on lock 0x7b5400126e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:04.309957 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":701178112}
I20260925 16:45:04.188817 14337 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.319060  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.322386  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:04.324599  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 270551us
I20260925 16:45:04.329487  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.333628  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.287943 14357 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:04.348076  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:04.351797  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 333880us
I20260925 16:45:04.357052  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.360865  8971 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: [14.13-14.13]
I20260925 16:45:04.361901  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.363021  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.364075  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:04.357750  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:04.364164  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.368363  9041 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260925 16:45:04.368717  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.363641  8975 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:04.372020  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:04.372520  9044 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:04.368436  8969 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:04.299710 14465 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260925 16:45:04.287797 14449 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.302172 14141 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.047s
I20260925 16:45:04.376283  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:04.377563  9693 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260925 16:45:04.379321  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:04.380172  9698 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:04.383608  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.384267  8970 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:04.406308  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:04.343596 14372 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.467841  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:04.300211 14227 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.303412 14358 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.465816  9044 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:04.470059  9694 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:04.522656  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:04.459512  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 69847.9us
I20260925 16:45:04.540499  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:04.541450  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 165240us
I20260925 16:45:04.369889 14075 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:04.339687 14471 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.120s
I20260925 16:45:04.458962 14339 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:04.525086 14261 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.334717 14463 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260925 16:45:04.604403  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.375015 14374 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.608146  9701 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:04.588711  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:04.369686 14481 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:04.468853 14132 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.603566 14093 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260925 16:45:04.650182  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:04.346478 14332 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.139s
I20260925 16:45:04.366140 13925 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.180s
I20260925 16:45:04.669440  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:04.376394 14018 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.274s
W20260925 16:45:04.733170  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83086.2us
I20260925 16:45:04.677879  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:04.678093  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1452) took 1676 ms. Trace:
I20260925 16:45:04.603642 14269 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:04.734102  9041 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
W20260925 16:45:04.688591  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 100005us
I20260925 16:45:04.345911 13883 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.655857  8971 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260925 16:45:04.726444 14337 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.734678  9699 rpcz_store.cc:276] 0925 16:45:03.001689 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.001863 (+   174us) service_pool.cc:227] Handling call
0925 16:45:03.050275 (+ 48412us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:03.347101 (+296826us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:04.677860 (+1330759us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:04.678036 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":680184064}
I20260925 16:45:04.468833 14281 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.245s
W20260925 16:45:04.715899 14477 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.433s	user 0.000s	sys 0.001s
I20260925 16:45:04.525787 14372 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:04.741501  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 383170us
I20260925 16:45:04.679200 14138 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:04.717669 14481 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:04.719982 14339 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:04.549458 14357 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.686852 14261 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.789099  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:04.799664 14469 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.497s	user 0.001s	sys 0.000s
I20260925 16:45:04.810359  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1939) took 1058 ms. Trace:
I20260925 16:45:04.810808  8966 rpcz_store.cc:276] 0925 16:45:03.751733 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.774566 (+ 22833us) service_pool.cc:227] Handling call
0925 16:45:04.810205 (+1035639us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540036f954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:04.810295 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":560036736}
I20260925 16:45:04.811265  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:04.740765 14075 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:04.789917  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:04.738442 14117 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:04.736093 14269 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:04.729131 14132 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.765437 14481 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:04.795596  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:04.824891  9702 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 14
W20260925 16:45:04.796319 14480 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
W20260925 16:45:04.795104 14432 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
W20260925 16:45:04.796808 14122 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.741s	user 0.007s	sys 0.003s
I20260925 16:45:04.796974 14018 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:04.797459 14493 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260925 16:45:04.765540 14453 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.096s	user 0.001s	sys 0.003s
I20260925 16:45:04.760828 14494 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.798187 14449 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:04.798365 14491 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:45:04.798761 14437 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.783361 14138 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.745941 14190 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.714905 14374 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.757917 14337 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:04.801718 14484 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
W20260925 16:45:04.809748 14443 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.309s	user 0.007s	sys 0.011s
I20260925 16:45:04.800707 14328 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.859288 14273 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.799999 14390 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.804067 14489 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.799907 14357 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:04.810170 14261 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:04.799685 14358 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.817317 14311 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:04.820775 14461 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.831569 14269 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:04.828626 14456 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.860589 14493 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:04.882513 14337 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.903163 14489 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.906818 14489 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.868392 14494 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.908000 14456 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.909932 14494 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:04.879142 14437 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.910624 14456 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.801147 14388 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:04.867635 14465 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:04.912690 14388 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.912834 14465 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.915336 14388 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:04.896540 14374 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:04.887990 14339 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:04.899068 14372 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:04.900054 14476 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.587s	user 0.000s	sys 0.011s
I20260925 16:45:04.941941 14476 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.944825 14476 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.915763 14465 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:04.814236  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56216.7us
W20260925 16:45:05.034763  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.006s	sys 0.009s
W20260925 16:45:05.035416  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.006s	sys 0.010s
W20260925 16:45:05.035907  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 675757us
I20260925 16:45:05.035967  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:05.037890  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:05.039393  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:05.041277  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:04.817735  9046 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:04.789462  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:04.858219  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:05.065631  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 207366us
I20260925 16:45:04.800293  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:04.853523  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:04.828105 14075 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.820207 14093 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260925 16:45:05.107549  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:04.896683 14132 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.108635  9121 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:04.881345 14190 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:05.109297  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 287722us
I20260925 16:45:04.897675 14227 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:04.899848 14273 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.112622  9118 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 15. Ops: []
I20260925 16:45:04.902558 14311 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.116346 14311 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:04.893210 14328 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.930131 14337 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:04.859272 14122 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.874603 14018 consensus_queue.cc:1225] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260925 16:45:05.060201  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3004) took 1836 ms. Trace:
I20260925 16:45:05.060588 14138 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.060890 13883 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.069787 14388 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:04.936076 14437 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:05.157202 14522 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.157472 14122 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.157683 13883 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.903748 14461 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:05.072104  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 323448us
I20260925 16:45:05.160650 14388 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.161983 14461 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.072284 14465 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.163903 14465 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:04.903553 14493 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:05.165340 14337 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.166535 14337 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.159226 14522 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.087141 14267 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:05.168699  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48828us
I20260925 16:45:05.097011  9698 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:05.104542 14349 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:05.172343 14190 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.105401  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.123261 14449 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:05.173626 14449 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.125226  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.174038 14449 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:05.174368  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.174925  9116 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:05.175748 14456 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:05.176098  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.176424 14456 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.176903 14456 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:05.177902 14248 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:05.178925  9116 raft_consensus.cc:2396] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260925 16:45:05.179283 14261 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:05.125800 14390 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:05.180766 14390 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.181243 14390 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:05.127252 14494 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.173997 14522 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.127390 14489 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.167585 14465 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.143959 14490 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.128773 14339 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.185417 14494 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.185864 14339 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.187834  9123 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:05.189057 14339 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:05.131268  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.185463 14490 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.191154  9124 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:05.142931 14513 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.192236 14513 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.195343 14513 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.140128  9122 rpcz_store.cc:276] 0925 16:45:03.223379 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.223499 (+   120us) service_pool.cc:227] Handling call
0925 16:45:03.225730 (+  2231us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:03.226088 (+   358us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:03.226123 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:03.226542 (+   419us) log.cc:842] Serialized 26 byte log entry
0925 16:45:03.575322 (+348780us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:03.575374 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.575459 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:04.459567 (+884108us) spinlock_profiling.cc:243] Waited 1.88 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:05.059412 (+599845us) raft_consensus.cc:1671] finished
0925 16:45:05.059457 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:05.059937 (+   480us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":324,"raft.run_cpu_time_us":70,"raft.run_wall_time_us":70,"spinlock_wait_cycles":4328832,"thread_start_us":348453,"threads_started":1,"wal-append.queue_time_us":426087}
I20260925 16:45:05.145696 14479 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.199204 14479 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.200521  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.202488  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.115272 14273 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.148140  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.098358 14476 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:05.163051 14505 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.087013 14517 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.205857  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.205724 14505 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.206549 14517 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.173228 14190 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.170310 14267 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.208395 14190 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.210511 14267 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.210698 14190 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.172392 14349 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.211208 14349 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:05.211956 14505 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.184149 14489 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:05.213423 14516 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
W20260925 16:45:05.147305  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1021) took 1574 ms (client timeout 1884 ms). Trace:
I20260925 16:45:05.128017 14511 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:04.834724 14117 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.172122 14018 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.216171 14511 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.209678 14517 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.217521 14117 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.217211 14018 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.196276 14494 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:05.087353 14518 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.213054 14503 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.219390 14518 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.220293 14503 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.222025 14518 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.222976 14503 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:05.195477  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44621us
I20260925 16:45:05.143316  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.224586  9701 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:05.225852  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:05.228394  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:05.215500  8973 rpcz_store.cc:269] 0925 16:45:03.573144 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.577129 (+  3985us) service_pool.cc:227] Handling call
0925 16:45:05.146597 (+1569468us) spinlock_profiling.cc:243] Waited 449 ms on lock 0x7b54001e2b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:05.147021 (+   424us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1033569664}
I20260925 16:45:05.231648 14328 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.232033  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.233027  9696 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:05.234014 13925 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:05.234416 13925 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.237037  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.238049  9701 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 9.
I20260925 16:45:05.234520  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.239571  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.240011  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.241029  9693 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:05.218587 14511 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.237146 13925 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:05.241068  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65652us
I20260925 16:45:05.195807 14490 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.204792  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.250927 14132 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.251796 14132 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.252413  9122 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:05.253252  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:05.253433  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 92702.8us
I20260925 16:45:05.249455  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.215317 14489 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.261287  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.265827 14127 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:05.266505 14127 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.267036 14127 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:05.268442  9044 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:45:05.272807  9702 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:05.273322  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.205682 14479 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:05.280457  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 97381.9us
I20260925 16:45:05.292879  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.260118 14476 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:05.279287 14376 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.980s	user 0.001s	sys 0.016s
I20260925 16:45:05.247856 14449 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:05.300290  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44613.2us
I20260925 16:45:05.290673 14273 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:05.327245  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.327991  9702 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
W20260925 16:45:05.332377 14444 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.871s	user 0.008s	sys 0.015s
I20260925 16:45:05.333657  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:05.336485 14376 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:05.338410 14457 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.513s	user 0.009s	sys 0.011s
I20260925 16:45:05.339156 14376 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.293037 14489 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:05.340119 14489 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.340700 14489 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:05.341593 14485 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.734s	user 0.001s	sys 0.001s
I20260925 16:45:05.323944 13883 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.313160 14132 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.316576  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.300946 14018 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.347543  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:05.348953 14495 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.549s	user 0.001s	sys 0.000s
I20260925 16:45:05.349500  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.277813 14349 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:05.351298 14482 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.552s	user 0.001s	sys 0.000s
I20260925 16:45:05.351991 14349 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.353194  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1247) took 2037 ms. Trace:
W20260925 16:45:05.353907 14487 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.556s	user 0.000s	sys 0.001s
I20260925 16:45:05.317417 14286 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.356288 14286 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.318215  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.319377  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.358356  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.359182  9048 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:45:05.360224  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:05.361435  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.362619  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.362782 14273 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:05.321350  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:05.363974  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52766.8us
I20260925 16:45:05.364667  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.364934  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.365630  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.365892  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.366430  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.358424  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.367118  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.367358  9047 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:05.368387  8972 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
W20260925 16:45:05.368886  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 76108us
I20260925 16:45:05.323956 14341 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:05.369549 14341 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:05.320330  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.370707  9041 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:05.361258  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.371672 14525 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:45:05.371889  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:05.372658  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 521113us
I20260925 16:45:05.372756  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.363270  9700 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:05.373613  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.321152  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.372169 14525 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.379385 14018 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:05.392593 14286 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.375826  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.374500 14132 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:05.378522  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.378933  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.353765  9120 rpcz_store.cc:276] 0925 16:45:03.315316 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.315496 (+   180us) service_pool.cc:227] Handling call
0925 16:45:03.315978 (+   482us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:03.893553 (+577575us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:03.893582 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:03.897802 (+  4220us) log.cc:842] Serialized 26 byte log entry
0925 16:45:04.271773 (+373971us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:04.271810 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:04.271876 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:05.350364 (+1078488us) spinlock_profiling.cc:243] Waited 20.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:05.352519 (+  2155us) raft_consensus.cc:1671] finished
0925 16:45:05.352554 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:05.352955 (+   401us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":577181,"raft.queue_time_us":577616,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":4317,"spinlock_wait_cycles":47447424,"thread_start_us":283857,"threads_started":1,"wal-append.queue_time_us":883243}
I20260925 16:45:05.370800 14341 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.379730  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.378855  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.381199  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1022) took 1858 ms. Trace:
I20260925 16:45:05.353964 14449 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.386600  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.340911 14388 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:05.391158  9701 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:05.378575  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.403280  9700 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:05.392669 14525 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:05.404197  9123 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 8.
I20260925 16:45:05.394503  9121 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:05.410676  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.413316  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.397137  9042 rpcz_store.cc:276] 0925 16:45:03.523150 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.523320 (+   170us) service_pool.cc:227] Handling call
0925 16:45:03.523624 (+   304us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:03.531265 (+  7641us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:03.531305 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:03.539292 (+  7987us) log.cc:842] Serialized 52 byte log entry
0925 16:45:03.691975 (+152683us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:03.692016 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:03.692112 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:05.337069 (+1644957us) spinlock_profiling.cc:243] Waited 8 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:05.380725 (+ 43656us) raft_consensus.cc:1671] finished
0925 16:45:05.380746 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:05.381012 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6975,"raft.queue_time_us":6485,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":3865,"spinlock_wait_cycles":19826432,"thread_start_us":122156,"threads_started":1,"wal-append.queue_time_us":263780}
I20260925 16:45:05.407862 14018 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.418387 14018 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.420603 14018 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.410935  9697 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:05.430743 14075 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.432412  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.433151  9045 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:05.436213 14432 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:05.436618 14432 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:05.437585 14432 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.439085 14432 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:05.439808  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:05.440136  9696 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:45:05.440455  8968 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:05.440871  8971 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:05.441826  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:05.442488  8971 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:05.443259  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.452162 14341 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:05.455778  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.456215  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.457544  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:05.458462  9699 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:05.458842 14269 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.554s	user 0.011s	sys 0.011s
I20260925 16:45:05.460515 14337 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:05.462069 14357 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.559s	user 0.008s	sys 0.008s
I20260925 16:45:05.462420  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:05.443388  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3a3bc92ca0a4efa913eca1800a1550d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 12 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:05.444449  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.465391  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.466125  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.466572  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.467587  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.468251  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.469009 14142 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:05.469408 14142 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.469746 14142 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:05.472988  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1068) took 1090 ms. Trace:
I20260925 16:45:05.473747 14075 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:45:05.473441  9698 rpcz_store.cc:276] 0925 16:45:04.382121 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:04.384409 (+  2288us) service_pool.cc:227] Handling call
0925 16:45:04.384673 (+   264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:05.171862 (+787189us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.472693 (+300831us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b54006eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:05.472911 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1584054144}
I20260925 16:45:05.474413 14075 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.474964 14075 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:05.476594  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.479498 14337 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:05.479954  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.428598 14190 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.481714 14190 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.395605 14311 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.446363  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.463017 14269 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.442495  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:05.469599  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:05.447870  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.471222  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.483667 14190 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:05.518879  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 8dc3391062084f45a6ba62d28d340722 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:05.488160  9117 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:05.484474  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:05.505262  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44792us
I20260925 16:45:05.511965  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.486733  9120 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:05.509039  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.496949  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.521271  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.508401  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:05.500886  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 167686us
I20260925 16:45:05.522312  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 13. Ops: []
I20260925 16:45:05.503374  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 2976) took 1491 ms. Trace:
I20260925 16:45:05.528069  9124 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:05.493599  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.501818  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2840) took 1628 ms. Trace:
I20260925 16:45:05.531759 14142 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.539353  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:05.508584  8872 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 2 to 6, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 6 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:05.540858  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 129048us
I20260925 16:45:05.479972 14337 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:05.535383  9118 rpcz_store.cc:276] 0925 16:45:03.873064 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:03.873279 (+   215us) service_pool.cc:227] Handling call
0925 16:45:05.100461 (+1227182us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:05.113255 (+ 12794us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.501644 (+388389us) spinlock_profiling.cc:243] Waited 1.19 s on lock 0x7b540019cdd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:05.501772 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2744377728}
I20260925 16:45:05.532130  9043 rpcz_store.cc:276] 0925 16:45:04.012096 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:04.021124 (+  9028us) service_pool.cc:227] Handling call
0925 16:45:04.037406 (+ 16282us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:04.279861 (+242455us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:04.279897 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:04.279935 (+    38us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:04.279980 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.502884 (+1222904us) spinlock_profiling.cc:243] Waited 242 ms on lock 0x7b54000a82d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:05.502945 (+    61us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:05.503171 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":557131520}
W20260925 16:45:05.499807 14481 consensus_meta.cc:287] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.006s
I20260925 16:45:05.502254  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.539660  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:05.548236  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.518627 14127 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.544962  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:05.550552  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:05.487115 14269 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.484094 14311 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:05.556021  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44206.2us
I20260925 16:45:05.552034  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:05.506721 14402 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.555217  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:05.554983  8975 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:05.541570 14337 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:05.541569  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.884s (SENT) [suppressed 28 similar messages]
I20260925 16:45:05.558604  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.561846  8872 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 10, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:05.574846  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:05.576762  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:05.579742 14494 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:45:05.579950 14103 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:05.580401 14494 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:05.581472 14494 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.583022  9121 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:05.584515 14127 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.585249 14410 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:05.585675 14410 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.585992 14410 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:05.586372  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.588219  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.588811  9118 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:05.589619  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.591997  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.558957 14481 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.595193 14481 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.595904 14496 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.596233  9695 raft_consensus.cc:2354] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11.
I20260925 16:45:05.596860 14481 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.596524 14496 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.597494  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1066) took 1221 ms. Trace:
I20260925 16:45:05.597343 14481 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.597849  9695 rpcz_store.cc:276] 0925 16:45:04.376432 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:04.376931 (+   499us) service_pool.cc:227] Handling call
0925 16:45:05.597258 (+1220327us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b54006905d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:05.597418 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2455702784}
I20260925 16:45:05.598834 14496 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.599397 14376 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:45:05.584570 14358 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:45:05.600055  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.600461 14358 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:05.600631 14481 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.600787  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:05.600965 14103 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:05.602082 14103 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.600189 14376 consensus_queue.cc:1225] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 9.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
I20260925 16:45:05.599255 14402 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.613696 14456 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:05.614631  8872 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:05.616089 14458 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:05.617004  8872 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 11, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 11 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:05.618338  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.619824  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2542) took 1210 ms. Trace:
I20260925 16:45:05.619880  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.621100  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.620290  8974 rpcz_store.cc:276] 0925 16:45:04.359914 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:04.367044 (+  7130us) service_pool.cc:227] Handling call
0925 16:45:04.367317 (+   273us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.017787 (+650470us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:05.085056 (+ 67269us) log.cc:842] Serialized 14 byte log entry
0925 16:45:05.376139 (+291083us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.497477 (+121338us) log.cc:842] Serialized 26 byte log entry
0925 16:45:05.497692 (+   215us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:05.498295 (+   603us) log.cc:842] Serialized 14 byte log entry
0925 16:45:05.510449 (+ 12154us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.527230 (+ 16781us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b54002cbad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:05.527275 (+    45us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:05.546466 (+ 19191us) raft_consensus.cc:1671] finished
0925 16:45:05.546492 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:05.570062 (+ 23570us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":86147,"prepare.queue_time_us":13565,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":97,"raft.queue_time_us":167149,"raft.run_cpu_time_us":261,"raft.run_wall_time_us":4383,"spinlock_wait_cycles":670171392,"thread_start_us":553949,"threads_started":3,"wal-append.queue_time_us":388145}
I20260925 16:45:05.622206  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.622514  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.622880  8972 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:05.623091  8974 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 9.
I20260925 16:45:05.568113 14018 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:05.510776 14489 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.513355 14075 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.579521 14341 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.049s
I20260925 16:45:05.569373  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.584681  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:05.624068  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.623672  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.630780  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.639500  8972 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:05.630822  9117 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:45:05.626072  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:05.641472  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91011.8us
I20260925 16:45:05.641477  9123 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:05.641456  9695 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:05.558142 14142 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.664400  9049 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:05.660928  9124 raft_consensus.cc:2396] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 10 because replica has last-logged OpId of term: 8 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
W20260925 16:45:05.661492  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 100904us
I20260925 16:45:05.668561  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.670595  9120 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:05.673866  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:05.607479 14402 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.628759 14358 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:05.625785 14489 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.673336  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:05.571780 14357 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.619047  8872 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:05.627962 14075 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.677398  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:05.684437  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.688481  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.688442  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:05.554124 14390 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:05.695636  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 138472us
I20260925 16:45:05.690150  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.673103 14311 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:05.696725  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.704449  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.706059  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:05.708280  9047 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 9: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:05.708714  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.624243 14018 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.711419  9045 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:05.714577  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:05.718382  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:05.725065  9044 raft_consensus.cc:2354] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
W20260925 16:45:05.732456  8871 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 341) took 40525 ms (client timeout 15000 ms). Trace:
I20260925 16:45:05.724876 14261 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:05.737371  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.706103 14402 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:05.702600 14456 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:05.710866 14142 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:05.693948 14341 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260925 16:45:05.768610  9090 leader_election.cc:398] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11.
I20260925 16:45:05.710593 14138 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:05.741657  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.778121  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.748382  8968 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260925 16:45:05.757265  8971 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:05.740144 14511 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:05.819221  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:05.700536 14357 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.745952  8872 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 11, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 11 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:05.836313  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.835588  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:05.837795  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63837us
W20260925 16:45:05.841483  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 300834us
I20260925 16:45:05.767227 14261 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:05.714288 14489 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.056s
W20260925 16:45:05.863245  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 144959us
W20260925 16:45:05.865190  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 139920us
W20260925 16:45:05.878616  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 132577us
I20260925 16:45:05.881700  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:05.885064  9695 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:05.882987  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:05.901748  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53827.1us
I20260925 16:45:05.820745 14402 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:05.909586  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:05.918294  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:05.919516  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:05.863956 14513 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:05.775799 14142 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:05.851274 14261 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:05.941252  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 103835us
W20260925 16:45:05.732919  8871 rpcz_store.cc:269] 0925 16:44:25.207291 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:25.210424 (+  3133us) service_pool.cc:227] Handling call
0925 16:44:26.606068 (+1395644us) spinlock_profiling.cc:243] Waited 9.63 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:45:05.732176 (+39126108us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:44:54.496249 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:44:54.496943 (+   694us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:44:54.497008 (+    65us) write_op.cc:435] Acquired schema lock
0925 16:44:54.497048 (+    40us) tablet.cc:660] Decoding operations
0925 16:44:54.498129 (+  1081us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:44:54.498237 (+   108us) write_op.cc:641] Partition lock acquired for write op
0925 16:44:54.498298 (+    61us) tablet.cc:683] Acquiring locks for 8 operations
0925 16:44:54.513658 (+ 15360us) tablet.cc:699] Row locks acquired
0925 16:44:54.513704 (+    46us) write_op.cc:260] PREPARE: finished
0925 16:44:54.513917 (+   213us) write_op.cc:270] Start()
0925 16:44:54.514092 (+   175us) write_op.cc:276] Timestamp: P: 1790354694513830 usec, L: 0
0925 16:44:54.514131 (+    39us) op_driver.cc:331] REPLICATION: starting
0925 16:44:54.545348 (+ 31217us) log.cc:842] Serialized 3223 byte log entry
0925 16:44:55.224015 (+678667us) op_driver.cc:444] REPLICATION: finished
0925 16:44:55.299454 (+ 75439us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f7198fe45fe 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719f93a410
0925 16:44:55.575046 (+275592us) write_op.cc:301] APPLY: starting
0925 16:44:55.581482 (+  6436us) tablet.cc:1365] starting BulkCheckPresence
0925 16:44:55.780243 (+198761us) tablet.cc:1368] finished BulkCheckPresence
0925 16:44:55.780289 (+    46us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:44:56.154541 (+374252us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:44:56.178323 (+ 23782us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0925 16:44:56.178369 (+    46us) write_op.cc:312] APPLY: finished
0925 16:44:56.178655 (+   286us) log.cc:842] Serialized 81 byte log entry
0925 16:44:56.456538 (+277883us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:56.501182 (+ 44644us) write_op.cc:454] Released schema lock
0925 16:44:56.521596 (+ 20414us) write_op.cc:341] FINISH: Updating metrics
0925 16:44:56.539554 (+ 17958us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:44:56.539583 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":8707243,"reported_tablets":47,"spinlock_wait_cycles":22140672,"child_traces":[["op",{"apply.queue_time_us":288111,"apply.run_cpu_time_us":40822,"apply.run_wall_time_us":1010999,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37519,"num_ops":8,"prepare.queue_time_us":116144,"prepare.run_cpu_time_us":47421,"prepare.run_wall_time_us":338241,"raft.queue_time_us":130357,"raft.run_cpu_time_us":13711,"raft.run_wall_time_us":145280,"replication_time_us":709798,"spinlock_wait_cycles":36366080,"thread_start_us":762194,"threads_started":5,"wal-append.queue_time_us":647387,"wal-append.run_cpu_time_us":26974,"wal-append.run_wall_time_us":2234876}]]}
I20260925 16:45:05.820995 14337 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:05.977078  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72797us
W20260925 16:45:05.972283  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83113.8us
W20260925 16:45:05.964953 14432 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.525s	user 0.014s	sys 0.000s
I20260925 16:45:05.999155  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:06.001080  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.001802  9120 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:05.950445 14345 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:05.849080 14138 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.010351  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:05.965804 14127 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:05.964119  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 84519.2us
I20260925 16:45:06.043900  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:05.971786 14261 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:06.022935 14448 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:45:06.050782  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 509184us
I20260925 16:45:06.023352 14093 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:06.024482 14527 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260925 16:45:06.024590 14337 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:05.982486 14341 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:06.024972 14141 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.194s
I20260925 16:45:06.025930 14360 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:06.027812 14446 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:06.016670 14339 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:06.036201  9116 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260925 16:45:06.036844  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 127354us
I20260925 16:45:06.038472 14458 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:06.038964 14489 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:06.009845  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:06.030984 14410 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.040226  8872 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.057950 14448 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:06.050114 14217 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:06.065490 14390 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:06.061983  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.098124  9120 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
W20260925 16:45:06.107992  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64201us
I20260925 16:45:06.112042  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.114709  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:06.105278  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 423147us
I20260925 16:45:06.077399 14511 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:06.122547  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.137971  8974 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:06.108894  8872 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 10, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 10 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:45:06.148552  8973 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.638s	user 0.013s	sys 0.057s
I20260925 16:45:06.109133 14448 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:06.070050 14456 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260925 16:45:06.152256  8973 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.014s	sys 0.057s
I20260925 16:45:06.130609  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.155074  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.065793 14402 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.156040  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.152992  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:06.154337  9089 leader_election.cc:398] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:06.154685  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:06.161482  9089 leader_election.cc:401] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:06.155778  9123 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:06.108359 14458 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.124811 14018 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.136658 14432 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:45:06.174763  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52303.1us
W20260925 16:45:06.174846  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 154727us
I20260925 16:45:06.146734 14337 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:06.103264 14093 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.069s
I20260925 16:45:06.155652 14512 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:06.120114 14341 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.156227 14390 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:45:06.176638 13925 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.883s	user 0.008s	sys 0.004s
I20260925 16:45:06.119879 14489 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.123478 14339 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.275066  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:06.270046  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:06.232275  8872 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.281920  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:06.186508 14512 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:06.147563 14446 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.142287 14494 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.037s
I20260925 16:45:06.178790 14481 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:06.250526  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:06.251633  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.262179  9119 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260925 16:45:06.180634 14357 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:06.179908 14395 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:06.211568 14127 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.154937 14360 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:06.180042 14493 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.826s	user 0.005s	sys 0.009s
I20260925 16:45:06.232081 14376 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:06.295287  8971 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
W20260925 16:45:06.283593 14525 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.800s	user 0.014s	sys 0.000s
I20260925 16:45:06.201488  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.299830  9119 pending_rounds.cc:76] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 5
I20260925 16:45:06.341580  9119 pending_rounds.cc:97] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260925 16:45:06.341806  8970 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: [13.13-13.13]
I20260925 16:45:06.341917  9119 raft_consensus.cc:2866] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:06.278093 14142 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.332155  8872 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 6 to 11, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 11 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.292578 14512 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.333891  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:06.355551  9701 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.015s	sys 0.034s
I20260925 16:45:06.288929 14390 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260925 16:45:06.262636 13925 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:06.345834  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 359242us
W20260925 16:45:06.340222 14317 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.016s	sys 0.052s
W20260925 16:45:06.345351  8967 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.070s
I20260925 16:45:06.338769 14481 raft_consensus.cc:2741] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
W20260925 16:45:06.362799  8967 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.858s	user 0.000s	sys 0.071s
I20260925 16:45:06.365849  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.385613  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1313) took 1023 ms. Trace:
I20260925 16:45:06.397785  9695 raft_consensus.cc:2354] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
W20260925 16:45:06.398939  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65148.4us
I20260925 16:45:06.399930  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:06.362534 14317 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.908s	user 0.017s	sys 0.052s
I20260925 16:45:06.366339  8872 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.338632 14493 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:06.446245  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46433.4us
I20260925 16:45:06.447192  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.348193 14525 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.367311 14410 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.451546  9048 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:06.445302  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:06.364921 14432 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:06.298882 14458 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.393685  9701 rpcz_store.cc:276] 0925 16:45:05.362616 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.411453 (+ 48837us) service_pool.cc:227] Handling call
0925 16:45:05.434616 (+ 23163us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:05.434962 (+   346us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:05.779653 (+344691us) log.cc:842] Serialized 14 byte log entry
0925 16:45:06.364080 (+584427us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:06.364146 (+    66us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:06.385241 (+ 21095us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.385356 (+   115us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.385535 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":660571,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":5985,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":26693,"thread_start_us":854473,"threads_started":2}
I20260925 16:45:06.473192  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:06.477887  8872 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:06.464370  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 12359c2bff0b46de91daa934c219103c, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.416752 14337 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:45:06.479934  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 12359c2bff0b46de91daa934c219103c, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.484172  9044 raft_consensus.cc:2354] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:45:06.457190 14432 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:06.484527  8966 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:06.467872 14494 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:06.490855  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.492139  8872 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 11, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 11 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.414965 14376 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.485118 14142 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:06.486755 14341 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.508881  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:06.516923  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 387149us
W20260925 16:45:06.517957  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49573.5us
I20260925 16:45:06.518893  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:06.520539  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.522282  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:06.501892 14018 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:06.506104 14494 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:45:06.533753  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:06.538925  8872 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 6 to 10. New cstate: current_term: 10 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.509397 14142 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:06.509224 14402 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.543208  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.551188  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:06.557397  9123 raft_consensus.cc:2396] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 16 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260925 16:45:06.531945 14488 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:06.528189 14337 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:06.534964 14489 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.547562 14341 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:06.563045  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 312580us
I20260925 16:45:06.535789 14494 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:06.540696 14386 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:06.564945  8872 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.530628 14339 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:06.551191 14142 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.579730  9665 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.579351  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:06.580080  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 391298us
I20260925 16:45:06.578377  8872 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 12 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.563163 14550 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:06.568934 14481 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:06.571561 14494 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:06.569813 14360 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:06.569440 14446 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.570689 14488 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.574478 14553 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:06.563799 14093 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260925 16:45:06.586125 14497 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.576026 14311 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:06.596895  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:06.597642  8872 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 5 to 10. New cstate: current_term: 10 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.582074 14337 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
W20260925 16:45:06.592907  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 123450us
I20260925 16:45:06.576476 13925 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:06.597980 14545 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260925 16:45:06.604597  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.609712  9698 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.603735 14493 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:06.605291  9701 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:06.559716 14432 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.606925  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:06.597735 14525 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:06.600930 14539 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.255s	user 0.006s	sys 0.000s
I20260925 16:45:06.617624  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.618229  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.619397  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.620067  8968 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:06.622110  9118 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:06.617728  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72033.9us
I20260925 16:45:06.622751  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.621486 14341 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260925 16:45:06.626219  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:06.628190 14537 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:45:06.628618 14470 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:06.629030 14470 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.629781  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1948) took 1122 ms. Trace:
I20260925 16:45:06.629910 14470 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.630156  8973 rpcz_store.cc:276] 0925 16:45:05.507078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.509108 (+  2030us) service_pool.cc:227] Handling call
0925 16:45:05.509500 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.509930 (+   430us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.509956 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.510330 (+   374us) log.cc:842] Serialized 26 byte log entry
0925 16:45:06.160158 (+649828us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:06.179346 (+ 19188us) log.cc:842] Serialized 14 byte log entry
0925 16:45:06.179581 (+   235us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.179678 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.629583 (+449905us) raft_consensus.cc:1671] finished
0925 16:45:06.629602 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.629727 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":17144,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":2091,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":6148,"thread_start_us":649337,"threads_started":1,"wal-append.queue_time_us":1000600}
I20260925 16:45:06.632357  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:06.628232  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:06.633250  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.618860  8872 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 6 to 11. New cstate: current_term: 11 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:45:06.634855 14536 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.002s
I20260925 16:45:06.635655  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:06.640342 14311 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.635746  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:06.621763 14548 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260925 16:45:06.645618 14311 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:06.646335  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.647543  8971 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:06.649564  8872 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.651959  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.652042 14552 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:06.652770  8970 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:06.658000  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.662276  9118 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:06.663769  8872 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 6 to 10, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.594668 14550 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.673373  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:06.637573 14339 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260925 16:45:06.687294  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90245.2us
I20260925 16:45:06.658375 14376 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.689136  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.684824  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:06.686820  8872 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 7 to 8, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.690564  9119 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:06.693964  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.695154  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.684535  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.696722  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:06.697161  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1037) took 1179 ms. Trace:
I20260925 16:45:06.704558  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.702221  9042 rpcz_store.cc:276] 0925 16:45:05.517434 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.517556 (+   122us) service_pool.cc:227] Handling call
0925 16:45:05.517897 (+   341us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.518301 (+   404us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.518334 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.518812 (+   478us) log.cc:842] Serialized 26 byte log entry
0925 16:45:05.886727 (+367915us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:05.886779 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.886851 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.696971 (+810120us) raft_consensus.cc:1671] finished
0925 16:45:06.696988 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.697099 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1078,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":153,"thread_start_us":367486,"threads_started":1,"wal-append.queue_time_us":732578}
W20260925 16:45:06.706764  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71184.3us
I20260925 16:45:06.660518  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:06.712809 14557 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:06.713346 14557 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:06.715193 14535 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.163s	user 0.001s	sys 0.001s
I20260925 16:45:06.715246 14557 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:06.707552  8971 raft_consensus.cc:595] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
W20260925 16:45:06.704789 14558 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260925 16:45:06.721827  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.720836  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.718668  8872 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:06.720345  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48403.6us
I20260925 16:45:06.724004  9698 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:06.724361  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:06.725466  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.705384 14402 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:06.727175  9119 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:06.666954 14552 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.727164  8872 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.709414 14357 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:06.732740 14357 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:06.733124 14357 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.739471 14559 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:06.739727  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2556) took 1209 ms. Trace:
I20260925 16:45:06.739965  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1037) took 1226 ms. Trace:
I20260925 16:45:06.740175 14559 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:06.729317  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:06.728539  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56138.6us
I20260925 16:45:06.746007  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.748957  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49c7db4b3fda45159275230bc247b929"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:06.749794  8971 raft_consensus.cc:595] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.750176  8971 raft_consensus.cc:603] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:06.740382  8975 rpcz_store.cc:276] 0925 16:45:05.513922 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.726179 (+212257us) service_pool.cc:227] Handling call
0925 16:45:05.818277 (+ 92098us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:05.917325 (+ 99048us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.917370 (+    45us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:06.059580 (+142210us) log.cc:842] Serialized 52 byte log entry
0925 16:45:06.500897 (+441317us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:06.697319 (+196422us) log.cc:842] Serialized 14 byte log entry
0925 16:45:06.702810 (+  5491us) log.cc:842] Serialized 14 byte log entry
0925 16:45:06.703068 (+   258us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.703184 (+   116us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.739764 (+ 36580us) raft_consensus.cc:1671] finished
0925 16:45:06.739784 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.739913 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26869,"prepare.queue_time_us":133405,"prepare.run_cpu_time_us":146,"prepare.run_wall_time_us":7611,"raft.queue_time_us":64983,"raft.run_cpu_time_us":268,"raft.run_wall_time_us":40415,"spinlock_wait_cycles":13447040,"thread_start_us":509540,"threads_started":2,"wal-append.queue_time_us":548518}
I20260925 16:45:06.747272  8872 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 10 to 12, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 12 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:06.721553 14317 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:06.755306  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.757863  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.755903  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:06.729749 14402 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:06.761607  8970 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:06.766240 14562 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:06.767220 14530 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260925 16:45:06.767975  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2559) took 1329 ms. Trace:
I20260925 16:45:06.768488  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1074) took 1468 ms. Trace:
I20260925 16:45:06.768975  8971 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
W20260925 16:45:06.770376 14261 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.697s	user 0.010s	sys 0.000s
I20260925 16:45:06.770738 14261 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.771469 14512 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.772010  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:06.773051 14552 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:06.773545 14565 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260925 16:45:06.740197  8969 rpcz_store.cc:276] 0925 16:45:05.437320 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.437440 (+   120us) service_pool.cc:227] Handling call
0925 16:45:05.437833 (+   393us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.504973 (+ 67140us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.505002 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.505444 (+   442us) log.cc:842] Serialized 26 byte log entry
0925 16:45:05.834810 (+329366us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:05.917132 (+ 82322us) log.cc:842] Serialized 14 byte log entry
0925 16:45:05.983409 (+ 66277us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.983506 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.646167 (+662661us) raft_consensus.cc:1671] finished
0925 16:45:06.646185 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.646311 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":136567,"prepare.queue_time_us":74465,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":133358,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":11368,"spinlock_wait_cycles":24821632,"thread_start_us":328944,"threads_started":1,"wal-append.queue_time_us":838856}
I20260925 16:45:06.729874 14571 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:06.777756 14544 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.495s	user 0.002s	sys 0.001s
I20260925 16:45:06.778092 14571 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:06.778354 14374 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:06.778520 14571 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:06.763516 14402 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:06.780143 14358 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.092s	user 0.008s	sys 0.004s
I20260925 16:45:06.771827 14317 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.777607 14337 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:06.780544 14358 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.792680  9118 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:06.764289  8872 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 12 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.797159 14550 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.768330  8967 rpcz_store.cc:276] 0925 16:45:05.438417 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.446092 (+  7675us) service_pool.cc:227] Handling call
0925 16:45:05.446438 (+   346us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.503674 (+ 57236us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.503730 (+    56us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.504322 (+   592us) log.cc:842] Serialized 26 byte log entry
0925 16:45:06.365354 (+861032us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:06.401038 (+ 35684us) log.cc:842] Serialized 14 byte log entry
0925 16:45:06.401238 (+   200us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.401356 (+   118us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.767769 (+366413us) raft_consensus.cc:1671] finished
0925 16:45:06.767793 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.767921 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58668,"prepare.queue_time_us":36383,"prepare.run_wall_time_us":7067,"raft.queue_time_us":109435,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":10530,"spinlock_wait_cycles":6434048,"thread_start_us":860372,"threads_started":1,"wal-append.queue_time_us":910159}
I20260925 16:45:06.799289 14570 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:06.799919 14570 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.701546 14488 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.800907 14317 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.802376 14337 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:06.803215  9702 raft_consensus.cc:2354] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:45:06.803555  9123 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:06.803963 14349 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:06.804379 14349 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.781781 14489 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:06.804915 14358 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:06.805306 14489 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.806255 14489 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.808800  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:06.809362  8967 raft_consensus.cc:595] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.809824 14142 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:06.813938  9122 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.558s	user 0.080s	sys 0.109s
I20260925 16:45:06.802124 14570 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.815495 14574 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:06.816054  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.816442  9695 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:45:06.816982  9695 raft_consensus.cc:595] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.817282  9695 raft_consensus.cc:603] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:06.818328  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 108038us
I20260925 16:45:06.818333 14360 raft_consensus.cc:979] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:06.819137 14360 raft_consensus.cc:1067] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:06.820039  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:06.821269  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:06.823261 14565 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:06.824450 14562 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:06.824880 14127 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:06.825049 14562 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:06.826617 14471 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:06.794147 14552 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:06.826522 14562 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.768841  9693 rpcz_store.cc:276] 0925 16:45:05.299632 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.299783 (+   151us) service_pool.cc:227] Handling call
0925 16:45:05.348444 (+ 48661us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.349057 (+   613us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.349088 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.349584 (+   496us) log.cc:842] Serialized 26 byte log entry
0925 16:45:05.775687 (+426103us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:05.775772 (+    85us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:05.775837 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.768296 (+992459us) raft_consensus.cc:1671] finished
0925 16:45:06.768314 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.768436 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":6670,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":88,"thread_start_us":395276,"threads_started":1,"wal-append.queue_time_us":1214387}
I20260925 16:45:06.828483 14563 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:06.828852 14563 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.824023 14565 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:06.803135 14542 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.458s	user 0.000s	sys 0.000s
I20260925 16:45:06.834836 14018 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:06.814296  9122 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.558s	user 0.080s	sys 0.109s
I20260925 16:45:06.833005 14402 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.839434  9123 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:06.842015  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.852599  9117 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:06.865098  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.803356 14337 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:06.842465  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:06.782661 14448 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.609s	user 0.011s	sys 0.000s
I20260925 16:45:06.845753  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:06.841460  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:06.871470  8967 raft_consensus.cc:595] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:06.866888  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.814239 14497 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:06.868525  9049 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:06.872287  8967 raft_consensus.cc:603] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:06.873450  9695 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:06.879908  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 1956) took 1119 ms. Trace:
I20260925 16:45:06.881287  9041 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:06.882427 14261 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.906538  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:06.883088 14540 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.601s	user 0.005s	sys 0.001s
I20260925 16:45:06.907416  9695 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:06.846454 14471 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:45:06.908452  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.908888 14471 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.909082  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 2546) took 1543 ms. Trace:
I20260925 16:45:06.905941  8972 rpcz_store.cc:276] 0925 16:45:05.760466 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.763510 (+  3044us) service_pool.cc:227] Handling call
0925 16:45:05.818557 (+ 55047us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:06.272183 (+453626us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:06.272229 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:06.283076 (+ 10847us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:06.283123 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.879677 (+596554us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:06.879740 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.879845 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":997226880}
I20260925 16:45:06.910296  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1479) took 1383 ms. Trace:
I20260925 16:45:06.909171  9695 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:06.844693 14142 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.871508  8969 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:06.894829 14560 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:06.895896  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:06.896229 14286 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:06.898422  9697 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260925 16:45:06.900840 14138 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.901008 14512 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:06.903280  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1031) took 1501 ms. Trace:
I20260925 16:45:06.931586  9049 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:06.933025  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.962908  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1029) took 1452 ms. Trace:
I20260925 16:45:06.924959  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:06.911530  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:06.869576  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:06.917819  9700 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:06.848541 14018 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:06.943148  8972 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
W20260925 16:45:07.002586  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 106782us
W20260925 16:45:06.932385 14546 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.402s	user 0.000s	sys 0.003s
I20260925 16:45:06.985592  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1262) took 1519 ms. Trace:
I20260925 16:45:06.989755  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:06.909502  8966 rpcz_store.cc:276] 0925 16:45:05.365814 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.366046 (+   232us) service_pool.cc:227] Handling call
0925 16:45:06.908922 (+1542876us) spinlock_profiling.cc:243] Waited 1.12 s on lock 0x7b5400137754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:06.909033 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2567297408}
I20260925 16:45:06.986088  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:06.937773  8872 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 3 to 12, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 12 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:06.972314  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:06.986395 14075 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:07.048604  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.014523  8973 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:07.029016  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:06.920331  9042 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:06.932508  9043 pending_rounds.cc:76] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 5
I20260925 16:45:07.049348  9041 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:07.049474  9043 pending_rounds.cc:97] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260925 16:45:07.049796  9043 raft_consensus.cc:2866] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:07.050094  9090 leader_election.cc:398] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:07.039131  9116 rpcz_store.cc:276] 0925 16:45:05.466434 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.601792 (+135358us) service_pool.cc:227] Handling call
0925 16:45:05.602116 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:06.090531 (+488415us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.963900 (+873369us) spinlock_profiling.cc:243] Waited 434 ms on lock 0x7b5400144454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:06.985513 (+ 21613us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":997254400}
I20260925 16:45:07.050405  9090 leader_election.cc:401] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260925 16:45:07.033975  9695 raft_consensus.cc:2396] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
W20260925 16:45:06.912389 14556 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.190s	user 0.003s	sys 0.000s
I20260925 16:45:07.028445  9123 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:07.036118  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:07.028406  9048 rpcz_store.cc:276] 0925 16:45:05.402125 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.402254 (+   129us) service_pool.cc:227] Handling call
0925 16:45:06.903046 (+1500792us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001afc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:06.903196 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2307508992}
W20260925 16:45:07.036907  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 316136us
I20260925 16:45:06.916007  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.829618 14563 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.044500  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:06.915545 14402 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.032187  8974 rpcz_store.cc:276] 0925 16:45:05.511519 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.706532 (+195013us) service_pool.cc:227] Handling call
0925 16:45:05.719998 (+ 13466us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:06.138420 (+418422us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.962579 (+824159us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b5400355cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:06.962833 (+   254us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":960705792}
I20260925 16:45:06.917964 14470 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:07.028626  9121 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:07.057165  9121 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:07.052661  9698 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 10: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:07.057708  9696 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260925 16:45:07.055787  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66061.5us
I20260925 16:45:06.869923 14337 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:07.037923 14410 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:06.961221 14358 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:06.924677 14395 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.031541 14142 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:07.055550  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:07.053215  9047 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:07.001693 14286 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:06.921604  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:06.911404 14494 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:06.962821 14448 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:06.910676  9694 rpcz_store.cc:276] 0925 16:45:05.526333 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.526483 (+   150us) service_pool.cc:227] Handling call
0925 16:45:05.531872 (+  5389us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.538774 (+  6902us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:05.538807 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.539323 (+   516us) log.cc:842] Serialized 26 byte log entry
0925 16:45:05.877542 (+338219us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:06.386767 (+509225us) log.cc:842] Serialized 14 byte log entry
0925 16:45:06.388413 (+  1646us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.388507 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.835462 (+446955us) spinlock_profiling.cc:243] Waited 9.71 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:06.909929 (+ 74467us) raft_consensus.cc:1671] finished
0925 16:45:06.910029 (+   100us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:06.910147 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5260,"prepare.queue_time_us":275725,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":33,"raft.queue_time_us":14084,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":7537,"spinlock_wait_cycles":22331648,"thread_start_us":767075,"threads_started":2,"wal-append.queue_time_us":620012}
I20260925 16:45:07.084204 14458 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:07.048378 14560 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.048409 14075 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:07.060293 14360 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:45:06.928154 14349 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.031152 14141 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.057332 14574 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:07.038203 14576 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.160341  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:06.909778 14471 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:07.160960  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 106634us
I20260925 16:45:07.161316  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.045868 14138 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:06.921850 14103 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.221622 14141 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.221625  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.223315  9049 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:07.171216  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:07.163981  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 102520us
I20260925 16:45:07.224634  9042 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:07.225791  9089 leader_election.cc:398] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:45:07.226073  9089 leader_election.cc:401] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260925 16:45:07.175009  9117 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:07.228569 14127 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:45:07.221652 14138 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.230140  9117 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:07.165670  9123 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:07.175836  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.231492  9045 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:07.220830  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.233397  9090 leader_election.cc:398] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 9. Current term is 10.
I20260925 16:45:07.211668 14458 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:07.234113 14103 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.234354 14458 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.176056 14358 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.236467 14127 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:07.188865 14571 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.237151 14358 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.176407 14512 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.238526  9702 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:07.238762 14571 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.238005 14512 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.176954 14547 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.176884 14410 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.177752 14510 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:07.178367  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.203334 14488 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:07.178771 14395 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.299813  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3027) took 2097 ms. Trace:
I20260925 16:45:07.166873  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:07.181746  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 121748us
I20260925 16:45:07.180048 14142 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:07.186705 14233 raft_consensus.cc:979] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:07.186121 14286 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.188808  9120 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260925 16:45:07.190707  9041 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:07.305404  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.309849  8966 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:07.304834  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.173738  8872 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 6 to 8, leader changed from <none> to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:45:07.196528  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 141043us
I20260925 16:45:07.199992  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:07.201545  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.204409  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.203737  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1265) took 1736 ms. Trace:
I20260925 16:45:07.210362  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:07.313357  9116 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 10: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:07.169481 14565 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.224123 14141 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:07.178905  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 128605us
W20260925 16:45:07.296572  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56285.5us
I20260925 16:45:07.298242  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:07.298599  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.303519  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.316926  9124 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:07.304172  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.317739  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.318022  8974 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:07.221524 14349 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:07.221716 14576 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.316143  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:07.322242  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 144017us
I20260925 16:45:07.326043  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.217986 14360 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:07.328361  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 118114us
I20260925 16:45:07.231592 14138 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.238106 14103 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.335114  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.296756 14494 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.313324  9115 rpcz_store.cc:276] 0925 16:45:05.519443 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.603329 (+ 83886us) service_pool.cc:227] Handling call
0925 16:45:05.603602 (+   273us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:05.694578 (+ 90976us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:05.694610 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:05.707968 (+ 13358us) log.cc:842] Serialized 26 byte log entry
0925 16:45:06.058026 (+350058us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:06.058077 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:06.058226 (+   149us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:06.931548 (+873322us) spinlock_profiling.cc:243] Waited 5.78 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:07.198936 (+267388us) raft_consensus.cc:1671] finished
0925 16:45:07.198957 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:07.203642 (+  4685us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27049,"raft.queue_time_us":18196,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"spinlock_wait_cycles":13291776,"thread_start_us":344087,"threads_started":1,"wal-append.queue_time_us":774165}
I20260925 16:45:07.302527 14488 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:07.307070 14190 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:07.307723 14142 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:07.352816  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:07.347280  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.307569 14311 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:07.336356 14118 raft_consensus.cc:1067] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:07.311326 14553 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:07.356856  8872 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 5 to 8, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 8 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:07.349817 14493 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:07.359817  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.364297  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.365301  9693 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:07.363152  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:07.367200  8974 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:07.367626  8974 raft_consensus.cc:603] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:07.360383  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.368821 14103 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:07.221195 14337 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.366443  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:07.380918  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:07.385262 14567 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:07.385998 14567 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:07.349956 14233 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:07.389482  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:07.394770  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 340150us
W20260925 16:45:07.395493  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 3c0923848b9b426eade76023fdecc31c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:07.395833  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 3c0923848b9b426eade76023fdecc31c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.357986 14488 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:07.346683 14583 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:07.362807 14141 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:07.359484 14339 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:07.397830  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 404000us
I20260925 16:45:07.363206 14286 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:07.329033 14510 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.420200  9115 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:07.374728 14494 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:07.373092 14138 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:07.434479  9045 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:07.444147  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:07.447491  9124 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:07.394384 14093 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:07.402464 14493 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:07.453281 14448 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.454049 14493 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.369558 14553 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.460194 14560 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.387014 14567 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.461547 14567 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:07.433013 14432 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:07.418254 14571 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260925 16:45:07.351171 14547 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.410740 14525 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:07.469940 14525 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:07.470391 14525 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:07.467808 14190 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.473605 14190 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:07.475961 14395 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.358896 14075 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.478405 14075 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:07.300351  9122 rpcz_store.cc:276] 0925 16:45:05.202908 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:05.253455 (+ 50547us) service_pool.cc:227] Handling call
0925 16:45:05.253802 (+   347us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:05.254152 (+   350us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:06.847072 (+1592920us) log.cc:842] Serialized 14 byte log entry
0925 16:45:07.299311 (+452239us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:07.299396 (+    85us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:07.299471 (+    75us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:07.299561 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:07.299742 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30859,"prepare.queue_time_us":81801,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":41,"raft.queue_time_us":31197,"thread_start_us":1977424,"threads_started":2}
W20260925 16:45:07.479975 14357 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.746s	user 0.000s	sys 0.015s
I20260925 16:45:07.481550 14563 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:07.485198 14574 consensus_queue.cc:1159] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 15 status { last_received { term: 14 index: 11 } last_committed_idx: 10 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:07.486943 14574 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.488204 14561 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:07.490867  9042 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:07.496781 14510 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:07.498025  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 142595us
I20260925 16:45:07.498306 14583 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:07.499661 14583 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.504640 14565 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:07.506495 14565 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260925 16:45:07.508570 14550 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:45:07.509042 14550 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:07.510219 14550 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.510917 14190 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.498054 14524 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:07.514084 14512 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.515559 14550 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:45:07.530501  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 116549us
I20260925 16:45:07.511413  9121 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.530646 14571 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.540699 14571 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.541234  9119 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260925 16:45:07.542568 14571 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.540053 14576 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.543936  9121 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.427959 14494 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.546286 14494 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:07.548906  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.399204 14233 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.549594  9042 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:07.550470 14512 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:07.551016 14512 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.530591 14093 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:07.552980 14512 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.552809 14093 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.554467 14410 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.531126 14357 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.558494 14357 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.530939  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:07.561609  9048 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:07.564536 14553 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.565598  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.566115  9048 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:07.566246 14547 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.566569  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.568073  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.569075 14337 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:07.570832  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.572618 14190 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:07.574005  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:07.574680  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.576083  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:07.581761 14557 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.582255 14557 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.583132 14358 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:07.583575 14358 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.584764 14557 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.487373 14574 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.585357 14557 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:07.585439 14358 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.585762 14557 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:07.586186 14557 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:07.586798 14574 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.588848  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.589464  9700 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:07.590590  9042 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:07.590415 14488 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.593134 14488 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:07.597551 14470 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.517s	user 0.006s	sys 0.001s
I20260925 16:45:07.600726  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.602169  9090 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.605592  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:07.607298  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.607863  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.551350 14233 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:07.614267  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:07.618149  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:07.620076  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 256402us
I20260925 16:45:07.621522  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.625219  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:07.625941  9115 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:07.628948  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.562435 14018 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.631855  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.632584  9117 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:07.632807  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.636515  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.633522  9042 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:07.637224  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.636863  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.639523  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:07.645109  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.645677  9048 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:07.644080  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:07.644572  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.649081  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.645292  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.641992 14190 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:07.646796 14524 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.015s
I20260925 16:45:07.651891 14358 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:07.663932 14358 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:07.664079  9118 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:07.664444 14358 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:07.672039  9116 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:07.622268 14553 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:07.654841  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.632912 14574 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:07.636183 14552 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:07.681556  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:07.683382  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 319404us
I20260925 16:45:07.616442 14562 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260925 16:45:07.690065  9119 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:07.692898  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.694900  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.680646 14233 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.018s
I20260925 16:45:07.699030 14233 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:07.699369 14233 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:07.700417 14233 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.701802 14233 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:07.657281 14190 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.633759 14357 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260925 16:45:07.696138 14103 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:07.704984 14190 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.706431  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:07.706727 14018 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:07.663407 14525 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.711935  9045 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:07.712612 14525 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:07.713954  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 347812us
I20260925 16:45:07.683540 14269 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:07.530407 14360 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.723130  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:07.740403  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45868.3us
I20260925 16:45:07.743206  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.796757  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.747404  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.748945  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:07.798117  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.691015 14552 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:07.684437 14470 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.066s
I20260925 16:45:07.758443  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.759191  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.802520  8968 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:07.802932  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43819.1us
I20260925 16:45:07.761582  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.745837 14410 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:07.750316 14103 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:07.762588  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.766202  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.805287  8972 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:07.805369  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.767335 14386 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:07.757684 14512 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260925 16:45:07.774217  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.811028  9119 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:07.756992 14075 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:07.813397  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.814433  9116 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:07.800640 14357 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Stepping down as leader of term 12
W20260925 16:45:07.822005  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 78939.4us
I20260925 16:45:07.823235  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.839772  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.840163  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.856325  8967 raft_consensus.cc:2396] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 9.
I20260925 16:45:07.808336 14018 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:45:07.811168 14525 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:07.874168  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.876807  8974 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260925 16:45:07.861939  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:07.875021  9697 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:07.882546  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.885288  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.816573 14357 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:07.886063  9702 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:07.888202  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.885989  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:07.875550  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.839610 14410 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:07.839262 14547 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:07.890487  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.895954  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.900050  9700 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:07.906390  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:07.890079  9116 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:07.934151  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:07.875363 14269 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:07.866866 14525 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:07.911178 14142 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.000s
I20260925 16:45:07.912930 14470 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:07.923727 14018 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:07.859710 14597 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:07.925366 14358 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.818096 14075 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.926795 14190 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:07.881685 14576 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260925 16:45:07.928089  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:45:07.929231 14357 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.864746 14376 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:07.936391  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74592.5us
W20260925 16:45:07.936955  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47847.7us
I20260925 16:45:07.937851  8968 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:07.941224  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.938640  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.943630  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:07.957592  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51323.4us
I20260925 16:45:07.919257 14494 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.951018 14493 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:07.943822 14269 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.968252 14190 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:07.885684 14311 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.075s
I20260925 16:45:07.989657  9119 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:07.976590  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:07.989976  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.976998  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:07.990742  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.923326 14557 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.943467 14470 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:07.990770  8968 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:07.996131  8968 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:07.992815  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:07.971799  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:07.997980  9115 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:07.999200  9115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:07.999683  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:08.001222  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:08.011179  9117 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:08.013542  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:08.015770  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:07.970356 14595 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:07.945674 14142 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.021356  8973 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:08.021521  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:07.999872  9115 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:08.018481  8968 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:08.024749  8968 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:08.002368 14446 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:08.033434  9122 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260925 16:45:08.033918  9122 pending_rounds.cc:76] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 10
I20260925 16:45:08.032771  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:08.034197  9122 pending_rounds.cc:97] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260925 16:45:08.034544  9122 raft_consensus.cc:2866] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:08.036002  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:07.945238 14552 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:08.046286  9049 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:08.023893  9115 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:08.022262 14595 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:08.053682  8968 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:08.032768 14596 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:45:08.057782  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 361217us
I20260925 16:45:08.021817 14493 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:08.037843 14446 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:08.012790 14510 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.036s
I20260925 16:45:08.046882 14547 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:08.062697  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.067178  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.048069 14357 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:08.083314  9045 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:08.085258  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:08.057278 14579 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:07.996363 14525 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:08.067381 14593 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.254s	user 0.000s	sys 0.001s
I20260925 16:45:08.057410 14595 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:08.067016 14446 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:08.107919 14337 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:08.150718 14493 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.153563  9120 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:45:08.140352 14576 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:08.155812 14142 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.141173 14233 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:08.173465 14576 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:08.173849  9122 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:45:08.174470 14576 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.089629 14547 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:08.180112 14547 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:08.156005 14546 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:45:08.132750 14269 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.183410 14142 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:08.184945 14390 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:08.185597 14349 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:08.185987 14349 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:08.142241 14557 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:08.186700 14349 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:08.186621  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 191081us
I20260925 16:45:08.187857 14349 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:08.189244 14557 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260925 16:45:08.151449 14337 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:08.052377 14018 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:08.160267  9117 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:08.153643 14525 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:08.139114 14386 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:08.173791 14233 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:08.210009 14386 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:08.251617  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63519us
I20260925 16:45:08.293996  9115 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:08.320933  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59469us
I20260925 16:45:08.212958 14337 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:08.336333  9119 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:08.328372 14269 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:08.338792  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:08.320829 14494 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:08.346055  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.332949 14432 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:08.349627  9049 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:08.353603  9124 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:08.334111 14598 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:08.348134 14562 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.624s	user 0.006s	sys 0.013s
W20260925 16:45:08.347472 14497 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.042s	sys 0.022s
I20260925 16:45:08.364503 14075 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.362018 14598 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.366730 14190 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:08.367280 14470 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.367592  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.368207 14598 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.338493 14233 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.370024  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:08.370755  9049 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:08.366176 14497 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.043s	sys 0.022s
I20260925 16:45:08.357025  9115 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:08.371681  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:08.337697 14142 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260925 16:45:08.341784 14269 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:08.377452  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 400919us
W20260925 16:45:08.379879  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 352731us
W20260925 16:45:08.362517 14562 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.007s	sys 0.013s
I20260925 16:45:08.359678 14358 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:08.388958  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:08.379976  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:08.398690  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.400317  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.401644  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.394682  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:08.446852  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52266.4us
I20260925 16:45:08.448817  8973 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260925 16:45:08.378073 14360 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.026s	sys 0.057s
W20260925 16:45:08.407279  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 344676us
I20260925 16:45:08.351794 14563 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260925 16:45:08.409452  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:08.452643  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.354526 14550 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260925 16:45:08.410658  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:08.363428 14583 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260925 16:45:08.388234 14233 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:08.406463 14075 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:08.418001  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:08.479471  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.369824 14432 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.421751  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:08.486717  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65069.7us
I20260925 16:45:08.488168  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:08.443238  9698 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:08.489220  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:08.450860  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:08.450683  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.450692  9702 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:08.490365  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.421898  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:08.483978  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:08.455953  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:08.405416 14494 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:08.457564  9695 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260925 16:45:08.421484  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:08.496594  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.496981  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:08.499619  8975 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 10. (term mismatch)
I20260925 16:45:08.500110  8975 pending_rounds.cc:76] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 9
I20260925 16:45:08.500358  8975 pending_rounds.cc:97] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 12.10
I20260925 16:45:08.500623  8975 raft_consensus.cc:2866] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:08.462556  8967 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:08.362772 14386 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.412317 14258 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:08.472337 14410 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:08.473801 14446 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.474030 14595 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:08.452822 14360 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.026s	sys 0.057s
I20260925 16:45:08.550036  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:08.479018  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:08.552487  8972 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:08.552876  8972 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:08.480782  9042 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:08.457105  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.556811  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:08.405579 14190 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:08.491943  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:08.421178  9696 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:08.493678  9693 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:08.494834  9049 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:08.504437  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.450399 14488 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:08.492919  8973 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:08.513813  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:08.515041  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:08.454891 14456 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:08.527401 14604 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260925 16:45:08.527856 14446 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.509068 14470 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:08.529295 14386 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:08.420641 14590 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.158s
W20260925 16:45:08.533439 14616 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260925 16:45:08.540328 14093 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:08.541138 14606 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:45:08.542883 14432 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.543354 14410 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:08.549360 14595 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:08.478854  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.557567  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:08.633224  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 75734.3us
I20260925 16:45:08.557641  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:08.564076  9697 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:08.567340  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:08.569466  9698 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:08.563789  9041 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:08.568281  8972 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:08.589860  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:08.613000 14269 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:08.521262 14142 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:08.563184 14562 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:08.565533 14489 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:08.568939 14358 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:08.566066 14524 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:08.639060  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 128828us
I20260925 16:45:08.625568  9115 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:08.625913  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:08.520996 14258 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.638720  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:08.640393  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73166.3us
I20260925 16:45:08.641040  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:08.640070  8967 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:08.650277  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:08.651067  9045 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:08.652119  8972 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:08.585459 14456 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.657838  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.661471  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:08.652384  9115 pending_rounds.cc:76] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 9
I20260925 16:45:08.664076  9115 pending_rounds.cc:97] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260925 16:45:08.636574 14610 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:08.668073  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:08.671407  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:08.639238 14470 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:08.670820  8975 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 13 index: 6. (index mismatch)
I20260925 16:45:08.651342 14567 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:08.684473  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1286) took 1057 ms. Trace:
I20260925 16:45:08.665232  9115 raft_consensus.cc:2866] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:08.678570  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.693713  9121 rpcz_store.cc:276] 0925 16:45:07.626663 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:07.626839 (+   176us) service_pool.cc:227] Handling call
0925 16:45:07.647315 (+ 20476us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:07.655053 (+  7738us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:07.655097 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:07.668822 (+ 13725us) log.cc:842] Serialized 26 byte log entry
0925 16:45:08.053757 (+384935us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:08.053796 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:08.053861 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:08.684186 (+630325us) raft_consensus.cc:1671] finished
0925 16:45:08.684213 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:08.684400 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7292,"raft.queue_time_us":10624,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"thread_start_us":368781,"threads_started":1,"wal-append.queue_time_us":676577}
I20260925 16:45:08.659212 14075 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:08.690793  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 195493us
I20260925 16:45:08.639534 14562 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:08.692328  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 202017us
I20260925 16:45:08.703929  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.706286 14360 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:08.631639 14093 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.714679  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.641691 14488 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.053s
I20260925 16:45:08.670671 14631 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:08.671612 14190 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:08.649482 14563 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.048s
I20260925 16:45:08.664517 14142 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:08.648195 14524 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.724602  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:08.653187 14560 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260925 16:45:08.669986 14619 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:08.656527 14550 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260925 16:45:08.764832  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:08.731238  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 236169us
I20260925 16:45:08.716831  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.768322  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:08.770483  9116 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
W20260925 16:45:08.773878  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58526.8us
I20260925 16:45:08.716771 14562 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:08.719288 14567 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:08.695487 14610 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.718287 14075 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:08.774225  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 109326us
I20260925 16:45:08.814476  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:08.825302  8972 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:08.786190  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.886324  9693 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:08.725296 14395 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:08.775097  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:08.890750  8940 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:08.721670 14410 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:08.900094  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 234973us
I20260925 16:45:08.903717  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:08.906073 14258 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:08.910089  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:08.911767 14360 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:08.912191 14360 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:08.912552 14360 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:08.912672  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2895) took 1197 ms. Trace:
I20260925 16:45:08.913219 14524 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:08.915050 14376 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.940s	user 0.019s	sys 0.000s
W20260925 16:45:08.818432 14614 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
W20260925 16:45:08.912177 14628 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260925 16:45:08.915596 14376 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:08.918218 14625 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260925 16:45:08.920419 14560 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:08.920914 14560 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:08.921622 14560 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.922768 14560 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:08.853367 14093 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:08.924665 14357 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.817s	user 0.018s	sys 0.005s
I20260925 16:45:08.920495 14629 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:08.913062  9116 rpcz_store.cc:276] 0925 16:45:07.715126 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:07.955113 (+239987us) service_pool.cc:227] Handling call
0925 16:45:07.955502 (+   389us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:08.776070 (+820568us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:08.912445 (+136375us) spinlock_profiling.cc:243] Waited 815 ms on lock 0x7b540019bed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:08.912620 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1873794432}
I20260925 16:45:08.926103 14075 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:08.819005 14627 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
W20260925 16:45:08.817689 14623 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260925 16:45:08.926685  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2898) took 1172 ms. Trace:
I20260925 16:45:08.927174  9124 rpcz_store.cc:276] 0925 16:45:07.754078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.077964 (+323886us) service_pool.cc:227] Handling call
0925 16:45:08.132859 (+ 54895us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:08.363871 (+231012us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:08.926477 (+562606us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003bf1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:08.926631 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":493535616}
I20260925 16:45:08.931331  8971 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
W20260925 16:45:08.843010 14617 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.194s	user 0.000s	sys 0.001s
I20260925 16:45:08.761711 14622 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:08.794679 14552 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:08.760751 14190 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:08.951573  9701 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:08.817953 14633 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:08.956146  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.776793 14269 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:08.815491 14595 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:08.974802  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:08.781880 14613 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:08.979664  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76090.4us
I20260925 16:45:08.957046 14258 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:08.962316 14552 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:08.962905 14590 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:08.761724 14631 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.963181 14190 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:08.819751 14471 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.158s
I20260925 16:45:08.996248  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:08.954372 14337 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260925 16:45:08.996631  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2575) took 1189 ms. Trace:
I20260925 16:45:08.976496 14619 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:08.999969  8966 rpcz_store.cc:276] 0925 16:45:07.807320 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:07.817997 (+ 10677us) service_pool.cc:227] Handling call
0925 16:45:07.867209 (+ 49212us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:07.887752 (+ 20543us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:07.887807 (+    55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:07.888234 (+   427us) log.cc:842] Serialized 26 byte log entry
0925 16:45:08.406887 (+518653us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:08.406923 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:08.406994 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:08.996433 (+589439us) raft_consensus.cc:1671] finished
0925 16:45:08.996453 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:08.996579 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16352,"raft.queue_time_us":52751,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":12794,"thread_start_us":447361,"threads_started":1,"wal-append.queue_time_us":675789}
I20260925 16:45:08.772672 14621 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.211s
I20260925 16:45:08.986254 14524 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:08.983970 14512 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:08.997651  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:08.995999 14552 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:09.000864 14619 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:08.965417 14269 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:08.986974 14456 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.008746  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:08.987522 14395 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:08.998867  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:08.992738 14258 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.009876 14643 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:09.052076  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:09.073143  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:08.973877 14633 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.080232  9700 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:09.080870  8966 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:09.086988  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:09.087744  9700 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:09.089344  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:09.059887 14269 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:09.004169 14337 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:09.077369 14645 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.062s	user 0.000s	sys 0.002s
I20260925 16:45:08.986594 14613 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.097041  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.099396  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1050) took 1194 ms. Trace:
I20260925 16:45:09.110046  8974 rpcz_store.cc:276] 0925 16:45:07.904635 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.019031 (+114396us) service_pool.cc:227] Handling call
0925 16:45:09.099217 (+1080186us) spinlock_profiling.cc:243] Waited 639 ms on lock 0x7b540036f454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:09.099346 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1470266624}
I20260925 16:45:09.103384  9700 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:09.105232  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:49990 (request call id 898) took 1259 ms. Trace:
I20260925 16:45:09.111666  8969 rpcz_store.cc:276] 0925 16:45:07.845611 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:07.845767 (+   156us) service_pool.cc:227] Handling call
0925 16:45:09.104798 (+1259031us) spinlock_profiling.cc:243] Waited 450 ms on lock 0x7b54002cb5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:09.105139 (+   341us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1034990976}
I20260925 16:45:09.107760  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:09.143370  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 145783us
I20260925 16:45:09.145195  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:09.210548  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 424419us
I20260925 16:45:09.028808 14567 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:09.262173  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 176839us
I20260925 16:45:09.212554  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:09.112810 14075 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260925 16:45:09.298951  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:09.299400  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.291863  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:09.302060  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89625.6us
I20260925 16:45:09.293846  9048 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:09.294224  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:09.293218  9049 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:09.289142  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3086) took 1018 ms. Trace:
I20260925 16:45:09.138572 14630 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.313756  9043 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:09.305612  9117 rpcz_store.cc:276] 0925 16:45:08.271198 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.295170 (+ 23972us) service_pool.cc:227] Handling call
0925 16:45:08.331630 (+ 36460us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:08.331906 (+   276us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:45:08.350346 (+ 18440us) log.cc:842] Serialized 14 byte log entry
0925 16:45:09.074554 (+724208us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b180055a920. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:09.288614 (+214060us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:09.288687 (+    73us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:09.288768 (+    81us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:09.288879 (+   111us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:09.289069 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":18220,"prepare.run_wall_time_us":2820,"raft.queue_time_us":6161,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5028,"spinlock_wait_cycles":13716736,"thread_start_us":141915,"threads_started":1}
W20260925 16:45:09.318286  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 173157us
I20260925 16:45:09.329017  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:09.331276  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:09.337934  9115 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:09.296547 14626 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:09.341599  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44067.1us
I20260925 16:45:09.305960 14075 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:09.324863 14525 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.115s	user 0.007s	sys 0.005s
I20260925 16:45:09.309743 14550 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:09.316838 14374 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.316124 14656 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:09.089337 14643 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.335845 14524 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260925 16:45:09.407648  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 408812us
I20260925 16:45:09.410140  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.394225  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.411126 14626 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.412905  9117 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260925 16:45:09.425197  8969 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:09.419504 14525 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:09.341384 14386 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:45:09.391484 14604 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260925 16:45:09.347615 14458 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:09.435370  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 141241us
I20260925 16:45:09.387125 14579 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.387591 14075 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:09.390362 14649 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.391716 14622 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.288185 14638 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.216s
I20260925 16:45:09.421098 14524 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:09.420791 14395 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:09.458377  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:09.321671 14630 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:09.422645 14623 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260925 16:45:09.475677  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:09.477144  9697 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 15 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260925 16:45:09.425189 14626 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.470489  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:09.479038  9044 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:09.468248 14524 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:09.458456 14631 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:09.486593  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55955.3us
I20260925 16:45:09.491564  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:09.501497  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:09.478936 14641 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.455s	user 0.001s	sys 0.000s
I20260925 16:45:09.438341 14608 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260925 16:45:09.506534  9043 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
W20260925 16:45:09.507320  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1047) took 1603 ms (client timeout 2062 ms). Trace:
I20260925 16:45:09.507872  8974 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260925 16:45:09.508414  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:09.487561 14547 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.305s	user 0.012s	sys 0.011s
I20260925 16:45:09.505810  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:09.421645 14374 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.476375 14661 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
W20260925 16:45:09.507748  8971 rpcz_store.cc:269] 0925 16:45:07.903597 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.017896 (+114299us) service_pool.cc:227] Handling call
0925 16:45:09.507178 (+1489282us) spinlock_profiling.cc:243] Waited 883 ms on lock 0x7b540036ea54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:09.507276 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2030207232}
W20260925 16:45:09.518479 14650 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260925 16:45:09.518776 14583 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:45:09.519189 14644 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.202s	user 0.000s	sys 0.000s
I20260925 16:45:09.520714 14675 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:09.522217 14630 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.463570 14649 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.525841 14649 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:09.526158 14360 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.613s	user 0.009s	sys 0.000s
I20260925 16:45:09.501551 14258 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.526629 14360 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.513170 14349 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.016s
I20260925 16:45:09.478566 14648 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260925 16:45:09.528229 14633 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:09.530318 14358 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.880s	user 0.005s	sys 0.004s
I20260925 16:45:09.530709 14358 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:09.532696 14626 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.510007 14655 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
W20260925 16:45:09.534390 14560 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.001s
I20260925 16:45:09.513612 14547 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.537021  8968 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:09.537640 14599 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260925 16:45:09.538076 14547 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.503942 14667 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.050s
I20260925 16:45:09.543581 14374 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.544531  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3094) took 1078 ms. Trace:
I20260925 16:45:09.544961  9120 rpcz_store.cc:276] 0925 16:45:08.466282 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.466456 (+   174us) service_pool.cc:227] Handling call
0925 16:45:08.479621 (+ 13165us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:08.655178 (+175557us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:08.655223 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:08.660932 (+  5709us) log.cc:842] Serialized 26 byte log entry
0925 16:45:08.963728 (+302796us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:08.963813 (+    85us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:08.963946 (+   133us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:09.544307 (+580361us) raft_consensus.cc:1671] finished
0925 16:45:09.544327 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:09.544476 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":40746,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":16401,"thread_start_us":406276,"threads_started":2,"wal-append.queue_time_us":395145}
I20260925 16:45:09.501555 14103 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:09.548923  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.551517  9042 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:09.491901 14337 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.477051 14395 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.587298  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:09.566244  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:09.576195  9044 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:09.562779  8971 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260925 16:45:09.504132 14666 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.576321  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.578495  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:09.593565  9700 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:09.593609  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.579252  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:09.594324  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1508) took 1100 ms. Trace:
I20260925 16:45:09.594695  9694 rpcz_store.cc:276] 0925 16:45:08.494328 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:09.089023 (+594695us) service_pool.cc:227] Handling call
0925 16:45:09.134938 (+ 45915us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:09.289015 (+154077us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:09.289040 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:09.289079 (+    39us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:09.289106 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:09.594118 (+305012us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:09.594162 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:09.594275 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":32231296}
I20260925 16:45:09.452652 14579 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.599733  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.584873  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.597450  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:09.602030  9115 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:09.602185  9696 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 16
W20260925 16:45:09.546445 14635 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.440s	user 0.000s	sys 0.001s
I20260925 16:45:09.597357  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.603924  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:09.605751  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:09.470842 14622 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:09.608220  9124 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.004s	sys 0.008s
I20260925 16:45:09.610466  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:09.611979  9124 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.004s	sys 0.008s
I20260925 16:45:09.613737  8966 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 13: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:09.615171  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 320714us
I20260925 16:45:09.551000 14103 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:09.621095  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.622783  8967 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:09.623674  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.550117 14613 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.624651  8971 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:09.592295 14661 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:09.645531  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 157976us
I20260925 16:45:09.640610 14649 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260925 16:45:09.648713  9694 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:09.604542 14631 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.614845 14374 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:09.615620 14432 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:09.658452  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.627782 14337 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
W20260925 16:45:09.664565  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117212us
I20260925 16:45:09.662596  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3096) took 1106 ms. Trace:
I20260925 16:45:09.666133  9123 rpcz_store.cc:276] 0925 16:45:08.555876 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.575999 (+ 20123us) service_pool.cc:227] Handling call
0925 16:45:08.617334 (+ 41335us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:08.620167 (+  2833us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:08.620196 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:08.629566 (+  9370us) log.cc:842] Serialized 26 byte log entry
0925 16:45:08.691520 (+ 61954us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:08.691573 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:08.691662 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:09.662383 (+970721us) raft_consensus.cc:1671] finished
0925 16:45:09.662404 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:09.662546 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5394,"raft.queue_time_us":3108,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":6010,"thread_start_us":39205,"threads_started":1,"wal-append.queue_time_us":334264}
I20260925 16:45:09.671326  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:09.672317  9041 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:09.672509  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.677294  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:09.678578  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:09.688452 14670 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260925 16:45:09.688616  9044 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
W20260925 16:45:09.689368 14639 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.434s	user 0.001s	sys 0.000s
I20260925 16:45:09.668371 14571 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:09.661702 14432 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.660637 14550 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.674217 14643 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.605543 14666 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.683545 14337 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:09.714353 14562 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.775s	user 0.005s	sys 0.005s
W20260925 16:45:09.717299 14665 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260925 16:45:09.719039 14672 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:09.722944 14360 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:09.724363 14673 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260925 16:45:09.724982 14579 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:09.725945 14676 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260925 16:45:09.707890 14550 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.665102 14374 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.834416 14374 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.662077 14631 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.836942 14631 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.727998 14652 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.837997 14652 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.776372 14661 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:09.777882 14190 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.000s
I20260925 16:45:09.779626 14666 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.682411 14103 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.698832 14598 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
W20260925 16:45:09.780965 14269 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.639s	user 0.009s	sys 0.000s
I20260925 16:45:09.694996 14571 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:09.780689 14562 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.781893 14337 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.784543  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.858417  9044 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 17 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:45:09.699421 14432 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:09.859863 14687 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.860504 14687 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.863642 14687 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.863948 14374 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:09.864706 14374 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.787974 14524 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.801471 14643 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.867478 14376 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.868064 14643 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.868950 14687 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.869439 14687 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.869933 14524 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.799180  9696 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:09.871528 14687 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.871860  9042 raft_consensus.cc:2354] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13.
I20260925 16:45:09.872238 14687 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:09.868088 14376 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.870121 14643 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.824783  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:09.840950  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 135193us
I20260925 16:45:09.810624 14672 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:09.873441  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:09.867573 14374 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.841243 14567 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:09.900681  9041 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:09.901614  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:09.906514  9698 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:09.906464  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:09.905092  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:09.909125  9120 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:45:09.909077  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "088ac48c62d34a40b53987746a70b871"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:09.907671  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:09.847965 14598 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:09.909921  8970 raft_consensus.cc:595] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:09.912204  8970 raft_consensus.cc:603] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:09.900259 14552 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.856s	user 0.009s	sys 0.002s
I20260925 16:45:09.906153 14360 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:09.944612  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.903040 14103 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:09.926251 14579 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260925 16:45:09.939954  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 137746us
I20260925 16:45:09.899686 14666 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:09.908643 14567 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.929286  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.937512  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1052) took 2032 ms. Trace:
I20260925 16:45:09.938539 14571 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.908942 14524 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:09.877094 14646 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:09.857491 14269 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.927137 14583 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:09.845858 14190 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.962414 14190 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:09.963020  9118 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:09.903179 14395 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.956914 14655 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:09.966049 14655 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.966625  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:09.947767 14579 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:09.968696  9044 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 6. (term mismatch)
I20260925 16:45:09.969100 14579 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:09.969182  9044 pending_rounds.cc:76] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 5
I20260925 16:45:09.969640  9044 pending_rounds.cc:97] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 9.6
I20260925 16:45:09.969913  9044 raft_consensus.cc:2866] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:09.971076 14567 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.954470 14666 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:09.973346 14610 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.973652 14666 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:09.974007 14622 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.948880  8968 rpcz_store.cc:276] 0925 16:45:07.905299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.054648 (+149349us) service_pool.cc:227] Handling call
0925 16:45:08.055026 (+   378us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:09.537369 (+1482343us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:09.937231 (+399862us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b5400135e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:09.937443 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3407867648}
I20260925 16:45:09.948459  9123 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:09.952241  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.902369 14672 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:09.954175  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.955188  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.981986  9116 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:09.982317  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.983503  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.981292  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:09.985968  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.955958  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:09.956863 14646 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:09.959734 14562 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:09.993098  9122 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:09.994364 14550 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.960295 14598 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.996196  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.996750 14376 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.997283  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:09.998255  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.996214 14646 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:09.998796  8975 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:09.999293 14646 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:09.999823 14488 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:10.000200 14488 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:10.000507 14488 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:10.001726 14571 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:09.987373  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:09.999584  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.988855  9044 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:09.990047  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:09.990445  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:09.986542 14075 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.005s
I20260925 16:45:09.991068  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:10.017532  8972 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:09.988098 14652 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:09.991243 14512 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:10.012820 14269 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:10.014341  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:10.019800  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.024837  9044 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:10.024621  8970 raft_consensus.cc:595] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.025362  8970 raft_consensus.cc:603] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:09.951654 14563 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
W20260925 16:45:10.023797  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67396.7us
I20260925 16:45:10.005471 14666 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260925 16:45:10.035251 14512 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.037389 14512 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:10.038416  8966 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 10.
I20260925 16:45:10.042115 14590 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:10.042526 14590 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:10.040283  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.048013 14618 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:10.048523 14618 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:10.049500 14618 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.050984 14618 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.051270  9046 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260925 16:45:10.054720  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.056373  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.059872  8972 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:10.060120 14655 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.071374 14676 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:10.072481 14676 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:10.072814 14676 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:10.073552 14676 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.074800 14676 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:10.078522  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 2911) took 1206 ms. Trace:
W20260925 16:45:10.080274  9701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1496) took 1673 ms (client timeout 1809 ms). Trace:
W20260925 16:45:10.080768  9701 rpcz_store.cc:269] 0925 16:45:08.407331 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.407460 (+   129us) service_pool.cc:227] Handling call
0925 16:45:10.080062 (+1672602us) spinlock_profiling.cc:243] Waited 427 ms on lock 0x7b54004f1854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:10.080203 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":981055360}
I20260925 16:45:10.079066  9122 rpcz_store.cc:276] 0925 16:45:08.872634 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.873266 (+   632us) service_pool.cc:227] Handling call
0925 16:45:08.894170 (+ 20904us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:09.993620 (+1099450us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:10.078217 (+ 84597us) spinlock_profiling.cc:243] Waited 1.1 s on lock 0x7b5400041fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:10.078444 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2521159040}
I20260925 16:45:09.947168 14552 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:10.112218  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 131607us
I20260925 16:45:10.116739  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49c7db4b3fda45159275230bc247b929"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:10.116986  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.117589  8969 raft_consensus.cc:595] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.118181  8969 raft_consensus.cc:603] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:10.120209  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.128867  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.022883 14075 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.046955 14488 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.089419 14655 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:10.134704  9121 raft_consensus.cc:2354] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14.
I20260925 16:45:10.136689  9044 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:10.143010  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.043342 14590 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.144690  9044 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:10.159261  9119 raft_consensus.cc:2354] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:10.159940  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.164402  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.169977  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.171293 14337 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:10.174501 14337 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:10.153291 14595 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260925 16:45:10.172016  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:10.176899  8969 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.168103 14590 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.179360 14075 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:10.171896 14689 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260925 16:45:10.183730  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.184350  9043 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:10.185354  9043 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:10.187958  9050 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:10.152886 14596 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:10.206943  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.208194  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.210836  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.213188  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.211503  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.215413  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.148506 14655 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.216548  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.220615 14269 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:10.208568 14596 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.177409 14661 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260925 16:45:10.228580  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:10.229204  8969 raft_consensus.cc:595] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.175429 14337 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:10.232898 14698 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260925 16:45:10.201771 14432 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.241420 14432 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.229449 14596 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:10.247648  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 569454us
I20260925 16:45:10.249138 14552 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.249344  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.250463  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.253540  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.254134  9048 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:10.253710 14620 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:10.254040 14497 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:10.255285 14620 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:10.255654 14620 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:10.256479 14620 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.257591 14620 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:10.262163 14647 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:10.262687 14647 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.264053  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.264593  9694 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 13
I20260925 16:45:10.264990 14647 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:10.265257  9048 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:10.268370  9697 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:10.269695  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.271996  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.273823 14552 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:10.274315 14552 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:10.205256 14687 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:10.275171 14552 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.220422 14633 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:10.276163 14633 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:10.276646 14633 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:10.277238 14655 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:10.251642  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.279350  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.283561  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.284495  9043 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.289045  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.289724  9701 raft_consensus.cc:2362] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11. Re-sending same reply.
I20260925 16:45:10.290764  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1512) took 1296 ms. Trace:
I20260925 16:45:10.291150  9702 rpcz_store.cc:276] 0925 16:45:08.994477 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.998843 (+  4366us) service_pool.cc:227] Handling call
0925 16:45:08.999150 (+   307us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:09.207992 (+208842us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:09.208019 (+    27us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:09.385839 (+177820us) log.cc:842] Serialized 26 byte log entry
0925 16:45:09.544334 (+158495us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:09.545684 (+  1350us) log.cc:842] Serialized 14 byte log entry
0925 16:45:10.232735 (+687051us) spinlock_profiling.cc:243] Waited 30.3 ms on lock 0x7b18001d36e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:10.232960 (+   225us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:10.233719 (+   759us) spinlock_profiling.cc:243] Waited 110 ms on lock 0x7b54004c40d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:10.233775 (+    56us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:10.290575 (+ 56800us) raft_consensus.cc:1671] finished
0925 16:45:10.290594 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:10.290715 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3928,"prepare.queue_time_us":1142,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":46,"raft.queue_time_us":690267,"raft.run_cpu_time_us":244,"raft.run_wall_time_us":70834,"spinlock_wait_cycles":323235456,"thread_start_us":101386,"threads_started":1,"wal-append.queue_time_us":251045}
I20260925 16:45:10.294256 14571 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:10.294764 14571 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.297000 14571 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:10.302254  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.303612  9700 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260925 16:45:10.307391  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.304279  9698 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:10.304082  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.304117  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.314309  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.315569  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.316632  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.320802  9697 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:10.320585  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.326753  9694 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
W20260925 16:45:10.326762  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46668.6us
I20260925 16:45:10.327630  9695 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:10.330897  9694 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:45:10.216971 14666 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:10.333153  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.333775  9702 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:10.333941  9694 raft_consensus.cc:595] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.335216  9695 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:10.326126 14613 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260925 16:45:10.326640 14671 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260925 16:45:10.336913  9694 raft_consensus.cc:603] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:10.335953 14672 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.343806  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.345539  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:10.357534 14488 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:10.359220  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:45:10.360992  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:10.361639  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:10.360389  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1513) took 1365 ms. Trace:
I20260925 16:45:10.366050  9043 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:10.368244  9122 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:10.369035  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.369910  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:10.362073  9693 rpcz_store.cc:276] 0925 16:45:08.994747 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:08.999311 (+  4564us) service_pool.cc:227] Handling call
0925 16:45:09.010613 (+ 11302us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:09.045035 (+ 34422us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:09.142777 (+ 97742us) log.cc:842] Serialized 14 byte log entry
0925 16:45:10.334286 (+1191509us) log.cc:842] Serialized 14 byte log entry
0925 16:45:10.334467 (+   181us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:10.343461 (+  8994us) log.cc:842] Serialized 26 byte log entry
0925 16:45:10.347982 (+  4521us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:10.348034 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:10.348119 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:10.360206 (+ 12087us) raft_consensus.cc:1671] finished
0925 16:45:10.360223 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:10.360341 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":637587,"prepare.queue_time_us":345900,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":40,"raft.queue_time_us":651906,"raft.run_cpu_time_us":350,"raft.run_wall_time_us":6719,"thread_start_us":460899,"threads_started":3,"wal-append.queue_time_us":481509}
W20260925 16:45:10.380502 14697 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260925 16:45:10.348572 14651 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:10.392191  9693 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:10.395352  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1304) took 1317 ms. Trace:
I20260925 16:45:10.395884  9119 rpcz_store.cc:276] 0925 16:45:09.077813 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:09.078602 (+   789us) service_pool.cc:227] Handling call
0925 16:45:10.395104 (+1316502us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540010c054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:10.395261 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2395726720}
W20260925 16:45:10.413165 14702 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:45:10.419181 14631 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:45:10.420728 14631 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:10.421789 14631 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:10.422192 14631 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:10.427032  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:10.428448  8975 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260925 16:45:10.429275  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:10.429615  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:10.429937  8972 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:10.429804 14579 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.430816  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:10.431402  8975 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.432717 14672 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:10.437216  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 229084us
I20260925 16:45:10.438035  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.438830 14658 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:10.439023  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.443988  8973 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:10.451028 14349 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:10.451391 14349 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:10.451475  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:10.452569  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:10.452219 14349 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.453438 14349 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:10.454871  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 242466us
I20260925 16:45:10.455017 14510 raft_consensus.cc:979] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:10.442036  9124 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:10.455567 14374 raft_consensus.cc:1067] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:10.456079  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.443437  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:10.457538  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.458489 14471 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:10.458918 14471 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.440016 14692 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:10.460412 14692 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:10.460799 14692 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.460822 14471 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:10.440945  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:10.464166  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.442557  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:10.466255  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:10.467377  8972 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:10.440663  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1056) took 1103 ms. Trace:
I20260925 16:45:10.475219  8974 rpcz_store.cc:276] 0925 16:45:09.337681 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:09.337851 (+   170us) service_pool.cc:227] Handling call
0925 16:45:09.507553 (+169702us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:09.508224 (+   671us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:10.440492 (+932268us) spinlock_profiling.cc:243] Waited 117 ms on lock 0x7b540036ea50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:10.440614 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":269602688}
I20260925 16:45:10.474587  8968 raft_consensus.cc:2362] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16. Re-sending same reply.
I20260925 16:45:10.487968  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.490223  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.470088 14360 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:10.493455  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:10.492166  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:10.505323  9665 leader_election.cc:398] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:10.505249  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.529945  9120 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:10.504729  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:10.537477  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.538249  9045 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:10.488796 14349 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:10.543845  9124 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:10.530014  9665 leader_election.cc:401] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:10.504714 14579 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.526163 14656 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:10.549264  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85216.6us
I20260925 16:45:10.529183 14620 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:10.550031  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83875.9us
I20260925 16:45:10.532548 14432 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:10.539597  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.575516  9046 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.552537  9050 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:45:10.552963  9048 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:10.576248  9050 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:10.576633  9050 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:10.423281 14631 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:10.557212  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61489.8us
I20260925 16:45:10.584257  9045 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:10.590229  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.592496  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.593015  9666 leader_election.cc:398] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13.
I20260925 16:45:10.593464  9666 leader_election.cc:401] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:10.594873  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.577641 14590 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:10.584638 14620 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.598143 14571 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13.
I20260925 16:45:10.598791 14620 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:10.584725 14432 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:10.599611 14432 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:10.599750 14646 raft_consensus.cc:2741] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election decision vote started in defunct term 11: won
I20260925 16:45:10.559194 14656 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:10.600943 14656 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:10.532303 14456 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260925 16:45:10.558431 14550 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:10.611187  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:10.612838 14683 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:10.613533 14683 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.614378 14567 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:10.615813 14691 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:10.616313 14691 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:10.616537  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.617134 14691 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.617794 14672 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:10.618294 14672 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:10.619163 14672 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:10.620559 14712 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260925 16:45:10.620469  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.621476  9048 raft_consensus.cc:2354] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16.
I20260925 16:45:10.558758 14675 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:10.623224  9048 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:10.624148  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:10.625110  9046 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:10.644193  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:10.644258  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.627566  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:10.642889  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 156541us
I20260925 16:45:10.650187  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.650908  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.652236  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.655337  9666 leader_election.cc:398] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16.
I20260925 16:45:10.655139  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:10.655768  9666 leader_election.cc:401] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:10.658910  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.659614  9702 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.659811  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:10.660468  9045 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:10.662245  9698 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:10.663796  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.678726  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.666630  9124 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:10.682404  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.682641  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:10.619153 14376 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:10.615586 14683 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.731937  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.732476  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:10.733239  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 78219.7us
I20260925 16:45:10.734056  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:10.735097  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:10.735025  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.740175  9701 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.732613  9696 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:10.742019  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59518.9us
I20260925 16:45:10.661545 14687 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:10.649495 14658 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:10.641841 14567 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:10.753310  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68500.4us
I20260925 16:45:10.801308  9666 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:10.801829  9666 leader_election.cc:401] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
W20260925 16:45:10.808840 14679 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260925 16:45:10.810009 14715 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.184s	user 0.000s	sys 0.000s
I20260925 16:45:10.767927 14390 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:10.817875 14390 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:10.826408  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 380720us
I20260925 16:45:10.827719 14560 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:10.828241 14560 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.830137 14560 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.842403  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:10.844841  9049 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:45:10.855046  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:10.765810  9701 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:10.731456 14647 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16.
I20260925 16:45:10.734421  9050 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.678123 14571 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.748965  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:10.775491  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:10.739480  9693 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:10.743990  8921 placement_policy_util.cc:244] tablet c694676902c54ad8bfe8e7fd5a725e33: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260925 16:45:10.686947 14622 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:10.815312 14598 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:10.625790 14103 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.113s
W20260925 16:45:10.922742  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67783.4us
I20260925 16:45:10.685011 14667 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:10.928978  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 180126us
I20260925 16:45:10.857586  9696 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:10.686720 14666 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:10.913268  9050 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:10.913555  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3024) took 1621 ms. Trace:
W20260925 16:45:10.792400 14639 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.108s	user 0.000s	sys 0.000s
I20260925 16:45:10.747669 14680 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:10.734529 14583 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:10.790215 14706 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.297s	user 0.000s	sys 0.001s
I20260925 16:45:10.935030  9047 rpcz_store.cc:276] 0925 16:45:09.291690 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:09.291821 (+   131us) service_pool.cc:227] Handling call
0925 16:45:09.292098 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:09.445884 (+153786us) raft_consensus.cc:1520] Early marking committed up to index 8
0925 16:45:09.476199 (+ 30315us) log.cc:842] Serialized 14 byte log entry
0925 16:45:10.155638 (+679439us) spinlock_profiling.cc:243] Waited 3.5 ms on lock 0x7b180038f560. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b 00007f719bf3488a
0925 16:45:10.484874 (+329236us) log.cc:842] Serialized 14 byte log entry
0925 16:45:10.485171 (+   297us) log.cc:842] Serialized 14 byte log entry
0925 16:45:10.485312 (+   141us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:10.485360 (+    48us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:10.485433 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:10.847195 (+361762us) spinlock_profiling.cc:243] Waited 8.8 ms on lock 0x7b180038f560. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:10.913317 (+ 66122us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b54000d48d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:10.913366 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:10.913499 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":210523,"prepare.queue_time_us":30533,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":1610,"raft.queue_time_us":225875,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":46692,"spinlock_wait_cycles":470407296,"thread_start_us":124642,"threads_started":1,"wal-append.queue_time_us":991424}
I20260925 16:45:10.933187 14693 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:10.924088  8939 leader_election.cc:398] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14.
I20260925 16:45:10.780373 14376 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:10.772363 14471 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:10.797268 14619 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:10.778568 14608 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.157s
I20260925 16:45:10.958722  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:10.983201  9123 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:10.868623 14567 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:10.685202 14512 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:10.933039 14357 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:10.933503 14349 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:10.968851  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:10.976599  9047 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:45:10.849821 14658 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.942989 14687 raft_consensus.cc:2741] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260925 16:45:10.925765 14360 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260925 16:45:10.963716  9702 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:10.987056 14390 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:10.949674 14666 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:10.961997 14590 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:10.959684 14676 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:10.960263 14629 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:10.934212 14493 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260925 16:45:10.938061 14667 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:10.983601 14655 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.016435  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:10.966082 14678 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260925 16:45:10.990118 14376 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:11.019193  9047 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:11.021541  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:10.992897 14471 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:10.962580 14583 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.029070  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:11.033069  8966 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:11.033622  8966 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:11.024194  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.033182  9048 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260925 16:45:10.990833 14337 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260925 16:45:11.034636  8966 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.054582  8966 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:10.988896 14619 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.050585  9694 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:11.014472 14512 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.008458 14233 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.035564  9123 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:11.012537 14629 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.029182 14655 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.070696 14666 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.128885  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:11.001655 14349 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.084794 14658 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.051463 14590 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.092727 14656 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:11.096702 14706 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260925 16:45:11.055766 14687 consensus_queue.cc:1159] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 10 status { last_received { term: 10 index: 6 } last_committed_idx: 6 last_received_current_leader { term: 10 index: 6 } }
I20260925 16:45:11.107502  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:11.070746 14675 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:11.115713  8966 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:11.106220  8971 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 15
W20260925 16:45:11.120234  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52331.9us
I20260925 16:45:11.146847  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:11.123863  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:11.124109 14725 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
I20260925 16:45:11.124559 14489 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:11.124836 14722 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260925 16:45:11.121064 14512 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.180383  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:11.125989 14667 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:11.126814 14633 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.850s	user 0.009s	sys 0.002s
I20260925 16:45:11.127133  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:11.127835 14567 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.082974 14619 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:11.131405  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 201736us
I20260925 16:45:11.122351 14233 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:11.106360  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 305203us
I20260925 16:45:11.150797  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:11.156247 14629 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.139710 14590 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.158501 14456 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:11.160926 14360 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.161192 14656 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.161324 14675 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:11.124747 14376 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.142508  9123 raft_consensus.cc:2354] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:11.188417 14690 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:11.200281  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:11.200436  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49942.9us
W20260925 16:45:11.182994 14692 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.721s	user 0.009s	sys 0.001s
W20260925 16:45:11.188366 14432 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.586s	user 0.008s	sys 0.002s
I20260925 16:45:11.203472  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:11.205109  8971 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:11.144714  9115 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
W20260925 16:45:11.246027  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 265498us
I20260925 16:45:11.249181  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:11.246265  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:11.253017  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:11.208649 14142 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:11.185966 14560 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:11.197844  8972 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:11.215947  8939 leader_election.cc:398] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:11.217415 14512 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.206591 14446 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260925 16:45:11.183962 14489 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.218413 14676 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:11.124595 14471 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:11.201025  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 453648us
I20260925 16:45:11.259093  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:11.262384  8939 leader_election.cc:401] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:11.198738 14633 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.214107 14103 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.252686 14458 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:11.295677  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:11.295789  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79939.4us
I20260925 16:45:11.213912 14360 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.262953 14357 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:11.302325  8968 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:11.265220 14643 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:11.322989  9116 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
W20260925 16:45:11.317957  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 349420us
I20260925 16:45:11.282441 14676 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:11.321979  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.327865  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:11.278724 14524 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.336556  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:11.248742 14432 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.330022  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:11.337545  9695 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:11.340430  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:11.341143  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:11.341292  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:11.301766 14733 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:11.281059 14557 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.060s
I20260925 16:45:11.315424 14103 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.374112  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:11.336876 14622 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:11.383172  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:11.386199  9119 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:11.387192  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.258534 14692 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.277450 14560 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.383272  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.403667  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:11.344640 14552 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:11.347609 14672 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:11.341522 14349 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.314383  8972 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260925 16:45:11.350363 14075 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:11.417804  8968 raft_consensus.cc:2396] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 14 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260925 16:45:11.339601 14524 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.447294  9045 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:11.335840 14643 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.508577  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:11.513628  9050 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:11.417912 14622 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:11.451824 14730 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.192s	user 0.000s	sys 0.001s
W20260925 16:45:11.520597  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 204959us
I20260925 16:45:11.419021 14690 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:11.511183 14233 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.510267 14672 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:11.393704 14655 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.654495  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:11.658159 14458 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:11.524202 14590 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:11.423833 14571 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:11.596871 14703 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260925 16:45:11.418008 14680 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:11.679951  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:11.724588  9695 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:11.690173  9702 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:11.600286 14690 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:11.786005 14458 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.664373 14656 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.789953  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.600139 14622 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.760445 14446 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.667229 14666 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:11.791440  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 378485us
I20260925 16:45:11.787828 14489 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.788127 14690 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:11.813123  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:11.788957 14597 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.820583  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:11.800303 14075 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:11.801854 14633 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:11.803138 14357 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.806290 14736 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.800591 14571 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:11.802970 14590 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:11.833464  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 537803us
I20260925 16:45:11.839322  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:11.841126  9665 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14.
I20260925 16:45:11.817493 14360 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.509397 14734 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.270s
I20260925 16:45:11.843731  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:11.825918 14489 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.850376  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:11.852910  9045 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:11.826205 14432 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.846478 14655 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.857592 14560 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.857527 14489 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.858281 14647 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:11.858721 14647 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:11.859879 14432 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:11.859645 14647 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.860368 14432 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.860811 14622 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:11.861359 14622 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:11.872853  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.846342 14357 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.812047 14656 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.817421 14446 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.843495 14524 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.847574 14103 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.830911 14597 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.821162 14666 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.843398 14633 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.875947 14749 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.876322 14692 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.861848 14622 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.848861 14590 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.847227 14571 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.921787 14571 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.922281 14571 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:11.924235  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1998) took 1299 ms. Trace:
I20260925 16:45:11.924572  9048 rpcz_store.cc:276] 0925 16:45:10.624484 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.730945 (+106461us) service_pool.cc:227] Handling call
0925 16:45:10.731210 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:11.036504 (+305294us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:11.924031 (+887527us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:11.924184 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":693702528}
W20260925 16:45:11.925132 14675 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.683s	user 0.009s	sys 0.000s
I20260925 16:45:11.925618 14675 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:11.927964  8970 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:11.899374 14691 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.030s
I20260925 16:45:11.929826 14446 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.932755  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1997) took 1309 ms. Trace:
I20260925 16:45:11.933606 14666 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.933203  9046 rpcz_store.cc:276] 0925 16:45:10.623233 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.678514 (+ 55281us) service_pool.cc:227] Handling call
0925 16:45:10.745012 (+ 66498us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:10.768353 (+ 23341us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:10.768384 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:10.768811 (+   427us) log.cc:842] Serialized 26 byte log entry
0925 16:45:11.788647 (+1019836us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b18002e9900. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:45:11.847636 (+ 58989us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:11.847691 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:11.847804 (+   113us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:11.932405 (+ 84601us) raft_consensus.cc:1671] finished
0925 16:45:11.932432 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:11.932689 (+   257us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22868,"raft.queue_time_us":23472,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":17845,"spinlock_wait_cycles":157351808,"thread_start_us":58754,"threads_started":1,"wal-append.queue_time_us":1122453}
I20260925 16:45:11.895131 14489 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.904013 14432 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.937191  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 1999) took 1094 ms. Trace:
I20260925 16:45:11.937456 14360 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:11.938014 14360 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.938827 14620 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:11.939464 14744 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260925 16:45:11.889292 14598 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.958s	user 0.012s	sys 0.000s
I20260925 16:45:11.881104 14643 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.912438 14583 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.889707 14753 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.940527  9041 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:11.941148 14735 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:11.940894 14753 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.941622 14735 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.943005 14753 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.944603 14622 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:11.937645  9044 rpcz_store.cc:276] 0925 16:45:10.842635 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.852501 (+  9866us) service_pool.cc:227] Handling call
0925 16:45:10.852851 (+   350us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:11.058673 (+205822us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:11.384439 (+325766us) log.cc:842] Serialized 14 byte log entry
0925 16:45:11.384684 (+   245us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:11.384727 (+    43us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:11.384767 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:11.936941 (+552174us) spinlock_profiling.cc:243] Waited 206 ms on lock 0x7b54000a82d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:11.936998 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:11.937131 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":83364,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":3089,"raft.queue_time_us":413775,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9139,"spinlock_wait_cycles":472800640,"thread_start_us":263784,"threads_started":1}
I20260925 16:45:11.945133 14622 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:11.945750 14622 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.949719 14557 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:11.950534 14590 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:11.918233 14747 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:11.917497 14357 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.953773  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.958019  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.950220 14557 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.849006 14736 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.979859  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:11.875280 14655 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:11.985925  9117 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:11.986629  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.993848  8971 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:11.985586  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 169058us
I20260925 16:45:11.990975  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.998473  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:11.998955  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:11.999725 14557 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.002120  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.002789  8971 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:12.003984 14675 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:11.855537 14672 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.006598  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:11.996701  8968 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:12.010025  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:11.960068 14075 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.012509  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.013181  9044 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:12.014058 14738 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.014552 14738 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:12.014925 14738 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.016085  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1118) took 1358 ms. Trace:
I20260925 16:45:12.016513  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3138) took 1054 ms. Trace:
I20260925 16:45:12.017200  9115 rpcz_store.cc:276] 0925 16:45:10.962216 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.962756 (+   540us) service_pool.cc:227] Handling call
0925 16:45:12.016343 (+1053587us) spinlock_profiling.cc:243] Waited 149 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:12.016458 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":341962496}
I20260925 16:45:12.016451  9694 rpcz_store.cc:276] 0925 16:45:10.657871 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.658057 (+   186us) service_pool.cc:227] Handling call
0925 16:45:12.015936 (+1357879us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b540066dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:12.016031 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":654157184}
W20260925 16:45:11.993745 14652 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.004s	sys 0.014s
W20260925 16:45:12.021195 14652 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.004s	sys 0.014s
I20260925 16:45:11.978798 14678 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:11.906551 14633 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.024132  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:12.030413 14656 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.031266 14631 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:12.032727 14655 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:11.939477 14620 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.035107 14620 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.019613 14557 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.038308  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:12.054939  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57145.3us
I20260925 16:45:12.056653  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.057837  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:12.053156  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.044368  9044 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:12.086112  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3128) took 1600 ms. Trace:
I20260925 16:45:12.086503  9116 rpcz_store.cc:276] 0925 16:45:10.486188 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.486294 (+   106us) service_pool.cc:227] Handling call
0925 16:45:10.486571 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:11.323470 (+836899us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:12.045569 (+722099us) spinlock_profiling.cc:243] Waited 836 ms on lock 0x7b54001c8c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:12.086059 (+ 40490us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1922986880}
I20260925 16:45:12.026254 14360 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.089783  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:11.908571 14749 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.093144  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.094403  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.095104  9116 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:12.094453  8968 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:12.097568  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:12.095983  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:12.099189  9046 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.103102  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.103739  9116 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:12.106258  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:12.108662  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.110991  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.038439 14557 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:12.111812  9044 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:12.140213  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.090955 14656 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.140974  9047 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:12.091140 14622 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.093667 14488 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:12.141512  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.148520  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.028777 14678 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.096562 14736 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.156028 14488 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.156430 14488 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:12.137147 14735 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.158735  9116 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:12.160259 14571 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:12.161000 14571 consensus_queue.cc:1225] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 20.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260925 16:45:12.161302 14675 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:12.161736 14675 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.162084 14675 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:12.148458 14744 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
W20260925 16:45:12.152144  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 15 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:12.164014 14762 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260925 16:45:12.165189 14762 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:12.139930 14376 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.165495 14493 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.165571  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.166109 14493 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.166016 14376 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.166623 14493 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.137251 14745 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:12.167605 14618 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:12.168094 14618 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.168533 14618 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:12.168931  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.169417 14656 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.157207 14676 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.813s	user 0.006s	sys 0.003s
I20260925 16:45:12.170964 14676 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.171970  9117 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:12.155165 14655 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.169938  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.176666  9116 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:12.191205  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.167878 14745 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.186911  9046 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:12.199604  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.139552 14357 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.139840 14557 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.137672 14755 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.216555  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:12.155303 14743 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.345s	user 0.001s	sys 0.004s
I20260925 16:45:12.214624  9048 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:12.139271 14374 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.154856 14633 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.152315 14597 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.220774  9117 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:45:12.165519 14762 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:12.213339  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 370608us
I20260925 16:45:12.243520  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.244231  9115 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
W20260925 16:45:12.223142  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 381034us
I20260925 16:45:12.225953  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.239346  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.211930 14658 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.153885 14749 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.243422  8968 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:12.207897 14745 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:12.248809  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.215126 14753 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:12.207683 14655 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.217021 14763 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.271323  8968 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.274676  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.273336  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.274077  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.271453  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:12.278874  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.268571  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.279639  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.281268  8974 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:12.282964  9117 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:12.251341  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:12.286590  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.274922 14525 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:12.269507 14470 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:12.295712 14376 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.295842 14470 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.296048  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.296293 14470 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:12.296963  9045 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260925 16:45:12.280653  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:12.295545 14525 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.298532 14525 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:12.269230 14633 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.299155 14633 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.218371 14357 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.301229 14633 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.301342 14357 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.302181 14656 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.271994  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:12.319403  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45907.5us
I20260925 16:45:12.320122  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.320753  8974 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:12.321113  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:12.324155  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45801.7us
I20260925 16:45:12.324651  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.320758  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:12.321135  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:12.327080  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55158.5us
I20260925 16:45:12.320425  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.325264  9047 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:12.248773 14658 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.332165  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:12.326649  9121 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:12.265547 14678 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.337427  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.337858  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.339584  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.340157  9700 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:12.341755  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.343730  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:12.344241  9701 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.345063  9695 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260925 16:45:12.348760  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:12.352141  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.350455  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:12.353542  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.013s	sys 0.045s
W20260925 16:45:12.353883  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.538s	user 0.013s	sys 0.045s
I20260925 16:45:12.355338  9048 raft_consensus.cc:2379] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:12.241688 14374 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:12.357648  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 42b301336d224f89acb2543ae4e24a12, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.356280  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.321846 14471 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:12.358404  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:12.358597  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 42b301336d224f89acb2543ae4e24a12, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.331279 14608 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.333446 14634 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:12.358400  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.362782  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.359342  9695 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:12.333642 14667 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.332381 14753 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:12.381624  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.321419 14360 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260925 16:45:12.368283  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:12.359378  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.004s	sys 0.041s
W20260925 16:45:12.386906  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.005s	sys 0.041s
I20260925 16:45:12.350603 14552 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.337304 14658 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.337597 14736 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:12.379315  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.334286 14633 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260925 16:45:12.365922  9701 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:12.367067 14608 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.270888 14690 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.357456  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.352319 14656 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:12.224287 14755 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.387950  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.355382 14683 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.389449  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:12.400755  8967 raft_consensus.cc:595] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:12.401189  8967 raft_consensus.cc:603] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:12.357966 14432 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.348193 14766 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:12.383841  9697 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:45:12.372002 14747 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:12.385010  9695 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:12.375459 14735 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.395473  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.372195 14687 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:12.414548  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.373207 14634 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.401494  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.398079 14608 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.389685 14446 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:12.388531 14376 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.389899 14552 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.414395  8971 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:12.418309  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.378014 14667 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.418581  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.302829 14763 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.404435  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.417937  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:12.433429  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.751s	user 0.004s	sys 0.021s
I20260925 16:45:12.375288 14471 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.440256  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.758s	user 0.004s	sys 0.021s
I20260925 16:45:12.439662  9048 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:12.443094  9702 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:12.399492 14666 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.423746  8966 raft_consensus.cc:2354] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14.
I20260925 16:45:12.482218  9702 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:54192
I20260925 16:45:12.349514 14762 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.486557  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.490577  9701 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:12.485613  9702 raft_consensus.cc:595] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:12.491417  9702 raft_consensus.cc:603] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:12.489214  9048 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:12.443568  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:12.397279 14736 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.499112  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:12.443502 14552 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.422254 14692 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:12.405511 14683 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.402294 14656 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.509763  9695 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:12.405154 14579 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.447814 14766 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:12.402185 14768 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:12.415474 14747 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.512531  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.513180  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:12.493019 14596 raft_consensus.cc:979] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:12.517978  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.505734 14758 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.430467 14634 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:12.420403 14676 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.440335 14687 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.525430  9701 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:12.408211 14432 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.418358 14672 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.100s
I20260925 16:45:12.443747 14376 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:12.591554  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73665.4us
I20260925 16:45:12.625396  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.625734  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6030f186a664452b127609fadec766b"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:12.414990 14751 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.156s
I20260925 16:45:12.561117  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:12.592339  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 151447us
I20260925 16:45:12.593212  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.636564  9702 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:12.561340 14747 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:12.449738 14738 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.436718 14735 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.539119 14649 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.520936 14765 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.626446  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.648257  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:12.545230  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.542297 14768 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.537711 14631 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.629779  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.638547  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:12.658708  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.509618 14666 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.639298  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.621315 14687 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:12.541015 14766 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.543844 14692 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:12.673318  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 160208us
I20260925 16:45:12.450174 14753 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.572543 14752 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:12.562206 14762 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:12.600041 14622 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:12.562028 14655 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.657460 14620 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:12.514703 14773 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.152s
I20260925 16:45:12.651005 14649 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.546411  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.655023  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:12.599918 14678 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.574520 14769 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:12.671543  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.814s (SENT) [suppressed 5 similar messages]
I20260925 16:45:12.672821  9699 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:12.693288 14693 raft_consensus.cc:1067] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:12.677425  9044 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:12.679867  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:12.687541  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:12.721882  9123 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.687866  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.723140  9116 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:12.690042  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.725369  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:12.726966  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52508.7us
I20260925 16:45:12.690219  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2005) took 1660 ms. Trace:
I20260925 16:45:12.727568  8972 rpcz_store.cc:276] 0925 16:45:11.030251 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:11.030358 (+   107us) service_pool.cc:227] Handling call
0925 16:45:11.047306 (+ 16948us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:11.416684 (+369378us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:12.689993 (+1273309us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54003e7e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:12.690170 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":345880832}
I20260925 16:45:12.649480 14446 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:12.542686 14579 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.733431 14781 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260925 16:45:12.734236 14579 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.648574 14598 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:12.734752 14598 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:12.735203 14598 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:12.735863 14446 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.737918 14683 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.738214 14446 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:12.741323 14618 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.572s	user 0.009s	sys 0.000s
I20260925 16:45:12.741755 14618 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.659649 14374 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.664484 14631 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.622570 14758 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:12.699537  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51356.5us
I20260925 16:45:12.700104 14613 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260925 16:45:12.701239 14774 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260925 16:45:12.744555 14675 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.003s
I20260925 16:45:12.724452 14357 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:12.687986 14692 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.663187 14765 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.688408 14771 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260925 16:45:12.657888 14768 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:45:12.709345  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 1982) took 2715 ms (client timeout 2807 ms). Trace:
I20260925 16:45:12.709615  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.712831  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.673156 14766 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.717371  8973 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 11: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:12.692818  9045 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:12.698112 14690 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.745678  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:12.812021  9041 rpcz_store.cc:269] 0925 16:45:09.983446 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:09.985679 (+  2233us) service_pool.cc:227] Handling call
0925 16:45:12.698187 (+2712508us) spinlock_profiling.cc:243] Waited 1.95 s on lock 0x7b5400362754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:12.698389 (+   202us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4493225216}
I20260925 16:45:12.746340 14432 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.748013 14666 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.748101 14608 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.749341 14493 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.000s
I20260925 16:45:12.787856 14620 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.824573  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.788033 14613 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.752166 14470 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.752964 14735 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.729748 14471 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.711083 14655 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:12.760766  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.710110 14755 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.698995  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.767553  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:12.842840  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75389.3us
W20260925 16:45:12.701812 14776 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260925 16:45:12.744658 14563 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:12.847360 14563 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:12.847796 14563 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:12.851817 14787 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:12.852270 14787 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:12.853590 14618 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.853508 14787 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.855016 14797 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.854806 14563 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.855499 14797 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.856117  9697 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:12.857496 14797 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.857955 14563 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:12.858850 14775 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.195s	user 0.000s	sys 0.000s
I20260925 16:45:12.859411 14791 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.831629 14613 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:12.796475  9123 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
W20260925 16:45:12.797041  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 163592us
I20260925 16:45:12.797091 14675 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.881042 14675 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.881618  8968 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:12.761354 14656 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
W20260925 16:45:12.842952 14779 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.249s	user 0.001s	sys 0.000s
I20260925 16:45:12.885100  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:12.730863 14769 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.814956  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.818120  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.819257  9049 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:12.803929  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.704425 14784 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.095s
I20260925 16:45:12.786657 14763 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.828313  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2010) took 1012 ms. Trace:
I20260925 16:45:12.695817 14752 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.730193 14678 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.832181  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 193706us
I20260925 16:45:12.896893  8966 rpcz_store.cc:276] 0925 16:45:11.815816 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:11.815960 (+   144us) service_pool.cc:227] Handling call
0925 16:45:12.828057 (+1012097us) spinlock_profiling.cc:243] Waited 594 ms on lock 0x7b5400355cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:12.828244 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1366388608}
W20260925 16:45:12.897435  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 93635.9us
I20260925 16:45:12.897508  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:12.891461  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:12.814181 14736 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.838963  9693 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:12.730237 14672 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.843549  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.906484  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:12.907099  9044 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:12.824891 14596 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.694934 14525 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.864173  9115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:12.908213  9115 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:12.908563  9115 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:12.909689 14788 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.910418  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.910745 14752 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.910624 14788 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.742734 14667 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.865669  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:12.840979 14488 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.684s	user 0.012s	sys 0.000s
W20260925 16:45:12.870415 14783 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.157s	user 0.000s	sys 0.001s
W20260925 16:45:12.871124 14782 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260925 16:45:12.871074 14470 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.871622 14754 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:12.872462 14778 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.198s	user 0.001s	sys 0.000s
I20260925 16:45:12.872579 14608 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:12.827270 14493 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:12.873294 14777 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260925 16:45:12.872977 14747 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.874210 14658 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.831429 14620 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.750298 14649 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.899998  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:12.975884  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 76248.2us
I20260925 16:45:12.914000 14672 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.854826 14787 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:12.984189 14672 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:12.917060  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73610.6us
I20260925 16:45:12.984740 14651 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.985239 14651 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.985822  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:12.963485 14765 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:12.914324  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 237541us
I20260925 16:45:12.889793 14738 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.925704  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.995185  8972 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:12.906071 14655 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:12.930590 14789 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:12.931082 14631 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.859926 14791 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.907258 14693 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:13.004645 14693 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:13.005048 14693 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:12.994896 14736 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.006912  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.007529  9047 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:12.997769 14731 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260925 16:45:12.934397  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.009519  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.921479 14799 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260925 16:45:13.011569 14788 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.002154 14797 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:13.012332 14797 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.014344 14797 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.011574 14658 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.019076 14651 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.019958 14789 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.024272 14768 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.934441  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:12.906898 14618 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:13.029943 14618 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.921219 14571 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:45:12.953845 14745 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.651s	user 0.009s	sys 0.000s
I20260925 16:45:12.958216  8970 raft_consensus.cc:595] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:12.958664 14769 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.958907 14613 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.038563  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.038807  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.039372 14613 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:13.040143  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:12.959131 14754 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.041780  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.042366  9695 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:13.042480  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1072) took 1077 ms. Trace:
I20260925 16:45:13.043035 14754 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.960126 14796 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:12.924567 14786 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:12.960884 14493 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.933207 14790 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.235s
I20260925 16:45:13.044646 14598 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.045315  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.963251 14678 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.964435 14802 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:13.046538  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.047132  8973 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:13.047596 14746 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:13.048161 14746 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.049998  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.050194 14746 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.050926 14618 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.052137 14745 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.053339  9700 raft_consensus.cc:2354] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:45:13.055516  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.056995 14745 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:13.057556 14768 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.962446 14634 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:12.952064 14800 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.029s
I20260925 16:45:12.889561 14376 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.979868 14755 raft_consensus.cc:2741] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260925 16:45:12.980473 14649 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.981030 14337 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:12.981990 14620 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.917761 14596 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:12.982328 14758 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:12.918155  9049 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:12.989441  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.073714  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.074051  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:13.074760  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.075137  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.075372 14642 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:13.075832  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.063544 14649 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.076824  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.078015 14649 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:13.078203  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.078845  9117 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:13.079485  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.078840 14800 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:13.080243 14789 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.080324 14800 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:13.081002  8966 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:13.081326 14800 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.081815  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:13.082640 14800 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:13.063788 14337 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.080574  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.085616  9041 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:13.086664  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.998682  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:12.931118 14692 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.074775 14596 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.093655  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.095129  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.095810  9041 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
W20260925 16:45:12.978144 14557 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.747s	user 0.005s	sys 0.005s
I20260925 16:45:13.096786 14557 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.098737  9694 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
W20260925 16:45:13.064164  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60768.7us
I20260925 16:45:13.098963  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.100741  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.996292  8969 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:13.004933  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.103647  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.104156  9050 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:13.104501  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.105177  9124 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.105321  9050 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:13.026597  9042 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:12.968084 14525 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.939077  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.108376 14766 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.109623  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.110762 14766 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.111023  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.029284  9047 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:13.034547  8970 raft_consensus.cc:603] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:13.034657  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 363124us
I20260925 16:45:13.036314  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.036718 14747 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:12.925051 14488 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.065474 14618 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:13.126232  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet e7e6790e980f40f8aeb12986a2ac7ed6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:13.126585  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet e7e6790e980f40f8aeb12986a2ac7ed6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.126473 14618 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.059055 14791 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.044960  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.127990  9046 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:13.057849  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.129475  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:12.966528  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:13.058145  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 363544us
I20260925 16:45:13.130028 14687 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.131628  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:13.132591 14620 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:13.132961 14620 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:13.133286  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.134420  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.135510  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.136399  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.136579 14796 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:13.136979  8973 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:13.137126 14796 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:13.137408 14488 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.137769  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.133281 14620 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:13.118468  9124 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.042819  8975 rpcz_store.cc:276] 0925 16:45:11.964630 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:11.964790 (+   160us) service_pool.cc:227] Handling call
0925 16:45:11.965140 (+   350us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:11.965501 (+   361us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:11.965529 (+    28us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:12.324323 (+358794us) spinlock_profiling.cc:243] Waited 5.3 ms on lock 0x7b18003921a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a
0925 16:45:12.828652 (+504329us) spinlock_profiling.cc:243] Waited 7.72 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:45:12.843762 (+ 15110us) log.cc:842] Serialized 52 byte log entry
0925 16:45:12.928000 (+ 84238us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:12.928623 (+   623us) log.cc:842] Serialized 14 byte log entry
0925 16:45:13.042131 (+113508us) spinlock_profiling.cc:243] Waited 29.7 ms on lock 0x7b5400067820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bebdfb3 00007f719bf2af0f 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c
0925 16:45:13.042178 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:13.042251 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:13.042293 (+    42us) raft_consensus.cc:1671] finished
0925 16:45:13.042305 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:13.042429 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":57997,"prepare.queue_time_us":155,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":39242,"raft.run_cpu_time_us":257,"raft.run_wall_time_us":26496,"spinlock_wait_cycles":98218752,"thread_start_us":54517,"threads_started":1,"wal-append.queue_time_us":64743}
I20260925 16:45:13.139963  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.076102 14642 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:13.089263  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.083350 14376 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:13.090387  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:12.992486  9115 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.095677  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:12.990772  9044 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:13.118960  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.143537 14647 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:13.119633  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:13.121764  9696 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:13.122777  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.122944  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.146184  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.147738  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.149098  9115 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:13.150411 14690 raft_consensus.cc:979] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:13.150864 14791 raft_consensus.cc:1067] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:13.151793  9045 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:13.129585 14618 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.138813  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.152403  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:13.153061  8973 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:13.141268 14642 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:13.158617  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.144272  9122 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
W20260925 16:45:13.094616 14552 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.566s	user 0.002s	sys 0.007s
I20260925 16:45:13.169771  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.140874  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
W20260925 16:45:13.154147  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 12359c2bff0b46de91daa934c219103c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.170450  9701 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:13.170713  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 12359c2bff0b46de91daa934c219103c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.046535 14598 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.064111 14634 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.104506  8966 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18.
I20260925 16:45:13.160763  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.158116  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.163182  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.165139  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.167593  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.169234  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.170228  9693 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:13.043627  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.170173  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.169234  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.158566  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.172194  9089 leader_election.cc:398] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14.
W20260925 16:45:13.166530  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46956.2us
I20260925 16:45:13.172906  8975 raft_consensus.cc:595] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.173631  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.175129  9045 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:13.091300 14337 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:13.184103  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.182569  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.184557  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.184757  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.185469  9043 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:45:13.185465  9046 raft_consensus.cc:2354] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:13.182075  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.186280  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.186555  8975 raft_consensus.cc:603] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:13.182931  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64056.6us
I20260925 16:45:13.186595  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.187860  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.188167  9046 raft_consensus.cc:2354] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:13.113410 14693 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.190435  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.190850  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.191283  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.196362  9119 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:13.191613  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.170778 14642 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:13.192507  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.194093  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:13.194433  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.199047  8941 leader_election.cc:398] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:45:13.179198 14758 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:13.202585  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.182279 14690 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:13.206533  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.201052  8967 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:13.201327  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:13.201507  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.203266  9695 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:13.200179  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.207923  9693 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:13.208036  8940 leader_election.cc:398] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:13.208333  8940 leader_election.cc:401] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:45:13.184247 14629 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:13.204469  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.200536  9699 raft_consensus.cc:2354] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:45:13.181972 14376 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:13.188361 14747 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:13.209331  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.213442  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:13.219798  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 1998) took 2771 ms (client timeout 1814 ms). Trace:
I20260925 16:45:13.239560  9694 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 16 because replica has last-logged OpId of term: 13 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 12.
I20260925 16:45:13.197901 14103 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:13.244848  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.245602  9699 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.209388 14672 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.227610 14693 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.254763 14619 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.256780  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.257575  9702 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:13.182061 14755 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260925 16:45:13.231226  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.285176  9115 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:13.190795 14567 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:13.229833  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.236424  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:13.239629  8969 rpcz_store.cc:269] 0925 16:45:10.426599 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:10.426732 (+   133us) service_pool.cc:227] Handling call
0925 16:45:13.197477 (+2770745us) spinlock_profiling.cc:243] Waited 2.38 s on lock 0x7b54003566d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:13.197557 (+    80us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5468657536}
I20260925 16:45:13.209064  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.195607 14596 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:13.249522 14804 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:13.249979  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.201622 14786 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:13.201974 14758 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:13.293906  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57586.8us
I20260925 16:45:13.198176 14734 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260925 16:45:13.213204  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.230625  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.267590  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.270946  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.272271  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.272653  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.275789  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.307489  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:13.253687  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:13.288029  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79136.3us
I20260925 16:45:13.230178 14687 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.225503 14629 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:13.195405 14337 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260925 16:45:13.325853  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.235729 14690 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:13.246158 14769 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:45:13.297827  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68073.6us
I20260925 16:45:13.289465 14596 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:13.294492  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.336606  9122 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.253520  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:13.337352  8971 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.300691 14758 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:13.229082 14692 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:13.327764  9694 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:13.241526 14608 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:13.294674 14672 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:13.290831 14567 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:13.296838 14613 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:13.333488  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.176183 14552 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.333858  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.335201  9046 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:13.337175 14376 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.324760  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.417348  9050 raft_consensus.cc:2354] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:13.300407 14622 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:13.338716  9115 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:13.381990 14692 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:13.436295  9666 leader_election.cc:398] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:13.436755  9666 leader_election.cc:401] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:45:13.357336  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.438292  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.252077 14766 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.066s
I20260925 16:45:13.347163  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.316872 14765 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:13.319077 14446 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:13.315791 14493 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:13.325683 14629 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:13.371364  9043 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:13.485294  9043 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:13.355952 14786 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.081s
I20260925 16:45:13.376513  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.481153  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:13.492482  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 116062us
I20260925 16:45:13.343082 14596 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:13.358548 14652 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:13.392606  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:13.338877  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 85306.3us
I20260925 16:45:13.493396  9694 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.393349 14784 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260925 16:45:13.508587  9124 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:13.365772 14678 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:13.425623  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 92227.6us
I20260925 16:45:13.297272 14557 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:13.428548  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.443336  9118 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:13.360095 14620 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.478534  9123 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:13.480314  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53558us
I20260925 16:45:13.335626 14525 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:13.410324 14567 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:13.530211  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:13.530920  9700 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:13.490337  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:13.490576  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54476.2us
W20260925 16:45:13.457760 14778 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260925 16:45:13.493788  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.513032  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.460777 14597 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:45:13.516772  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88310.1us
I20260925 16:45:13.519456  9089 leader_election.cc:398] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:13.547144  9089 leader_election.cc:401] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:45:13.547406  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.548800  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.494134 14736 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.550017  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.551831  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.552501  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:13.553035  9696 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.502836 14755 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:13.565287  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:13.572227  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59300.2us
I20260925 16:45:13.573167  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.557317  9694 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.569950  9697 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:13.482316 14357 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260925 16:45:13.581202  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.593935  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.576048  9123 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.587565 14349 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:13.564157 14762 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:13.587764 14655 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:13.488777 14446 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.521476 14622 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:13.591035 14583 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:13.586925  9119 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:45:13.524828 14747 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:13.604592  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 110923us
I20260925 16:45:13.610168  8941 leader_election.cc:398] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13.
I20260925 16:45:13.610854  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.606088  9043 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.614321  9696 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.615739  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.619580  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:13.620844  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47784.5us
I20260925 16:45:13.623255  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.517584 14337 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.077s
I20260925 16:45:13.476119 14690 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.632174  9041 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:13.601418 14804 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.556479 14525 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:13.632972  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.655784  8971 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:13.628178  9699 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.520237 14678 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.657689  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.623391 14753 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:13.670017 14678 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:13.633494 14787 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.646s	user 0.009s	sys 0.001s
I20260925 16:45:13.672755  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:45:13.673584  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.636607 14493 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:13.668711  9119 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:13.626829 14693 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:13.680442  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.681236  8969 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.674042  9693 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:13.642702 14093 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:13.641812 14755 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:13.637687 14687 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.692087  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.693419  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.677330 14493 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:13.658815 14597 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.696211 14493 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:13.705432  8969 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.602310 14692 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.642125 14802 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260925 16:45:13.688290 14142 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:13.692556 14755 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:13.712616  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:13.725860 14826 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
I20260925 16:45:13.732640  9699 raft_consensus.cc:2354] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:13.706157 14093 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:13.709129 14552 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:13.753980  9090 leader_election.cc:398] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:13.758104  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.758602  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.759387  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.760165  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.771446  9122 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:13.760613  8975 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260925 16:45:13.783066  9090 leader_election.cc:401] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260925 16:45:13.762425 14821 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.194s	user 0.003s	sys 0.000s
I20260925 16:45:13.770155 14646 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:13.772789 14376 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:13.733440 14789 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:13.779127 14800 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.696s	user 0.007s	sys 0.003s
I20260925 16:45:13.785252  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.785336  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:13.827176  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.751011 14458 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.760885  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:13.796182  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 57081.1us
I20260925 16:45:13.796468  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:13.797115  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:13.728181 14620 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.805007  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.778394 14769 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:13.815781  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:13.735158 14142 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:13.837528 14142 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.696215 14525 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:13.736598 14647 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.593s	user 0.009s	sys 0.001s
W20260925 16:45:13.827033 14783 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260925 16:45:13.788903 14734 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:13.788653 14656 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:13.853709  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.858294  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.860751  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.861617  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:13.916754  8969 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:13.917122  9119 raft_consensus.cc:2354] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:13.917796  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.830493 14787 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.076s
W20260925 16:45:13.862697  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66308.6us
I20260925 16:45:13.798354 14552 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.867146  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.831665  9116 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:45:13.873389  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48377.8us
I20260925 16:45:13.819528 14655 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15.
I20260925 16:45:13.889205  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.814697 14376 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:13.889319  9698 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:45:13.889366  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:13.890333 14807 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260925 16:45:13.901018  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:13.889400 14646 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.032s
I20260925 16:45:13.900051 14746 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:13.720722 14622 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.870368 14672 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:13.871148 14772 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:13.862579  9117 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:13.920048  8972 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:13.962996  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.921440  8966 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:13.891989 14446 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:13.927162  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.967968  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.922231  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:13.932183  8968 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:13.952456 14745 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:13.933480 14599 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:13.833536 14735 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.085s
I20260925 16:45:13.931282 14597 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:13.944005 14493 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.944845  9041 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:13.901685  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:13.931536  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73334.4us
I20260925 16:45:13.968794  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:13.969678  8973 raft_consensus.cc:2354] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:13.970115  9702 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:13.970391 14828 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:45:13.959133 14376 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:13.972853  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:13.975457 14758 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.605s	user 0.007s	sys 0.000s
W20260925 16:45:13.958855 14103 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.706s	user 0.007s	sys 0.004s
W20260925 16:45:13.988476  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66321.9us
I20260925 16:45:14.006964  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:13.902364 14093 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:13.993917  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.995738  9041 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:14.011313  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.993430  8975 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:14.012642  8939 leader_election.cc:398] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:13.989912 14634 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.014003  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:13.962347 14746 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.021610  8971 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:14.022919  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 194628us
I20260925 16:45:14.027165  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.031982 14376 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:14.035411 14596 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.524s	user 0.004s	sys 0.002s
I20260925 16:45:14.025353 14763 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.021471 14741 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.015s
W20260925 16:45:14.039119 14629 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.537s	user 0.006s	sys 0.000s
I20260925 16:45:14.040850 14746 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.009523 14103 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:14.047863  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.048998  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:14.043413 14797 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:14.049655 14642 consensus_meta.cc:287] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.838s	user 0.009s	sys 0.000s
I20260925 16:45:14.051910 14493 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.092280 14780 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.017s
I20260925 16:45:14.087654 14596 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.112287  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1126) took 1744 ms. Trace:
I20260925 16:45:14.112637  9698 rpcz_store.cc:276] 0925 16:45:12.368246 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:12.370029 (+  1783us) service_pool.cc:227] Handling call
0925 16:45:12.370352 (+   323us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:13.949023 (+1578671us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:14.112088 (+163065us) spinlock_profiling.cc:243] Waited 1.52 s on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:14.112238 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3492529024}
I20260925 16:45:14.113624 14596 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.114213 14488 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:14.114564 14488 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.114622 14765 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:14.115305 14765 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:14.115585 14488 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.116783 14488 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:14.054816  9118 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:14.057530  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:14.119832 14755 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.120601  9117 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:14.015576 14672 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260925 16:45:14.096547 14731 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:14.123211 14642 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.124480  9049 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:14.125192 14642 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.129046  8969 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:14.015739 14691 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:14.053898  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.148051 14691 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.065140  8967 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:45:14.019152 14597 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:14.148976 14691 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.078977  9043 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.080310  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3162) took 1195 ms. Trace:
I20260925 16:45:14.150731  9123 rpcz_store.cc:276] 0925 16:45:12.884719 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:12.884864 (+   145us) service_pool.cc:227] Handling call
0925 16:45:14.080128 (+1195264us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b54003bf6d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:14.080248 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1363322624}
W20260925 16:45:14.091403  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43616.1us
W20260925 16:45:14.088855  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67639.8us
I20260925 16:45:14.154713 14786 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:14.155035 14656 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260925 16:45:14.097154  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48234.9us
I20260925 16:45:14.050766  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:14.096398 14736 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.526s	user 0.008s	sys 0.001s
I20260925 16:45:14.099910 14735 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:14.016040 14758 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:14.104715 14567 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.536s	user 0.009s	sys 0.000s
I20260925 16:45:13.989977 14745 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.092999 14652 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:14.133656  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.135264  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.059437  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.136556  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.096673 14629 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.141388  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.182770  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1091) took 1109 ms. Trace:
I20260925 16:45:14.183247  9045 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:14.185424  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.187911  9118 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:14.182547 14567 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.189244 14613 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:14.189683 14613 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:14.190873 14567 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.192021  9123 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:14.192355  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:14.184751  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:14.183197  9049 rpcz_store.cc:276] 0925 16:45:13.073808 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:13.076639 (+  2831us) service_pool.cc:227] Handling call
0925 16:45:14.182589 (+1105950us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b54001bfdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:14.182718 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2407563648}
I20260925 16:45:14.194913  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:14.196077  8974 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:14.199086  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:14.182545 14735 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.200105 14676 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:14.200611 14676 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.200486 14735 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.201400 14676 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.176616 14736 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:14.210973 14765 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:14.214538 14818 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.693s	user 0.003s	sys 0.000s
I20260925 16:45:14.180176 14652 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:14.218300 14745 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.220319 14758 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.220929  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.223001 14802 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:14.224361  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:14.183315 14762 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.044s
I20260925 16:45:14.229949  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:14.231503  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:14.195679 14103 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:14.232954  9695 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:45:14.233294  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47959.4us
I20260925 16:45:14.234113  9699 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:14.294148  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:14.235194  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 175859us
I20260925 16:45:14.236321  9048 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:14.240758  9124 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:14.257431  9693 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
W20260925 16:45:14.259342  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 339156us
I20260925 16:45:14.298748  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.299057  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:14.285430  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47939.1us
I20260925 16:45:14.192858 14376 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:14.237859 14652 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:14.289465  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:14.302975  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:14.307226  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.308874  9666 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18.
I20260925 16:45:14.309365  9666 leader_election.cc:401] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260925 16:45:14.309437  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.232828  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:14.237901 14557 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:14.303452  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.238117 14634 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.052s
I20260925 16:45:14.314121  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:14.293013 14103 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:14.318313  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.317018  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.291109 14349 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:14.365989 14349 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.360016 14655 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:14.367034 14655 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:14.367401 14655 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:14.368419 14349 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.317816 14836 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.375415 14655 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.312825 14376 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260925 16:45:14.380386  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62181.5us
I20260925 16:45:14.385699  9666 leader_election.cc:398] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:14.305158 14672 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.387257 14656 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:14.387442  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1145) took 1223 ms. Trace:
I20260925 16:45:14.415311  9701 rpcz_store.cc:276] 0925 16:45:13.164024 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:13.171755 (+  7731us) service_pool.cc:227] Handling call
0925 16:45:13.172012 (+   257us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:13.172326 (+   314us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:13.172351 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:13.180180 (+  7829us) log.cc:842] Serialized 26 byte log entry
0925 16:45:13.306487 (+126307us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:13.306529 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:13.306605 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:14.214049 (+907444us) spinlock_profiling.cc:243] Waited 7.45 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:14.327148 (+113099us) raft_consensus.cc:1671] finished
0925 16:45:14.327177 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:14.387386 (+ 60209us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":86,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":5859,"spinlock_wait_cycles":17124736,"thread_start_us":101272,"threads_started":1,"wal-append.queue_time_us":216970}
I20260925 16:45:14.417284 14018 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:14.417773 14018 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:14.418148 14608 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Stepping down as leader of term 16
W20260925 16:45:14.418510  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1090) took 1300 ms (client timeout 1703 ms). Trace:
W20260925 16:45:14.418931  8970 rpcz_store.cc:269] 0925 16:45:13.118067 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:13.122564 (+  4497us) service_pool.cc:227] Handling call
0925 16:45:14.418350 (+1295786us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b54003e8854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:14.418462 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1105592064}
I20260925 16:45:14.418643 14018 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.426481  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:14.427858  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:14.317404 14690 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.548s	user 0.011s	sys 0.007s
I20260925 16:45:14.402099 14655 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:14.402570 14567 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:14.407047 14629 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.407313  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.413133 14765 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.327929 14772 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18.
I20260925 16:45:14.361032 14769 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260925 16:45:14.361541 14799 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:14.324950 14763 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.096s
I20260925 16:45:14.326809 14786 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.361116 14796 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:14.379617 14103 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:14.422618 14758 raft_consensus.cc:979] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
W20260925 16:45:14.377077  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63806.9us
I20260925 16:45:14.466101 14741 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:14.450040  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.328015 14734 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:14.418541 14608 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:14.429258 14349 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:45:14.455838  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 157219us
I20260925 16:45:14.284783 14802 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:14.451154 14690 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.011s	sys 0.008s
I20260925 16:45:14.477638 14357 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:14.452734 14571 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Stepping down as leader of term 12
W20260925 16:45:14.389286  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72346.8us
I20260925 16:45:14.501799  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.502808  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.483891  9116 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260925 16:45:14.475283 14769 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:14.477243 14796 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.452960 14841 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260925 16:45:14.494387  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:14.494128  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.471725  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1390) took 1281 ms. Trace:
I20260925 16:45:14.485934 14596 raft_consensus.cc:1067] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:14.491586 14741 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:14.494097 14843 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:14.487601 14734 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:14.511471 14755 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:14.505366 14769 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:14.509397 14786 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:14.523592  9695 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:14.526100  9124 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:14.520113  9697 rpcz_store.cc:276] 0925 16:45:13.190687 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:13.191389 (+   702us) service_pool.cc:227] Handling call
0925 16:45:14.471508 (+1280119us) spinlock_profiling.cc:243] Waited 373 ms on lock 0x7b5400426154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:14.471648 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":856955136}
I20260925 16:45:14.503588  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:14.543782  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:14.547080  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:14.547646 14802 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.529855 14493 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:14.501120 14571 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:14.548767 14571 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.549751 14571 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:14.551787 14799 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:14.552330 14799 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:14.553231 14799 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.484644 14735 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260925 16:45:14.556169 14567 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.556704 14735 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:14.557152 14735 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.557991 14735 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.506796 14629 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:14.559585 14103 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.561481  8973 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
W20260925 16:45:14.564935 14848 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:14.565032 14103 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.567606  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.568427  9117 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:14.569913  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:14.572393  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2012) took 1572 ms. Trace:
I20260925 16:45:14.572898  8974 rpcz_store.cc:276] 0925 16:45:13.000057 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:13.000230 (+   173us) service_pool.cc:227] Handling call
0925 16:45:13.197590 (+197360us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:14.199362 (+1001772us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:14.394850 (+195488us) spinlock_profiling.cc:243] Waited 998 ms on lock 0x7b54003566d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:14.572167 (+177317us) spinlock_profiling.cc:243] Waited 197 ms on lock 0x7b54003566d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:14.572329 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2749073024}
I20260925 16:45:14.533066 14734 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:14.537552  9115 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:14.533182 14608 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.576579 14608 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:14.578109  9118 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:14.579216 14652 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.580319  8975 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260925 16:45:14.581205 14652 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.582937 14796 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:14.584384  8966 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260925 16:45:14.525861 14804 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:14.586139  9117 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:14.586829  9117 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:14.541241  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.587257  9117 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:14.528458 14613 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:14.589068  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47913.2us
I20260925 16:45:14.592531  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:14.593550  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 274850us
I20260925 16:45:14.611680  9120 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:14.612427  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.602000  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.616189  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.618130  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.622956  9693 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
W20260925 16:45:14.621539  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 82121.5us
I20260925 16:45:14.627310  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:14.628515  8970 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:14.631467  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:14.632088  9048 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:14.633625  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.634824  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.586544 14525 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.046s
I20260925 16:45:14.636562  9042 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:14.637176  9117 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.637652  9048 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:14.638934  9117 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:14.601200 14762 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:14.643326  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:14.589815 14655 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:14.617816 14093 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:14.584203 14786 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:14.653685  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 339606us
I20260925 16:45:14.643239  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.653802  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.630834 14749 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:14.604532 14629 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.042s
I20260925 16:45:14.675220  9695 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:14.676910  9697 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:14.665253  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:14.589205 14804 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.683044  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:14.648653 14836 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:14.572433 14741 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.665632 14599 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
W20260925 16:45:14.691031  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57895us
I20260925 16:45:14.697984 14860 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.661840 14655 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:14.698401 14857 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:45:14.699107 14676 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:45:14.699930 14655 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.700294 14458 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:14.700688 14458 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.699954 14676 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:14.701562 14458 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.702840 14458 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:14.704387 14613 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.704638 14583 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:14.681869 14692 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:14.709630  9118 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:14.711855 14804 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:14.714077  9118 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:14.726353  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:14.727015  9115 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:14.689812 14836 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:14.732306 14845 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260925 16:45:14.743388  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72027.5us
I20260925 16:45:14.745106  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:14.747175 14854 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260925 16:45:14.748776 14789 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:14.749207 14789 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.748961 14599 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:14.749509 14786 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:14.751294 14749 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:14.751916 14861 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:14.753154  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2029) took 1187 ms. Trace:
I20260925 16:45:14.753515  9050 rpcz_store.cc:276] 0925 16:45:13.565237 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:13.567186 (+  1949us) service_pool.cc:227] Handling call
0925 16:45:14.752968 (+1185782us) spinlock_profiling.cc:243] Waited 817 ms on lock 0x7b5400362754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:14.753103 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1878643968}
I20260925 16:45:14.742192 14836 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:14.731199 14583 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260925 16:45:14.766773 14655 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:14.766021 14734 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:14.773950  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 159043us
W20260925 16:45:14.781256  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58847.8us
W20260925 16:45:14.796921  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51920us
I20260925 16:45:14.797642 14693 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:14.798846 14357 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:14.799314 14357 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:14.795527 14142 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260925 16:45:14.807945  9123 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:14.808943 14734 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.811710  9119 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260925 16:45:14.812017 14762 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:14.812443 14762 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:14.813169 14762 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.814288 14762 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:14.815270  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 322921us
I20260925 16:45:14.795245 14349 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.021s
I20260925 16:45:14.817742 14018 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:14.817772  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.823251 14765 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:14.825368  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.827518  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:14.825690  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50914.1us
I20260925 16:45:14.842404  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:14.842821  8975 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
W20260925 16:45:14.846263  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48746.6us
I20260925 16:45:14.848831  9701 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:45:14.854815  9047 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:14.856621  9701 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.12-12.12]
I20260925 16:45:14.872009 14845 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:14.872543 14845 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:14.872967 14690 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:14.770184 14655 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.873369 14690 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:14.873775 14690 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:14.874874 14655 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:14.878132 14567 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:14.878533 14567 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:14.880183  8968 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:14.880904 14841 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:14.881779 14841 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:14.882493 14841 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.883720 14789 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.884770 14841 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:14.884915 14789 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:14.886392  9698 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260925 16:45:14.888314 14769 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.889501 14769 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:14.890242  9696 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260925 16:45:14.891266 14858 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.151s	user 0.000s	sys 0.001s
I20260925 16:45:14.893214 14791 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:14.893652 14791 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.896471  9119 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260925 16:45:14.895465 14791 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.905957  9121 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:45:14.907027  8968 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 11. (term mismatch)
I20260925 16:45:14.907439  8968 pending_rounds.cc:76] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 10
I20260925 16:45:14.907727  8968 pending_rounds.cc:97] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 12.11
I20260925 16:45:14.908020  8968 raft_consensus.cc:2866] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:45:14.913264  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57025.1us
W20260925 16:45:14.914314  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85417.4us
I20260925 16:45:14.856472 14795 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:14.917534  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:14.918291  9047 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:14.879388 14567 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.920464  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:14.921063  9119 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
W20260925 16:45:14.830945 14142 consensus_queue.cc:1159] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 16 status { last_received { term: 13 index: 10 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: [15.11-15.11]" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:14.922299  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:14.923902  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:14.944970  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.946013  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:14.949077  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:14.949088  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:14.949687  9047 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:14.949723  8973 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:14.950273  8973 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:14.950963  8973 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:14.949944  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:14.951398  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:14.957430  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:14.959100  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:14.959311  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:14.959870  9048 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:14.962170  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:14.962286  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:14.962514  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:14.963145  9048 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:14.969087  9047 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:14.972581  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:14.976040  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:14.977548  9696 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:14.933772 14741 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:14.987743  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:14.991956  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.944528 14843 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:14.926581 14745 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.057s
I20260925 16:45:15.012313  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:14.937037 14780 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:14.928602 14795 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:14.989732 14741 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:15.023049 14741 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:14.973865 14488 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.044s
I20260925 16:45:15.031767 14642 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260925 16:45:15.033027 14874 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:45:15.023965 14613 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260925 16:45:14.979101 14749 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260925 16:45:15.019739 14796 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:15.040408 14735 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:15.041311 14357 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.017108 14772 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:15.017510 14797 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260925 16:45:15.043905 14643 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:15.044802 14797 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:15.044823  9695 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:15.045246 14797 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:14.979655 14861 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260925 16:45:15.046134 14797 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.046502 14872 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:15.048296 14567 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:15.022022 14672 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:15.060421 14795 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:14.992218 14804 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260925 16:45:15.070004  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:15.047490 14797 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:15.080525  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:15.096570  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84390.6us
I20260925 16:45:15.097416  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:15.043545 14357 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.106614  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:15.109901 14845 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.112267 14796 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:15.099818  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:15.138458 14873 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.099666 14672 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:15.106580 14629 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260925 16:45:15.116362 14831 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:15.152381  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45883.2us
I20260925 16:45:15.020949 14843 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.143369 14787 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:15.142729 14873 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:15.167836 14883 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260925 16:45:15.095757 14741 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.125458 14795 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260925 16:45:15.189848  9702 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:15.143891 14755 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.039s
I20260925 16:45:15.169162 14799 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:15.142628 14836 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.234629 14357 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:15.191097 14787 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.238762 14787 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:15.237123 14357 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.246107 14357 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.247961 14873 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:15.202960 14843 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.249455 14836 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.207612 14845 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:15.200165 14563 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.267210 14741 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:15.210094 14690 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.273717 14690 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.320948  8968 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:15.322628  8972 raft_consensus.cc:2354] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17.
I20260925 16:45:15.324203  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:15.340709  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:15.341738  9048 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:15.342933  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:15.352622  9047 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:15.368396 14525 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.369329 14525 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.264789 14563 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.373919 14583 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.374244 14687 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.374842 14583 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.375169 14563 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:15.382198  9045 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:15.390395 14446 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:15.391479 14446 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.392340  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:15.392839  9694 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:15.396253 14525 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:15.397045  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56815.6us
I20260925 16:45:15.396252  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:15.399677 14446 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:15.375106 14687 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:15.417763  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48460.2us
I20260925 16:45:15.419477  9047 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
W20260925 16:45:15.421173  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 264724us
I20260925 16:45:15.425655  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:15.431361  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:15.432785  8970 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:15.434226 14672 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:15.434746 14672 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:15.438170  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:15.441857  9048 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:15.442008  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:15.442973  8975 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:15.443045 14784 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:15.443687 14784 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:15.448020  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:15.454605  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:15.454794  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:15.454888  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:15.455210  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:15.455506  9124 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:15.455713  9696 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:15.456957 14446 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:45:15.444850 14672 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.458513 14672 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:15.459688  8973 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:15.460235  9046 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:45:15.465723 14687 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:15.455770  9041 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:15.466452  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:15.468953 14784 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.474190  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:15.475803 14488 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:15.476128 14784 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:15.476207 14488 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:15.476716 14488 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:15.459398 14446 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:15.483399 14446 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:15.484622 14446 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.489629  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:15.490480  9042 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:15.494940  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:15.495682  8968 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
W20260925 16:45:15.504992  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 51516.3us
I20260925 16:45:15.509111  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:15.512877 14583 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.513289  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:15.521413  9050 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:15.539057  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:15.540031  9696 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:15.545308  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:15.546283  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
W20260925 16:45:15.547813 14846 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.356s	user 0.002s	sys 0.002s
I20260925 16:45:15.548206  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:15.549448 14897 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:15.549958 14897 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:15.550410 14897 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:15.557029  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:15.574301  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:15.576395  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:15.577644  9124 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260925 16:45:15.580463  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:15.582275  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:15.589232  8973 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:15.592460 14800 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:15.584555  8869 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:15.606261  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:15.606927  9120 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:45:15.608348  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:15.608932  9117 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:15.609351  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:15.610293  9118 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:15.612277  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:15.618054  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:15.609375  9124 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260925 16:45:15.611584  9118 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:15.629763  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:15.653885  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:15.660082 14599 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:15.660400 14841 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:15.660595 14599 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:15.661010 14599 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:15.663846  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53901us
I20260925 16:45:15.676710  9120 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:15.688546  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2036) took 1095 ms. Trace:
I20260925 16:45:15.688665  8972 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260925 16:45:15.689060  8966 rpcz_store.cc:276] 0925 16:45:14.593132 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:14.593253 (+   121us) service_pool.cc:227] Handling call
0925 16:45:14.593663 (+   410us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:14.637228 (+ 43565us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:14.637257 (+    29us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:15.471520 (+834263us) spinlock_profiling.cc:243] Waited 3.61 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:45:15.472358 (+   838us) log.cc:842] Serialized 52 byte log entry
0925 16:45:15.503890 (+ 31532us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:15.503909 (+    19us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:15.513805 (+  9896us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:15.668494 (+154689us) raft_consensus.cc:1671] finished
0925 16:45:15.668519 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:15.688361 (+ 19842us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":43123,"raft.queue_time_us":43530,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":76,"spinlock_wait_cycles":8298240,"thread_start_us":31105,"threads_started":1,"wal-append.queue_time_us":94696}
I20260925 16:45:15.697184 14018 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:15.697777 14018 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:15.706089 14869 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:15.706918 14869 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.709805 14869 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:15.710886 14687 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:45:15.712091  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:15.713106  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:15.713766  8972 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
W20260925 16:45:15.714151  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49610.1us
I20260925 16:45:15.714740 14843 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:15.712073  9118 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:15.716871  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:15.717665  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 99928us
I20260925 16:45:15.739136  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:15.726500 14018 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:15.750732  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82661.6us
I20260925 16:45:15.685412  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:15.752326 14904 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260925 16:45:15.753767 14357 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:15.772701 14897 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.779618  9117 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:15.779570  8973 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260925 16:45:15.784335  9122 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:15.780800 14446 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260925 16:45:15.808707  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 155078us
I20260925 16:45:15.798010 14446 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:15.823592 14800 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:15.823334 14831 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:15.824100 14800 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:15.824743 14784 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:15.825109 14784 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:15.825958 14784 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.827615 14892 raft_consensus.cc:2741] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260925 16:45:15.828359 14741 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.828961 14741 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.832643 14784 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:15.832934  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:15.833629  9702 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:15.838110  8869 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:15.839781  8869 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 12, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:15.844197  8869 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:45:15.851727  8872 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 220) took 20368 ms (client timeout 15000 ms). Trace:
I20260925 16:45:15.849788  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:15.821169 14446 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:15.874085  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:15.870546  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:15.868784 14018 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:15.892505  8869 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 10 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:15.871804 14892 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:15.896595 14599 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:15.906163 14690 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:15.906826 14690 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:15.907174  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3a3bc92ca0a4efa913eca1800a1550d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:15.876089 14741 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:15.910517  9047 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:15.862715 14488 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:15.899312 14892 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:15.920270  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:15.930540 14741 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:15.931056 14741 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:15.931393 14741 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:15.932312 14911 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:45:15.934237 14357 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:45:15.938179 14881 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.756s	user 0.002s	sys 0.004s
I20260925 16:45:15.928110 14892 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:15.975716  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 133909us
I20260925 16:45:15.966279  8869 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:15.990535  8869 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 13, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:16.011966  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.013145  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.013856  9043 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:16.019591  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.010205  8869 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:16.019145  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.042557  8869 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:16.052601 14376 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:16.053067 14376 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.053419 14376 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:15.852177  8872 rpcz_store.cc:269] 0925 16:44:55.467063 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:55.467327 (+   264us) service_pool.cc:227] Handling call
0925 16:45:15.835595 (+20368268us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:45:08.365008 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:45:08.544149 (+179141us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:45:08.544213 (+    64us) write_op.cc:435] Acquired schema lock
0925 16:45:08.544238 (+    25us) tablet.cc:660] Decoding operations
0925 16:45:08.547042 (+  2804us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:45:08.547174 (+   132us) write_op.cc:641] Partition lock acquired for write op
0925 16:45:08.547217 (+    43us) tablet.cc:683] Acquiring locks for 28 operations
0925 16:45:08.853033 (+305816us) tablet.cc:699] Row locks acquired
0925 16:45:08.853075 (+    42us) write_op.cc:260] PREPARE: finished
0925 16:45:08.853243 (+   168us) write_op.cc:270] Start()
0925 16:45:08.853391 (+   148us) write_op.cc:276] Timestamp: P: 1790354708853173 usec, L: 0
0925 16:45:08.853431 (+    40us) op_driver.cc:331] REPLICATION: starting
0925 16:45:08.995750 (+142319us) log.cc:842] Serialized 10996 byte log entry
0925 16:45:10.035132 (+1039382us) op_driver.cc:444] REPLICATION: finished
0925 16:45:10.271345 (+236213us) write_op.cc:301] APPLY: starting
0925 16:45:10.271475 (+   130us) tablet.cc:1365] starting BulkCheckPresence
0925 16:45:11.217131 (+945656us) tablet.cc:1368] finished BulkCheckPresence
0925 16:45:11.217249 (+   118us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:45:12.839466 (+1622217us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:45:12.909814 (+ 70348us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0925 16:45:12.909863 (+    49us) write_op.cc:312] APPLY: finished
0925 16:45:12.910874 (+  1011us) log.cc:842] Serialized 244 byte log entry
0925 16:45:12.928272 (+ 17398us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:12.928522 (+   250us) write_op.cc:454] Released schema lock
0925 16:45:12.928624 (+   102us) write_op.cc:341] FINISH: Updating metrics
0925 16:45:12.929047 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:12.929088 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":39251,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":186763,"apply.run_cpu_time_us":50491,"apply.run_wall_time_us":2658421,"cfile_cache_hit":114,"cfile_cache_hit_bytes":120999,"num_ops":28,"prepare.queue_time_us":631444,"prepare.run_cpu_time_us":46691,"prepare.run_wall_time_us":1076772,"raft.queue_time_us":233685,"raft.run_cpu_time_us":18002,"raft.run_wall_time_us":126100,"replication_time_us":1181608,"thread_start_us":822262,"threads_started":5,"wal-append.queue_time_us":487906,"wal-append.run_cpu_time_us":26719,"wal-append.run_wall_time_us":2428667}]]}
I20260925 16:45:16.044855 14690 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.035849 14599 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.045152 14784 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
W20260925 16:45:16.071285 14909 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260925 16:45:16.071216  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.072052  9697 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:16.073064  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.073813 14872 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.074389 14872 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.076382 14872 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.069463 14357 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:16.077260 14907 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260925 16:45:16.076862 14800 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.077527 14357 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.078569  8968 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:16.069350 14831 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:16.058159 14687 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
W20260925 16:45:16.084262 14913 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.110s	user 0.000s	sys 0.002s
I20260925 16:45:16.084553 14800 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.085425 14741 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.086747 14784 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:16.087733 14784 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:16.090662  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 189302us
W20260925 16:45:16.095304  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43669.5us
I20260925 16:45:16.102228  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.102517  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.103477  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:16.110407  8869 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:45:16.116288 14908 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260925 16:45:16.117691  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:16.118394  9043 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:16.119058  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.120651  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.103189 14446 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.103973 14897 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.094970 14357 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.121707  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.130312  9118 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:16.111162 14488 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.128961 14747 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.104140 14687 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:16.131764  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:16.127489  9117 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:16.120091 14690 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.141353  8869 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:16.144469  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.142650  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.144502  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.135669 14747 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.147701  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.124830 14741 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.156195 14892 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:16.159806 14878 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260925 16:45:16.160283 14687 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.126906 14831 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:16.174759 14596 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:16.188730  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.174875 14446 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.176311 14690 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.177536 14652 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:16.181991  9118 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:45:16.183641  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52012.8us
I20260925 16:45:16.187227  9043 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:16.190086  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.197479  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.197695  9117 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:16.187784  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.193197  9119 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:16.190248  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.198493  9693 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:16.199643  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.199530  8869 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:16.191895 14831 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:16.190948 14563 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:16.207774  8869 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:16.211670 14786 raft_consensus.cc:2741] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260925 16:45:16.211951 14772 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:16.212535 14772 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.212978 14772 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:16.213928 14493 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.214243  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.214918  9118 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:16.214466 14493 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.216703 14735 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:16.216925 14493 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.219141 14142 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.203449 14596 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:16.219501  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.220321  9123 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 11: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:16.219982 14142 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.220530 14596 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.222482  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.223052  9118 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:16.217199 14735 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:16.224714 14690 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.224561 14735 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.217718 14804 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:16.217993  9116 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260925 16:45:16.218209  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.228986  9043 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:16.229951  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.239228  9118 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:16.245148  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.250411  9124 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:16.222513 14142 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.261374 14804 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:16.261965  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71771.6us
I20260925 16:45:16.262115  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.263043 14692 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:16.262131  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.270392  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:16.263976 14758 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.265110 14652 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.219552 14613 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260925 16:45:16.267568  9117 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:16.252935  8869 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 9, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 9 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:16.248566 14446 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:16.265586  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:16.278409  9701 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:16.282428  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.292135  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.292290  8973 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:16.273118 14906 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.180s	user 0.000s	sys 0.001s
I20260925 16:45:16.274096 14692 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.285030  9014 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.294911 14652 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.300313 14446 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.291190 14018 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260925 16:45:16.302270 14563 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.309182 14446 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.309043 14563 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.309700  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.309813 14795 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:16.302969 14692 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:16.310482 14795 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:16.310726 14747 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.311314 14804 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.311479 14795 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.314440 14789 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:16.314625  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.314860 14789 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.316103 14789 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:16.316505 14745 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:16.316884 14745 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:16.317691 14745 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.318867 14745 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:16.306911 14598 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:16.322111  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.322511  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.326475 14337 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:16.280280 14758 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.337006 14789 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.338138 14758 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.338528 14892 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.340679  9048 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:45:16.341498  9701 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:16.342295  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.344473 14892 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:16.345027 14892 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:16.345976 14892 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.346563  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.347424 14018 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:16.349193  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.349874  9045 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.350837  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:16.351562  9047 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.352778  9048 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:16.354396 14598 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:16.355367 14598 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.324901  9693 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:16.331593 14772 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.359511  9697 raft_consensus.cc:2379] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:16.359879 14376 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.360811 14772 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.361929 14376 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.338815 14692 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.364038  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.363662  8973 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:16.359859  9119 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:16.368052  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.377034  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.379971  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.380772 14652 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.380784  9697 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.385390  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.386133  9124 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:16.383504  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.389747  9702 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:16.395330  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:16.395780  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48063.4us
I20260925 16:45:16.396088 14692 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.388556 14687 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:16.397629 14687 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:16.398018 14687 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:16.398396  9089 leader_election.cc:398] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17.
I20260925 16:45:16.398716  9089 leader_election.cc:401] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:16.389068  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.395967  9048 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:16.397109 14789 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.407166  9693 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:16.414788  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:16.415125  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.416747  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.425429 14861 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:16.399322 14795 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17.
I20260925 16:45:16.435967  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.436255  9090 leader_election.cc:398] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.436532  9090 leader_election.cc:401] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260925 16:45:16.437125 14795 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.439525 14780 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:16.440127 14780 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:16.440888  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.442891 14652 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:16.443851  9694 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:16.451040  9697 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:16.451078  9119 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:16.454948  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.453945  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.460254  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:16.461356  9048 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:16.460944  8974 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:16.464685  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.462004 14804 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:16.475167  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.466167 14142 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:16.478912  9702 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:16.481249  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.469143 14596 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:16.470597 14376 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.488095  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.488838  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.488408  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.475212 14758 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.513865  9117 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:16.495168  9118 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:45:16.491407  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:16.520654  8968 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:16.487571  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.521342  9116 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:16.536517  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.537132  9116 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:16.542060  8968 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:16.553661 14142 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:16.554698 14142 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.440959 14780 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.493876 14596 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:16.563480  8974 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:16.567179  9048 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260925 16:45:16.533684 14735 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.485821 14831 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.489274 14376 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.508236 14804 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:16.576402 14741 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260925 16:45:16.584371 14768 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.585898 14735 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.581751  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.523535 14758 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.595866  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:16.596722  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.601837  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.589007 14563 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.600133 14768 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.605259 14866 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260925 16:45:16.606709 14768 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.607261  9048 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:45:16.609222 14735 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.609859 14692 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:16.610373 14692 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.610718 14692 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:16.612515 14922 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260925 16:45:16.600955 14446 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:16.616726  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.617501  9117 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:16.618284 14758 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.619516  9089 leader_election.cc:398] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.620959  9089 leader_election.cc:398] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:45:16.622629 14357 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.622519 14804 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.623292 14357 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.604825 14613 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:16.627669  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:16.628361  8974 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:16.630546  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.630810 14018 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:16.632318 14784 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:16.632989 14772 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.633392 14018 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:16.609694  9116 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:16.633453 14772 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.633939 14018 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:16.634850 14018 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.635977 14018 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:16.636061 14772 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.638232  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.638947  9116 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:16.639868  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.640690 14772 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:16.641031 14772 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.641342 14772 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:16.643208  9124 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:16.643853 14866 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.644340 14866 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.646493 14866 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.647400  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.648226  9045 raft_consensus.cc:2396] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260925 16:45:16.649199 14772 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.651649  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.652156  9116 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:16.656234  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.657208 14446 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:45:16.658558  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.659267  9697 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:16.662732 14357 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.664301 14613 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:16.598783 14652 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:16.665526  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.667081 14747 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:16.667428 14747 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.667801 14747 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:16.662755  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.670728  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.627245  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.669301  9118 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:16.672802  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.670794  9116 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:16.673424  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
W20260925 16:45:16.674192  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43747.5us
I20260925 16:45:16.674386  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.681532  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:16.685113  8968 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:45:16.673429 14758 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:16.682575  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:16.695003  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:16.688906 14749 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:16.696560  8966 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:16.689086 14758 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:16.697799  8975 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:16.660499 14772 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.699452  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:16.698628 14749 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.702445 14795 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260925 16:45:16.704092 14758 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.704974 14488 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:16.707183 14866 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:16.692591 14357 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:16.671578 14596 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.715759 14749 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:16.712219  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:16.717149 14488 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.743043  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:16.742936  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.734400 14446 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:16.749933  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 148153us
I20260925 16:45:16.742152 14357 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:16.733841 14692 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.761400 14357 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.762135 14692 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.749747 14758 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:16.697578 14613 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.748653 14866 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:16.745764 14488 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:16.765484 14376 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.757565 14687 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.751509 14831 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:16.769649 14687 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.752492 14446 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.775815  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:16.792887  9123 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:16.799039  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:16.800094  8966 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:16.801072  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:16.802250 14932 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
W20260925 16:45:16.803555 14937 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
W20260925 16:45:16.807629  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 106271us
I20260925 16:45:16.812309  8968 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:16.813853  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:16.814129  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.815907  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.822181  9116 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:16.823282  9117 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
W20260925 16:45:16.824244  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 233559us
I20260925 16:45:16.833070  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.833489  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.834187  9701 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:16.831560  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46809.8us
I20260925 16:45:16.837524 14772 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.838024 14772 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:16.840092 14772 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.842298  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:16.843521 14735 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:16.847855  9043 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:16.848129 14784 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:16.836997  9049 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.6, Last appended by leader: 5, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:16.848671 14784 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:16.878744  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49044.4us
I20260925 16:45:16.871956  9699 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:16.881317  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.883682  9123 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:16.877980  9118 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:16.890189  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:16.890933  9122 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:16.892258  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.893165  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:16.905864  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.906653  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:16.914079  9043 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:16.870080 14804 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260925 16:45:16.919504 14784 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:16.919983 14804 consensus_queue.cc:1225] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 14.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260925 16:45:16.921020  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:16.921255 14804 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:16.921638 14804 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:16.921679  9699 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:16.922457 14804 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:16.914117 14652 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:16.930768  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:16.904883 14613 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:16.923626 14804 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:16.962733  9122 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260925 16:45:16.972045  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:16.924471 14931 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
W20260925 16:45:16.977828  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 84744.2us
I20260925 16:45:16.973749 14446 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:16.975380 14746 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260925 16:45:16.948920 14613 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:16.981709 14933 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:16.982596  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:17.004963  9123 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260925 16:45:16.988603  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:16.989221  8974 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:16.970156 14795 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260925 16:45:17.006021  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 124790us
I20260925 16:45:16.976785 14861 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:16.960289 14831 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.056s
I20260925 16:45:16.957118 14488 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:17.004165 14613 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:17.021721  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:16.997046 14931 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:17.013459 14795 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:17.017722 14772 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:17.039323 14936 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260925 16:45:17.031776 14749 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:17.039476  9047 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:45:17.040683  9045 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 6.
I20260925 16:45:17.040517 14892 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:45:17.041000 14749 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:17.030790 14795 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:17.032186 14940 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260925 16:45:17.048593 14018 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:17.050727  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:17.051455  8972 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:16.924765 14687 consensus_queue.cc:1159] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 14 status { last_received { term: 12 index: 9 } last_committed_idx: 9 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:17.051959 14931 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.032212 14741 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:17.061533  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:17.062294 14939 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.152s	user 0.001s	sys 0.000s
I20260925 16:45:17.061439  9118 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:45:17.063409  9694 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260925 16:45:17.065080 14488 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:17.045615 14142 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.020s
I20260925 16:45:17.073171  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:17.073755  8972 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:17.095100  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:17.103511  9122 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:17.115180  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:17.116166  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:17.116696  9118 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:17.037398 14772 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.032467 14861 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.104844 14741 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:17.105226 14933 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:17.120661  8972 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:17.136987  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:17.142804 14772 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:17.143762 14741 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.051577 14747 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.150535  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:17.151322  9124 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:17.152405 14142 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:45:17.160408 14945 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.051s	user 0.002s	sys 0.000s
I20260925 16:45:17.160552  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:17.163981  9046 raft_consensus.cc:2354] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16.
I20260925 16:45:17.164747 14747 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:17.111855 14941 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260925 16:45:17.169479  9694 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:17.170435  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:17.181267  9115 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:45:17.181573 14142 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:17.184660  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:17.185469  8969 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:17.119154 14950 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.064s
I20260925 16:45:17.191203  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:17.198137  9695 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 16
I20260925 16:45:17.182587 14488 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:17.300176 14836 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260925 16:45:17.293236 14142 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:17.310513  9118 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
W20260925 16:45:17.320693  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 128251us
W20260925 16:45:17.320675  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 151720us
I20260925 16:45:17.318011  8975 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:17.322702  8966 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 10. (term mismatch)
I20260925 16:45:17.323056  8966 pending_rounds.cc:76] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 9
I20260925 16:45:17.323303  8966 pending_rounds.cc:97] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 13.10
W20260925 16:45:17.323521 14956 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
I20260925 16:45:17.323555  8966 raft_consensus.cc:2866] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:17.331243  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:17.331789  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:17.332018  9123 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:17.332475  9124 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:17.333235  9050 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:17.340723  9694 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:45:17.345609  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:17.346707  9118 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:17.356670  9697 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
W20260925 16:45:17.353902  8860 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica e3a3bc92ca0a4efa913eca1800a1550d is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:17.364516  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:17.333060 14613 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.368768 14613 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:17.369011 14795 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.369325 14613 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:17.370047  9124 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:17.370433  8969 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:17.372546  8973 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260925 16:45:17.375810 14958 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.195s	user 0.000s	sys 0.002s
I20260925 16:45:17.358556 14357 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:17.379025 14357 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:17.379391 14357 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:17.380216 14488 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:17.381251 14488 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:17.381968  9699 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:17.339439 14861 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:17.380255 14960 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260925 16:45:17.389809 14959 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:45:17.389566 14934 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260925 16:45:17.403467  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46129.2us
I20260925 16:45:17.400609  9123 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:17.419806  9014 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:17.420235  9014 leader_election.cc:401] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:17.371577 14892 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:17.363878 14804 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
W20260925 16:45:17.423812 14948 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:45:17.461496  9123 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
W20260925 16:45:17.510712  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83975.5us
W20260925 16:45:17.509171  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 151525us
I20260925 16:45:17.463040 14969 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 16
I20260925 16:45:17.429886 14892 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.530174  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:17.523638  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91329.6us
I20260925 16:45:17.531922  9117 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:17.440979 14446 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.072s
I20260925 16:45:17.554847  9695 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:17.573093  9117 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:17.574386  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:17.592319  9695 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:17.586305 14795 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:17.656787  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 128514us
I20260925 16:45:17.558660 14741 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260925 16:45:17.664296  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:17.664983  9695 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:17.705480  9695 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:17.718477 14892 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:17.687958 14446 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
W20260925 16:45:17.730453  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 381141us
I20260925 16:45:17.680668 14934 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
W20260925 16:45:17.731877 14962 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260925 16:45:17.748564  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:17.756914  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58958.1us
I20260925 16:45:17.760946  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:17.761863  9695 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:17.758790  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:17.811105  9695 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:45:17.749243 14934 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:17.844481  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 85785.5us
I20260925 16:45:17.845289  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:17.871133  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117804us
W20260925 16:45:17.874382 14971 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.176s	user 0.000s	sys 0.000s
W20260925 16:45:17.875969 14984 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260925 16:45:17.876085  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2055) took 1139 ms. Trace:
W20260925 16:45:17.876065 14981 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260925 16:45:17.877936  8975 rpcz_store.cc:276] 0925 16:45:16.736421 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:16.736632 (+   211us) service_pool.cc:227] Handling call
0925 16:45:17.875892 (+1139260us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b54001c3c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:17.876008 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":671801728}
I20260925 16:45:17.880733  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:17.852710 14955 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
W20260925 16:45:17.895450  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 312365us
I20260925 16:45:17.879644 14493 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:17.892068 14357 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.512s	user 0.010s	sys 0.001s
W20260925 16:45:17.904742  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 149383us
I20260925 16:45:17.903517 14955 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:17.909116 14977 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:17.909567 14977 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:17.910066 14977 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:17.909396 14955 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.911994 14995 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:45:17.914619 14995 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:17.918259 15001 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:17.918758 15001 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:17.920033 14934 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:17.920049 14968 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.311s	user 0.000s	sys 0.001s
I20260925 16:45:17.926426  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1110) took 1114 ms. Trace:
I20260925 16:45:17.908274 14357 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:17.926797  9046 rpcz_store.cc:276] 0925 16:45:16.811975 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:16.815672 (+  3697us) service_pool.cc:227] Handling call
0925 16:45:17.926226 (+1110554us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400127354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:17.926362 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":798808960}
I20260925 16:45:17.928535 14357 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:17.930343  9696 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:17.908113 14493 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:17.936300  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 85247.2us
I20260925 16:45:17.942457  9694 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260925 16:45:17.915122 14995 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:17.961980  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:17.963835  9118 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:17.962847  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62985.1us
I20260925 16:45:17.968835  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:17.969605  9043 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:17.975234  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:17.978725 14988 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.074s
I20260925 16:45:17.979911 14987 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:17.980379 14987 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:17.980731 14987 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:17.981151 14952 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:17.981611 14952 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:17.963505 14953 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.036648  9118 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
W20260925 16:45:18.036337  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64038.9us
I20260925 16:45:18.039628  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:17.983668 14952 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:18.038640 14493 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.042055 14953 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:18.188841  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 308165us
I20260925 16:45:17.919617 15001 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:18.258509  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 216025us
W20260925 16:45:18.319424 14969 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.775s	user 0.006s	sys 0.010s
W20260925 16:45:18.527899  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.013s	sys 0.012s
I20260925 16:45:18.535454 14458 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:18.536689  9016 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12359c2bff0b46de91daa934c219103c. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:45:18.537859  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.523s (SENT) [suppressed 1 similar messages]
W20260925 16:45:18.540652 14977 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.630s	user 0.021s	sys 0.003s
I20260925 16:45:18.541793 14995 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:18.542734  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 499922us
I20260925 16:45:17.974826 14892 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.555181 14652 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.610098 15015 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:18.557535 15009 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:18.539489 14987 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.558s	user 0.004s	sys 0.020s
W20260925 16:45:18.573320  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.013s	sys 0.013s
W20260925 16:45:18.667940  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 66973.9us
I20260925 16:45:18.582312 14458 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.582443 14563 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260925 16:45:18.568035 14613 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:18.600834 14999 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:18.602516  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1611) took 1554 ms. Trace:
I20260925 16:45:18.604921  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1483) took 1017 ms. Trace:
I20260925 16:45:18.607113 14953 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.555810  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:18.557554 14986 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.596060 15003 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.721498  9699 rpcz_store.cc:276] 0925 16:45:17.047950 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.056765 (+  8815us) service_pool.cc:227] Handling call
0925 16:45:17.056977 (+   212us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:17.386354 (+329377us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:18.602254 (+1215900us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b54004f1854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:18.602431 (+   177us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":724375424}
W20260925 16:45:18.667384  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67479.5us
I20260925 16:45:18.627036 14969 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:18.722194  9696 rpcz_store.cc:276] 0925 16:45:17.587860 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.588037 (+   177us) service_pool.cc:227] Handling call
0925 16:45:17.588361 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:17.930747 (+342386us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:18.604686 (+673939us) spinlock_profiling.cc:243] Waited 341 ms on lock 0x7b540066dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:18.604855 (+   169us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":785063808}
I20260925 16:45:18.610126 14892 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.734061  8966 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:18.675045 14337 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:18.590111 14977 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.667950 14687 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.740685 14687 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.681038 14955 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:18.675186 14987 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.723879 14613 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:18.749928  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1485) took 1083 ms. Trace:
I20260925 16:45:18.750352 14613 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.751132 14987 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.673507 14652 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.752310 14642 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:18.751899 14955 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.752779 14642 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.753350 14652 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.754043  8968 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260925 16:45:18.754761 14642 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.730798 15003 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.756194 14977 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.726127 14995 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:18.757294 14995 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.757827 15003 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:18.758040 14955 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.758555 14376 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:18.759268 14995 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.746729  9119 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:18.748380  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:18.761868  8973 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:18.731734 14747 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:18.759030 14376 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.744392 14458 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.750281  9700 rpcz_store.cc:276] 0925 16:45:17.666363 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.666529 (+   166us) service_pool.cc:227] Handling call
0925 16:45:17.669229 (+  2700us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:17.673236 (+  4007us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:17.809602 (+136366us) log.cc:842] Serialized 14 byte log entry
0925 16:45:18.248033 (+438431us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:18.533357 (+285324us) log.cc:842] Serialized 52 byte log entry
0925 16:45:18.542506 (+  9149us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:18.568142 (+ 25636us) log.cc:842] Serialized 14 byte log entry
0925 16:45:18.568338 (+   196us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:18.568415 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:18.749644 (+181229us) raft_consensus.cc:1671] finished
0925 16:45:18.749671 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:18.749781 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":58524,"prepare.queue_time_us":438063,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":53,"raft.queue_time_us":625991,"raft.run_cpu_time_us":457,"raft.run_wall_time_us":14526,"thread_start_us":280152,"threads_started":3,"wal-append.queue_time_us":877008}
I20260925 16:45:18.765231  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:18.774463  9119 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:18.782089  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:18.783787  9119 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:18.735920 14953 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.813588  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:18.814064 14953 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.737988 14758 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.730319 14999 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.729362 14986 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.775039 14780 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:18.818876  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:18.824800  8973 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:18.813398  9123 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:18.826877  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43592.6us
I20260925 16:45:18.816447 15003 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:18.836251 14987 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.836462 15003 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.836805 14987 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.837071  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:18.837071  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:18.838413 15003 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.839257 14987 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.841485  9120 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260925 16:45:18.845417  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:18.844810  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:18.851796  9048 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 16
I20260925 16:45:18.672643 15015 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.783416 14690 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.819845 14955 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.808298 14772 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:18.871212 14687 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.871800 14493 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:18.872751 14987 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:18.873538  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:18.873127 14987 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:18.872723 14493 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.002s
I20260925 16:45:18.874938 14493 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:18.875310 14493 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:18.875051 14987 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.876314 14987 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:18.876049 14493 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.876601 14376 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.877183 14493 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:18.880674 14999 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:18.881220 14999 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:18.881803  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:18.881671 14999 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.883358 14563 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:18.883776 14986 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:18.883844 14563 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.764775 14337 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.774009 14747 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.849215 14446 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:18.895879  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:18.896739  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:18.674654 15009 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.830729 14596 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.824079 14758 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.899731 14458 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:18.929773  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3052) took 1580 ms. Trace:
I20260925 16:45:18.938694  9124 rpcz_store.cc:276] 0925 16:45:17.339863 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.340041 (+   178us) service_pool.cc:227] Handling call
0925 16:45:17.340295 (+   254us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:17.370402 (+ 30107us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:18.920110 (+1549708us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b540007dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:18.920266 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":68071296}
W20260925 16:45:18.922001 15013 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:45:18.918581  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:18.899837 15004 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.889154 14985 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.831538 14780 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.887956 14953 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:18.889678 15024 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.897404 15016 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:18.943979  9045 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:18.940184  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:18.932633 14995 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:18.949066  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:18.886288 14690 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.927963 14446 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.928361 14563 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.951098 15005 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.210s
I20260925 16:45:18.951323 15004 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.028282 14892 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.029814 15004 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.958124 15025 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.030570 15025 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.031810 14758 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.032364 15036 ts_tablet_manager.cc:927] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.032701 15025 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:18.958735 14780 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:18.887889 14955 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.034046 14446 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.034699 14955 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.959328 15021 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.035418 14747 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:18.964017  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:18.960604  9043 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:18.960407 14985 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.980177 15015 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.035446 15021 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.048985  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:19.050347 14985 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.051484 14768 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:19.052042 14768 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:19.051764 15012 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:19.053598 14446 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:19.050700 15021 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.060389 14446 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.063102 14758 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:19.063856 14758 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:18.960342 14953 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.066283 14953 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.068233 14985 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:19.068257  8859 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:19.068892 14985 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.069157 14953 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.069370 15021 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.069895 15021 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.072235 15021 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.008601  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:18.897965 14772 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:18.938496 14458 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:18.889346 14979 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.134s
I20260925 16:45:19.009274 14978 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.014328 14997 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.011521 14995 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:19.015268 15019 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260925 16:45:19.015525 14972 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:19.016546 15017 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260925 16:45:19.016705 14746 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:19.017488  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:19.009449 15016 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.019214 14337 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.024657 15009 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.180992 14458 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:18.951282 14974 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:18.984400 15024 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:19.113044  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 104517us
I20260925 16:45:18.944626 14596 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.154405 14018 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.166594 14949 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:19.171370 14772 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.022017 14999 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.187179 14972 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:19.261777 14488 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.081s	sys 0.132s
I20260925 16:45:19.024940 14690 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.202505  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.217392  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.188266 14983 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
W20260925 16:45:18.924540  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 386679us
I20260925 16:45:19.313809  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.316058  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.189571  8966 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:19.318358  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:19.324463 15027 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260925 16:45:19.325192  9121 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:19.329401  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.334080  9119 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
W20260925 16:45:19.334960  8972 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.525s	user 0.017s	sys 0.007s
I20260925 16:45:19.184754 14978 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:19.330251 14488 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.081s	sys 0.135s
I20260925 16:45:19.194924 14831 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.308256 14446 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.185400 14997 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:19.344779  9046 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.024s	sys 0.046s
W20260925 16:45:19.357075  9046 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.024s	sys 0.047s
W20260925 16:45:19.339846  8972 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.530s	user 0.017s	sys 0.007s
I20260925 16:45:19.269905 14337 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:19.352072  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:19.358372  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.542s	user 0.020s	sys 0.054s
I20260925 16:45:19.356247  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:19.360440  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.545s	user 0.020s	sys 0.054s
W20260925 16:45:19.361666  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 545786us
I20260925 16:45:19.195112 14746 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:19.347371  9116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.014s	sys 0.058s
W20260925 16:45:19.367501  9116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.014s	sys 0.058s
W20260925 16:45:19.367970  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.003s	sys 0.023s
I20260925 16:45:19.360376  9694 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:19.340651 14949 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:19.350152 15001 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.024s	sys 0.049s
I20260925 16:45:19.370679  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3191) took 1396 ms. Trace:
I20260925 16:45:19.271056 14974 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.375648  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.312924 14018 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.364523 15025 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:19.403434  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.413746  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.354741 14772 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.403522  9047 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:19.410547  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.382079  9046 rpcz_store.cc:276] 0925 16:45:17.967364 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.967567 (+   203us) service_pool.cc:227] Handling call
0925 16:45:17.967885 (+   318us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:18.040290 (+ 72405us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:18.040352 (+    62us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:18.075841 (+ 35489us) log.cc:842] Serialized 26 byte log entry
0925 16:45:18.674181 (+598340us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:19.357670 (+683489us) log.cc:842] Serialized 14 byte log entry
0925 16:45:19.363317 (+  5647us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:19.363403 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:19.363444 (+    41us) raft_consensus.cc:1671] finished
0925 16:45:19.363455 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:19.363835 (+   380us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":73572,"prepare.queue_time_us":177328,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":80329,"raft.run_cpu_time_us":22701,"raft.run_wall_time_us":472042,"thread_start_us":760084,"threads_started":2,"wal-append.queue_time_us":246651}
I20260925 16:45:19.363893 14999 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:19.382288 14934 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.422s	user 0.013s	sys 0.040s
W20260925 16:45:19.380659 15001 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.025s	sys 0.049s
I20260925 16:45:19.425655  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.354543 14831 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.371404 14892 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.456151  9693 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
W20260925 16:45:19.447891  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 261346us
I20260925 16:45:19.458472 15036 tablet_copy_client.cc:316] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
W20260925 16:45:19.425287 15017 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260925 16:45:19.428776 14934 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.504s	user 0.013s	sys 0.041s
I20260925 16:45:19.460490  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.468866  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:19.472548  9700 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:19.473176  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:19.464507  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1958576060001178s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260925 16:45:19.473793  9042 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:19.431351 14795 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:19.367864 14337 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.431535 14613 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.476989  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:19.426930 15025 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.483356  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:19.514792 15045 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260925 16:45:19.514698  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.516800 15025 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.516912 14974 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.484099 14488 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.518092 14337 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.518203 14488 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.518376 14949 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.520023  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.468825 15044 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.423399 14772 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.523267  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.431996 14999 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.483902 14995 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.469108 14892 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.522310 14951 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:19.487216 15037 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.524684 14596 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.490531  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:19.596258  8966 raft_consensus.cc:595] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:19.596632  8966 raft_consensus.cc:603] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:19.524428 15026 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:19.599776  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.487592 14795 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:19.600924  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 124613us
I20260925 16:45:19.607525  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:19.583642 14972 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.556324 15044 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.583729 15016 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.497987 14613 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.621146  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.583442 15024 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.621825  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:19.615212  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1387) took 1654 ms. Trace:
I20260925 16:45:19.630380  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.627192  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.610236 15015 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:19.631819 15015 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:19.631973  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.632073  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.633675  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.633242 15015 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.623543  9700 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:19.633191  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.634352  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:19.635030  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.634387  9048 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:19.633157  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.652503  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.653445  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:19.613459 15030 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260925 16:45:19.657371  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.655787  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.657284  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.658563  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:19.610392 15043 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260925 16:45:19.630334  9116 rpcz_store.cc:276] 0925 16:45:17.960554 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.961593 (+  1039us) service_pool.cc:227] Handling call
0925 16:45:17.972512 (+ 10919us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:17.986657 (+ 14145us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:17.986686 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:18.039296 (+ 52610us) log.cc:842] Serialized 26 byte log entry
0925 16:45:19.372489 (+1333193us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:19.372525 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:19.372583 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:19.614976 (+242393us) raft_consensus.cc:1671] finished
0925 16:45:19.614998 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:19.615143 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3553,"raft.queue_time_us":21359,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5754,"thread_start_us":798606,"threads_started":1,"wal-append.queue_time_us":1366017}
I20260925 16:45:19.659060  9700 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:19.658162  9695 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:19.610809 14746 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.617901 14999 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.666241 14831 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.667313 14613 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.667480  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.668443  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.666347  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.660835 15028 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:19.709625 15028 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:19.709997 15028 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:19.600520 15037 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.713258 15037 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.671187  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3292) took 2222 ms. Trace:
I20260925 16:45:19.605019 15026 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.713709  9115 rpcz_store.cc:276] 0925 16:45:17.449047 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:17.449206 (+   159us) service_pool.cc:227] Handling call
0925 16:45:17.449616 (+   410us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:17.519950 (+ 70334us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:17.519994 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:18.860504 (+1340510us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b2c000d80e8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:45:18.922937 (+ 62433us) log.cc:842] Serialized 26 byte log entry
0925 16:45:19.371254 (+448317us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:19.371294 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:19.373478 (+  2184us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:19.670864 (+297386us) raft_consensus.cc:1671] finished
0925 16:45:19.670887 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:19.671107 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":56865,"raft.queue_time_us":59510,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":11348,"spinlock_wait_cycles":3494144,"thread_start_us":418466,"threads_started":1,"wal-append.queue_time_us":532433}
I20260925 16:45:19.715476  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.716032 15026 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.716531  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.717443 15044 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.717566  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.672310 14795 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.635123 14978 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.719187  9115 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260925 16:45:19.672782  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.673625 14018 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.676571  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.732645  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:19.733496  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.734340  9123 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 19 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260925 16:45:19.681559  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.736073  9697 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:19.685153  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.688052  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:19.737877  9695 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:19.695125  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.696228  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.634791 14488 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.705850  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.744436  9699 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:19.705687  9700 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:19.708555  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.708597 14758 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.724334  9119 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:19.727846 14955 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:19.719502 14458 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.748099  9050 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260925 16:45:19.723097  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:19.741271  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 106986us
I20260925 16:45:19.756364  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:19.758189  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260925 16:45:19.761827  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.762122  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.747361 14955 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.699653 14997 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.768175  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:19.772710  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.762014 14772 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:19.764916 14979 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:19.765214 14488 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:19.789827  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.794483  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.791741  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:19.765103 15055 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:19.776759 14972 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:19.815867  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.776608 14613 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:19.799083 14488 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.822600 14488 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.817526 14746 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:19.823869 14746 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:45:19.824774  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2743) took 1234 ms. Trace:
I20260925 16:45:19.825170  8970 rpcz_store.cc:276] 0925 16:45:18.590081 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.590471 (+   390us) service_pool.cc:227] Handling call
0925 16:45:18.590775 (+   304us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:18.946428 (+355653us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:18.946473 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:18.946515 (+    42us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:18.946550 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:19.824546 (+877996us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b54003c41d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:19.824601 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:19.824721 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":817469312}
I20260925 16:45:19.795783  9695 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:19.827451 14613 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.831310 14613 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.839804 14941 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:19.840384 14941 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.842007  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:19.842751 14941 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:19.843063 15021 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.843256 14941 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:19.843683 14018 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:19.843580 15021 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:19.844969 14941 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:19.845491 14941 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:19.846709  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 139672us
I20260925 16:45:19.851588  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:19.850610  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:19.854350 15002 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:19.863358  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.863250  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.798810 15016 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:19.856292  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:19.794047 14999 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.069s
I20260925 16:45:19.853626 14941 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:19.905860  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.895207  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:19.832717 15038 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.218s	user 0.002s	sys 0.000s
W20260925 16:45:19.911425  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61607.5us
W20260925 16:45:19.912081  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55882.3us
I20260925 16:45:20.006599  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:19.906304 15047 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260925 16:45:20.010152  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:19.865626 15024 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.013384  9117 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:19.886003 14955 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:20.018260  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 233396us
I20260925 16:45:20.082242  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:20.024279  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:20.028460  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.888367 14458 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:19.912515 14969 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:20.095299  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:19.987733 14018 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:19.819058 14972 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:20.092104  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 85705.5us
I20260925 16:45:19.912158 15016 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.097592  9124 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260925 16:45:20.112037  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.006090 15039 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.192644  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:20.177213  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81889.8us
I20260925 16:45:20.198065  9117 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:20.089603 15024 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.103648 15059 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:20.167268 15016 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:20.177385 14458 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:20.237968 15038 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.000s
I20260925 16:45:20.297379 15052 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:20.297858 15052 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:20.298310 15052 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:20.317818  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3198) took 1577 ms. Trace:
I20260925 16:45:20.318250  9045 rpcz_store.cc:276] 0925 16:45:18.740400 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.743529 (+  3129us) service_pool.cc:227] Handling call
0925 16:45:18.743914 (+   385us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:19.002687 (+258773us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:20.317559 (+1314872us) spinlock_profiling.cc:243] Waited 200 ms on lock 0x7b54001bfdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:20.317760 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":459143040}
I20260925 16:45:20.321455 14972 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:20.322583 14941 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.322757 14768 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.194352 15039 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.323952 14768 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:20.295717 14458 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.328625  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2750) took 1603 ms. Trace:
I20260925 16:45:20.254235 15059 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:20.325273 15039 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.335580 15059 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:20.329001  8972 rpcz_store.cc:276] 0925 16:45:18.724775 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.724918 (+   143us) service_pool.cc:227] Handling call
0925 16:45:18.752027 (+ 27109us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:18.808788 (+ 56761us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:18.808833 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:18.809343 (+   510us) log.cc:842] Serialized 26 byte log entry
0925 16:45:19.358144 (+548801us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:19.369647 (+ 11503us) log.cc:842] Serialized 14 byte log entry
0925 16:45:19.381981 (+ 12334us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:19.382092 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:19.832222 (+450130us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:20.328328 (+496106us) raft_consensus.cc:1671] finished
0925 16:45:20.328437 (+   109us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:20.328555 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":69208,"prepare.queue_time_us":13266,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5285,"raft.queue_time_us":94770,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":11511,"spinlock_wait_cycles":98472192,"thread_start_us":548485,"threads_started":1,"wal-append.queue_time_us":805222}
W20260925 16:45:20.337755 14979 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.543s	user 0.007s	sys 0.000s
I20260925 16:45:20.338279 14979 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260925 16:45:20.335210 15028 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.625s	user 0.007s	sys 0.004s
W20260925 16:45:20.330401  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 70328.5us
I20260925 16:45:20.333544 15024 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:20.343170  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.347563  9048 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:20.348510  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.349709  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.343255  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:20.352576  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 111366us
I20260925 16:45:20.355253  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.358515  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.356091  9046 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:20.341702 14458 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:20.365288  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 288836us
I20260925 16:45:20.368976  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:20.370285  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3214) took 1019 ms. Trace:
I20260925 16:45:20.370636  9047 rpcz_store.cc:276] 0925 16:45:19.350956 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.351791 (+   835us) service_pool.cc:227] Handling call
0925 16:45:20.370128 (+1018337us) spinlock_profiling.cc:243] Waited 43.4 ms on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:20.370238 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":99800832}
W20260925 16:45:20.360839 15031 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.890s	user 0.010s	sys 0.007s
W20260925 16:45:20.366626  9693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.008s	sys 0.004s
W20260925 16:45:20.373893  9693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.541s	user 0.008s	sys 0.004s
I20260925 16:45:20.375573  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:20.386386  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:20.386778  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.387601  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:20.400104 14941 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:20.400766 14941 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.404024  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:20.404147  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.382510 14892 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.399621 15054 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:20.406327 15054 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.408875 15054 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.409499 15054 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:20.415150 15048 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.415839 15048 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.418366 15048 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.352587 15028 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.421373 15028 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.422493 15071 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:20.425709 14941 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.436903  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:20.438045 14952 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:20.438485 14952 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.438910 14952 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:20.405542 14892 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:20.442467 14892 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.443035 14892 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:20.447468 15059 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.439033  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:20.454514  9046 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:20.454653  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.456975  9700 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:20.458230  9117 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260925 16:45:20.457826  9115 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260925 16:45:20.471014  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:20.475483 15039 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260925 16:45:20.478319 14093 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:20.478729 14093 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.479082 14093 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:20.470417 14018 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:20.481496  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:20.487028  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73409.3us
I20260925 16:45:20.487516  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.489488  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:20.489629  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.491326  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.484247 14784 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:20.496661  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.499161 15070 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:20.504954  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1627) took 1672 ms. Trace:
I20260925 16:45:20.506649  9047 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:45:20.508531 15078 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:20.510100 15079 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:20.510629 15079 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:20.506587  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.519479  9046 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:20.520424  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.521762  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.505371  9696 rpcz_store.cc:276] 0925 16:45:18.832707 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.832826 (+   119us) service_pool.cc:227] Handling call
0925 16:45:18.833112 (+   286us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:19.170581 (+337469us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:19.170611 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:19.179862 (+  9251us) log.cc:842] Serialized 26 byte log entry
0925 16:45:19.466393 (+286531us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:19.466616 (+   223us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:20.504546 (+1037930us) spinlock_profiling.cc:243] Waited 337 ms on lock 0x7b5400670554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:20.504612 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:20.504677 (+    65us) raft_consensus.cc:1671] finished
0925 16:45:20.504700 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:20.504903 (+   203us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":93,"spinlock_wait_cycles":775296384,"thread_start_us":275521,"threads_started":1,"wal-append.queue_time_us":451393}
I20260925 16:45:20.524037  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.480739 15052 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.533375  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:20.534409  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.537452  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:20.493886 15015 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:20.543607  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 994851us
I20260925 16:45:20.546610  9048 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:20.558890  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:20.560737  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.527498 15078 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:20.564445  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.535774 14941 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:20.516502 15016 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.567672  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.535597 14985 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:20.498447 14952 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.582612  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.557444 14897 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:20.583884  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.558933 15059 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.587064  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.588585  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:20.590969  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.597877  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.594900  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.601181  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.604471  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.558568 15015 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.584843 15078 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:20.613085  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.611961  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.620534  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.598781 15024 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:20.600521 14897 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:20.598029 14978 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.622826  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.561368 14018 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.629207  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet 12359c2bff0b46de91daa934c219103c from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:45:20.612167 14745 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:20.633334 15077 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:20.633848 14996 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.634285 14952 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.636060 15015 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.639930 14947 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.626448 14972 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:20.644263 15078 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.645865  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:20.648645 15052 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:20.650281  9041 raft_consensus.cc:2396] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260925 16:45:20.626252 15067 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:20.652546  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.699131 14642 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.699673 14642 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.702353  9045 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:20.619341 14690 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.686342  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1624) took 1917 ms. Trace:
I20260925 16:45:20.655179 15039 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:20.693336  9048 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:20.695894  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:20.703145  9698 rpcz_store.cc:276] 0925 16:45:18.736941 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.744741 (+  7800us) service_pool.cc:227] Handling call
0925 16:45:18.745004 (+   263us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:18.760388 (+ 15384us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:18.760421 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:18.760461 (+    40us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:18.760489 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:20.654586 (+1894097us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:20.654631 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:20.654739 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":34935680}
W20260925 16:45:20.702306  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3204) took 1807 ms (client timeout 2176 ms). Trace:
I20260925 16:45:20.687150 15021 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.706955  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:20.653901  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:20.706282  9043 rpcz_store.cc:269] 0925 16:45:18.895348 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.895560 (+   212us) service_pool.cc:227] Handling call
0925 16:45:20.702095 (+1806535us) spinlock_profiling.cc:243] Waited 58.8 ms on lock 0x7b54002625d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:20.702242 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":135239936}
I20260925 16:45:20.711576  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.710563  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:20.712568  8969 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:20.654517 14978 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:20.711792  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58470.4us
I20260925 16:45:20.715363  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.716943  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:20.685669  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet 12359c2bff0b46de91daa934c219103c from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-12359c2bff0b46de91daa934c219103c
I20260925 16:45:20.720892  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:20.721457  8970 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:20.721417  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.722945  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.723960  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:20.723420  9043 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:20.725850  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.726827 14974 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:20.727916 15069 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260925 16:45:20.732059  9047 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:20.732941 14978 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.695958 14947 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.717916 14897 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.733783  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1630) took 1367 ms. Trace:
I20260925 16:45:20.734647 14947 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.724326 15052 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:20.737259 15052 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.739317 15052 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.734150  9701 rpcz_store.cc:276] 0925 16:45:19.366316 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.366430 (+   114us) service_pool.cc:227] Handling call
0925 16:45:19.366803 (+   373us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:19.432211 (+ 65408us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:19.432251 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:19.432289 (+    38us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:19.432323 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:20.733574 (+1301251us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:20.733615 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:20.733731 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":149775104}
I20260925 16:45:20.740690  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.741360  9698 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:20.744634  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.720909 15041 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:20.747229  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:20.748551  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2076) took 1375 ms. Trace:
I20260925 16:45:20.713193 15026 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:20.690425 14996 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.748997  9049 rpcz_store.cc:276] 0925 16:45:19.373314 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.373442 (+   128us) service_pool.cc:227] Handling call
0925 16:45:20.370238 (+996796us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:20.370394 (+   156us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:20.370417 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:20.370452 (+    35us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:20.370480 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:20.370527 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:20.748386 (+377859us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54002517d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:20.748497 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2201983744}
I20260925 16:45:20.749538  8971 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:20.754256  9048 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:20.756121  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:20.756668  9698 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:20.757107 14996 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:20.757666 14746 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:20.758028 14746 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:20.758409 14746 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:20.735517 15079 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.762106  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:20.710553 14690 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.749866 15021 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:20.765045  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:20.775766 15079 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:20.776167 14690 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:20.776292 15079 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:20.777206 15079 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.771459  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:20.781749  8971 raft_consensus.cc:2396] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260925 16:45:20.690788 15077 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.760635 15016 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.809032  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:20.810365  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:20.783907  8970 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:20.822418  8970 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:20.822523  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:20.763895 15094 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.021s
I20260925 16:45:20.829414  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.780799 15021 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:20.832755  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.780714 15006 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:20.838569  9049 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:20.844302  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:20.765214 14934 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.060s
I20260925 16:45:20.827879 14947 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:20.829779 14978 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:20.833720 14690 raft_consensus.cc:2741] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260925 16:45:20.857362 14093 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.860042  9046 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:20.860414 14093 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.852766 14978 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:20.865082  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.864811 14892 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.837585 15021 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:20.848819 15015 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:20.865911  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2086) took 1374 ms (client timeout 1573 ms). Trace:
I20260925 16:45:20.866248 15015 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.865432 14978 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:20.843603 15024 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:20.868389 15015 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.822108 14758 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260925 16:45:20.870523  9698 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
W20260925 16:45:20.866282  9044 rpcz_store.cc:269] 0925 16:45:19.491614 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.525285 (+ 33671us) service_pool.cc:227] Handling call
0925 16:45:20.864928 (+1339643us) spinlock_profiling.cc:243] Waited 3.86 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:45:20.865862 (+   934us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8882944}
I20260925 16:45:20.852496 14831 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.871917 14831 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:20.839411 15091 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260925 16:45:20.876248  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:20.837944 15006 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:20.891218  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:20.891933  8970 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:20.890620 14974 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.892627 14974 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.893446 15077 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.894516 14974 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.895044 14974 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.895903 14892 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.897199 14746 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.898254  9043 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:20.888947 15006 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:20.895476 14974 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.901448 14974 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.902724 15024 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:20.903637  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.904445  9059 tablet_copy_source_session.cc:205] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:45:20.905468 14745 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.906450  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:20.889673 15016 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:20.907220  9698 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:20.907666 15016 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:20.908568 14746 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.888254 15015 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:20.909375 15015 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:20.909961 14978 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.910275  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.917436  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:20.924606  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:20.975253  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 140683us
I20260925 16:45:20.962502 15054 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:20.983510 15054 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:20.983912 15054 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:20.984566 14978 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:20.908600 15016 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:20.988684  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 148962us
I20260925 16:45:20.987321  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.990993  9049 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:20.992748 14974 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.993063  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:20.993517 14974 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:20.994349 14934 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:20.994858 14934 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:20.995335 14934 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:20.996918 14974 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:20.894547 14831 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.005224  9700 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:20.888000 15021 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.008473  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:21.009457  9700 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: [17.15-17.15]
W20260925 16:45:21.001904  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110209us
I20260925 16:45:21.009262  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:21.013273  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.013863  9694 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:21.015048  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:20.918716 14745 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.019253  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.020648  8972 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:21.022192  8972 raft_consensus.cc:595] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:21.022521  8972 raft_consensus.cc:603] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:21.026826  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:21.027684  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.028474  9698 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:21.031976  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1204) took 1065 ms. Trace:
I20260925 16:45:21.033615  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:21.032363  9695 rpcz_store.cc:276] 0925 16:45:19.961292 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.961484 (+   192us) service_pool.cc:227] Handling call
0925 16:45:19.961850 (+   366us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:20.204654 (+242804us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:20.204699 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:20.204760 (+    61us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:20.204803 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:21.026689 (+821886us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b540062e154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:21.026732 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:21.026828 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":557836544}
I20260925 16:45:21.044704  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:21.045324  9044 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:21.047212  9694 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:21.021215 15015 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:21.022533 14446 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:21.055522 14978 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:21.056491 15006 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:21.056861 14996 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:21.058568 14973 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:21.061151  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.076224  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.080834  8973 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:21.082456  9698 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:21.083176  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.083680  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.083904  8973 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:21.084815  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:21.092906  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65853.1us
I20260925 16:45:21.093272  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.106534  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:21.105849  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44797.7us
I20260925 16:45:21.079371 14446 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:21.107190  9115 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 8.
I20260925 16:45:21.140542  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:21.148422 15107 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260925 16:45:21.150018  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.150868  8966 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:21.151998  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.153110  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.153435  9698 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:21.154352  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.155543  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.149992 15021 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.156212  8969 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:21.157159  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.158381  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.162717 15036 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 12359c2bff0b46de91daa934c219103c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:45:21.163681  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.161988 15054 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.109341  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:21.168728  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:21.170738  8859 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:21.172549 15006 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:21.172849  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.173969 15101 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260925 16:45:21.174324 15101 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:21.174654 15101 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:21.175560  9047 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260925 16:45:21.176676 15034 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.011s	user 0.010s	sys 0.003s
I20260925 16:45:21.178960 15079 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:21.181181 15079 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.000s
I20260925 16:45:21.181939 15079 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:21.182235 15079 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:21.182726 14934 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.184621  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:21.188086  9119 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260925 16:45:21.189783  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3210) took 1973 ms (client timeout 2518 ms). Trace:
I20260925 16:45:21.189934  9119 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:21.190078  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3319) took 1817 ms. Trace:
W20260925 16:45:21.190171  9050 rpcz_store.cc:269] 0925 16:45:19.216917 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.217079 (+   162us) service_pool.cc:227] Handling call
0925 16:45:21.189613 (+1972534us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54002611d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:21.189735 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":957400320}
I20260925 16:45:21.190644  9118 rpcz_store.cc:276] 0925 16:45:19.372369 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.373460 (+  1091us) service_pool.cc:227] Handling call
0925 16:45:19.373704 (+   244us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:19.457269 (+ 83565us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:19.457312 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:19.457364 (+    52us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:19.457408 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:21.189871 (+1732463us) spinlock_profiling.cc:243] Waited 83.3 ms on lock 0x7b54001efad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:21.189917 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:21.190027 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":191682304}
I20260925 16:45:21.193451  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.194340  9044 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
W20260925 16:45:21.110436  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64288.5us
I20260925 16:45:21.094192 15083 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:21.197142  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:21.213344  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 129732us
I20260925 16:45:21.234781  9115 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:21.104559 14745 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:45:21.182960 15079 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:21.244951 15079 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:21.223922 15078 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:21.110015 14947 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:21.256476 14446 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:21.257764  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3302) took 2516 ms. Trace:
I20260925 16:45:21.236776 15083 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:21.260074  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 104124us
I20260925 16:45:21.264393  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:21.265489 14642 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.266822  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:21.267386 14934 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:21.267993 15054 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.264493  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:21.271750  8973 raft_consensus.cc:595] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:21.272153  8973 raft_consensus.cc:603] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:21.258857  9122 rpcz_store.cc:276] 0925 16:45:18.741634 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.745459 (+  3825us) service_pool.cc:227] Handling call
0925 16:45:18.745896 (+   437us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:18.775719 (+ 29823us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:18.775765 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:18.817637 (+ 41872us) log.cc:842] Serialized 506 byte log entry
0925 16:45:19.339674 (+522037us) raft_consensus.cc:1631] Marking committed up to 6
0925 16:45:19.340533 (+   859us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:21.248277 (+1907744us) spinlock_profiling.cc:243] Waited 23.2 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:21.248323 (+    46us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:21.248372 (+    49us) raft_consensus.cc:1671] finished
0925 16:45:21.248383 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:21.257692 (+  9309us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":53429504,"thread_start_us":489307,"threads_started":1,"wal-append.queue_time_us":660409,"wal-append.run_cpu_time_us":1761,"wal-append.run_wall_time_us":1129934}
I20260925 16:45:21.274710  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:21.235975 14772 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260925 16:45:21.277091  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:21.277767  9049 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:21.278000  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:21.281082  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.281912  9695 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:21.271626 15078 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:21.283605 15078 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:21.284425  9698 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260925 16:45:21.285308  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:21.286041  8975 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:21.275111 14979 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:21.287022 14979 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.286286 15015 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:21.288712 14690 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:21.289081 14690 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.289172 14979 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.279443 15073 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:21.289861 14690 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.290182  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:21.290232 15073 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.290908  9701 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:21.291267 14690 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:21.291996  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.292686 15073 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.293032  9699 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: [13.12-13.12]
I20260925 16:45:21.293642  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1636) took 1182 ms. Trace:
I20260925 16:45:21.293910  9699 rpcz_store.cc:276] 0925 16:45:20.111305 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:20.111467 (+   162us) service_pool.cc:227] Handling call
0925 16:45:20.111884 (+   417us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:21.292818 (+1180934us) spinlock_profiling.cc:243] Waited 94.1 ms on lock 0x7b54004f2520. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:45:21.293405 (+   587us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:21.293597 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":216331008}
I20260925 16:45:21.297421 14642 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:21.297799 14642 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:21.298142 14642 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:21.298202  9041 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:21.299566 14897 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:21.300278 14897 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.298177 14613 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:21.302184 14897 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.302203 14613 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:21.303334 15083 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.303531 14613 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.274572 14947 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.306166  9047 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:21.305908 14947 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.308763  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:21.238829 15025 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.032s
I20260925 16:45:21.309381  9694 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:21.309805  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:21.314113  9701 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:21.312206  9695 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:21.316479  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.317477  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:21.320623  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:21.319358  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.322937 15075 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:21.330257 15075 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:21.309392 14892 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:21.260979 15071 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:21.322192  9118 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:45:21.339178 14975 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:21.339681 14975 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:21.340169 14975 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:21.344842 14897 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:21.353569  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:21.354156  8975 raft_consensus.cc:595] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:21.350793  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1206) took 1385 ms. Trace:
I20260925 16:45:21.274115 14977 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.054s
I20260925 16:45:21.331990 15054 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:21.278651 15052 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260925 16:45:21.356117  9697 rpcz_store.cc:276] 0925 16:45:19.965362 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.965532 (+   170us) service_pool.cc:227] Handling call
0925 16:45:19.990288 (+ 24756us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:20.235994 (+245706us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:20.236035 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:20.236528 (+   493us) log.cc:842] Serialized 26 byte log entry
0925 16:45:20.470022 (+233494us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:20.470078 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:21.334634 (+864556us) spinlock_profiling.cc:243] Waited 245 ms on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:21.334698 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:21.334758 (+    60us) raft_consensus.cc:1671] finished
0925 16:45:21.334777 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:21.350624 (+ 15847us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1069,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":25627,"spinlock_wait_cycles":564114816,"thread_start_us":233084,"threads_started":1,"wal-append.queue_time_us":313404}
I20260925 16:45:21.371137  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:21.327940 14978 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260925 16:45:21.328508 15101 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.384670 15060 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:21.351938 14949 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.042s
I20260925 16:45:21.376756 15078 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260925 16:45:21.333491 15075 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.421062  9049 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:21.422366  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.295379 14768 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:45:21.423370 14997 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
W20260925 16:45:21.484416  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73725.4us
W20260925 16:45:21.492426 15118 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260925 16:45:21.492743 14642 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.493460  9046 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:21.493707 15117 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260925 16:45:21.494822 14642 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.496536 15101 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:45:21.498760  9044 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:21.499284  9047 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260925 16:45:21.499554  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.500126  9701 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:21.506163  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:21.506826  9116 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:21.511286 15111 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:45:21.512214 15111 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:21.512534 15111 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.513293 15111 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:21.514457 15111 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:21.519894 14975 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.485970 14997 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:21.536904  9698 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:45:21.560200  9049 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:21.575393  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.553823 15078 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260925 16:45:21.580412  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.586686  8975 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 18 because replica has last-logged OpId of term: 16 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260925 16:45:21.588501 14997 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.592497  9698 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:21.603492 14955 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:21.614959  9698 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:21.621133  9117 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:21.625541 14488 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:21.628629 14972 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:21.698014  9116 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
I20260925 16:45:21.701144  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.714684  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.715616  8966 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:21.720261  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.721131  8968 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:21.707978 15025 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Leader election won for term 9
I20260925 16:45:21.728384  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:21.729768  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.732008  9694 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:21.732090  8966 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:21.735801  8968 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260925 16:45:21.736452 15025 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:21.737427 15025 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.748672  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1117) took 2103 ms. Trace:
I20260925 16:45:21.720055 14975 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:21.749153  9042 rpcz_store.cc:276] 0925 16:45:19.631304 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:19.633415 (+  2111us) service_pool.cc:227] Handling call
0925 16:45:20.499971 (+866556us) spinlock_profiling.cc:243] Waited 7.02 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:21.296551 (+796580us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:21.296815 (+   264us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:21.296847 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:21.296882 (+    35us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:21.296914 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:21.296966 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:21.734454 (+437488us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b540011e750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:21.734532 (+    78us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":461,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":1847642752}
I20260925 16:45:21.758282  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.734217 14758 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:21.765272 14758 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.766453  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:21.750874 15079 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.013s
I20260925 16:45:21.775557  9694 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:21.792716  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.794898  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:21.808040  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.795246  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.809423  8967 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:21.795478  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.795537  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.793562  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.810913  8970 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:21.814664  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 6 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.795987  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.791587  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:21.817682 15103 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
W20260925 16:45:21.806134 15118 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:21.795928  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.820186  8972 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:45:21.822039 14996 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:21.822405 14996 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.823149 14996 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.824501 14996 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:21.827781 15131 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260925 16:45:21.831048  9701 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:21.833285  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.836015 15103 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.839368  8972 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 15. (term mismatch)
I20260925 16:45:21.839089  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.840063  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:21.838368  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.840111  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.840862  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.841214  8973 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:21.842201  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.843047  8972 pending_rounds.cc:76] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 14
I20260925 16:45:21.843438  8972 pending_rounds.cc:97] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 17.15
I20260925 16:45:21.843884  8972 raft_consensus.cc:2866] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:21.847368  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.849503  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.852543  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.853117  8966 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:21.856045  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.836933 15073 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:21.857821  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.856154  8969 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:21.868561  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.870901  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.847430 14458 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:21.869223  8972 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:21.879093 15021 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:21.883000 15095 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:21.887243  9701 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:21.882898 15036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:42268 (request call id 1626) took 3107 ms. Trace:
I20260925 16:45:21.893319 15036 rpcz_store.cc:276] 0925 16:45:18.784749 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:18.785459 (+   710us) service_pool.cc:227] Handling call
0925 16:45:19.032733 (+247274us) ts_tablet_manager.cc:928] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
0925 16:45:20.987962 (+1955229us) tablet_copy_client.cc:361] Tablet copy session begun
0925 16:45:21.817590 (+829628us) tablet_metadata.cc:641] Metadata flushed
0925 16:45:21.817936 (+   346us) tablet_copy_client.cc:490] Wrote new tablet metadata
0925 16:45:21.882078 (+ 64142us) tablet_copy_client.cc:411] Wrote new consensus metadata
0925 16:45:21.882421 (+   343us) tablet_replica.cc:205] Creating consensus instance
0925 16:45:21.882746 (+   325us) ts_tablet_manager.cc:983] Replica registered.
0925 16:45:21.882820 (+    74us) inbound_call.cc:173] Queueing success response
Metrics: {"dns_us":63717,"tablet-copy.queue_time_us":219007,"thread_start_us":509826,"threads_started":2}
I20260925 16:45:21.894897 15036 tablet_copy_client.cc:791] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:45:21.891460 15095 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.896924  9045 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:21.897522  9045 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:21.775789 14758 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:21.905918 15095 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.909260  9042 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:45:21.916112  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.916303 15103 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.895545 15036 tablet_copy_client.cc:655] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:45:21.925603 14758 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:21.928052  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.884994 15073 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:21.931348  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.921396  9045 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.933562  9045 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:21.892247 15021 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:21.939517  9046 pending_rounds.cc:76] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 11
I20260925 16:45:21.939941  9046 pending_rounds.cc:97] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 13.12
I20260925 16:45:21.940238  9046 raft_consensus.cc:2866] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:21.900069 14458 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:21.943440  9701 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:21.945192  9042 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:21.944489  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:21.931327 14018 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260925 16:45:21.954450 14613 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:21.955097 15021 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.956395 15021 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:21.960122 15073 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:21.963829 15042 consensus_queue.cc:1159] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8dc3391062084f45a6ba62d28d340722" responder_term: 12 status { last_received { term: 11 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:21.967172 14996 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:21.968544 14996 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:21.968909 14996 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:21.969667 14996 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:21.970427 15120 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.574s	user 0.000s	sys 0.002s
I20260925 16:45:21.970942 14996 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:21.967438 14988 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260925 16:45:21.936789 15005 consensus_queue.cc:1159] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 16 status { last_received { term: 15 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:21.976140 14458 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.951624 15095 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:21.981943 15044 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:21.982335 15044 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:21.983271 15044 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:21.986544 14749 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:21.987027 14749 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:21.988091 14749 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:21.995771 15130 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260925 16:45:21.998271 14749 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:22.003093 15044 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:22.010001  9701 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:22.011976 15042 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:22.014115 14947 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:22.015206 14947 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:22.015539 14947 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:22.016292 14947 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:22.017096  9049 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: [12.12-14.13]
I20260925 16:45:22.017614 14947 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:22.024626  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.032344  9045 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:22.043011  9701 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:22.034596 15011 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260925 16:45:22.048228 14804 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:22.048569 14804 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:22.049325 14804 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:22.045123 15055 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260925 16:45:22.050587 14804 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:22.045356 15079 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:22.052754 15079 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:22.054085 15103 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:22.054814 15079 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:22.059209  9695 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:22.067807 15036 tablet_copy_client.cc:531] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:45:22.068032  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:22.038461 14979 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260925 16:45:22.106601  8974 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260925 16:45:22.107070  8974 pending_rounds.cc:76] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 14
I20260925 16:45:22.107312  8974 pending_rounds.cc:97] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260925 16:45:22.107570  8974 raft_consensus.cc:2866] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:22.119455  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.121019  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.127190  9699 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:22.131170  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.133195  9116 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:22.135821  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.158526  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:22.223618  8966 raft_consensus.cc:595] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.224169  8966 raft_consensus.cc:603] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:22.226539 14018 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:22.227105 14018 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:22.229200  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77780.5us
I20260925 16:45:22.232335  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.249117  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:22.256443 14018 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:22.291929  9697 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260925 16:45:22.292487  9697 pending_rounds.cc:76] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 13
I20260925 16:45:22.292739  9697 pending_rounds.cc:97] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260925 16:45:22.293010  9697 raft_consensus.cc:2866] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:22.302469  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:22.308298  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.245348 15112 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:22.320070  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:22.320984  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:22.336792  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:22.340507  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:22.350528  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.358179  9041 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:22.359836  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.360459  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:22.336908 15076 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260925 16:45:22.349334 15079 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:22.379192  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.381716  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.391831  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.338653 15112 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:22.368110 14613 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.025s
I20260925 16:45:22.395973 14768 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:49548 (request call id 1) took 5574 ms. Trace:
I20260925 16:45:22.414616  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.432082  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.438486  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.455592 15067 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:22.456739 15067 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:22.457054 15067 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:22.457804 15067 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:22.459235 15067 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:22.464279  8973 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:45:22.472086  9047 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
W20260925 16:45:22.477555 14996 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.506s	user 0.003s	sys 0.006s
I20260925 16:45:22.478693  8969 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:22.479410  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:22.484380 15095 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.002s
I20260925 16:45:22.485060  8972 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17.
I20260925 16:45:22.479588 15112 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:22.489756  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:22.466439  8966 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:22.497201  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.495337  8968 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:22.509711  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.525372  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.536851  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.540665  9122 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:45:22.543129  8972 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17.
I20260925 16:45:22.522409 15079 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:22.566313  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.567203  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:22.567513  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.528967 15011 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260925 16:45:22.544791 15044 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:22.550073 15036 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:45:22.568339  8972 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:22.575500  8971 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:22.587363  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:22.600255  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.507s (SENT)
I20260925 16:45:22.603351  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.557291 15079 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:22.621546  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.622231  8968 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
W20260925 16:45:22.611562  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 117730us
I20260925 16:45:22.592353 15044 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:22.608624 15042 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:22.626365  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.634660  9699 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:22.635514 15044 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:22.640095 15149 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260925 16:45:22.646787  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.647600  8971 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:22.649633  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:22.631307 15148 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.201s	user 0.000s	sys 0.001s
I20260925 16:45:22.654811  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:22.659171  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.659788  8971 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:22.584878 14357 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.079s
W20260925 16:45:22.665333  8869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 343) took 27446 ms (client timeout 15000 ms). Trace:
I20260925 16:45:22.666483  9699 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:45:22.655748  9042 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:22.411055 14768 rpcz_store.cc:276] 0925 16:45:16.817739 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:16.818124 (+   385us) service_pool.cc:227] Handling call
0925 16:45:16.912992 (+ 94868us) log.cc:842] Serialized 506 byte log entry
0925 16:45:18.626712 (+1713720us) spinlock_profiling.cc:243] Waited 26 ms on lock 0x7b18003cdae0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:22.390039 (+3763327us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":116044,"raft.queue_time_us":85405,"raft.run_cpu_time_us":18285,"raft.run_wall_time_us":267153,"spinlock_wait_cycles":59708672,"thread_start_us":208334,"threads_started":1,"wal-append.queue_time_us":435243,"wal-append.run_cpu_time_us":20237,"wal-append.run_wall_time_us":1152414}
I20260925 16:45:22.675593  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:22.681617  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.549s (SENT)
I20260925 16:45:22.687223  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:22.665706  8869 rpcz_store.cc:269] 0925 16:44:55.219512 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:55.223612 (+  4100us) service_pool.cc:227] Handling call
0925 16:44:55.623305 (+399693us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:45:22.665266 (+27041961us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:45:16.585179 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:45:16.585820 (+   641us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:45:16.585871 (+    51us) write_op.cc:435] Acquired schema lock
0925 16:45:16.585883 (+    12us) tablet.cc:660] Decoding operations
0925 16:45:16.702950 (+117067us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:45:16.703057 (+   107us) write_op.cc:641] Partition lock acquired for write op
0925 16:45:16.703096 (+    39us) tablet.cc:683] Acquiring locks for 14 operations
0925 16:45:16.768191 (+ 65095us) tablet.cc:699] Row locks acquired
0925 16:45:16.768236 (+    45us) write_op.cc:260] PREPARE: finished
0925 16:45:16.768406 (+   170us) write_op.cc:270] Start()
0925 16:45:16.768554 (+   148us) write_op.cc:276] Timestamp: P: 1790354716768337 usec, L: 0
0925 16:45:16.768598 (+    44us) op_driver.cc:331] REPLICATION: starting
0925 16:45:16.769333 (+   735us) log.cc:842] Serialized 5629 byte log entry
0925 16:45:17.454730 (+685397us) op_driver.cc:444] REPLICATION: finished
0925 16:45:17.709340 (+254610us) write_op.cc:301] APPLY: starting
0925 16:45:17.709434 (+    94us) tablet.cc:1365] starting BulkCheckPresence
0925 16:45:17.721296 (+ 11862us) tablet.cc:1368] finished BulkCheckPresence
0925 16:45:17.721397 (+   101us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:45:17.983273 (+261876us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:45:18.204586 (+221313us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=28,mrs_lookups=0
0925 16:45:18.204655 (+    69us) write_op.cc:312] APPLY: finished
0925 16:45:18.205183 (+   528us) log.cc:842] Serialized 129 byte log entry
0925 16:45:18.533084 (+327901us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:18.533250 (+   166us) write_op.cc:454] Released schema lock
0925 16:45:18.533330 (+    80us) write_op.cc:341] FINISH: Updating metrics
0925 16:45:18.533678 (+   348us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:18.533714 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":295597,"reported_tablets":47,"spinlock_wait_cycles":4443392,"child_traces":[["op",{"apply.queue_time_us":247091,"apply.run_cpu_time_us":45133,"apply.run_wall_time_us":824855,"cfile_cache_hit":58,"cfile_cache_hit_bytes":62563,"num_ops":14,"prepare.queue_time_us":145972,"prepare.run_cpu_time_us":25220,"prepare.run_wall_time_us":362918,"raft.queue_time_us":285230,"raft.run_cpu_time_us":13668,"raft.run_wall_time_us":121959,"replication_time_us":678271,"thread_start_us":525857,"threads_started":4,"wal-append.queue_time_us":266663,"wal-append.run_cpu_time_us":34071,"wal-append.run_wall_time_us":2540112}]]}
I20260925 16:45:22.690203  8966 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Stepping down as leader of term 8
I20260925 16:45:22.690668  8966 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:22.692699  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.696064  8966 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:22.689925 15042 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:22.673658 14990 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
W20260925 16:45:22.724910 15151 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260925 16:45:22.724650 14979 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:22.720618  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.724767  8870 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:22.740849  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.742887  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:22.746014  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.573s (SENT)
I20260925 16:45:22.746624  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:22.735670 15153 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:22.751381 15021 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:22.754948  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.757217  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.759320  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.748519 15011 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:22.763937  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.765842  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.750880 14690 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:22.768525  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.769865  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.773130  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.775748  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:22.776216  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.600s (SENT)
I20260925 16:45:22.776801  9089 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:22.777540  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.753181 15112 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:22.797019  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 13 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:22.797356  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.760198  8870 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 2 to 8, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 8 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:22.758069 15095 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:45:22.764575 15155 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260925 16:45:22.779441  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.771376 14804 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260925 16:45:22.784068 15152 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.057s	user 0.000s	sys 0.001s
I20260925 16:45:22.784621  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:22.786127  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.767768 14947 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:22.763773 14973 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:22.768826 15103 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:22.804198  8870 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 5 to 8. New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:22.807030 14804 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:22.817775  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:22.809072 15021 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:22.807780 15079 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:22.824484  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.825932  8974 raft_consensus.cc:2396] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 17 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260925 16:45:22.818611  9049 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:22.815270 14973 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:22.831935 14973 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:22.836021  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.836097  8870 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 8 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:22.827935  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:22.824709  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 168459us
W20260925 16:45:22.816592  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 269977us
W20260925 16:45:22.852308  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.556s (SENT)
I20260925 16:45:22.855073  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:22.820529 14804 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:22.864944 14018 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:22.874949  8968 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:22.881614  8971 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:22.879307  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.884440  8974 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:22.885560  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:22.886309  9122 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:22.825371 15103 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:22.897341  8967 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:45:22.894936  8870 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 10 to 11, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 11 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:22.899717  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.900552  8974 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:22.892563  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.904659  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.866783 14749 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:22.877576 15044 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:22.897127 14772 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.013s
I20260925 16:45:22.915059 14613 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:22.915494  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.910272  8870 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:45:22.924265 15157 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260925 16:45:22.907009 15103 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:22.866770 15079 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260925 16:45:22.937556  8966 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 8 FOLLOWER]: Advancing to term 9
I20260925 16:45:22.938036  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.945773  8971 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260925 16:45:22.939800  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.946494  8971 pending_rounds.cc:76] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 11
I20260925 16:45:22.936334  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.946946  8971 pending_rounds.cc:97] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260925 16:45:22.947269  8971 raft_consensus.cc:2866] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:22.935205  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.939296  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.949035  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.940531  8975 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:45:22.949596  8971 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:22.947290  8969 raft_consensus.cc:2362] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15. Re-sending same reply.
I20260925 16:45:22.953894  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.955017  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:22.956060  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.958775  8973 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:22.959796  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.964258  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.964603  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.964862  8973 raft_consensus.cc:2362] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13. Re-sending same reply.
I20260925 16:45:22.965523  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.965934  8973 raft_consensus.cc:2362] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13. Re-sending same reply.
I20260925 16:45:22.966496  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.966950  8973 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:22.968075  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.968634  8974 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:22.969449  8870 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 9 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:22.970417  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.971251  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.971586  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:22.973420  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.971851  8975 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:22.977512  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.979486  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:22.973735  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 182763us
I20260925 16:45:22.984753  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.987002  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.987890  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.987859  8972 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:22.963148 14996 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:22.987505  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:22.988727  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:22.963413 14758 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:22.997015  8973 raft_consensus.cc:2362] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15. Re-sending same reply.
I20260925 16:45:22.969594 15095 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:23.001511  8974 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:23.000329  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:22.980782 14690 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:22.918948 14749 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:22.973510 15094 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:23.005573  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:23.012250  8975 raft_consensus.cc:2396] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 12 because replica has last-logged OpId of term: 11 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 11.
I20260925 16:45:23.013703  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:23.016043 15044 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:23.016535 15044 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:23.016886 15044 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:23.016155 15160 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260925 16:45:23.022471 14749 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:23.024749  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:23.025524  9694 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:23.031207  8870 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:23.031755 15060 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.021s
I20260925 16:45:23.008056  8973 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:45:23.011674  8971 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:23.036649  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:23.041386  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:23.042368  9117 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:23.042294  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 149839us
I20260925 16:45:23.043620  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.033838  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:23.045763  8970 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:23.047909  8966 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260925 16:45:23.046378  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.058799  8972 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:23.070675  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.074357  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.047022 15095 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:23.089766 15159 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:23.085800 14772 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:45:23.095144  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 58575.7us
I20260925 16:45:23.052224 14357 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:23.095834  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:23.055814 15161 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.131s	user 0.003s	sys 0.000s
I20260925 16:45:23.107802  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:23.106112  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 118605us
I20260925 16:45:23.097412 14997 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:23.099228 14749 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260925 16:45:23.108898  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 261398us
I20260925 16:45:23.110503  8870 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:23.120337  8974 pending_rounds.cc:76] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 11
I20260925 16:45:23.120621  8974 pending_rounds.cc:97] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260925 16:45:23.120849  8974 raft_consensus.cc:2866] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:23.123572  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:23.112666  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 249123us
I20260925 16:45:23.092890 14973 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.128938  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:23.134297  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 162800us
I20260925 16:45:23.101562 14780 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.025s
I20260925 16:45:23.136113  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.118736 15076 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:23.095856 15165 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.040s
I20260925 16:45:23.119870 14749 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:23.122146 14995 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:23.143277 14018 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:23.143795  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.143815 14018 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.144685 14018 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:23.145149  8968 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:23.144008  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.146829  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.146916  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.134330 15103 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:23.138674 15076 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:23.161294 14979 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:23.191970  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:23.161983 15172 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:23.162734 14973 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:23.163915 15094 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:23.165974 15055 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260925 16:45:23.154915 14988 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260925 16:45:23.145372 14749 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:23.172816 14804 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.176663 15044 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:23.199738  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c756d218cfc0470183a9fe1cc08a22ab, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.151481 15067 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:23.179072 15167 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:23.191094  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:23.193789  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 119443us
I20260925 16:45:23.204988 14018 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:23.215083  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c756d218cfc0470183a9fe1cc08a22ab, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.230681  9666 leader_election.cc:398] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17.
I20260925 16:45:23.231020  9666 leader_election.cc:401] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
W20260925 16:45:23.231405  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84543.9us
I20260925 16:45:23.204962 14979 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:23.232054  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70901.1us
I20260925 16:45:23.233105 14018 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:23.234705  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.236063  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.237341  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.238154  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.244999  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:23.245700 14997 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:23.240362 15170 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17.
I20260925 16:45:23.252980  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:23.255128 15042 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:23.256165 14804 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:23.256417  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.257217 15042 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:23.257598 15042 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.257951 15042 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:23.260699 15044 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:23.264667 14979 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.265519 15042 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.233057 15094 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:23.243803 15159 raft_consensus.cc:2741] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260925 16:45:23.269105  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.270834  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:23.271580  9118 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:23.282899  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.283556  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.284755  8971 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:23.282425  8975 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:45:23.283725  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43808.8us
I20260925 16:45:23.287993  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.268153 15042 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:23.310225 15159 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:23.310745 15159 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.311260 15159 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:23.314090 15042 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:23.284400 15016 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:23.294884  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.320016 15103 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:23.298986  9700 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:45:23.294576 14804 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:23.300376  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:23.299052  9118 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:23.297207 15079 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260925 16:45:23.289866 15044 raft_consensus.cc:2741] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260925 16:45:23.235428 15076 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.340675  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:23.341802 14997 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:23.342428 14997 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:23.343596 14997 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:23.310832 15166 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.289s	user 0.000s	sys 0.002s
W20260925 16:45:23.289331  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83775.8us
W20260925 16:45:23.346904  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 192286us
I20260925 16:45:23.364181 15103 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260925 16:45:23.368227 15103 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:23.422072  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 127248us
W20260925 16:45:23.422161  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 134244us
I20260925 16:45:23.427940  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.436136  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:23.438576  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.439170  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.426265  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.450917  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.454607  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:23.455242  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:23.463258  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 252758us
I20260925 16:45:23.368712 15103 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.490300  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.490418  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.492810 14018 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:23.497411  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:23.498855  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.504236 15044 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:23.505342  9122 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:23.426867 15076 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:23.506631 14018 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:23.507822  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.464795 15021 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:23.513393 14018 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:23.512944  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.515568  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.521709 14018 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:23.467501 14780 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:23.522588  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.489045 14357 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:23.464581 15176 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:23.467269 15177 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:23.524240 14018 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:23.524688 14018 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.524982 14018 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:23.527031  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.495296 15042 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:23.492910 15112 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:23.528656  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73494us
I20260925 16:45:23.528824  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.467309 14996 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.507354 15055 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:23.536103  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.512188 15179 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:23.468214 15002 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260925 16:45:23.523960 14357 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:23.560917 14357 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:23.561771 15060 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:23.569478  9120 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
W20260925 16:45:23.571482  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ef3a95f58f62434d84bf19310c928a92, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:23.571802  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ef3a95f58f62434d84bf19310c928a92, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.522969 15044 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.024s
I20260925 16:45:23.538437 15012 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:23.532663 15042 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.535634 15171 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:23.558962 14018 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:23.532902 15168 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:23.539844 15055 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.546804 15179 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:23.524272 15021 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.540861 14780 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:23.553427 15016 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:23.515727 15180 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
W20260925 16:45:23.640421  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66358.1us
I20260925 16:45:23.648293 14749 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.650804 14749 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:23.651954  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:23.651949 14018 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:23.602804 15055 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:23.541105 14996 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.592553 15042 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:23.540076 15112 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:23.662256  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c71d03191b9f4a22a2ae4170c54fd018, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:23.672385  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c71d03191b9f4a22a2ae4170c54fd018, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:23.672219  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 167681us
I20260925 16:45:23.559268 15172 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:23.645713 15036 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260925 16:45:23.678519  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:23.597675 15179 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:23.683579  8970 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 9.
W20260925 16:45:23.666855 15186 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260925 16:45:23.652899 15016 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:23.699404  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:23.582167 15181 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.093s
I20260925 16:45:23.701710  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:23.705013  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 167675us
I20260925 16:45:23.706171  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.708868  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:23.660506 15005 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.039s
W20260925 16:45:23.726384 15151 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.181s	user 0.002s	sys 0.000s
I20260925 16:45:23.753575  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:23.699523 15016 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:23.689129 15048 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:23.775219  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
W20260925 16:45:23.780555 15193 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260925 16:45:23.781168  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 92265.7us
I20260925 16:45:23.699795 15177 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:23.846377  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:23.855836  9693 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:23.691535 14954 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.094s
I20260925 16:45:23.858738  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:23.867115  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 176375us
I20260925 16:45:23.783532 15044 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:23.684412 15172 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:23.877714  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 185726us
I20260925 16:45:23.846406 15103 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:23.882102  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95428.6us
I20260925 16:45:23.784612 14780 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:23.893251  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:23.786409 14995 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.093s
I20260925 16:45:23.786878 15048 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.857111 15183 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.043s
I20260925 16:45:23.852674 15177 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.925812 15021 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:23.926501 15172 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:23.901984 15062 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:23.905805 15002 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:23.922075 15067 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:23.940250  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50345.2us
I20260925 16:45:23.920554 14758 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:23.934011 14996 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:23.960553  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:23.966387  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:23.970687  8974 raft_consensus.cc:595] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:23.971158  8974 raft_consensus.cc:603] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:23.974337  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:23.976863 15062 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:23.977962 15062 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.980247  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:23.980960  9693 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:23.986337  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:23.982741  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:23.994445 14018 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:23.994890 14018 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:23.995237 14018 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:24.008347  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:23.953454 14954 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:24.056761  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.058063 14804 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:24.067298  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:23.982169 15112 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:24.060413 15036 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260925 16:45:24.082325  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133335us
I20260925 16:45:24.094168  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:23.968793 14758 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:24.078549 15195 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
W20260925 16:45:24.108417  9699 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.667s	user 0.003s	sys 0.003s
W20260925 16:45:24.108798  9699 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.003s	sys 0.003s
W20260925 16:45:24.079125  9695 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.006s	sys 0.024s
I20260925 16:45:23.940435 15002 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:23.964803 15067 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.051702 14954 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:24.087620 14018 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.068367 14996 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:24.119254  9695 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.007s	sys 0.033s
W20260925 16:45:24.078557 15170 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.011s	sys 0.019s
I20260925 16:45:24.122228 15002 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:24.130909  9116 raft_consensus.cc:2354] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:24.123980 15067 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.152827  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:24.140415  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.141212  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.179476  9118 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:24.143299  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.151820 14018 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:24.159065  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.002s	sys 0.010s
W20260925 16:45:24.180989  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.002s	sys 0.010s
W20260925 16:45:24.181545  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 652722us
I20260925 16:45:24.182714 14018 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260925 16:45:24.146853 15170 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.011s	sys 0.019s
I20260925 16:45:24.185460  9124 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:24.186195  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.153460  9693 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:24.189888 14018 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:24.191581 14018 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:24.193212 14018 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:24.123236 14954 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.226336  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:24.226409  9693 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
W20260925 16:45:24.230554  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43580.5us
I20260925 16:45:24.233379  9049 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:24.231367  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:24.200644 15048 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:24.238044  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:24.281069 15159 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.969s	user 0.003s	sys 0.018s
I20260925 16:45:24.281623 15159 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.282745  9694 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:24.284451  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:24.285949  9042 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:24.285166 15168 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:24.286293  9121 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:24.286571 15168 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:24.287010 14357 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.726s	user 0.008s	sys 0.002s
I20260925 16:45:24.287501 15168 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.281569 15182 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:24.291069 15182 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:24.291914 15207 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.060s	user 0.000s	sys 0.002s
I20260925 16:45:24.292775 14768 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:24.293167 14768 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:24.294133 15076 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.000s
I20260925 16:45:24.282248 14954 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:24.299816  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:24.291113 14758 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:24.293977 14768 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.292021 15182 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.295343  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
W20260925 16:45:24.296298 15036 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.002s
W20260925 16:45:24.286047 15203 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.105s	user 0.000s	sys 0.002s
I20260925 16:45:24.285068 14747 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:24.312896  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:24.353497  8968 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
W20260925 16:45:24.320317  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 87809.5us
I20260925 16:45:24.325779  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.327263  9049 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:24.284934 15159 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.340622  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.342170  8970 raft_consensus.cc:595] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:24.344238 14018 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.349675  8969 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:24.352095  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.360157  9116 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:24.287374 14357 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:24.365300  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.757s	user 0.023s	sys 0.046s
W20260925 16:45:24.365654  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.023s	sys 0.046s
W20260925 16:45:24.366694 15055 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.692s	user 0.011s	sys 0.000s
I20260925 16:45:24.367067 15055 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.355904  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.357291  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.362092 14018 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.368122  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:24.353832  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 117592us
W20260925 16:45:24.352082 15206 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.165s	user 0.015s	sys 0.000s
I20260925 16:45:24.381865  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.385947  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.353729 15177 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.353274 14747 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:24.403997  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:24.393891  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 185824us
I20260925 16:45:24.369789 14768 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:24.375615 15182 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:24.398972 15183 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:24.401273 15165 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:24.402012 14979 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:24.358327 15011 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:24.369828 14973 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:24.397420 14780 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:24.404768  9693 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:24.405179  9694 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:24.405519  9117 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:24.408679  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 177395us
I20260925 16:45:24.405881  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:24.406553  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:24.410283  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 69479.9us
I20260925 16:45:24.351657 15201 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260925 16:45:24.376914 15190 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:24.460848  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54398.9us
I20260925 16:45:24.420760  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.422008  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.404709 15211 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:24.422433  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:24.422653  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:24.447984 15016 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.610s	user 0.006s	sys 0.003s
W20260925 16:45:24.424307 15179 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.725s	user 0.007s	sys 0.003s
I20260925 16:45:24.427073  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.456136  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.466976 15073 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:24.464264 15190 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.423907  9014 leader_election.cc:398] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
W20260925 16:45:24.483811  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60127.5us
I20260925 16:45:24.488960  9115 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:24.451198 14973 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.469812 15094 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:24.474493  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.449865 14780 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:24.506291 14357 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.512800  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:24.517953 15214 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:24.518322  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.518847 15214 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:24.519057 15002 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:24.519587 15002 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:24.519855 15048 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:24.521380 15220 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:24.521921 15220 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:24.522362 15220 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:24.522936 15048 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:24.540855  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.561033  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:24.562027 14613 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:24.562529 14613 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:24.562947 14613 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:24.563277 14772 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:24.480104 15168 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:24.444473 15165 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.482934 15073 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:24.580768  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.572999  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.511879 14780 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:24.586658  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.444046 15183 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.592795  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.593676  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.624527  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2813) took 1151 ms. Trace:
W20260925 16:45:24.588158 15203 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260925 16:45:24.631465  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 148530us
I20260925 16:45:24.624931  8973 rpcz_store.cc:276] 0925 16:45:23.473257 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:23.474317 (+  1060us) service_pool.cc:227] Handling call
0925 16:45:23.474672 (+   355us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:23.489475 (+ 14803us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:23.489516 (+    41us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:23.502138 (+ 12622us) log.cc:842] Serialized 52 byte log entry
0925 16:45:23.727949 (+225811us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b480024c258. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:45:23.920818 (+192869us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:23.929143 (+  8325us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.932407 (+  3264us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.968460 (+ 36053us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:23.968552 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:24.283197 (+314645us) spinlock_profiling.cc:243] Waited 2.69 ms on lock 0x7b18003acae0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:24.282572 (+  -625us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b18003acae0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:24.621194 (+338622us) spinlock_profiling.cc:243] Waited 25.2 ms on lock 0x7b24001ab388. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198e5acf4 00007f7198e58dfb 00007f7198ee7559 00007f7198ee71e5 00007f7198ee6740 00007f719bbd9578 00007f719bbd9cd8 00007f719bbb16e8 00007f719bbacaea 00007f719bbabf36
0925 16:45:24.624320 (+  3126us) raft_consensus.cc:1671] finished
0925 16:45:24.624357 (+    37us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:24.624475 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":111948,"prepare.queue_time_us":460728,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":6217,"raft.queue_time_us":66457,"raft.run_cpu_time_us":2610,"raft.run_wall_time_us":265031,"spinlock_wait_cycles":182155264,"thread_start_us":381322,"threads_started":1,"wal-append.queue_time_us":659624}
I20260925 16:45:24.644819  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:24.645637  9043 raft_consensus.cc:2396] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 7.
I20260925 16:45:24.638818  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.477713 15016 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.649281  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.650547  8973 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:24.592754 15180 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:24.499522 15179 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.655074  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:24.606980 15042 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.922s	user 0.007s	sys 0.004s
I20260925 16:45:24.655984  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:24.651546 15012 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.052s	user 0.010s	sys 0.002s
I20260925 16:45:24.667688  9120 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:24.627113 14690 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:24.644372 14772 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:24.652665 15225 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:24.683169 15048 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:24.684369 15226 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260925 16:45:24.619266 14747 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.520632 15002 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:24.692039 14690 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:24.692785 14613 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:24.695014 15228 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260925 16:45:24.695835  8974 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:24.696954 15165 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.697299  9049 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:24.699081 15190 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:24.700161 15237 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
I20260925 16:45:24.676695  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:24.731962  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55383.9us
I20260925 16:45:24.684284  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.709641  9693 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:24.659071 14973 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.725086  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:24.666221 15055 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.738075  8974 raft_consensus.cc:595] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.740168  8974 raft_consensus.cc:603] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:24.741420  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:24.677709 15012 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:24.738303  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.743026  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:24.749454  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2810) took 1278 ms. Trace:
I20260925 16:45:24.750429  9042 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:24.667626 15042 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.750013  8966 rpcz_store.cc:276] 0925 16:45:23.471090 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:23.491620 (+ 20530us) service_pool.cc:227] Handling call
0925 16:45:23.492025 (+   405us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:23.508684 (+ 16659us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:23.538459 (+ 29775us) spinlock_profiling.cc:243] Waited 6.52 ms on lock 0x7b180054d660. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:45:23.668159 (+129700us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.827588 (+159429us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:23.828484 (+   896us) log.cc:842] Serialized 52 byte log entry
0925 16:45:23.828661 (+   177us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:23.852539 (+ 23878us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.862231 (+  9692us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.890262 (+ 28031us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:23.904097 (+ 13835us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:23.945379 (+ 41282us) spinlock_profiling.cc:243] Waited 3.23 ms on lock 0x7b180054d660. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:24.285557 (+340178us) spinlock_profiling.cc:243] Waited 3.25 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:24.301028 (+ 15471us) spinlock_profiling.cc:243] Waited 4.22 ms on lock 0x7b480024c258. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:45:24.749166 (+448138us) raft_consensus.cc:1671] finished
0925 16:45:24.749199 (+    33us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:24.749379 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":166073,"prepare.queue_time_us":169875,"prepare.run_cpu_time_us":117,"prepare.run_wall_time_us":121,"raft.queue_time_us":131566,"raft.run_cpu_time_us":33207,"raft.run_wall_time_us":448317,"spinlock_wait_cycles":39588992,"thread_start_us":182571,"threads_started":2,"wal-append.queue_time_us":383777}
I20260925 16:45:24.747992  8974 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:24.737654 14747 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:24.761541  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:24.730412 14979 consensus_queue.cc:1159] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 20 status { last_received { term: 20 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 20 index: 12 } }
I20260925 16:45:24.739787 15194 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:24.748544 15095 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:24.769764 15190 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:24.721603 15048 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.773643  9119 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:24.785226  9118 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:24.788515  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:24.789137  8974 raft_consensus.cc:595] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.790763  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.760012 15216 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:24.793576 15042 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.793929 15048 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.796077  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.797626 15235 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:24.798249  8975 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260925 16:45:24.798207 15235 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:24.800618 15234 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
I20260925 16:45:24.801110 15235 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.801230  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.792389 15180 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:24.806008 14690 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:24.805838 15180 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.811616  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.813133  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:24.820043  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.821862  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:24.825805  8973 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:24.826556  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.772858 15190 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:24.836301  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49758.5us
I20260925 16:45:24.836429  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:24.840795  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:24.841424  8973 raft_consensus.cc:595] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.841883  8973 raft_consensus.cc:603] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:24.841792  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:24.843582  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.844686  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:24.844961  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:24.845906  8975 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:24.756906 15220 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.840468  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:24.861541  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:24.852945  9041 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:24.865056  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:24.830149 15233 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260925 16:45:24.869063  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:24.873828 14018 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:24.874296 14018 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:24.874655 14018 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:24.875824  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.884193  8975 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:24.885859  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.835386 15180 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.841969 15190 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:24.903064  9043 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:24.906054  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:24.908159  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:24.910390  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.910676  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:24.911320  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:24.912351  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:24.916513  9121 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:24.908428  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43668.6us
I20260925 16:45:24.857803 15183 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:24.927208 15005 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:24.932235 15235 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:24.934603 15236 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.001s
W20260925 16:45:24.909617 15242 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:45:24.945657  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:24.904379 15016 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:24.936934  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:24.949558  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63865us
I20260925 16:45:24.951740  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:24.953516 15005 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:24.955138  9122 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:24.956727  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:24.960309 14747 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:24.961134 14747 consensus_queue.cc:1225] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260925 16:45:24.961197  9695 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:24.918248 14613 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.921655 15179 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.967265  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:24.856137 15240 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.104s
I20260925 16:45:24.941824 15021 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:24.977146 14018 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:24.978549 14018 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:24.970696 15016 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:24.982370  9695 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:24.988703 15252 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:24.988888 15248 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260925 16:45:24.989307 15252 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.001560 15253 raft_consensus.cc:979] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:25.002094 15253 raft_consensus.cc:1067] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Signalling peer 8dc3391062084f45a6ba62d28d340722 to start an election
I20260925 16:45:25.002424 14780 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.004436  9047 raft_consensus.cc:2354] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
W20260925 16:45:25.007182 15226 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.276s	user 0.002s	sys 0.000s
I20260925 16:45:25.008530 15220 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:24.990499 15181 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260925 16:45:24.970742 15094 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:25.012025  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44881us
I20260925 16:45:24.966488 15201 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:25.014801  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49288.7us
W20260925 16:45:25.020983  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 149158us
I20260925 16:45:25.021879 14747 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260925 16:45:25.021652 14749 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.027117 14749 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.029711 14749 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.034798 14613 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:25.035617 14613 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.023069  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:25.038357 15252 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.038623 14613 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.038985  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:25.039799  9123 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:25.039479 15201 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.040720 15220 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:25.041100 15220 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.041571 15201 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:25.043118  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:25.020249 15225 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:25.091389  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:25.092439  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69459.3us
I20260925 16:45:25.033948 15190 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:25.121923  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73590.6us
I20260925 16:45:25.122740  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:25.123343  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:25.124364  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:25.124917  9695 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:25.126408  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:25.127130  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:25.050107 14780 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.135221  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:25.149928  9046 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:25.128659  9118 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:25.126674  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:25.151098  9122 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:25.156682 15227 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:25.108649 14768 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:25.041817 15220 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:25.157477 15205 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.829s	user 0.006s	sys 0.002s
W20260925 16:45:25.164747 15246 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260925 16:45:25.171487  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:25.150051 15225 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:25.183920  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:25.188103  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:25.153201 14613 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.169682  9046 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:55054
I20260925 16:45:25.122004 15021 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:25.191640 15044 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:25.205762 14780 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:25.205526 14613 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.206219 14780 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.206688 14780 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:25.202047  9046 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:25.234442  9046 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:25.203583  9695 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:25.172580 15227 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:25.230052  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2811) took 1757 ms. Trace:
I20260925 16:45:25.279639  9048 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:25.230574 15044 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:25.221400 15225 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.250201  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:25.248543  9122 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:45:25.244063 15062 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.004s	sys 0.011s
I20260925 16:45:25.271514 15227 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.272746 15011 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:25.276791  8971 rpcz_store.cc:276] 0925 16:45:23.472724 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:23.473132 (+   408us) service_pool.cc:227] Handling call
0925 16:45:23.473442 (+   310us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:23.488393 (+ 14951us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:23.596022 (+107629us) spinlock_profiling.cc:243] Waited 6.88 ms on lock 0x7b18003d2e80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:45:23.716888 (+120866us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.853659 (+136771us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:23.854145 (+   486us) log.cc:842] Serialized 26 byte log entry
0925 16:45:23.854297 (+   152us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:23.862261 (+  7964us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.881618 (+ 19357us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b480024c258. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:45:23.891040 (+  9422us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:23.891130 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:24.185575 (+294445us) spinlock_profiling.cc:243] Waited 4.4 ms on lock 0x7b18003d2e80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11
0925 16:45:24.251232 (+ 65657us) spinlock_profiling.cc:243] Waited 3.29 ms on lock 0x7b18003d2e80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:24.296943 (+ 45711us) spinlock_profiling.cc:243] Waited 17.8 ms on lock 0x7b18003d2e80. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:25.053222 (+756279us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b24001ab388. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198e5acf4 00007f7198e58dfb 00007f7198ee7559 00007f7198ee71e5 00007f7198ee682d 00007f719bb9546e 00007f719bbacc0c 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551
0925 16:45:25.229779 (+176557us) raft_consensus.cc:1671] finished
0925 16:45:25.229808 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:25.229980 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":98528,"prepare.queue_time_us":124282,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":93,"raft.queue_time_us":73039,"raft.run_cpu_time_us":2792,"raft.run_wall_time_us":407364,"spinlock_wait_cycles":158693248,"thread_start_us":257196,"threads_started":2,"wal-append.queue_time_us":184768}
I20260925 16:45:25.292268 14749 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:25.288722 15179 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260925 16:45:25.296353 15011 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.302169 15216 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:25.302675 15216 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:25.291736 15062 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.005s	sys 0.012s
I20260925 16:45:25.296689  9046 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.303354 15036 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260925 16:45:25.307138  9046 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.309676  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:25.309875  8859 catalog_manager.cc:5025] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER failed with leader 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:25.310372  9696 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:25.311462  9044 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:25.311882  9044 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.312597  9044 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.315435  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:25.315943  9044 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:25.316072  9048 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:25.316910  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:25.303869 15011 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.321939 15190 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.322239 14947 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:25.322840 14947 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:25.323222 14947 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:25.317480 15180 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.326121 15180 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.328334 15180 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.312180 14749 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.313148 15216 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.330190 15036 tablet_bootstrap.cc:492] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:45:25.331066 14749 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.331873 15036 ts_tablet_manager.cc:1397] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 2.804s	user 0.047s	sys 0.036s
I20260925 16:45:25.333446  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:25.334084  9697 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:25.337538  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:25.338869 15254 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:25.339223 15254 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.340350  9046 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:25.342885  9044 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260925 16:45:25.343261  9044 pending_rounds.cc:76] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 12
I20260925 16:45:25.343401  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:25.340926 15254 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:25.347743 15036 raft_consensus.cc:348] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.368152 15036 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:45:25.369096 15036 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:25.346942 14780 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.350142 14613 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.349341 15073 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.354018  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:25.355242  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2138) took 1040 ms. Trace:
I20260925 16:45:25.360937  9123 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:25.382483  9044 pending_rounds.cc:97] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260925 16:45:25.383105  9044 raft_consensus.cc:2866] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:25.377060  8968 rpcz_store.cc:276] 0925 16:45:24.314891 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:24.393149 (+ 78258us) service_pool.cc:227] Handling call
0925 16:45:24.393439 (+   290us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:24.493752 (+100313us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:24.493784 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:24.494809 (+  1025us) log.cc:842] Serialized 26 byte log entry
0925 16:45:24.654085 (+159276us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:24.661103 (+  7018us) log.cc:842] Serialized 14 byte log entry
0925 16:45:24.661481 (+   378us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:24.934998 (+273517us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b18000b2c60. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:25.354920 (+419922us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b54001b3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:25.354977 (+    57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:25.355026 (+    49us) raft_consensus.cc:1671] finished
0925 16:45:25.355041 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:25.355186 (+   145us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":91,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1638,"raft.run_cpu_time_us":211,"raft.run_wall_time_us":9856,"spinlock_wait_cycles":273506432,"thread_start_us":158849,"threads_started":1,"wal-append.queue_time_us":245371}
W20260925 16:45:25.392740 15238 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260925 16:45:25.376981 15254 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.372985 15261 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260925 16:45:25.399657 15261 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:25.400086 15261 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:25.400919 15261 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.401641  9122 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:25.399744 15254 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.403053 15002 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:25.388613 15060 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260925 16:45:25.404328 15060 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:25.404670 15060 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.380891  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:25.406949  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:25.377223 14780 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.407975  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:25.405411 15060 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.406630  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:25.409447  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:25.409767 15210 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.223s	user 0.010s	sys 0.015s
I20260925 16:45:25.412670  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1169) took 1678 ms. Trace:
I20260925 16:45:25.413479  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:25.414063  9694 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:25.413054  8972 rpcz_store.cc:276] 0925 16:45:23.734272 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:23.734431 (+   159us) service_pool.cc:227] Handling call
0925 16:45:23.734782 (+   351us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:23.784296 (+ 49514us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:23.784330 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:23.832591 (+ 48261us) log.cc:842] Serialized 26 byte log entry
0925 16:45:23.936767 (+104176us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:23.977226 (+ 40459us) log.cc:842] Serialized 14 byte log entry
0925 16:45:23.992481 (+ 15255us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:23.992621 (+   140us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:24.300479 (+307858us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:25.409490 (+1109011us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b24001ab388. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198e5acf4 00007f7198e58dfb 00007f7198ee7559 00007f7198ee71e5 00007f7198ee682d 00007f719bb9546e 00007f719bbacc0c 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551
0925 16:45:25.412438 (+  2948us) raft_consensus.cc:1671] finished
0925 16:45:25.412461 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:25.412610 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":295650,"prepare.queue_time_us":6434,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":118656,"raft.run_cpu_time_us":286,"raft.run_wall_time_us":69985,"spinlock_wait_cycles":114613504,"thread_start_us":86680,"threads_started":2,"wal-append.queue_time_us":235861}
I20260925 16:45:25.415416  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:25.371639 15036 ts_tablet_manager.cc:1428] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.039s	user 0.008s	sys 0.000s
I20260925 16:45:25.427460  9694 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:25.431650  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:25.406618 15094 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:25.457199  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:25.461911  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3441) took 1322 ms. Trace:
I20260925 16:45:25.378433 15073 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:25.440409  9048 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:25.443660 15261 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:25.448670  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3438) took 1353 ms. Trace:
I20260925 16:45:25.466764  9117 rpcz_store.cc:276] 0925 16:45:24.139679 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:24.139838 (+   159us) service_pool.cc:227] Handling call
0925 16:45:24.140129 (+   291us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:24.446833 (+306704us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:25.461644 (+1014811us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b5400143a54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:25.461836 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":581204352}
I20260925 16:45:25.451432  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1448) took 1863 ms. Trace:
I20260925 16:45:25.428918 15060 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:25.453636  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2163) took 1032 ms. Trace:
I20260925 16:45:25.464602  9696 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:25.468601 15180 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
I20260925 16:45:25.468683  9119 rpcz_store.cc:276] 0925 16:45:24.095492 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:24.096222 (+   730us) service_pool.cc:227] Handling call
0925 16:45:24.124027 (+ 27805us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:24.777687 (+653660us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:25.448363 (+670676us) spinlock_profiling.cc:243] Waited 649 ms on lock 0x7b54001c9154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:25.448594 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1493561600}
I20260925 16:45:25.472008  9049 rpcz_store.cc:276] 0925 16:45:24.421510 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:24.421705 (+   195us) service_pool.cc:227] Handling call
0925 16:45:25.453300 (+1031595us) spinlock_profiling.cc:243] Waited 225 ms on lock 0x7b5400127354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:25.453439 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":518502144}
I20260925 16:45:25.469224  9120 rpcz_store.cc:276] 0925 16:45:23.588024 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:23.588151 (+   127us) service_pool.cc:227] Handling call
0925 16:45:23.646472 (+ 58321us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:24.668231 (+1021759us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:25.451146 (+782915us) spinlock_profiling.cc:243] Waited 1.02 s on lock 0x7b540010c054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:25.451358 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2348009216}
I20260925 16:45:25.474521  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:25.470112  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-12359c2bff0b46de91daa934c219103c received from {username='slave'} at 127.0.0.1:43114
I20260925 16:45:25.430338  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:25.485116  8972 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:25.491688  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:25.507274 15255 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:25.506335  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:25.515048  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:25.451658 14947 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.494410  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-12359c2bff0b46de91daa934c219103c on tablet 12359c2bff0b46de91daa934c219103c with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:25.503029 15214 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:25.504585 14990 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260925 16:45:25.528899  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:25.531253  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:25.512125 15181 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.020s
I20260925 16:45:25.532253 15254 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:25.521773 15255 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:25.510097 15044 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260925 16:45:25.495903 15197 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260925 16:45:25.550551 14990 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:25.554955  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2161) took 1145 ms. Trace:
I20260925 16:45:25.555327  9042 rpcz_store.cc:276] 0925 16:45:24.409180 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:24.413318 (+  4138us) service_pool.cc:227] Handling call
0925 16:45:24.449143 (+ 35825us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:24.750839 (+301696us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:25.554793 (+803954us) spinlock_profiling.cc:243] Waited 301 ms on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:25.554913 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":692445440}
I20260925 16:45:25.548293 15254 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:25.552138 15012 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:25.552395 15214 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.552083 14990 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.560088 15012 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:25.563661 14947 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.552038 15167 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260925 16:45:25.558409 15179 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.468827 15094 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.569895 15227 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:25.603391 15227 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.604691 15094 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.561995 15255 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.605415 15227 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.564806 14990 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.608207 14990 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:25.563793 15012 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.613866 15012 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:25.613739 15179 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.616070 15179 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.568229 15214 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.568212 15254 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.623754 15254 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:25.690114  8969 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:25.531797  8972 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:25.722487  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:25.724061  9042 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:25.728945  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:25.826498  9042 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:45:25.828476  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:25.849318  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:25.854348  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:25.856562  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:25.867060 15196 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:25.874190 15196 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:25.875792 15196 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:25.909742  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 90163.5us
I20260925 16:45:25.913849 15067 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:25.914587 15067 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:25.916767 15001 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:25.917783 15001 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.925218 15001 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.922004 15067 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:25.936254  9694 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:25.938052  9121 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:25.941917 15216 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:45:25.818408  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64901.2us
I20260925 16:45:25.982568 15103 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:25.983770 15103 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:25.988008 15103 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:25.988284 15257 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:25.988972 15257 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:26.029119  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 202412us
I20260925 16:45:26.029914 15261 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:26.030843 15261 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.015652 15220 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:26.031914 15059 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.032720 15059 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:26.039050 15222 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.039862 15261 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.039996 15222 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.013072 15103 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:26.040436  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.068547  9697 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:26.068845  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:26.072446  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.074313 15094 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:26.075368  9699 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:26.079424  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.058519  9041 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:26.057861 15059 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.089989  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:26.101022  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.101920  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.102375  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.102844  9049 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:26.103442  9120 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:26.106453  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.112470 15277 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:26.112605  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.113451  9042 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:26.115530  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.117506 15059 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:26.122803 15258 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:26.110450 15222 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.128196  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1157) took 1273 ms. Trace:
I20260925 16:45:26.128564 15214 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:26.129014 15214 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:26.129262  9116 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:26.129361 15214 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:26.128602  9047 rpcz_store.cc:276] 0925 16:45:24.842695 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:24.861170 (+ 18475us) service_pool.cc:227] Handling call
0925 16:45:26.092151 (+1230981us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:26.116169 (+ 24018us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":326025984}
I20260925 16:45:26.129388  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.132802 14768 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.020s
I20260925 16:45:26.136822  9117 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
W20260925 16:45:26.144323  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 113678us
I20260925 16:45:26.144941 15261 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:26.125844 15196 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:26.150267 15261 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:26.115976 15103 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.154464 15261 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:26.157838 15261 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.158452 15095 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:26.113312 15277 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.167973 15277 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:26.169693  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.170827 15067 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:26.170944 15059 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:26.171514 15067 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.155964 15196 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:26.171427 15059 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:26.124966 15258 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.178601 15067 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.179373  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.178383 15196 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:26.164564 15095 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:26.177065  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.191058  9123 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:26.181097 15059 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.196077 15095 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.182365 15261 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.203889  9116 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:26.205088 15257 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:26.208910  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56751.4us
I20260925 16:45:26.212141 15211 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:26.212603 15211 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:26.212978 15211 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:26.216856 15094 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:26.223978  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:26.226033 14749 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:26.226191  9050 raft_consensus.cc:2396] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260925 16:45:26.226445 14749 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:26.226908 14749 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.229115 15258 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.223493 15059 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:26.231761  9695 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:45:26.232870  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.233171 15059 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.235602 15197 raft_consensus.cc:979] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:26.236234 15197 raft_consensus.cc:1067] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:26.236424  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:26.237041  9116 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.241585  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:26.244199 15257 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:26.245783  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83720.5us
I20260925 16:45:26.247754 14613 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:26.207108 15095 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:26.255381 15278 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260925 16:45:26.261721  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.262396 15103 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.263343  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:26.267341  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2176) took 1225 ms (client timeout 1607 ms). Trace:
I20260925 16:45:26.267750  9044 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
W20260925 16:45:26.267773  9050 rpcz_store.cc:269] 0925 16:45:25.042012 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:25.042905 (+   893us) service_pool.cc:227] Handling call
0925 16:45:26.267118 (+1224213us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b54002625d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:26.267279 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2718310272}
I20260925 16:45:26.268137  9044 pending_rounds.cc:76] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 8
I20260925 16:45:26.270807  9044 pending_rounds.cc:97] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260925 16:45:26.249117 15067 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260925 16:45:26.280301  9044 raft_consensus.cc:2866] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:26.278362  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:26.286936  8973 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:45:26.279625  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.290087  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.291981  9666 leader_election.cc:398] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:26.292351  9666 leader_election.cc:401] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:45:26.309773  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.275282 15001 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260925 16:45:26.320848  9693 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:26.329753  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.333870 15021 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:26.334086 15159 raft_consensus.cc:2741] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:45:26.334566 15021 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:26.335755 15021 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.337265 15179 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:26.342098 14979 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:26.350909  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.362739  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.363353  9050 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260925 16:45:26.367390  9119 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
W20260925 16:45:26.368573  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 95855.7us
I20260925 16:45:26.371898  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.362035 15258 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:26.391443  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.394055  9050 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:26.394248  9122 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:26.350548 15211 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.406912  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:26.407902 14995 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:26.408066  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.372531 15103 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260925 16:45:26.409649  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:26.411016 15044 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:26.411379 15044 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:26.411762 15044 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:26.411787  9119 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:26.416402  9119 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:26.416735  9119 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:26.421507 15214 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.422705  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.423524  9050 raft_consensus.cc:2354] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:26.440099 14613 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:26.446432 14613 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.448760 14613 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.453088 14947 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:26.453886 15197 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:26.453771 14947 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:26.454707 15197 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.458230  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.458419  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.459134  8969 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:26.461542  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.456914 14947 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.461999 15211 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.463958  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:26.464702  8966 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.468679 14749 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.470317  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.470758 14749 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.471845  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:26.472024 15216 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.472323  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:26.472566  9700 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.472720 15216 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.423635 15214 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.476091  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.476841  9696 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:26.480871  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.481657  9050 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:26.482100 15196 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.483783  8967 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:26.471128  9049 raft_consensus.cc:2354] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:26.488610  8940 leader_election.cc:398] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:26.488910  8940 leader_election.cc:401] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:26.493000 15044 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.506516  9047 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:26.493782 15225 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:26.505591  9119 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.481630  9700 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:26.496819 14947 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:26.471006 15197 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.497774 15216 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.503068  8966 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:26.498445  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.504998  9116 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:26.509821  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:26.519654  9694 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:26.515043  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.520145  9123 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 13
I20260925 16:45:26.521287  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.522113 15214 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:26.522583 15214 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:26.514936  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.523571 15214 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:26.528183  9696 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:26.533656  8972 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:45:26.525156 15094 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:26.537740  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:26.538707 15044 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.541317  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:26.542315  8973 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 13: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:26.543031 14947 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.544414  9044 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:26.545441 14947 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.534017 15197 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:26.546389 15197 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:26.547716 15197 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.551098 15067 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:26.551678 15067 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:26.553148 15196 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.552809 15067 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.553829  9119 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.533977 14749 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.554543 14749 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.556540 14749 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.535678 15225 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.557803  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.558486  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:26.559057  9699 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:26.559131 15225 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:26.563813  9118 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:26.572314  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.577132  8872 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 12, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:26.578085  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:26.578809  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:26.580328  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:26.580781  8872 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 7 to 12. New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:26.583120  8872 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 13, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 13 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:26.585618  8870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 339) took 41188 ms (client timeout 15000 ms). Trace:
I20260925 16:45:26.586251  9044 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:26.589375  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.594981 15044 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260925 16:45:26.599997  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 106018us
I20260925 16:45:26.574601  9123 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:26.620478  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:26.647096  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.650431  9123 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:26.656070  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.656982  8969 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:26.657215 14780 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:26.659226  9124 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 22
I20260925 16:45:26.660087  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:26.660244 15240 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:26.660887 15240 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:26.661482  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.661968 15240 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.664021 15255 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:45:26.664261  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.664865 14995 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.665159  9119 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:26.665396 14995 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.666136  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:26.666970  9116 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:26.664014  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3481) took 1321 ms. Trace:
I20260925 16:45:26.677739  9118 rpcz_store.cc:276] 0925 16:45:25.342979 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:25.343127 (+   148us) service_pool.cc:227] Handling call
0925 16:45:26.663769 (+1320642us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540019bed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:26.663941 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2437981568}
I20260925 16:45:26.667663 14995 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:26.679348  9699 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:26.670264  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.682194  9123 raft_consensus.cc:2354] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:26.670648  9089 leader_election.cc:398] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:26.683058  9089 leader_election.cc:401] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:26.660959  9117 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:26.681205  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:26.625850  8872 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 14, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:26.701753  9124 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260925 16:45:26.703915  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.704952  8966 raft_consensus.cc:2354] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:26.697474  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:26.715334  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:26.719992  8967 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:26.619231 15021 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.084s
I20260925 16:45:26.722107  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.725703  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.723747  8872 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 14, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:26.727950 15094 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:26.735205  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:26.738891  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.742403  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.727774 14947 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:26.742666  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:26.730441 15095 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:26.748661  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:26.743521  8872 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 15. New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:26.759279  8939 leader_election.cc:398] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:26.742058 15103 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:26.741873 15261 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:26.742787 14749 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:26.749977 14947 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:26.757082 15197 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:26.737490 15196 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260925 16:45:26.765857  8872 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 13, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 13 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:26.787051 15042 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.769879 15182 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.784463  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:26.787859  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.776772 14947 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:26.592753  8870 rpcz_store.cc:269] 0925 16:44:45.411638 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:45.450917 (+ 39279us) service_pool.cc:227] Handling call
0925 16:44:46.763796 (+1312879us) spinlock_profiling.cc:243] Waited 315 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:45:26.585275 (+39821479us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:45:23.576448 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:45:23.857493 (+281045us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:45:23.862885 (+  5392us) write_op.cc:435] Acquired schema lock
0925 16:45:23.866581 (+  3696us) tablet.cc:660] Decoding operations
0925 16:45:24.067161 (+200580us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:45:24.067233 (+    72us) write_op.cc:641] Partition lock acquired for write op
0925 16:45:24.067265 (+    32us) tablet.cc:683] Acquiring locks for 9 operations
0925 16:45:24.119784 (+ 52519us) tablet.cc:699] Row locks acquired
0925 16:45:24.125159 (+  5375us) write_op.cc:260] PREPARE: finished
0925 16:45:24.181525 (+ 56366us) write_op.cc:270] Start()
0925 16:45:24.200964 (+ 19439us) write_op.cc:276] Timestamp: P: 1790354724179005 usec, L: 0
0925 16:45:24.200987 (+    23us) op_driver.cc:331] REPLICATION: starting
0925 16:45:24.405276 (+204289us) log.cc:842] Serialized 3631 byte log entry
0925 16:45:24.944770 (+539494us) op_driver.cc:444] REPLICATION: finished
0925 16:45:25.082240 (+137470us) write_op.cc:301] APPLY: starting
0925 16:45:25.082365 (+   125us) tablet.cc:1365] starting BulkCheckPresence
0925 16:45:25.280620 (+198255us) tablet.cc:1368] finished BulkCheckPresence
0925 16:45:25.299306 (+ 18686us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:45:25.370189 (+ 70883us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:45:25.370450 (+   261us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0925 16:45:25.370500 (+    50us) write_op.cc:312] APPLY: finished
0925 16:45:25.370841 (+   341us) log.cc:842] Serialized 89 byte log entry
0925 16:45:25.374003 (+  3162us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:25.374122 (+   119us) write_op.cc:454] Released schema lock
0925 16:45:25.374170 (+    48us) write_op.cc:341] FINISH: Updating metrics
0925 16:45:25.378570 (+  4400us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:25.378597 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":328849,"reported_tablets":47,"spinlock_wait_cycles":723368192,"child_traces":[["op",{"apply.queue_time_us":114874,"apply.run_cpu_time_us":15694,"apply.run_wall_time_us":296732,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41693,"num_ops":9,"prepare.queue_time_us":266882,"prepare.run_cpu_time_us":36867,"prepare.run_wall_time_us":1035891,"raft.queue_time_us":95081,"raft.run_cpu_time_us":30844,"raft.run_wall_time_us":178784,"replication_time_us":732053,"thread_start_us":431835,"threads_started":4,"wal-append.queue_time_us":288223,"wal-append.run_cpu_time_us":10351,"wal-append.run_wall_time_us":1692274}]]}
I20260925 16:45:26.798703 15094 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:26.799034 15179 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.799077  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:26.780099 14749 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:26.797078  8872 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 14, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 14 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:45:26.820353  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 124378us
I20260925 16:45:26.829738  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:26.832187  8968 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:26.834609  8872 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 11, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 11 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:26.796271 15055 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:26.837535  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:26.842942  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43987.6us
I20260925 16:45:26.838507 15044 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:26.862534  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.792424 15042 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.867856  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:26.868455  8967 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:26.865242  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.869482  8872 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 14, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 14 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:26.868744  8967 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:26.871745  8972 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:26.851143 15211 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:26.835660 15167 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.138s
I20260925 16:45:26.877213  8967 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.897399  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:26.900401  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.901242 15254 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:26.832577 15182 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.914364  8967 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:26.930018  8872 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 16, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 16 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:26.872464 15179 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.912808 15254 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:26.942793  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105340us
I20260925 16:45:26.940056  9044 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:26.944957  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:26.912470 15255 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.028s
I20260925 16:45:26.932864 15055 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:26.906241 14749 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.914203 15211 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.969903 15182 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:26.974098  8872 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 13, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:26.980904  8967 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:26.981616 15238 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:26.985086 15304 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:26.985610 15304 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:26.985948 15304 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:26.986573 15268 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:26.987001 15268 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:26.987947 15268 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:26.989523 15268 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:26.989908  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:26.990633  9697 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:26.991525  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:26.992214  9117 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:26.993212 15238 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:26.981808 15055 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:26.982692  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:26.947252 15261 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:26.983577 15274 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:26.980300  8872 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 10, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 10 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:27.003631 15179 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:26.983271 15283 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
W20260925 16:45:26.980300 15287 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260925 16:45:27.009429 15254 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:27.014678 15211 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:27.000116 15222 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
W20260925 16:45:27.016690 15286 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260925 16:45:27.019822  9014 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:27.021859 14780 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:27.022235 14780 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:27.022518 15055 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:27.023020 14780 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:27.024083  9048 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:45:27.024142  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.003396  8872 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:27.024647  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:27.025779  8972 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260925 16:45:27.025602  8872 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 18, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:27.029088 15196 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:27.034245 15197 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:27.034842 15197 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.036798 15197 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:27.038761 15295 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260925 16:45:27.040930  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.041620  9044 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:27.042784  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:27.044440  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:27.045251  9124 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:27.027261  8872 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 13, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:27.045984  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:27.047215 15222 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:27.047931 15222 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:27.048244 15222 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:27.048659 15222 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:27.046126  8872 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 11, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 11 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:27.050035  8872 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:27.052838 15042 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:27.053598 15261 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:27.060258  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 162947us
I20260925 16:45:27.064304 15304 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.069569  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:27.070317  9123 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:27.051229  8872 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:27.074452 14947 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.074409  8872 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:27.075788 15261 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:27.076977  9696 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEARNER]: Advancing to term 15
I20260925 16:45:27.077433 15183 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:27.078343  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:27.077721 15103 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:27.078966  9697 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:27.085680  8971 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:27.091183  9089 leader_election.cc:398] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13.
I20260925 16:45:27.079443 15304 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:27.142751  9695 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:27.146880  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:27.147720  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 64202.6us
I20260925 16:45:27.152287 15103 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:27.152719 15103 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:27.153087 15103 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:27.156018  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:27.157779 14947 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:27.158067 15222 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.160365 15222 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:27.136592  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46749.3us
I20260925 16:45:27.167232 15180 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:27.178937  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:27.181725  9044 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:27.188620  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:27.189781 15182 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260925 16:45:27.194550  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106889us
I20260925 16:45:27.195001 14780 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:27.197954  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:27.172729  8872 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 4 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:27.204138  9118 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260925 16:45:27.206622  9122 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:27.209860 15055 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:27.212994  9116 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:45:27.214552 14947 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:27.215126 14947 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.179214 15254 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
I20260925 16:45:27.217013 14947 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:27.217773  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.218437  9044 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:27.216426  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:27.222018  9696 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260925 16:45:27.222337  9124 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:27.227152  9123 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:27.230304  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:27.232236  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:27.232846  8971 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:27.234368  9048 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:27.234929  8966 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:27.240819  8872 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 15, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 15 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:27.245960 15180 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:27.246024 14995 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260925 16:45:27.246722 15180 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:27.247738 15240 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:27.249284 15180 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:27.249387 14979 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:27.257030  9696 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEARNER]: Committing config change with OpId 13.7: config changed from index -1 to 7, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:45:27.258555  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.259274  9047 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:27.212915 15103 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:27.268193  8971 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:27.268163  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:27.269591  9117 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:27.273082  8872 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 14, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:27.275846  8966 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:27.276779  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:27.278180 14947 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:27.278195 15299 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:27.280062 15299 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:27.280422 15299 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:27.281291 14780 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:27.281543  8872 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 13, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 13 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:27.283777 15261 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:27.284332 15261 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:27.287914 15197 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:27.288375  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:27.289012  9700 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:27.291538 15103 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:27.291851  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:27.288488 15197 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:27.293009  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:27.294040  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:27.283406  8872 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:27.299067  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:27.300469  9117 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:27.301424  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:27.302253  8966 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:27.298713  9700 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:27.296262 15274 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:27.311838  8973 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:27.297566 14780 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:27.315861  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:27.316237 14780 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:27.316552  8975 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:27.317265 14780 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.310483  8872 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 3 to 14, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:27.313292  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:27.325291  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:27.325987  9123 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:27.328874  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:27.330938  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.333618  9044 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:27.326485  8966 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:27.336889  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:27.337289 14979 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:27.339788 15274 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.309450 15180 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:27.337093  8973 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260925 16:45:27.345067  8966 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260925 16:45:27.408749  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:27.412680  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.413409  9047 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:27.414397 15182 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:27.409261 15197 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:27.414747 15311 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.002s
I20260925 16:45:27.441648  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:27.342691 15216 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:27.457170  8872 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:27.463409  8872 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:27.342540 15059 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
I20260925 16:45:27.500779  8872 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 13. New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:27.444273 15182 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:27.449633 15216 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:27.573518  9044 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260925 16:45:27.582626  9048 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260925 16:45:27.452589 15167 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.121s
I20260925 16:45:27.572252 15216 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:27.581745 15315 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260925 16:45:27.582374  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:27.589859  8974 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:27.598592 15303 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.150s
I20260925 16:45:27.612313  9117 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:27.603106 15299 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.618391 15055 raft_consensus.cc:2741] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260925 16:45:27.619223  8970 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
W20260925 16:45:27.619995 15322 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260925 16:45:27.622761  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:27.623535  8975 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:27.624579  9694 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:27.620569  8872 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 16. New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:45:27.612443 15316 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260925 16:45:27.651726 15274 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:27.652784 15318 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.166s	user 0.002s	sys 0.000s
I20260925 16:45:27.612738 15182 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:27.663846 15261 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:27.699719  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 106085us
I20260925 16:45:27.709956  8872 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 11, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 11 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:27.682611 15299 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:27.718540  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:27.722914 15216 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.702361  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:27.729167  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:27.736284  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60223.1us
I20260925 16:45:27.736157  8872 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 10, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:27.744557  8972 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:27.739488  9047 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:45:27.780927  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 78695us
I20260925 16:45:27.784731  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:27.822765 15216 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:27.823892  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 105443us
I20260925 16:45:27.825639  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:27.826828 15103 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
W20260925 16:45:27.827347  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45167.2us
I20260925 16:45:27.827513 15103 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:27.828433  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:27.828730 15274 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:27.829190 15274 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:27.829584 15274 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:27.829710 15261 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:27.830297 15261 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:27.831238 15261 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:27.832754 15307 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:45:27.828599 15103 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:27.835482  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 89375.4us
I20260925 16:45:27.834897 15180 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:27.858654  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:27.863093  8972 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:27.860440  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:27.857445 15180 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:27.866592 15211 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:27.869534 14780 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:27.892913  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:27.892365  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:27.876350 15095 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:27.880338 15180 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:27.893999 15211 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:27.999965  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 170543us
W20260925 16:45:28.008291  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 167905us
I20260925 16:45:27.896023 14780 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:28.018071  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:28.031057  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:28.051869 15328 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
I20260925 16:45:28.008075 15095 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:28.068953  8975 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260925 16:45:28.071230  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44303.7us
W20260925 16:45:28.074911  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55904.8us
I20260925 16:45:28.114837  8970 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
W20260925 16:45:28.126519  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 96058.3us
I20260925 16:45:28.125871 15167 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:28.128669 15167 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:28.130916 15167 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:28.132068  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73235.8us
W20260925 16:45:28.123090 15333 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.228s	user 0.001s	sys 0.000s
I20260925 16:45:28.154243  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:28.156469 15331 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.146s	user 0.001s	sys 0.000s
I20260925 16:45:28.159047 14780 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:28.148420 15095 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.165277  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:28.168586 15335 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:28.169009 15335 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:28.169338 15335 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:28.170467 15180 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:28.173144  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 154819us
I20260925 16:45:28.173218  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:28.174067  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:28.178319  9044 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260925 16:45:28.178813  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63164.5us
I20260925 16:45:28.183429  9048 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:28.185984  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:28.186915  8970 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:28.194300 15274 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:28.196539  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 181442us
I20260925 16:45:28.198607  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:28.200680  9123 raft_consensus.cc:2354] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17.
I20260925 16:45:28.202721  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:28.205585 15274 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:28.206620 15180 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:28.190264 15167 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
W20260925 16:45:28.269178  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56516.5us
W20260925 16:45:28.272153  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73622.9us
I20260925 16:45:28.171974 15337 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260925 16:45:28.277355  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:28.296432  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:28.302258  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:28.302999  9050 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:28.304528  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:28.305328  9048 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:28.315680  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:28.275138 15180 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:28.275635 15167 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:28.391515  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:28.451495  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 60135.9us
I20260925 16:45:28.461695  9048 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
W20260925 16:45:28.461851  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 224814us
I20260925 16:45:28.461318 15055 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:28.493701  9121 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:45:28.465693 15055 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:28.495610 15055 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:28.457662 15196 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:28.453657 15325 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:28.509821  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 329775us
W20260925 16:45:28.513289  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 242486us
W20260925 16:45:28.550572  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 236569us
I20260925 16:45:28.446651 15335 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.555651  8939 leader_election.cc:398] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17.
I20260925 16:45:28.564143  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:28.624392 15340 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:28.625047 15340 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:28.627161 15340 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:28.629009 15055 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:28.632874 15335 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:28.566094 15332 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:28.635919 15340 raft_consensus.cc:1050] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:45:28.635600 15332 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.638401 15332 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:28.635147 15055 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:28.640339 15370 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:28.640950 15370 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:28.641687  9123 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:28.641911 15370 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:28.550004 15325 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.645489  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:28.646095  9117 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:28.646654 15325 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:28.648018  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:28.649194 15359 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260925 16:45:28.674273  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:28.671838 15357 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260925 16:45:28.688074  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:28.696635  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:28.569191 15167 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:28.699899  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 232080us
I20260925 16:45:28.568172 15358 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.121s
W20260925 16:45:28.689654 15304 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.016s	sys 0.030s
W20260925 16:45:28.702986  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 511570us
I20260925 16:45:28.711652  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:28.715126  8968 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:28.709132  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 159119us
I20260925 16:45:28.730875  9118 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:28.738404  9118 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:28.739501  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:28.700886 15159 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:28.715129 15304 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.016s	sys 0.030s
I20260925 16:45:28.721078 15307 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:28.805577 15094 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:28.808422 15384 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:28.811188 15094 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.813567 15094 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:28.813423 15381 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
W20260925 16:45:28.818663  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55283us
W20260925 16:45:28.804246 15331 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260925 16:45:28.773936 15325 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:28.806355 15320 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.085s	user 0.004s	sys 0.010s
W20260925 16:45:28.819895  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 117270us
W20260925 16:45:28.835145  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 112472us
I20260925 16:45:28.808765 15327 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:28.769037 15197 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.052s
I20260925 16:45:28.845739  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:28.847877  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:28.850298  9696 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:28.851302  9121 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:28.818288 15211 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:28.850193  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 134063us
W20260925 16:45:28.844147 15362 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
I20260925 16:45:28.772655 15159 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.837402 15332 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:28.805076 15307 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.815932 15103 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.038s
I20260925 16:45:28.811403 15384 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.873875 15332 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.876101 15332 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:28.876850  9695 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:28.876987  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:28.879719  9050 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.567s	user 0.007s	sys 0.004s
W20260925 16:45:28.872649 15303 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.014s	sys 0.014s
W20260925 16:45:28.906153 15303 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.185s	user 0.014s	sys 0.014s
I20260925 16:45:28.888588 15376 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:28.894807  9696 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:28.906816 15334 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:28.861208 15196 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:28.902092  9050 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:28.878577  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:28.986238  9042 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:28.850556 15325 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.986974  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:28.908097  8968 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
W20260925 16:45:28.985534  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 91930.9us
I20260925 16:45:28.985391 15211 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:28.878759 15094 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:28.857613 15327 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:28.907752 15240 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.119s
W20260925 16:45:29.031019  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 126002us
W20260925 16:45:29.031824  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 122799us
I20260925 16:45:29.033154  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:29.042861  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 181247us
I20260925 16:45:29.027803 15211 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:29.037788 15182 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.318s	user 0.026s	sys 0.056s
I20260925 16:45:29.034852 15334 consensus_queue.cc:1225] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:45:29.057349  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3540) took 1799 ms. Trace:
I20260925 16:45:29.059439  9116 rpcz_store.cc:276] 0925 16:45:27.252415 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:27.252555 (+   140us) service_pool.cc:227] Handling call
0925 16:45:27.252860 (+   305us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:27.268969 (+ 16109us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:27.268999 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:27.289942 (+ 20943us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4800250458. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:45:27.292213 (+  2271us) log.cc:842] Serialized 26 byte log entry
0925 16:45:27.425998 (+133785us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:27.426038 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:27.426097 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:28.557582 (+1131485us) spinlock_profiling.cc:243] Waited 5.1 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:29.051771 (+494189us) raft_consensus.cc:1671] finished
0925 16:45:29.051800 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:29.051983 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18034,"raft.queue_time_us":19854,"raft.run_cpu_time_us":2471,"raft.run_wall_time_us":14532,"spinlock_wait_cycles":39493888,"thread_start_us":133420,"threads_started":1,"wal-append.queue_time_us":428394}
I20260925 16:45:29.037969 15303 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.043802 15332 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:28.990792 15196 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:29.053275 15182 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.333s	user 0.027s	sys 0.057s
I20260925 16:45:29.074783  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.076537  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.082851 15377 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:29.083833 15377 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:29.084456 15377 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:29.082947 15398 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
W20260925 16:45:29.078315  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51829.9us
I20260925 16:45:29.085187 15398 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:29.086024 15364 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.086483 15398 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.086655 15364 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:45:29.090565 15382 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260925 16:45:29.091432 15211 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.092994  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.093247 15211 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:29.093699  8968 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:29.100814 15384 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.101439 15352 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.102039 15352 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:29.104074 15378 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260925 16:45:29.100972 15180 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:29.106227 15180 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:29.107398 15180 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:29.108346 15324 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.388s	user 0.001s	sys 0.006s
I20260925 16:45:29.109441 15352 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:29.112457  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:29.038930 15094 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.139930  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.141465  9121 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:29.143548  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.141966  9121 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:29.149911 15196 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.143962 15159 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.081535 15303 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:29.153843 15094 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.154484 15373 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.155149 15373 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.155788 15303 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.104146 15343 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.144490  8968 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:29.163743  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.172887  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.133147 15332 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:29.180581  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.187081 15325 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.188333  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.188611  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.184216 15094 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.192305 15094 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.194162 15373 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.194468 15094 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.194970  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.195431 15307 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:29.196301  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.196301  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.199242  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.183039  9121 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.196743  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.198297  9117 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:29.196996  9049 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:29.206426  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.206838  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:29.208948  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.208956  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:29.211659  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.213312  9047 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:29.212435  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 148087us
W20260925 16:45:29.216229  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 176638us
I20260925 16:45:29.219908  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.221393  9121 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:29.224556  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.227787  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.234309  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.229662  9117 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:29.233174  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:29.222036  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 351036us
I20260925 16:45:29.237581  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.207638 15332 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.224871  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:29.229686  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:29.248202  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.249466  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:29.252261  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.011s	sys 0.024s
I20260925 16:45:29.252358  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:29.253032  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.011s	sys 0.024s
I20260925 16:45:29.172559 15343 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.261399 14947 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:29.222890 15325 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:29.263008 15325 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.263463 15325 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:29.261551 15358 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.269685 15358 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.271981  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:29.272691  8974 raft_consensus.cc:595] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.272945  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.273164  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.273630  8969 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:29.274003 15327 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.222550 15094 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:29.222649 15364 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:29.277388  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67051.9us
I20260925 16:45:29.278123  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:29.273104  8974 raft_consensus.cc:603] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:29.280329  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:29.280997  9694 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:29.240234 15103 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:29.284898  8969 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:29.244917 15332 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:29.287565  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44013.9us
I20260925 16:45:29.255571 15095 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:29.251791 14613 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.288350  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:29.292189  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.307020  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.307511  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.305876 15358 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.308720 15307 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:29.287045 15384 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.320370  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.320202  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:29.322719  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:29.285744 15343 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:29.318821  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.265012 15222 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260925 16:45:29.350693  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.351217  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.322036 15307 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:29.356495 15307 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:29.359504  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 134704us
I20260925 16:45:29.372088  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:29.371891  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.373711  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.375087  9041 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:29.317898 15335 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260925 16:45:29.378401  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.379046  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:29.385761  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65523.4us
I20260925 16:45:29.372372 15364 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
W20260925 16:45:29.376479 15326 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.550s	user 0.005s	sys 0.003s
I20260925 16:45:29.368263 15358 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.370535 15167 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.316464 14613 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.358319 15384 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.374210 15348 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.478922 15240 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:29.479355 15358 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.480212 15416 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:29.478999 15390 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:29.484066 15395 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:29.483867  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.488420 15167 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.497896  9121 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 11. (term mismatch)
I20260925 16:45:29.387105 14947 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.645229  9121 pending_rounds.cc:76] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 10
I20260925 16:45:29.645766  9121 pending_rounds.cc:97] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 14.11
I20260925 16:45:29.646123  9121 raft_consensus.cc:2866] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:29.646329 14947 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:29.631178  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 227266us
I20260925 16:45:29.649315 15395 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:29.649678 15347 raft_consensus.cc:465] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Not starting pre-election -- already a leader
I20260925 16:45:29.650631 15395 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.634018 15416 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:29.652562 15416 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:29.654619  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.656952  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.657433 15400 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:29.639768  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 250252us
I20260925 16:45:29.395612 15364 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:29.647946 15418 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:29.658185 15400 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:29.657582 15211 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.564s	user 0.010s	sys 0.000s
W20260925 16:45:29.659883  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 279370us
W20260925 16:45:29.660702  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 270335us
I20260925 16:45:29.662840  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.598598 15240 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:29.660212  9697 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:29.665748  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.597126 15396 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:29.666433 15358 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.680315 15240 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:29.681301 15381 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:29.689955 14947 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:29.658720 15418 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.693171 15387 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:29.693454 15384 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.694042 15405 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.694296 15384 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.694881 15418 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.694742 15405 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.697453 15405 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.698071 15372 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:29.698575 15372 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.698997 15372 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:29.633167 15196 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:29.597606 15222 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:29.701107 15222 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.703790 15392 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:29.704350 15392 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:29.704701 15392 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:29.700214 15196 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.707162 15196 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:29.708755 15413 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260925 16:45:29.695058 15384 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.710036 15391 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:29.711417 15384 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.713346 15222 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.716070 15419 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:29.716604 15419 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.718525 15419 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.721508 15167 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.723335  9041 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
W20260925 16:45:29.723348 15326 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:45:29.728112  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2182) took 2413 ms. Trace:
W20260925 16:45:29.729802 15377 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.645s	user 0.011s	sys 0.002s
I20260925 16:45:29.730238 15377 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:29.731914  9047 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260925 16:45:29.732376 14613 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:29.733218  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.728487  8971 rpcz_store.cc:276] 0925 16:45:27.315003 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:27.315104 (+   101us) service_pool.cc:227] Handling call
0925 16:45:27.346092 (+ 30988us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:27.410617 (+ 64525us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:27.410651 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:27.411071 (+   420us) log.cc:842] Serialized 26 byte log entry
0925 16:45:27.627757 (+216686us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:27.644258 (+ 16501us) log.cc:842] Serialized 14 byte log entry
0925 16:45:27.694061 (+ 49803us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:27.694146 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:28.713023 (+1018877us) spinlock_profiling.cc:243] Waited 32 ms on lock 0x7b1800441940. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511
0925 16:45:29.269413 (+556390us) spinlock_profiling.cc:243] Waited 5.57 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:29.727882 (+458469us) raft_consensus.cc:1671] finished
0925 16:45:29.727905 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:29.728025 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":143841,"prepare.queue_time_us":16642,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":119321,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":17113,"spinlock_wait_cycles":86316672,"thread_start_us":156535,"threads_started":1,"wal-append.queue_time_us":274758}
I20260925 16:45:29.736716  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.737337  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.737608  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3327) took 1017 ms. Trace:
I20260925 16:45:29.737999  9042 rpcz_store.cc:276] 0925 16:45:28.719923 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:28.720097 (+   174us) service_pool.cc:227] Handling call
0925 16:45:28.910748 (+190651us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:28.986687 (+ 75939us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:29.737434 (+750747us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54002a3350. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:29.737552 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":394016000}
I20260925 16:45:29.643955 15348 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.743934 15094 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:45:29.744904 15094 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:29.745250 15348 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.747198  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.748430  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.749719 15398 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:29.738384 15400 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:29.695580 15418 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:29.754189 15325 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.755777  9696 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:29.756621 15261 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:29.757113 15261 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.759106 15261 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:29.761150 15377 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.761523  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.762279  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.763109 15261 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:29.763854  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.769508  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:29.768815  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 377509us
I20260925 16:45:29.771268  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:29.731986 15301 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 15 current term: 15 is higher.
I20260925 16:45:29.770526 15396 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.797024  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.798244 15332 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.799856  9695 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:29.803200  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 431745us
I20260925 16:45:29.753293 15416 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:29.816047  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:29.824710  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:29.826989  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 139385us
I20260925 16:45:29.828325  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:29.831178  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.835033  8971 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260925 16:45:29.812844 15350 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:29.813054 15261 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:29.838326  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.849998  9121 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:29.839465  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:29.835261  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 175849us
I20260925 16:45:29.853078  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:29.854656  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 190440us
I20260925 16:45:29.855388  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:29.834817 15334 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:29.834615 15055 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:29.858459  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:29.868789  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:29.862610  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 196910us
I20260925 16:45:29.869335  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:29.863272  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.000s	sys 0.027s
W20260925 16:45:29.873293  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.556s	user 0.000s	sys 0.028s
W20260925 16:45:29.897341  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 565587us
I20260925 16:45:29.829591 14995 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
W20260925 16:45:29.915021  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48837.7us
I20260925 16:45:29.933256  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:29.860055 15167 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:29.962648  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49042.2us
W20260925 16:45:29.947629  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49316.7us
I20260925 16:45:29.874509 15418 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:29.864377 15055 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:29.944166  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 91188.6us
I20260925 16:45:29.989279  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:29.982913 15418 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:29.996745 15418 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:29.963927 15332 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:30.002517 15094 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:30.030158 15382 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:45:30.004276  8974 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260925 16:45:30.005632  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.009299 15372 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:30.031517  9116 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260925 16:45:30.020164  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.032807  9699 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:29.994005 15342 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260925 16:45:30.023903 15396 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.026407 15350 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.041620  8967 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:30.027191 15415 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260925 16:45:30.027469 15222 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:29.989420 15055 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:30.057250 15222 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.058919  9699 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260925 16:45:30.060685  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:30.062930 15301 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:45:29.932474 15334 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260925 16:45:29.967005 15325 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:30.064560 15240 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.021673 15416 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.034669  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.045642  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.066768  9046 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:30.027480 15369 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.067356 15240 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:29.977977 15344 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260925 16:45:30.047302  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:30.091991  9116 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:30.051164 15350 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.045522 15261 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260925 16:45:30.059502 15222 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.098541  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:29.990422 15167 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.067631 15369 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:30.043999  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44729.4us
I20260925 16:45:30.049665  9045 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260925 16:45:30.075117  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:30.083426  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.083737  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.084503  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.095947  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:30.112205  9116 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:30.110985  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:30.112248  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.113077  8970 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:30.055925  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:30.116020  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60155.3us
I20260925 16:45:30.120018  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:30.120276  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45283.4us
I20260925 16:45:30.120487 15350 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.121258  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.121351  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:30.121850 15350 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:30.122146 15369 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.122294  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.122762 15352 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:30.123157 15352 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:30.123332  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:30.124058  8967 raft_consensus.cc:595] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:30.124469  8967 raft_consensus.cc:603] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:30.136513  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.141436  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:30.143929  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.145258  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.147055  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:30.150802  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.150465  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:30.109149 15261 consensus_queue.cc:1225] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260925 16:45:30.151533  9043 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 18
I20260925 16:45:30.159081  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.126056 15390 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:30.123487 15352 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:30.085762 15055 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:30.131281 15416 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:30.190135  9041 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260925 16:45:30.103508 15392 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.206420  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:30.188176  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46499.3us
I20260925 16:45:30.191939  8970 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:30.216149  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.216735 15433 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:30.160225 15423 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:30.219591  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:30.222533  8970 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:30.226418  8970 raft_consensus.cc:595] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.223671  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.226886  8970 raft_consensus.cc:603] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:30.186087 15274 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.230190  9115 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:30.235687  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:30.239904  8975 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260925 16:45:30.240634  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.244618  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.245997  9693 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:30.219919 15167 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.284334 15429 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260925 16:45:30.288825  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.248335 15407 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:30.183276 15430 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.102s
I20260925 16:45:30.248044 15274 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.244371 15197 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260925 16:45:30.250548 15372 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.285574  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:30.337296  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:30.354475  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 119529us
I20260925 16:45:30.352790  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:30.357944  8975 raft_consensus.cc:595] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.358332  8975 raft_consensus.cc:603] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:30.355904  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.382859  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.360014 15196 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:30.359602 15405 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:45:30.387163  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 198052us
I20260925 16:45:30.282086 15398 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.096s
I20260925 16:45:30.408496  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:30.431638  9043 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:30.435598 15423 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:30.436384 15423 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.439337 15423 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.395139 15261 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:30.412858 15196 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:30.363669 15418 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.376157 15094 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.065s
I20260925 16:45:30.376344 15347 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.073s
I20260925 16:45:30.467808  8968 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:30.468422  8968 raft_consensus.cc:595] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:30.468763  8968 raft_consensus.cc:603] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:30.441321 15299 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260925 16:45:30.475345  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 253287us
W20260925 16:45:30.468604  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60228.8us
I20260925 16:45:30.461795 15196 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:30.450520 15167 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.469327 15363 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:30.483475 15363 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:30.479982  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:30.481781  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:30.488894  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:30.473656 15094 consensus_queue.cc:1225] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 14.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260925 16:45:30.494771  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:30.496171  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:30.470229 15440 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:30.472460 15055 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:30.482321 15179 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:30.502014  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:30.507299  9116 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:30.507014  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:30.507149  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 293944us
I20260925 16:45:30.514062  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:30.513940  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:30.522728  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:30.492672 15392 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.514041  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:30.499994 15368 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:30.490682 15167 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.539855 15167 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:30.549683 15364 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.551152 15364 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:30.553316 15418 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.506831 15179 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:30.524811 15055 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:30.583658  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:30.587175  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 204380us
I20260925 16:45:30.556653 15450 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
W20260925 16:45:30.591645  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77696.8us
W20260925 16:45:30.596015  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 81361.7us
I20260925 16:45:30.581501 15371 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:30.598042  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.559331 15216 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
W20260925 16:45:30.593011 15436 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.127s	user 0.000s	sys 0.001s
I20260925 16:45:30.593477 15447 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:30.612704 15443 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:30.591636 15055 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:30.591204 15274 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.593290 15421 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:30.621613  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 105011us
I20260925 16:45:30.592535 15445 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:30.629787  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.623478  8975 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260925 16:45:30.594225 15450 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:30.625826  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:30.627869  9123 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260925 16:45:30.630334  8975 pending_rounds.cc:76] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 15
I20260925 16:45:30.630746  8975 pending_rounds.cc:97] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260925 16:45:30.630820  8970 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:30.631050  8975 raft_consensus.cc:2866] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:30.629326  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.556759 15363 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.643822  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1822) took 1268 ms. Trace:
I20260925 16:45:30.645434  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1177) took 1351 ms. Trace:
I20260925 16:45:30.645787  9044 rpcz_store.cc:276] 0925 16:45:29.282801 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.283305 (+   504us) service_pool.cc:227] Handling call
0925 16:45:29.283503 (+   198us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:29.685701 (+402198us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:29.685773 (+    72us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:29.685837 (+    64us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:29.685927 (+    90us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:30.633980 (+948053us) spinlock_profiling.cc:243] Waited 402 ms on lock 0x7b540011e754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:30.634022 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:30.634123 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":924329856}
I20260925 16:45:30.644381  9700 rpcz_store.cc:276] 0925 16:45:29.364738 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.365032 (+   294us) service_pool.cc:227] Handling call
0925 16:45:29.365300 (+   268us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:29.745944 (+380644us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:29.745978 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:29.746019 (+    41us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:29.746051 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:30.632843 (+886792us) spinlock_profiling.cc:243] Waited 380 ms on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:30.632882 (+    39us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:30.632980 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":874946304}
W20260925 16:45:30.649832 15369 consensus_queue.cc:1159] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: [16.12-16.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:30.650844  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3145) took 1751 ms. Trace:
I20260925 16:45:30.651212  9118 rpcz_store.cc:276] 0925 16:45:28.899671 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:28.899889 (+   218us) service_pool.cc:227] Handling call
0925 16:45:28.900166 (+   277us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:29.027583 (+127417us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:29.027622 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:29.032558 (+  4936us) log.cc:842] Serialized 26 byte log entry
0925 16:45:30.433011 (+1400453us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b18003161e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:45:30.513760 (+ 80749us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:30.513800 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:30.513858 (+    58us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:30.650562 (+136704us) raft_consensus.cc:1671] finished
0925 16:45:30.650587 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:30.650793 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":97381,"raft.queue_time_us":130298,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":8312,"spinlock_wait_cycles":2825088,"thread_start_us":80580,"threads_started":1,"wal-append.queue_time_us":1555780}
I20260925 16:45:30.654374 15419 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:30.631134 15447 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.605052 15371 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.656855 15447 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.635597 15443 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.658754 15443 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:30.660154 15055 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.631646 15103 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:30.662624 15103 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.670336 15352 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.674613  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:30.680384 15450 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:30.681752 15450 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.683869 15363 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:30.685772  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.689368  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.689671  9044 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: [13.9-13.9]
I20260925 16:45:30.636845 15421 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.692076 15421 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.657173 15371 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:30.704802  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:30.708310  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59458.3us
W20260925 16:45:30.724000  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76627.6us
I20260925 16:45:30.726578  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:30.727787  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:30.727986  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.742151  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:30.744608  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:30.756016  9041 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:30.765378  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.690814 15196 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:30.831173  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45046.5us
I20260925 16:45:30.831067  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:30.832299  9048 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:45:30.848562  9118 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:30.744678 15159 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:30.722827 15455 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.862082  8966 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 9. (term mismatch)
I20260925 16:45:30.862545  8966 pending_rounds.cc:76] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 8
I20260925 16:45:30.862749  8966 pending_rounds.cc:97] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 13.9
I20260925 16:45:30.862962  8966 raft_consensus.cc:2866] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:30.839895  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:30.863736 15325 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:30.833389  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 124282us
I20260925 16:45:30.849814  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2240) took 1031 ms. Trace:
I20260925 16:45:30.865486  9042 rpcz_store.cc:276] 0925 16:45:29.815853 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.817551 (+  1698us) service_pool.cc:227] Handling call
0925 16:45:30.781239 (+963688us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:45:30.847611 (+ 66372us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4218624}
I20260925 16:45:30.848512  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2244) took 1031 ms. Trace:
I20260925 16:45:30.866761  9048 rpcz_store.cc:276] 0925 16:45:29.816973 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.817124 (+   151us) service_pool.cc:227] Handling call
0925 16:45:30.767469 (+950345us) spinlock_profiling.cc:243] Waited 2.15 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:30.831837 (+ 64368us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:30.848197 (+ 16360us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:30.848435 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4954368}
I20260925 16:45:30.870321  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.871528  8972 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:30.871811  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:30.865989  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:30.940948 15167 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:45:30.881369 15371 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:30.882208 15418 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.949522  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2243) took 1132 ms. Trace:
I20260925 16:45:30.967329  9050 rpcz_store.cc:276] 0925 16:45:29.816675 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.817914 (+  1239us) service_pool.cc:227] Handling call
0925 16:45:30.948585 (+1130671us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:30.948854 (+   269us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:30.949094 (+   240us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:30.949132 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:30.949187 (+    55us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:30.949238 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:30.949306 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:30.949437 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3596032}
I20260925 16:45:30.935300 15261 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:30.867789 15325 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:30.986711  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:30.989920  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:30.883559 15339 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.095s
I20260925 16:45:30.868701 15455 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.020335 15299 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:31.030754  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:31.009225 15352 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:30.991348 15261 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:30.980626 15418 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.017560 15423 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.154765  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.160789  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:31.215516  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 335048us
I20260925 16:45:31.027563 15299 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.222007 15325 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.226459 14979 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:31.227495 15427 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:31.167639 15196 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:31.285015  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 134091us
W20260925 16:45:31.255391  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 266402us
I20260925 16:45:31.287019  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:31.240192 15452 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260925 16:45:31.283622  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 311275us
I20260925 16:45:31.294618  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:31.295238  9116 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:31.328498  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 173842us
I20260925 16:45:31.330428  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.165279 15423 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:31.341763  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 124948us
I20260925 16:45:31.334619  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:31.335759  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45059.9us
I20260925 16:45:31.257342 15325 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:31.241496 15470 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:31.283255 15352 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:31.294467 15364 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.376312  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:31.398949 15460 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.243s	user 0.000s	sys 0.000s
I20260925 16:45:31.400099 15418 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.401348 15261 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.402954 15261 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.409031 15299 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.411988 15478 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:31.412673 15478 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:31.413657 15451 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.414248 15451 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.416666 15451 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.418387 15423 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.420945  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.422955  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.423949  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.424774  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.339169 15196 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.440835  9048 raft_consensus.cc:2396] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260925 16:45:31.368552 15197 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.442456  9116 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:31.448654 15465 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:31.451324 14979 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.451962 15428 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:31.452293 15353 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.452533 15428 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.452987 15353 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.454946 15428 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.458592 15197 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.368923 15470 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.461791 15197 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.462590 15470 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.463584 15196 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.464905 15455 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.465647 15455 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.466205 15455 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.466576 15196 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.467514 15475 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:31.468195 15475 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260925 16:45:31.407681 15363 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.723s	user 0.006s	sys 0.003s
I20260925 16:45:31.451982 14979 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.473565 14979 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.473938  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.474591  9118 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:31.397478 15364 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.476773 15364 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.479127  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.480015  9048 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:31.482163  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.484143  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.403574 15261 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.488605 15261 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.455454 15353 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.495244 15479 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.495074  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.495820 15479 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.496444 15455 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.497843 15479 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.491230  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:31.503741 15451 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:31.504407 15451 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.504861 15451 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:31.508687  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.385787 15352 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.518659 15352 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.523597  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:31.525413  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.006s	sys 0.002s
W20260925 16:45:31.525934  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.007s	sys 0.003s
I20260925 16:45:31.528728  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.530526  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.535805  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.537763  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.538949  9048 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:31.541234  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.542562  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:31.544003 15486 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:31.544549 15486 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:31.545404 15486 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:31.548724  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.549052  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:31.550225  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 216157us
I20260925 16:45:31.551180  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.552706  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.553740 15383 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:31.554363 15383 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:31.555449  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.558342  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.559449 15491 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:31.560107 15491 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:31.561038 15491 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.566615  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.571542  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.530608  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.576052  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.578806 15338 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:31.579154 15352 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:31.579300 15338 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:31.578946 15491 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:31.580896 15484 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.581426 15484 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.580442 15338 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.584499  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.583515  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.588493  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.592303  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:31.593315  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 430270us
I20260925 16:45:31.592406 15483 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:31.594928  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.594588  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.598620 15363 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:31.599088 15261 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.599584  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.600019 15261 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.600313 15486 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.600838 15182 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:31.601656 15363 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.602216 15363 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.589570 15479 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:31.603569 15486 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.604177 15363 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.603955 15479 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.606587  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.607137  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.607964  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:31.608798  9042 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:31.607450  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 197941us
I20260925 16:45:31.600270  8968 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
W20260925 16:45:31.612656  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82142.1us
I20260925 16:45:31.615363  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.625008  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.625008  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.626057  9050 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:31.626296  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.602720 15261 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.627054  8969 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:31.629120  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.629456  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.631508  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.603636 15103 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.634068  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.636505  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2220) took 1644 ms. Trace:
I20260925 16:45:31.597544 15352 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:31.637111 15484 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.636896  8966 rpcz_store.cc:276] 0925 16:45:29.992462 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.992630 (+   168us) service_pool.cc:227] Handling call
0925 16:45:29.993029 (+   399us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:30.863444 (+870415us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:31.636258 (+772814us) spinlock_profiling.cc:243] Waited 868 ms on lock 0x7b54003566d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:31.636426 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1997275008}
I20260925 16:45:31.640213  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.642655  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.643868  8966 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260925 16:45:31.648072  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.650662  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:31.651903  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3339) took 2355 ms. Trace:
I20260925 16:45:31.652616  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.646008  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.653439  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.654697  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.659439  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.660023  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.660133  8967 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:31.661614  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.662696  8972 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260925 16:45:31.652266  9047 rpcz_store.cc:276] 0925 16:45:29.290751 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.290991 (+   240us) service_pool.cc:227] Handling call
0925 16:45:29.291281 (+   290us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:29.732327 (+441046us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:31.645475 (+1913148us) spinlock_profiling.cc:243] Waited 440 ms on lock 0x7b54000a78d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:31.645648 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1012848512}
I20260925 16:45:31.665696  8966 raft_consensus.cc:2396] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260925 16:45:31.665901  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.667132 15491 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:31.663626  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.670463  8968 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:31.676175  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:31.676633 15471 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.375s	user 0.006s	sys 0.003s
I20260925 16:45:31.677342 15202 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:31.677551 15491 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:31.672186 15484 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:31.680071 15484 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.680418 15484 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:31.681886  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3582) took 1541 ms. Trace:
I20260925 16:45:31.682252  9124 rpcz_store.cc:276] 0925 16:45:30.140102 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:30.140792 (+   690us) service_pool.cc:227] Handling call
0925 16:45:30.188027 (+ 47235us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:30.386948 (+198921us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:30.386988 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:30.387033 (+    45us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:30.387076 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:31.681669 (+1294593us) spinlock_profiling.cc:243] Waited 199 ms on lock 0x7b54003bf6d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:31.681715 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:31.681834 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":457017728}
I20260925 16:45:31.683820 15451 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.685082  8971 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:31.685647 15261 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:31.689414  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:31.692894  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:31.693416  9042 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:31.694777  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.695576  8975 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:31.696586  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.686086 15451 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.700634  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:31.701442  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 59808.5us
I20260925 16:45:31.704877  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.694149 15479 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.708981  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.710474  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.706961 15261 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:31.710973  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.699746 15202 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:31.711634  9702 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:45:31.711347 15261 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.711813 15202 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.703227 15327 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:31.713318 15327 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.713441 15261 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.713732 15327 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:31.716012 15395 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.702275 15491 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:31.713792 15202 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.721789  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:31.728859 15337 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:31.729421 15337 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.727082 15427 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.732587 15427 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.734484 15427 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.710219 15451 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:31.735937  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.736145 15451 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:31.736169  9118 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:31.737123 15451 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.744885  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.745584  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:31.745862  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.727932 15395 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.747913 15496 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:31.748803 15395 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.731498 15337 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.750151  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:31.750931 15429 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:31.751466 15429 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:31.751860 15429 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:31.755888  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.758713  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.760100  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:31.760340  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.760895  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.761245  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.761515  9694 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:31.717451 15491 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:31.764073 15491 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.765466 15491 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:31.720714 15479 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:31.767972 15202 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:31.768414 15202 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.768751 15179 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.769788 15179 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:31.770381 15202 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.770900 15202 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.771313 15202 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.774725 15327 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.777706  9702 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:31.778509 15376 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:31.779587 15376 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:31.721712 15103 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:31.780131 15376 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.782133 15376 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.784144  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.785868 15238 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:31.786264 15238 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:31.786603 15238 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:31.788786  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.792819 15494 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.794152 15238 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.794672 15494 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.798454  9048 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260925 16:45:31.799674  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.802475  9043 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:31.802825  8966 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 12. (term mismatch)
I20260925 16:45:31.803128  8966 pending_rounds.cc:76] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 11
I20260925 16:45:31.803263  8966 pending_rounds.cc:97] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260925 16:45:31.803399  8966 raft_consensus.cc:2866] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:31.804374 15327 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.804813  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.806823  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:31.811493 15202 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:31.800168 15303 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.816298 15303 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.804207 15494 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.817147  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.818363 15303 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.818423  9045 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:31.820240 15340 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 7, Current term: 15, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.818646  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:31.824200  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:31.825107  9047 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260925 16:45:31.825482  9047 pending_rounds.cc:76] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 7
I20260925 16:45:31.825515 15449 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:31.825819  9047 pending_rounds.cc:97] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260925 16:45:31.825999  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.826035 15449 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.826666 15449 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:31.827162 15274 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260925 16:45:31.823484  9693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1345) took 2515 ms (client timeout 1875 ms). Trace:
W20260925 16:45:31.829084  9693 rpcz_store.cc:269] 0925 16:45:29.307732 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.322477 (+ 14745us) service_pool.cc:227] Handling call
0925 16:45:31.823278 (+2500801us) spinlock_profiling.cc:243] Waited 895 ms on lock 0x7b540079e5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:31.823393 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2057973504}
I20260925 16:45:31.826146  9047 raft_consensus.cc:2866] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:31.832597  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.835757  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.836025  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.841431  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:31.844661  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:31.848678  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.849697  9693 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:31.853788  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.856055  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.856235  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.861299  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:31.863431  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:31.735361 15484 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.869019  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.869037  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:31.871044  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.875195  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.884318  9699 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:31.881400  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.887622  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.865670 15450 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260925 16:45:31.887687  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1346) took 2579 ms (client timeout 1750 ms). Trace:
I20260925 16:45:31.864532 15363 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.891574  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.876514 15202 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:45:31.895031  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:31.895651  9702 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:31.895855 15366 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:31.896327 15366 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.896679 15366 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:31.897946 15346 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:31.898490 15346 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.899989  8968 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
W20260925 16:45:31.889263  9697 rpcz_store.cc:269] 0925 16:45:29.308051 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.319912 (+ 11861us) service_pool.cc:227] Handling call
0925 16:45:31.887520 (+2567608us) spinlock_profiling.cc:243] Waited 309 ms on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:31.887621 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":711636352}
I20260925 16:45:31.900673 15346 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:31.901791  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.886587 15400 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:31.889361 15310 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260925 16:45:31.886405 15238 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:31.891119 15391 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:31.891393 15196 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:31.874058 15478 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:31.876543 15304 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:31.911228  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.907091 15341 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:31.866947 15001 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260925 16:45:31.956785 15001 consensus_queue.cc:1225] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:45:31.957532 15001 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:31.957928 15001 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:31.958735 15429 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.958921 15001 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.962401 15001 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:31.902518  9702 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:45:31.912132  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:31.916335  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:45:31.966087  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49875.5us
I20260925 16:45:31.966812  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.921257  9697 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:31.921123  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:31.964552  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52859.6us
I20260925 16:45:31.968160  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.976943  9124 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 9. (term mismatch)
I20260925 16:45:31.977365  9124 pending_rounds.cc:76] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 8
I20260925 16:45:31.977593  9124 pending_rounds.cc:97] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260925 16:45:31.977836  9124 raft_consensus.cc:2866] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:45:31.979910  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 67842.9us
W20260925 16:45:31.982625  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61565.6us
I20260925 16:45:31.985842  8969 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 12: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:31.988622  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77415.5us
I20260925 16:45:31.904865 15310 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:31.890066 15450 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:31.904109 15487 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:31.889531 15180 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.107s
I20260925 16:45:31.996361 15457 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:31.996637 15180 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:31.996915  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:31.883073 15268 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.101s
I20260925 16:45:31.998685 15344 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:31.998754 15268 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:31.999218 15268 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:31.999290 15341 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:32.000171 15268 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.000957 15341 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:32.001368 15341 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:32.001576 15268 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:31.984766 15159 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:31.987600 15103 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:31.913787 15363 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:31.991374 15310 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:32.004942 15310 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:32.005491 15363 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:32.007081  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:31.987754 15346 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:32.008237 15346 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:31.988059 15327 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:32.013422  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:32.015280  9693 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:31.990809 15364 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:32.016145 15364 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:31.994141 15304 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:32.018690 15364 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.019769 15180 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.020664 15180 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.021384  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:32.022163  8971 raft_consensus.cc:595] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:32.022615  8971 raft_consensus.cc:603] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:32.010906 15341 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.028920 15484 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.029225 15341 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:32.031726  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1815) took 2805 ms. Trace:
I20260925 16:45:31.984715 15494 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:32.047570  9117 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260925 16:45:32.032158  9695 rpcz_store.cc:276] 0925 16:45:29.226536 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.226980 (+   444us) service_pool.cc:227] Handling call
0925 16:45:29.227273 (+   293us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:29.800259 (+572986us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:32.031462 (+2231203us) spinlock_profiling.cc:243] Waited 572 ms on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:32.031623 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1316348160}
I20260925 16:45:32.052342  9702 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:32.048827  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.049572  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:31.989434 15348 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:32.057404  9050 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260925 16:45:32.053089  9043 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:32.055241  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.059556  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:32.052248  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62229.8us
I20260925 16:45:32.009577 15402 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260925 16:45:32.062201  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:32.096414  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 58614us
I20260925 16:45:32.065116  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.068238  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.072454 15094 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:32.099915  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:32.072986  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:32.073473 15429 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:32.073783 15310 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.075629  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.076123  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.076750  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:32.109579  8975 raft_consensus.cc:595] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.109989  8975 raft_consensus.cc:603] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:32.053860 15475 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260925 16:45:32.079803  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.080407 15363 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:32.057197 15348 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:32.081755 15449 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.089389 15344 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:32.091862 15240 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:32.101022 15180 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:32.013403 15450 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:32.106911  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45414.9us
I20260925 16:45:32.111212  8967 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260925 16:45:32.120060  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:32.148818  9115 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:32.149107 15344 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:32.120607  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54367.5us
I20260925 16:45:32.143875  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.120935 15179 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:32.155138  9123 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:32.108883 15433 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:32.126974 15303 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:32.066570  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:32.101416 15339 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:32.171093 15339 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:32.171806 15391 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:32.172330 15391 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.172097 15339 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.173532 15339 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:32.174245 15391 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.175922 15179 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:32.176275 15179 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.176432 15240 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:32.176867 15240 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:32.177106 15179 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.177754 15449 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:32.177596 15240 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.178716 15303 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:32.116365 15478 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:32.100169 15094 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:32.143785  9116 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:32.154053  9700 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:32.155975  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6030f186a664452b127609fadec766b"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:32.123004 15461 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:45:32.059850 15494 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.190394 15094 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:32.191258 15461 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:32.191632 15461 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.166154 15383 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:32.192277 15383 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.192456 15461 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.193931 15478 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.168031  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.132563 15348 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:32.189069 15375 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:32.195290 15303 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.195626  8971 raft_consensus.cc:595] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:32.191061 15433 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.178808 15240 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:32.200030  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.152601 15301 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:32.213752  8971 raft_consensus.cc:603] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:32.199014 15094 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.193763 15461 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:32.216487  9700 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:32.194489 15383 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.220283  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:32.179600 15441 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.653s	user 0.004s	sys 0.012s
I20260925 16:45:32.224875  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.213337 15268 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:32.228000  9046 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260925 16:45:32.244678  9046 pending_rounds.cc:76] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 10
I20260925 16:45:32.244913  9046 pending_rounds.cc:97] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260925 16:45:32.245172  9046 raft_consensus.cc:2866] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:32.230706  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:32.235786 15303 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.256683 15303 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:32.259975 15496 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:32.261670 15478 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.264626 15103 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:32.266271  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:32.227413 15366 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.268147  9118 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:32.270355 15433 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.270778 15366 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:32.237419 15301 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.274895 15301 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:32.240509  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:32.242748  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:32.240347 15375 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260925 16:45:32.189138 15310 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:32.256011  9697 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:32.283003 15094 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.285542  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 2930) took 2195 ms. Trace:
I20260925 16:45:32.243806 15494 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:32.285892  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:32.289067 15491 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.523s	user 0.008s	sys 0.003s
I20260925 16:45:32.292591 15425 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:32.293540  9042 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260925 16:45:32.296322  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:32.300230  8968 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: [17.12-17.12]
I20260925 16:45:32.304879  9048 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:32.259424  9115 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:32.303321  8974 rpcz_store.cc:276] 0925 16:45:30.090289 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:30.090472 (+   183us) service_pool.cc:227] Handling call
0925 16:45:30.102095 (+ 11623us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:30.102301 (+   206us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:30.102322 (+    21us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:30.135798 (+ 33476us) log.cc:842] Serialized 26 byte log entry
0925 16:45:30.329672 (+193874us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:30.329719 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:30.329810 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:32.179093 (+1849283us) spinlock_profiling.cc:243] Waited 9.68 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:32.285142 (+106049us) raft_consensus.cc:1671] finished
0925 16:45:32.285163 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:32.285363 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":22255488,"thread_start_us":117365,"threads_started":1,"wal-append.queue_time_us":300562}
W20260925 16:45:32.312244  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 64612.5us
I20260925 16:45:32.318099  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:32.308848  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:32.324424  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:32.325106  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:32.331359  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:32.340493  9700 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:32.322942 15433 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:45:32.364800  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 51349.6us
I20260925 16:45:32.328702 15304 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:32.381747  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85494.4us
I20260925 16:45:32.389292  9047 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:32.393890  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.401230  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1198) took 3028 ms. Trace:
I20260925 16:45:32.316496 15363 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260925 16:45:32.401918  9049 rpcz_store.cc:276] 0925 16:45:29.355489 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.355711 (+   222us) service_pool.cc:227] Handling call
0925 16:45:32.373416 (+3017705us) spinlock_profiling.cc:243] Waited 2.72 s on lock 0x7b54002616d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:32.384220 (+ 10804us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6245002624}
I20260925 16:45:32.420487 15450 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.423206 15450 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.424100  9043 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: [13.8-13.8]
I20260925 16:45:32.334860 15425 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.428606 15425 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.379987 15420 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:32.374359 15484 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:32.356387 15094 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.046s
I20260925 16:45:32.361153 15340 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.045s
I20260925 16:45:32.464655  9044 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:32.486585  9702 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:32.487238  9700 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:32.489635 15372 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:32.491624  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "8dc3391062084f45a6ba62d28d340722"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:32.494283  8971 raft_consensus.cc:595] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.494640  8971 raft_consensus.cc:603] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:32.496784  9698 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:32.500602  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.454000 15484 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.502564  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.503232  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:32.514364  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:32.515584  9118 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:45:32.529109  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:32.530015  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.535270  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:32.543342 15483 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:32.544409 15483 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:32.544708 15483 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.545240 15384 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:32.493609 15372 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.545482 15483 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.546732 15483 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:32.547398 15372 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:32.548998 15474 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
W20260925 16:45:32.550863  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 51588.7us
I20260925 16:45:32.551819  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:32.554724 15480 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:32.555199 15480 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.555958 15480 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.559335 15484 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:32.560405  8968 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:32.562317 15375 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:32.563445 15375 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:32.563859 15375 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.564771 15375 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.566278 15375 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:32.593186  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:32.594583  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 65543us
W20260925 16:45:32.591490  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49064.4us
I20260925 16:45:32.534070  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.599062  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:32.601768  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67786.2us
I20260925 16:45:32.602767  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:32.604501  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.611151  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:32.623319  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:32.625237  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.626446  8971 raft_consensus.cc:2396] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:45:32.636018  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:32.636893  8966 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:32.637279  8966 raft_consensus.cc:603] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:32.642722  9121 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260925 16:45:32.643210  9121 pending_rounds.cc:76] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 8
I20260925 16:45:32.643466  9121 pending_rounds.cc:97] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260925 16:45:32.644001  9121 raft_consensus.cc:2866] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:32.645927  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:32.612681 15001 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260925 16:45:32.655565  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:32.592414 15363 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:32.606117 15343 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:32.667228  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.667727  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:32.669890  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.616336 15491 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:32.613824 15094 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:32.678419  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:32.628386 15350 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:32.671089 15103 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:32.699152 15179 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:32.699165 15350 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260925 16:45:32.705121  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:32.672508 15494 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:32.712452 15180 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:32.714224  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:32.715355 15505 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.244s	user 0.000s	sys 0.001s
I20260925 16:45:32.716732 15461 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:32.629249 15348 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.738521 15001 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:32.739123 15447 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:32.739966  9116 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
W20260925 16:45:32.741065  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133659us
I20260925 16:45:32.718173 15268 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:32.758617  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:32.753022  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:32.779983  9695 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:32.683174 15343 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.758208 15001 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:32.758194 15447 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:32.768610 15400 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:32.775405 15332 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260925 16:45:32.817082  9699 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:45:32.790448 15268 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:32.719796 15103 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:32.878621 15268 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.891497 15433 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260925 16:45:32.877198 15001 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:32.955657  9124 raft_consensus.cc:2396] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260925 16:45:32.880999 15447 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:32.963682  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:32.957985 15348 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:32.867758 15491 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:32.991289 15001 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:32.999614 15343 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:33.004618 15103 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:33.025470 15515 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.206s	user 0.005s	sys 0.000s
W20260925 16:45:33.044000 15514 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.159s	user 0.001s	sys 0.001s
I20260925 16:45:33.011775 15348 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:33.058861  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:33.061082  9041 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260925 16:45:33.071848  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:33.071907  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:33.061285 15363 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:45:33.085783  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 234663us
W20260925 16:45:33.090466  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 217237us
I20260925 16:45:33.093554  8966 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:33.096065  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:33.076505 15222 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:33.081033 15512 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:33.102597 15512 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:33.103464 15512 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:33.104641 15512 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:33.057861 15348 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:33.097600 14979 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260925 16:45:33.116255  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 329546us
I20260925 16:45:33.098310  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:33.119063 15338 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:33.110579 15511 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260925 16:45:33.056460 15491 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:33.097272 15159 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:33.121699 15383 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:33.151924 15425 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:33.153964 15425 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:33.159534 15375 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.593s	user 0.015s	sys 0.001s
I20260925 16:45:33.159963 15348 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:33.276494 15425 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:33.292347  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:33.293080  9122 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:33.334782  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3617) took 1168 ms. Trace:
I20260925 16:45:33.339047 15347 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:33.339573 15347 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:33.341558 15347 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:33.348574 15483 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:33.349053 15483 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:33.350035  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:33.350665  9120 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:33.351118 15483 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:33.352325  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:33.353744 15433 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:33.354102 15433 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:33.354435 15433 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:33.362109  9120 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:45:33.367887  9122 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:33.335196  9119 rpcz_store.cc:276] 0925 16:45:32.166764 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:32.166980 (+   216us) service_pool.cc:227] Handling call
0925 16:45:32.181164 (+ 14184us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:32.181404 (+   240us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:45:32.464605 (+283201us) log.cc:842] Serialized 14 byte log entry
0925 16:45:33.334287 (+869682us) spinlock_profiling.cc:243] Waited 1.63 ms on lock 0x7b1800471fa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:33.334439 (+   152us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:33.334503 (+    64us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:33.334544 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:33.334617 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:33.334729 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":44932,"prepare.queue_time_us":630396,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":5973,"raft.queue_time_us":522045,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":3744512,"thread_start_us":629074,"threads_started":2,"wal-append.queue_time_us":481509}
I20260925 16:45:33.371289  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:33.388175 15491 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:33.386843 15347 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:33.388671 15491 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:33.390148 15347 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:33.390684 15491 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:33.391276 15347 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:33.391685 15347 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:33.392759 15347 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:33.394418 15347 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:45:33.381445 15508 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.775s	user 0.004s	sys 0.000s
I20260925 16:45:33.372172  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:33.408392  8966 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:33.410070  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:33.410841  9045 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
W20260925 16:45:33.412724  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3384) took 1365 ms (client timeout 1546 ms). Trace:
W20260925 16:45:33.413055  9045 rpcz_store.cc:269] 0925 16:45:32.047804 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:32.049332 (+  1528us) service_pool.cc:227] Handling call
0925 16:45:33.412586 (+1363254us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b54000b0ed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:33.412676 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3122132352}
I20260925 16:45:33.413713 15352 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:33.414099 15352 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:33.414463 15352 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:33.421773  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:33.417478  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:33.442528  8966 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:33.446013  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:33.452172  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:33.452937  8975 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
W20260925 16:45:33.565461  8940 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.546s (SENT) [suppressed 52 similar messages]
I20260925 16:45:33.725229 15537 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:33.726029 15537 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:33.728816 15537 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:33.769975 15537 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:33.770704 15537 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:33.773180 15537 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.273490 15541 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.274318 15541 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.276957 15541 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.282351 15539 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.459479 15541 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.336283  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.409971 15542 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.460057 15541 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:34.452128  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.804s	user 0.010s	sys 0.002s
W20260925 16:45:34.455916  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080019a040 after lost signal to thread 7803
I20260925 16:45:34.457587 15364 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260925 16:45:34.461153  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08001ed400 after lost signal to thread 7806
I20260925 16:45:34.459223 15539 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.461977 15541 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.460208  9121 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:34.464013 15541 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:34.462003  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.010s	sys 0.002s
I20260925 16:45:34.464483 15541 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.466393 15541 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.466885 15541 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.467358 15541 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.468880 15540 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.469411 15540 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.460249 15542 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.454219 15543 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.472615 15543 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.475210 15543 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.476339 15541 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:34.282851  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.004s	sys 0.012s
W20260925 16:45:34.477635  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.889s	user 0.004s	sys 0.012s
W20260925 16:45:34.477926  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 889360us
I20260925 16:45:34.472954  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.479799  9122 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:34.480356  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3207) took 1033 ms. Trace:
I20260925 16:45:34.462961 15539 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.480804 15541 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.480949 15274 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.481304 15301 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.480679  9122 rpcz_store.cc:276] 0925 16:45:33.447136 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:34.472694 (+1025558us) service_pool.cc:227] Handling call
0925 16:45:34.480305 (+  7611us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:34.482189 15517 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.487769 15274 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.490314 15274 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.490873 15274 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.496068 15543 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.496716 15543 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.485152 15539 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.485615 15545 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.491314 15274 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.485716 15301 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.486622 15517 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.533236  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1382) took 2225 ms. Trace:
W20260925 16:45:34.543848  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87566.4us
I20260925 16:45:34.549780 15544 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:34.548139  9702 rpcz_store.cc:276] 0925 16:45:32.307391 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:32.307512 (+   121us) service_pool.cc:227] Handling call
0925 16:45:32.486314 (+178802us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:32.495293 (+  8979us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:34.533039 (+2037746us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54006eebd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:34.533179 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":344502528}
W20260925 16:45:34.533121 15352 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.118s	user 0.022s	sys 0.000s
I20260925 16:45:34.546167 15543 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.527872 15540 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.560071  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.548370 15545 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.553960 15542 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:34.554706 15350 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.218s	user 0.006s	sys 0.015s
I20260925 16:45:34.561347 15478 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:34.561614 15350 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.225s	user 0.007s	sys 0.016s
I20260925 16:45:34.555078 15301 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.561877 15478 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.562325 15301 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.562764 15301 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.564841 15301 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.565719 15301 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.556488 15274 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.564843 15478 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.566725 15325 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.567410 15301 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.567461 15325 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.551880 15544 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:34.569690 15325 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.570216 15325 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:34.569530 15544 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.570871 15544 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.570631 15325 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.548561 15539 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.566776 15478 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:34.573448  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.573969 15542 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.485123 15541 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.572266 15301 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.574461 15542 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.579011 15487 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.579066  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.579805  9122 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 11.
I20260925 16:45:34.573480 15543 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.580528  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.580415 15543 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.580839  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.581442  9121 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:34.581753  9120 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:34.581991 15540 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.582711 15543 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.582468 15540 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.580154 15542 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.583168  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.584348  9118 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:34.575351 15478 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.577718 15517 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.579583 15487 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.577636 15325 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.584894  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.586055 15094 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.593796  9122 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:34.588914  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.590238 15541 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.590433 15478 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.590996 15517 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.575579 15350 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.592911  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.595943  9124 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:34.592284 15540 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.593571 15542 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.583184 15543 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.602456 15487 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.594664 15546 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:34.594775 15103 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:34.592927 15539 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.604257  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.559212 15352 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:34.597548 15325 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:34.598094 15094 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.608188 15325 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.609483 15094 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.609568 15541 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:34.610126 15541 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.610340 15094 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:34.610679 15541 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:34.606312 15103 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:34.611572 15103 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.610733 15094 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.612191 15094 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:33.441264 15347 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.613427 15347 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.615327 15347 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.615965  9119 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:34.603646 15350 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.618368 15350 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.605245 15540 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.621341 15350 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:34.602713 15542 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.605121 15543 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.622196 15494 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:34.622810 15461 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.650272 15461 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.652068 15543 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.653018 15542 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.623284 15352 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.625108 15103 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.654860 15461 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.655112 15103 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.621896 15325 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.655877 15325 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.656064 15384 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:34.656389 15325 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.656519 15384 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.657966 15494 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.658560 15325 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.659057 15325 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.626582  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.659940 15494 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.660442 15494 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.660557  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.629475 15094 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.660897 15494 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.661262  9117 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:34.662076 15343 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.662544 15094 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.662923 15350 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:34.663439 15350 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.663836 15350 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:34.659483 15325 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.666064 15325 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.666604 15325 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.667119 15301 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.667078 15325 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.667923 15301 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.633175 15478 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.633502 15531 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.633674 15487 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.636966  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.638754 15327 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.606609 15546 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:34.660701  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.629284 15541 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.632689 15547 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.678781  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.679189  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.679642  8975 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:34.679960 15103 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:34.680105  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.680356 15103 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.680738  9120 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.676525 15546 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:34.683795  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.684796 15541 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.685913  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.686461  8973 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:34.687065 15512 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.687503 15512 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.690491 15512 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.690907 15512 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.691313 15512 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.648828 15540 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.696736 15384 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.697232 15384 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.697681 15384 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.698165 15447 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.699221 15540 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.699600 15384 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.701337 14979 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.701905 15545 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.701818 14979 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.704437  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.680748  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.670466 15402 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.662583 15343 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.675134  9115 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:34.601804 15517 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.713387  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.714099  9118 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:34.673378  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.333s	user 0.014s	sys 0.013s
I20260925 16:45:34.680795 15103 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.710039  9122 raft_consensus.cc:2396] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260925 16:45:34.706666  8974 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:34.705276  9124 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:34.712426  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:34.709460 15433 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.349s	user 0.013s	sys 0.008s
I20260925 16:45:34.726397  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.726336  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.726640  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.720218  9117 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:34.728041  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:34.714811  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.375s	user 0.014s	sys 0.013s
I20260925 16:45:34.722851  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.728610  8968 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:34.727562  8971 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:34.733736  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.669729 15325 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.733994  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:34.738543  9121 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:34.741356  9695 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:34.743283  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.744640  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.745558  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.747052  9118 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:34.748018  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.748667  9124 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:34.748860  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.750087  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.754240  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:34.676965 15478 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.676548 15547 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.757239 15478 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.758052 15547 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.707739 15531 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:34.758915  9071 debug-util.cc:398] Leaking SignalData structure 0x7b0800383960 after lost signal to thread 8907
I20260925 16:45:34.760390 15531 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.761168 15494 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.763383 15343 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.732154 15301 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.763919  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.764775  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:34.765554 15517 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.732580 15433 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.771075 15433 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.707288 15487 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.774010 15487 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.707472 15327 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.776027 15327 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.782241 15537 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.783562  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:34.785521  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:34.786816 15546 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.715468 15402 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:34.759584  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08003b99e0 after lost signal to thread 8927
I20260925 16:45:34.789760 15402 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:34.789916  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080033ac80 after lost signal to thread 8999
I20260925 16:45:34.746474  9121 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:34.797816  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.782992 15537 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.798725  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.724963 15384 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:34.803954  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60106.7us
I20260925 16:45:34.804755  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.808844  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.740646 14979 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.782341 15512 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.799922 15531 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.815644 15531 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.817562 15531 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.810994 15384 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.801239 15196 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:34.813315 15517 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:34.800150 15548 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.831938 15196 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.797075 15545 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:34.832114 15517 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:34.832407 15196 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:34.832499 15545 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:34.832996 15545 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.833112 15517 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.823223 15487 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.835989 15487 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.809299  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.823436 15546 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.811223 15391 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:34.826200 15537 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:34.821201 15480 raft_consensus.cc:2741] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:45:34.858105  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.829561  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.830554  9120 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:34.852831  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.856127  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.856388  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.859635  9115 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:34.832204 15548 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.860316  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.857546 15391 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.861135 15391 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:34.861362  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.861966 15548 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.862167  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.862473 15222 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:34.863020 15222 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:34.863215 15546 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:34.863456 15540 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:34.863595 15546 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.859203  9121 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:34.863986 15540 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.864138 15546 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:34.864459 15540 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:34.864866 15222 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:34.866127 15537 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.857545 15547 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.866614 15537 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.866976 15547 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.845000 15487 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.868686  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2284) took 2578 ms. Trace:
W20260925 16:45:34.868870  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08003b6200 after lost signal to thread 9074
I20260925 16:45:34.869040 15547 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:34.869238  9071 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7760 after lost signal to thread 9075
I20260925 16:45:34.869292  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.828583 15103 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.872011 15480 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:34.872376 15480 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:34.872690 15480 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:34.874147 15301 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:34.874512 15301 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.874863 15301 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:34.876391  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.877213  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.877472 15420 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:34.863044  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.879596  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.862416  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.880932 15537 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.882654 15384 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.817466 15350 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.884234 15347 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:34.884637 15347 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.885000 15347 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:34.885493 15372 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:34.885753 15350 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.885975 15372 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:34.886700 15042 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.886912 15372 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.887174 15042 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.877832 15420 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:34.902875 15363 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.903400 15363 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.889356  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.888018  8975 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:34.905072  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.905434 15420 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.905593 15363 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.905865 15180 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:34.906277 15180 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.906637 15180 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:34.900595  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 62158.4us
I20260925 16:45:34.906561  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.891729  8966 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:34.896659 15364 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:34.911059  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.908946 15537 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:34.911729  8974 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:34.912278 15537 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:34.912768 15537 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:34.869045  9046 rpcz_store.cc:276] 0925 16:45:32.290510 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:32.296980 (+  6470us) service_pool.cc:227] Handling call
0925 16:45:32.297315 (+   335us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:32.297621 (+   306us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:32.297650 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:32.298095 (+   445us) log.cc:842] Serialized 26 byte log entry
0925 16:45:32.440302 (+142207us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:32.440340 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:32.440408 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:33.374421 (+934013us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:34.868393 (+1493972us) raft_consensus.cc:1671] finished
0925 16:45:34.868415 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:34.868639 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":580,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":97,"spinlock_wait_cycles":30721920,"thread_start_us":141858,"threads_started":1,"wal-append.queue_time_us":173684,"wal-append.run_cpu_time_us":25591,"wal-append.run_wall_time_us":2127906}
I20260925 16:45:34.890229  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.914340  9118 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:34.916396  8971 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:34.916833 15042 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:34.916589  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.917033  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.922770  8973 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:34.924014  8974 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:34.887576 15103 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.911906 15364 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.920131  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.920564  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.930999  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.931360  9122 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:34.921485  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.925946  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.928155  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.931473  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.931643  9120 raft_consensus.cc:2354] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:34.933897  9124 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:34.932020  9121 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:34.932015  8971 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:34.941406  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.943082  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.943923  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:34.944880  9118 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:34.945832  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.937616  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:34.947896  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:34.948438  9119 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:34.948482  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:34.949093  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.949891  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.950678  8974 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:34.951890  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.952545  8968 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 10.
I20260925 16:45:34.953007  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:34.956605  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.958528  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.959550  9121 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:34.955770 15544 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.972185 15544 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:34.972951 15364 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:34.975875  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:34.975399  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.978075  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:34.978704  8968 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:34.930457 15363 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.930085 15350 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.977758  8975 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:34.980278  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:34.932765 15042 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:34.981601  9702 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:34.982106  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:34.974215 15433 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:34.974018 15384 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:35.016964  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:34.991597 15042 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.997979 15347 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.991200  9119 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
W20260925 16:45:35.004828  9071 debug-util.cc:398] Leaking SignalData structure 0x7b0800337d40 after lost signal to thread 9148
I20260925 16:45:35.010195 15196 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.974360 15325 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:34.987007  9698 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:34.985733 15519 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:34.983395 15521 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.017004 15433 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:34.976704 15103 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:35.026530  9071 debug-util.cc:398] Leaking SignalData structure 0x7b0800321440 after lost signal to thread 9726
I20260925 16:45:35.030117  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.028313  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.035485 15196 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.031119 15325 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:35.069391 15433 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:35.069943 15325 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:34.989675 15363 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.035488 15042 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:35.035504 15347 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:35.081835 15521 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:34.989508 15350 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.017786 15384 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:35.100059 15384 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:35.037104 15519 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.102191 15103 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:35.094913  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66718us
I20260925 16:45:35.097170 15196 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:35.103350 15196 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:35.104406 15103 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.104212 15196 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:35.099403  9071 debug-util.cc:398] Leaking SignalData structure 0x7b080024da00 after lost signal to thread 9727
I20260925 16:45:35.029377 15222 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:35.108434 15545 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.109042 15222 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:35.103505  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.111482  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.116266 15544 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:35.116523  8940 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.546s (SENT)
I20260925 16:45:35.116812 15544 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:35.116994  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.117334 15544 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:35.118273  9121 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:35.118727 15517 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:35.112160  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.117223  9124 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:35.121116  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.117208 15521 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.122406  9118 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:35.122912  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.123474 15350 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.123770 15548 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:35.124176 15548 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:35.124542 15548 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:35.125598  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.126223  9695 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:45:35.126055 15540 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.126897  9697 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260925 16:45:35.127780  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.127979  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.128324  9697 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:35.122148 15103 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:35.130441  9124 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:35.130522 15545 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.130092  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.130712 15103 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:35.131214  9701 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:35.131747 15103 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.137583  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.110659 15372 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.140336  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.140918  9702 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:35.107213 15546 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.140885  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.144747  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:35.148049  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.178820  9120 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:35.136837 15462 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.187409  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.178854  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.191133  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.193635  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.194433  9050 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:35.190274  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.196048  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.196309  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.196740  8966 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:35.196923  8975 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:35.141644 15400 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.198570  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.198939  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.199460  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.199543  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.200313  8968 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:35.200201  8971 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:35.202369  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.205154  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:35.192106  9014 connection.cc:232] RPC call timeout handler was delayed by -1.3181573390002086s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1516s for a response
I20260925 16:45:35.205924  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.221887  8973 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
W20260925 16:45:35.201171  8872 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 344) took 19045 ms (client timeout 15000 ms). Trace:
I20260925 16:45:35.222184  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:35.185038 14749 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:35.190462 15454 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:35.237756  8974 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:35.225095  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.186880 15406 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.187041 15368 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.191937 15304 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:35.221767 15338 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:35.287052 15338 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.288501  9695 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260925 16:45:35.289165 15338 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.289767  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:35.289891  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.290378  9695 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:35.290597  9698 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:35.290680 15304 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.291450  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.292680 15304 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.293432  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.293881  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.294587  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.295009  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.118299 15544 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.292627  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.297889  9042 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
W20260925 16:45:35.296880  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 147811us
I20260925 16:45:35.245896  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.295720  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.197695 15268 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:35.303838  9695 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:35.305516  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.194521 15526 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:35.199460 15540 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.200083 15399 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:35.194722 15541 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.307678 15391 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:35.290697 15556 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260925 16:45:35.314829  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.349372  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.238850 15550 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:35.320120  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.321621  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.323223  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.325343  8972 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:35.356115  8971 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:35.327121 15338 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.327189 15304 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:35.364248 15304 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.327805 15240 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.239420 15222 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.368227 15240 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.369014 15301 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.370139 15240 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.328191  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:35.328303 15467 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.370694  9121 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:35.328868  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.329107 14979 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:35.329535 15339 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:35.329872  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:35.328625  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106537us
I20260925 16:45:35.181981 15372 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.200551 15474 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:35.200492 15001 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:35.337309  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.383355  9697 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:35.303043 14749 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.297422 15519 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.397007  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.398029 15391 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.398444  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:35.399909  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:35.350014  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 171916us
I20260925 16:45:35.360139 15547 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260925 16:45:35.222630  8872 rpcz_store.cc:269] 0925 16:45:16.152013 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:16.153314 (+  1301us) service_pool.cc:227] Handling call
0925 16:45:35.196415 (+19043101us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:45:28.573635 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:45:28.850535 (+276900us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:45:28.862159 (+ 11624us) write_op.cc:435] Acquired schema lock
0925 16:45:28.862175 (+    16us) tablet.cc:660] Decoding operations
0925 16:45:28.886779 (+ 24604us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:45:28.886917 (+   138us) write_op.cc:641] Partition lock acquired for write op
0925 16:45:28.887017 (+   100us) tablet.cc:683] Acquiring locks for 32 operations
0925 16:45:29.313694 (+426677us) tablet.cc:699] Row locks acquired
0925 16:45:29.313734 (+    40us) write_op.cc:260] PREPARE: finished
0925 16:45:29.313895 (+   161us) write_op.cc:270] Start()
0925 16:45:29.314050 (+   155us) write_op.cc:276] Timestamp: P: 1790354729313830 usec, L: 0
0925 16:45:29.314088 (+    38us) op_driver.cc:331] REPLICATION: starting
0925 16:45:29.314906 (+   818us) log.cc:842] Serialized 12529 byte log entry
0925 16:45:29.765427 (+450521us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b1800500800. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:30.255486 (+490059us) op_driver.cc:444] REPLICATION: finished
0925 16:45:30.539070 (+283584us) write_op.cc:301] APPLY: starting
0925 16:45:30.539202 (+   132us) tablet.cc:1365] starting BulkCheckPresence
0925 16:45:31.500933 (+961731us) tablet.cc:1368] finished BulkCheckPresence
0925 16:45:31.500987 (+    54us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:45:31.959685 (+458698us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:45:31.960248 (+   563us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=64,key_file_lookups=64,delta_file_lookups=64,mrs_lookups=0
0925 16:45:31.960316 (+    68us) write_op.cc:312] APPLY: finished
0925 16:45:31.961505 (+  1189us) log.cc:842] Serialized 276 byte log entry
0925 16:45:32.114927 (+153422us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:32.115163 (+   236us) write_op.cc:454] Released schema lock
0925 16:45:32.115256 (+    93us) write_op.cc:341] FINISH: Updating metrics
0925 16:45:32.124288 (+  9032us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:32.124331 (+    43us) write_op.cc:454] Released schema lock
0925 16:45:32.396565 (+272234us) spinlock_profiling.cc:243] Waited 34.3 ms on lock 0x7b1800500800. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
Metrics: {"mutex_wait_us":25377,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":243991,"apply.run_cpu_time_us":124373,"apply.run_wall_time_us":1592975,"cfile_cache_hit":130,"cfile_cache_hit_bytes":137695,"num_ops":32,"prepare.queue_time_us":270263,"prepare.run_cpu_time_us":57916,"prepare.run_wall_time_us":964495,"raft.queue_time_us":152694,"raft.run_cpu_time_us":17165,"raft.run_wall_time_us":251618,"replication_time_us":936039,"spinlock_wait_cycles":85567616,"thread_start_us":506436,"threads_started":5,"wal-append.queue_time_us":510981,"wal-append.run_cpu_time_us":22809,"wal-append.run_wall_time_us":2395944}]]}
I20260925 16:45:35.352965  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.308483 15268 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.303617 15454 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:35.333475 15340 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:35.337366 15541 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.360949  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.361564  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.363346 15338 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.411334  9122 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260925 16:45:35.411979  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.391229 15537 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.204973 15400 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.327840  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:35.413728  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52262.1us
I20260925 16:45:35.372658  8970 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:35.370781  9118 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 15
I20260925 16:45:35.194973 15462 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.379338  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.340679  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.298126 15548 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.385795  9042 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:35.386656  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.378371 15339 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.388007 15356 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.006s
I20260925 16:45:35.388450 15433 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.388796 15372 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.389168 15001 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.390429 15546 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.383265 15325 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.360337 15363 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.405671  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.414352  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.417233  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.309854 15406 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.344623 15399 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.419224 15338 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.371094 15467 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.419860 15487 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:35.385123 15474 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.378589  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.421288  8975 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:35.400900 15517 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:35.326702 15526 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.309921 15368 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.369522 15550 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.422616  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.490893  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.610553  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.552343  9115 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:35.561251  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60212.9us
I20260925 16:45:35.631855  9122 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:35.405279 15547 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:35.584870  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88206.1us
I20260925 16:45:35.512485  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.490442  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.633215  9702 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:35.552951  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.420894 15541 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.636317  8966 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:35.408382 15454 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:35.405155 15268 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:35.427317  9118 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:35.673964  9694 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:35.674981  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:35.422566 15480 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.544s	user 0.006s	sys 0.004s
I20260925 16:45:35.648931  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:35.592722 15558 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
W20260925 16:45:35.609858 15559 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:35.421933  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:35.664556  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 277975us
I20260925 16:45:35.695050  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.664777 15547 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:35.665239  9121 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:35.665635  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.663689  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:35.412346 15180 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.505s	user 0.008s	sys 0.001s
I20260925 16:45:35.670621  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.582720 15304 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:35.507747 15420 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.602s	user 0.009s	sys 0.000s
I20260925 16:45:35.708557 15550 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.708694 15420 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.584272 15421 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.107s
W20260925 16:45:35.709558 15560 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260925 16:45:35.710178 15421 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:35.710510 15421 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:35.710870 15420 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:35.671890  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.627602  8868 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:35.712173  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.712631  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3230) took 1003 ms. Trace:
I20260925 16:45:35.712769 15368 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.713020  9116 rpcz_store.cc:276] 0925 16:45:34.708903 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:34.709179 (+   276us) service_pool.cc:227] Handling call
0925 16:45:34.720037 (+ 10858us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:34.800647 (+ 80610us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:34.800675 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:34.814251 (+ 13576us) log.cc:842] Serialized 26 byte log entry
0925 16:45:35.003457 (+189206us) spinlock_profiling.cc:243] Waited 14.5 ms on lock 0x7b1800319660. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:45:35.142722 (+139265us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:35.142758 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:35.199800 (+ 57042us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b5400041ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:35.199850 (+    50us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:35.712413 (+512563us) raft_consensus.cc:1671] finished
0925 16:45:35.712431 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:35.712546 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8476,"raft.queue_time_us":8614,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":10301,"spinlock_wait_cycles":198088704,"thread_start_us":139096,"threads_started":1,"wal-append.queue_time_us":559086}
I20260925 16:45:35.714339  9122 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:35.629227 15487 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.507670  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.630205 15301 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:35.731086  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 434699us
I20260925 16:45:35.422729 15425 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:35.697213  9700 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:35.633529  9117 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260925 16:45:35.741642  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 324453us
I20260925 16:45:35.698319  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.700297  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:35.743110  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 50604.8us
I20260925 16:45:35.743613  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.745298  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.701639  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.704170  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:35.749289  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45220.5us
I20260925 16:45:35.749501  9043 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:35.750840  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.700455  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.684698 15552 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:35.684948 15551 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260925 16:45:35.416013 15340 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 9 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.416180 15344 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.269s
I20260925 16:45:35.707988  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.714171 15526 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.580960 15400 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.715396 15399 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.716358 15462 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.485826 15519 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.206s
I20260925 16:45:35.707563  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.708732 15406 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.669493 15517 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260925 16:45:35.711261 15421 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.720917  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.722568  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.485548 15447 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.204s
I20260925 16:45:35.725447 15467 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.726043  9116 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:35.676973  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:35.732745  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.685623 14749 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.734988  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.633620 15339 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:35.732223 15103 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.011s	sys 0.021s
W20260925 16:45:35.744381  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 251745us
W20260925 16:45:35.791880 15103 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.657s	user 0.011s	sys 0.021s
I20260925 16:45:35.747936  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.792543  8974 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:35.751590  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.792765  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.793715  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.784582  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.756979  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.794533  9042 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:35.707274 15363 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:35.760339  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.760931  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.761538  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.792701  9700 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:35.762493  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.761077  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.715031  8868 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 7 to 13, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 13 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:35.796932  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54508.2us
I20260925 16:45:35.748670 15356 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:35.688601 15480 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.728579 15180 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:35.755676 15546 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:35.786418 15568 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.787365 15433 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:35.826877  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77538.5us
I20260925 16:45:35.757848 15301 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:35.734740 15487 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:45:35.760291  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57868.8us
I20260925 16:45:35.795893  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.835105  9048 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:35.796993  9047 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:35.798862 15356 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.799445 15103 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:35.798763  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.800203  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.801220  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.840165  9043 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:35.798040  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 121160us
I20260925 16:45:35.841444  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.826762 15521 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:35.764569 15537 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:35.825672  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.824349  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.830204  9123 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:35.848554  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.850627  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.832544  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.792407 15567 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:35.835927  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.836308  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.854332  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.854346  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.830969 15301 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.752704 15552 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.876438  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.837275  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.837671  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.837955  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:35.803228  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:35.876657  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52378.2us
W20260925 16:45:35.880862  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 88633.4us
I20260925 16:45:35.882068  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.845813  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.846479  9116 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:35.847047  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.883350  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:35.884245  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.885172  9049 raft_consensus.cc:2396] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 19 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260925 16:45:35.852946  9043 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:35.853760  8975 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 13: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:35.848260  9042 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:35.799769 15222 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:35.855381  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.846478 15001 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.856127 15567 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.858238 15474 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.864643 15480 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.881328 15552 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:35.865195 15477 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260925 16:45:35.839490 15356 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:35.830541 15347 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260925 16:45:35.866834 15340 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:35.867527  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.868537 15398 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:35.868795 15550 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260925 16:45:35.840921 15384 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.739s	user 0.005s	sys 0.005s
I20260925 16:45:35.836424 15467 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260925 16:45:35.933833  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.855085  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.882658  9041 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:35.892313  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.949728  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.893211  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.950835  9050 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:45:35.894284  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48540.7us
I20260925 16:45:35.894382  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.896226 15573 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:35.872275 15547 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.832893 15568 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.898234  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.892413 15042 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:35.900980 15454 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:35.899578  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:35.876204 15301 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:35.864830 15180 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:35.904903  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.964684  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:35.897567 15537 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260925 16:45:35.907897  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.965737  8966 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:35.907938  9120 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260925 16:45:35.908306  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.908816  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:35.909825  9121 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:35.918381  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.921768 15364 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:35.881356 15548 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:35.918154  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.886919 15521 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:35.931128  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 63665.8us
I20260925 16:45:35.898608 15400 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:35.945192  8968 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:35.945235  8974 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:35.956773  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.976143  9697 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:35.904023 15567 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:35.978857  9124 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:35.958941  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.979476  9050 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:35.979409  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.980446  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.980698  9049 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:35.980952  9050 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:35.981460  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.962303  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.907226  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:35.934710 15550 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:35.984006  8973 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:35.984107 15550 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:35.984200  9045 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:35.984508  8969 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:35.968850  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:35.985327  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:35.986042  9045 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:35.985337  9700 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:35.987581  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.970695 15540 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:35.971276 15546 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:35.934998 15474 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:35.922484 15545 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260925 16:45:35.931638 15398 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:35.976992  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:35.985733 15180 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:36.008970 15180 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:36.009377 15180 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:35.991873  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.012125  9042 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:36.013478 15547 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:35.958024 15573 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:35.959761 15042 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:36.013792 15487 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.014330 15042 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:36.016124 15521 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.021736 15477 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:36.023406 15477 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:36.001022  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:36.030194  9050 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:36.032086  8966 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:36.004400  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.005992  8971 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:36.006731 15529 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
W20260925 16:45:36.007282 15574 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:45:36.006827 15398 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.007444 15399 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:36.014096 15573 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:35.936448 15384 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.031558  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.053654  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:36.049314  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 149978us
W20260925 16:45:36.068095  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 184392us
I20260925 16:45:36.058220  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.037379 15477 consensus_queue.cc:1225] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 15.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:45:36.071574  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:36.072160  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:36.073182  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:36.077024  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.074744  9695 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:36.046991 15487 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.069802  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:36.000610 15546 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.092103  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:36.093360 15548 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:36.094732 15466 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:36.096287 15567 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.100521 15567 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.101148 15356 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.097405 15339 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.107275 15454 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.082852 15526 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:36.056918 15400 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260925 16:45:36.105885 15550 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.101917 15552 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.106164 15301 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.073673 15572 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:36.062572 15568 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.108168 15487 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:36.121449 15487 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:36.121846 15487 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:36.122059 15550 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.114382 15526 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.118762 15384 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:36.124063 15526 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.124715 15552 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.125415 15526 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:36.125586 15546 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.116334 15268 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.127246 15573 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.130911 15356 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.164738  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:35.973750  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.272812  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.274116  8969 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:36.179392  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:36.276517 15341 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:36.276993  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.277890  8966 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.278941 15350 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:36.181710  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.279945  9115 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:45:36.280182  8972 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:36.282410 15301 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:36.181757  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:36.181885  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:36.284886  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.183754  8974 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:36.184420  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:36.286194  8967 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:36.183360  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.287286  8970 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:36.275252  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 301382us
I20260925 16:45:36.186053  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.200500  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:36.201521  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 180409us
I20260925 16:45:36.203266  9047 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:36.203375  9044 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:36.204257  9048 raft_consensus.cc:2354] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17.
I20260925 16:45:36.204381  9046 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:45:36.206025  9118 raft_consensus.cc:2354] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19.
I20260925 16:45:36.207932  9049 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:45:36.209781  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 132691us
I20260925 16:45:36.214425  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:36.216236  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 146381us
I20260925 16:45:36.217253  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:36.131148 15339 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.135162 15487 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.298179 15339 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:36.298684  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 98584.4us
I20260925 16:45:36.129122 15573 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.299643  9665 leader_election.cc:398] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:36.300141  9665 leader_election.cc:401] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:45:36.299937  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.119190 15042 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.129104 15268 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:36.233597 15480 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:36.302446 15480 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:36.304128 15573 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15.
I20260925 16:45:36.304690  9117 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:36.251165 15521 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:36.305640  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.254904 15196 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:36.256547  9119 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:36.265955 15425 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:36.307309 15425 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.307449  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.304147 15480 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:36.308650  9700 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:36.308811 15425 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.301314  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.303570  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.312983  9696 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.313706  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.314159  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.314527  9046 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:36.251823  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3242) took 1110 ms. Trace:
I20260925 16:45:36.269505 15544 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:36.290633  8975 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:36.282647 15545 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260925 16:45:36.279349 15350 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:36.304333  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.315680  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.306536  9697 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.277019 15341 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.320462 15487 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.338483 15340 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:45:36.320750  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.339056 15340 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.341325  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.342268  9044 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:36.343034  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.318001 15544 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:36.343858 15350 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:36.344836 15544 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.332836  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.345721  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.346732 15544 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:36.336803  9694 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.336863 15341 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.337031  9014 leader_election.cc:398] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19.
I20260925 16:45:36.352501  9014 leader_election.cc:401] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
W20260925 16:45:36.344987  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 206508us
I20260925 16:45:36.319729 15042 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.315867  9124 rpcz_store.cc:276] 0925 16:45:35.141492 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:35.141615 (+   123us) service_pool.cc:227] Handling call
0925 16:45:36.251301 (+1109686us) spinlock_profiling.cc:243] Waited 787 ms on lock 0x7b540010c554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:36.251550 (+   249us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1809571072}
I20260925 16:45:36.347030  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.343336  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.311493 15425 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:36.346820  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.354780  9048 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:36.337086 15325 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:36.358716 15545 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:36.321440 15421 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:36.366016  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66375.8us
I20260925 16:45:36.367123 15339 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.372051  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.374508 15551 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:36.375043 15551 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:36.375460 15551 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.378135  9042 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.380010 15344 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:36.380450 15344 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.374542  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:36.360698  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.374887  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.381527 15344 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.380000  8972 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:36.386020  8969 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:36.387204  9697 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:36.381484  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:36.336828 15583 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.244s	user 0.004s	sys 0.000s
I20260925 16:45:36.393952  9696 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:36.394732 15398 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:36.395735 15474 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:36.403723 15474 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.405301  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.405196 15474 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.407131 15474 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.409327  9049 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:36.410426  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.411232  9049 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 19
I20260925 16:45:36.396747 15545 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:36.412003  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.412226 15545 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:36.412680 15545 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:36.413630 15545 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.414031 15340 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.415109 15545 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:36.415683 15340 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:36.418800 15347 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:36.422611  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:36.423724 15454 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:36.424183  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:36.419395 15347 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.424230 15042 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:36.424571 15454 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.425423 15042 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:36.426986 15344 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:36.426626 15042 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.450356  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:36.451684 15596 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
W20260925 16:45:36.454030  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111122us
I20260925 16:45:36.460047  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.460302 15454 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.461301 15462 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:36.461640 15454 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:36.461807  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 125101us
I20260925 16:45:36.462783 15467 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:36.463198 15467 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.464231 15467 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.465296 15467 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:36.461696 15356 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:36.473800 15356 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.462458 15454 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.405352  8970 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:36.479908  9694 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
W20260925 16:45:36.482164  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 127886us
I20260925 16:45:36.479055  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:36.478047  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.484004  9041 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:36.489790 15001 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:36.489790  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53118.9us
I20260925 16:45:36.492906  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.490010 15180 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.494439  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.499920 15454 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.500537 15347 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.501758  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.502666 15325 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:36.503230 15180 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.507346  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.507887  9665 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.510514 15001 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:36.513198 15546 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.513687 15001 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.515908 15341 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:36.515974 15578 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:36.516690 15578 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:36.517701 15578 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.528837  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:36.529462  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 124356us
I20260925 16:45:36.530157  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.530437  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:36.530814  9048 raft_consensus.cc:2362] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14. Re-sending same reply.
I20260925 16:45:36.532645  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.530395  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:36.536051  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43538us
I20260925 16:45:36.535218 15325 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:36.538596 15325 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:36.538940 15325 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:36.540244  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.543303  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.514896 15001 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.551029  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.552841  9047 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:36.554715  9048 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:36.555773  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:36.556789  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 65246.6us
I20260925 16:45:36.560230  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.521765 15480 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.562218  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:36.566387  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 108593us
I20260925 16:45:36.565369  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:36.568548  9694 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:36.570251  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:36.570658  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.570787  8966 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:36.574831  9115 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
W20260925 16:45:36.575134  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71545.1us
W20260925 16:45:36.576560  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46327.7us
I20260925 16:45:36.576622  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.578045  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.577651  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.584518  9049 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:36.583349 15338 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260925 16:45:36.572361  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.586059  9042 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:36.586782 15339 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19.
W20260925 16:45:36.592298  9045 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.606s	user 0.005s	sys 0.010s
I20260925 16:45:36.593196  9045 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 17 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260925 16:45:36.594403  9050 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260925 16:45:36.594762  9050 pending_rounds.cc:76] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 8
I20260925 16:45:36.594987  9050 pending_rounds.cc:97] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 15.9
I20260925 16:45:36.595290  9050 raft_consensus.cc:2894] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Aborting config change with OpId 15.9: Aborted: Op aborted by new leader
I20260925 16:45:36.587054 15548 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:36.595818  9050 raft_consensus.cc:2866] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:36.597980  9044 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:36.572821 15421 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:36.605612  9043 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260925 16:45:36.607594  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56455.1us
I20260925 16:45:36.610140 15584 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:36.611156 15584 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:36.612730 15350 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.612598 15584 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.613950  8967 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:36.561333 15356 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.619107  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:36.619823 15598 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260925 16:45:36.621215  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.621986 15433 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:36.622412 15487 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.622434 15433 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:36.623538 15433 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:36.622907  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.624786  9048 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:36.605136 15545 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:36.604271 15421 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:36.633299 15340 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:36.655573  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:36.583401 15551 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.662494  8967 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:36.649322 15421 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:36.651551 15341 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.670384  9115 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260925 16:45:36.672719  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 100409us
I20260925 16:45:36.673259  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:36.678035  9049 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:36.678807  9044 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:36.674546  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:36.682438  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104938us
W20260925 16:45:36.682912  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60097.1us
I20260925 16:45:36.679811  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:36.692395  9047 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:36.670835 15340 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.688664 15480 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.680176 15196 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260925 16:45:36.683980 15548 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:36.705586 15548 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:36.705976 15548 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:36.708164 15350 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.708544 14749 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:36.708976 14749 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.667193 15338 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260925 16:45:36.712215  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1205) took 1347 ms. Trace:
I20260925 16:45:36.712882  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.711436  8969 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:36.714692  9045 rpcz_store.cc:276] 0925 16:45:35.362434 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:36.686612 (+1324178us) service_pool.cc:227] Handling call
0925 16:45:36.710064 (+ 23452us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:36.724825 15599 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.140s	user 0.003s	sys 0.000s
I20260925 16:45:36.727978  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:36.734092  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.735563  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:36.737622  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 88217.5us
I20260925 16:45:36.737522 14749 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.737522 15338 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:36.738969  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.740036 15487 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:36.740433 15487 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:36.740475 15601 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260925 16:45:36.740907 15487 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:36.736166 15545 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.748538 15339 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:36.749039 15339 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:36.718369 15325 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.749768 15573 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:36.751490  9696 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:36.751930 15325 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.752765  9697 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:36.752705  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.753732  9695 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:36.755853  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 63017.3us
I20260925 16:45:36.756371  9702 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.15-16.15]
I20260925 16:45:36.756624  8940 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.759322  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.759959 15339 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.761615 15339 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:36.761225 15340 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.762813 15363 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:36.763602 15363 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:36.768882  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.737255  9042 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:36.782207  9115 raft_consensus.cc:2354] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16.
I20260925 16:45:36.782909  9046 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:36.796952  9702 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260925 16:45:36.801923  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:36.805769  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45201.9us
I20260925 16:45:36.801712  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:36.810702 14749 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:36.811877 15588 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:45:36.813189 15604 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
W20260925 16:45:36.816339  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 80878.7us
I20260925 16:45:36.785465 15467 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260925 16:45:36.836859  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.831089 15551 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.850740  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.844089 15480 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:36.852546  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.843645 15421 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.857661  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.858887  8939 leader_election.cc:398] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16.
I20260925 16:45:36.865478  8939 leader_election.cc:401] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260925 16:45:36.859997 15551 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:36.861546 15325 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:36.872854 15588 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:36.873539 15588 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:36.863761  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 127142us
I20260925 16:45:36.849298 15573 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:36.872453  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.872993 15325 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:36.876238  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 88562.3us
I20260925 16:45:36.876926 15325 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.878422  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:36.878438 15325 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:36.889297  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.889912  9695 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:36.890336  9697 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:36.891835  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.854193 15467 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:36.892561 15578 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:36.892688  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.893234 15578 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:36.894230  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.894371 15578 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.895200  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:36.869258 15421 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:36.900561  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.901410 15304 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:36.874714 15588 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.901117 15433 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.902799 15588 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:36.902534 15548 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.903834  9694 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:36.904136 15433 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.904798 15548 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.906540  9695 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:36.908399 15546 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16.
I20260925 16:45:36.907963  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
W20260925 16:45:36.911590  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68966us
I20260925 16:45:36.912796  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.912964  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.925523  9694 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: [12.11-12.11]
W20260925 16:45:36.908318  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91394.8us
I20260925 16:45:36.922544 15551 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.928320  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.914104  9699 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:36.935753  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.937299  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.937742 15487 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.942015 15487 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:36.938325 15350 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:36.945253  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:36.923564  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.951499 15546 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:36.951887 15551 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:36.954388  8972 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:36.956310  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 61208.1us
I20260925 16:45:36.957989  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.957080 15480 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:36.959161 15584 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:36.960116 15480 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:36.961647  8968 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 11. Current term is 12. Ops: []
I20260925 16:45:36.961306 15480 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:36.963377  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.965566  9702 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:36.966962  9699 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEARNER]: Advancing to term 17
I20260925 16:45:36.967398 15350 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:36.969915  9123 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:36.970877  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.982218  9698 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:36.973701  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.984182  9697 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:36.975606  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:36.975963  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.985575  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:36.986660 15521 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:36.987223 15521 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:36.971392  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.982776 15350 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:36.974684  9701 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:36.991128 15350 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:36.991742  8968 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:45:36.997942 15339 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:36.999949 15339 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:36.989517  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.000511 15551 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.000877  8972 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.001266 15551 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:36.876394  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:36.976233  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:36.999809 15467 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:37.005401  9699 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260925 16:45:37.007941 15551 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:37.000514 15339 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:37.015224  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:37.029675  9701 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:37.015743 15042 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.018429 15467 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:37.039144 15467 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:37.040496  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.019093 15613 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:37.041164 15613 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:37.041769 15613 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.041877  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.042682  9121 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:37.015975 15551 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.043955 15551 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.017922 15363 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.025302  9694 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:37.026542 15584 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:37.027601  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.028365  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.033058  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:37.033207  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.033663  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.033743  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.034443  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.037770 15449 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:37.043463  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.038370 15042 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:37.040105 15467 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.018419  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.044402  9116 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:37.021529  8972 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
W20260925 16:45:37.051520  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 175204us
I20260925 16:45:37.050547  9120 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:37.055763  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:37.058688  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 87419.5us
I20260925 16:45:37.060746  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.061321  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:37.064037 14749 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.071278  8967 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:37.068003 15344 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
W20260925 16:45:37.073621  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55331us
I20260925 16:45:37.071460 15584 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
W20260925 16:45:37.064580 15304 consensus_queue.cc:1159] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 16 status { last_received { term: 15 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:37.076644  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.076939 15301 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:37.078125 15301 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:37.078460 15301 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.075946 15584 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.079893 15344 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:37.071924 15363 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:37.080595 15584 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.080930 15344 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.081928 15584 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:37.082254 15551 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:37.070389 15467 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.085124 14749 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.073494 15339 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.087428 14749 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:37.087716 15544 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:37.088124 15339 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:37.079293 15301 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.091482 15301 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:37.053999 15588 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.094058  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:37.094944  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:37.105666  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45001.3us
I20260925 16:45:37.104241  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.108942  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.109313  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:37.109691 14749 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:37.110139 14749 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.110085  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.118399 14749 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:37.113018  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:45:37.114423  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 138300us
I20260925 16:45:37.115566  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:37.115419 15544 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260925 16:45:37.102586  9120 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:37.124281  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.125067  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:37.128603 15421 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:37.129505  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.130275  9119 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:37.130802  9119 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.131577  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.132268  9119 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.134090 15449 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:37.134267  9119 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:37.135236 15042 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:37.134753 15449 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.137375  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:37.136658 15449 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.137231 15042 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:37.138986 15042 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:37.139672 15042 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.139945 15545 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:37.141907 15545 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:37.142068 15480 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:37.142304 15545 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:37.143339 15042 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.148244 15487 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.148728 15325 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:37.141299 15621 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:37.149335 15325 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:37.150094 15363 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:37.140996 15619 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.008s
I20260925 16:45:37.149569 15621 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.150522 15363 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:37.123636 15350 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.100241 15613 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.150553 15325 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.156890  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.158056 15613 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:37.148285  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44217.7us
I20260925 16:45:37.140674  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.175314  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.174966  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.133737  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.156118 15363 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.180723  9119 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 17 index: 15. (term mismatch)
I20260925 16:45:37.200398  9119 pending_rounds.cc:76] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 14
I20260925 16:45:37.200989  9119 pending_rounds.cc:97] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 16.15
I20260925 16:45:37.201344  9119 raft_consensus.cc:2866] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:37.180305  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.116981 15588 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.174706 15467 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:37.160312 15350 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.175722 15196 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.158600 15480 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.199977 15613 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.217118  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.220045 14749 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.222133  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.204945 15521 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:37.223628  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.206100 15544 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:37.224272 14749 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:37.227738  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:37.228703  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53487.4us
I20260925 16:45:37.230095  9699 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:45:37.232174  9701 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260925 16:45:37.233086  9694 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:37.235199  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 94761.4us
W20260925 16:45:37.223419 15578 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 17 current term: 17 is higher.
I20260925 16:45:37.226312 15521 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:37.246253 15619 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:37.248696  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:37.235970 15613 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:37.262748  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45263.6us
I20260925 16:45:37.263664  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.252682 15521 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:37.239765 15421 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.024s
I20260925 16:45:37.281591 15304 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:37.288153 15620 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:37.288561 15620 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.289417 15620 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.290742 15620 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:37.291872 15588 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.245040 15544 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260925 16:45:37.295096  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:37.272562 15350 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:37.295797  9124 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:37.275051 15545 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.264125 15619 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.325469 15545 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.325706 15619 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.326469  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.327324 15487 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:37.327766 15487 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:37.328205  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.317766  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:37.328365 15487 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:37.329691  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.330152 15433 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:37.330520 15613 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:37.331067 15613 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:37.250969 15621 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.331947 15613 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.332540 15621 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:37.333160  9699 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260925 16:45:37.336266 15626 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260925 16:45:37.336675 15487 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.337764 15588 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:37.338158 15588 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:37.338493 15588 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:37.338800 15421 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:37.341816  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.345532  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.299767 15350 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:37.348033 15350 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:37.348272  8968 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:37.338960 15487 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.245563 15356 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260925 16:45:37.358760 15619 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:37.364223  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 117055us
W20260925 16:45:37.385344  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 130226us
I20260925 16:45:37.386173  8972 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:37.356217 15196 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:37.398932  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.399922  8969 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:37.399973  8968 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:37.398303  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.254591 15480 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.411923 15480 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:37.412195  8972 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:37.417043  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.417512  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.419083  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.420332  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.420994 15339 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:37.422459  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.422742  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.423319  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.424160  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:37.424853  9046 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:37.425238  9044 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:37.425747  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.427861  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.428577  9042 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:37.428898  9045 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:37.429332  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.430987  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.431815  9050 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:45:37.432596  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.433677  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.434790  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.435958  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.437140  9048 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:37.362011 15363 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.440026 15363 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:37.440595  9047 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:37.362346 15588 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.439440  8972 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:37.442687 15588 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.444089  8967 raft_consensus.cc:2354] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:37.445736  8940 leader_election.cc:398] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17.
I20260925 16:45:37.445415 15521 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.446044  8940 leader_election.cc:401] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:37.447928 15544 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:37.448537 15544 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17.
I20260925 16:45:37.454969  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.455765  9117 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:37.461100  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:37.465571  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49936.7us
I20260925 16:45:37.465694 15613 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:37.476404 15613 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:37.476764 15613 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:37.477635 15613 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.478809 15613 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.447592 15521 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.480307  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.480408  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:37.481137 15325 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:37.482283  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.482528  9696 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:37.488122 15391 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:37.489368 15363 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260925 16:45:37.490235  9702 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:37.493086  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:37.493805  9048 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:37.494763  9044 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:37.495507  9015 leader_election.cc:398] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:37.495836  9015 leader_election.cc:401] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260925 16:45:37.495751  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.496097  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.496789 15339 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.496946  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.471591 15350 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.501111 15350 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.499640  9042 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:37.501401  9702 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:37.504300  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:37.497035  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.473042  9049 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:37.512436  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:37.514014  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.515225  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.517266  9117 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:37.521953  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:37.523311  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.526278  9047 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260925 16:45:37.527448  9046 raft_consensus.cc:2354] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16.
I20260925 16:45:37.534802  9115 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:37.508718 15325 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:37.543208  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.522814 15433 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260925 16:45:37.531916 15356 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
W20260925 16:45:37.553530  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 419866us
I20260925 16:45:37.538519 15487 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260925 16:45:37.526046 15301 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260925 16:45:37.533614 15621 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260925 16:45:37.566359  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:37.547402 15325 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:37.578336  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.578588  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.579794  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.583088  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.584048 15350 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:37.586501  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.588478  9702 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:37.590231  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:37.590963 15487 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:37.591301  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.591464  9120 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 13. (term mismatch)
I20260925 16:45:37.629658  9120 pending_rounds.cc:76] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 12
I20260925 16:45:37.629895  9120 pending_rounds.cc:97] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260925 16:45:37.630144  9120 raft_consensus.cc:2866] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:37.592949  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.594338 15325 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:37.594805 15578 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.597163 15584 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:37.598485 15487 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.605219  9696 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:37.537724 15619 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260925 16:45:37.544623 15196 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260925 16:45:37.563447 15356 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:37.626179 15363 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:37.627372  9694 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
W20260925 16:45:37.629107  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 244636us
W20260925 16:45:37.636418  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50013.8us
W20260925 16:45:37.636946  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44070.4us
I20260925 16:45:37.648085  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.632140 15613 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:37.645232 15544 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:37.649884 15623 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260925 16:45:37.707625  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53586.2us
I20260925 16:45:37.672861 14749 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:37.712337  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:37.715749 15613 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:37.721741 15624 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:37.722137 15624 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:37.712497 15630 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260925 16:45:37.724761  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 81976.5us
I20260925 16:45:37.726449  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.727123  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:37.727921  8967 raft_consensus.cc:595] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.728236  8967 raft_consensus.cc:603] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:37.728397  9696 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:37.727519 15196 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:37.730397 15196 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.720674  8865 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 13, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 13 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:37.732488  8865 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 18, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 18 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:37.733732 15196 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:37.730429 15641 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260925 16:45:37.734745  8865 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 16, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:37.736960 15364 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:37.737017  8940 leader_election.cc:398] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16.
I20260925 16:45:37.738741  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.739670 15364 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:37.739253  8865 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 15, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:37.749528  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:37.774282 14749 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:37.791483 15433 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:37.794664  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:37.794945  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:37.795424  8967 raft_consensus.cc:595] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.795918  9041 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 11 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:45:37.795867  8967 raft_consensus.cc:603] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:37.650523 15578 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.093s
I20260925 16:45:37.800781  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:37.802302  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 90046.9us
I20260925 16:45:37.759083 15339 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:37.799425 15487 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:37.743302 15304 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260925 16:45:37.807878 14749 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.829053  9696 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:37.831578  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.831933  9120 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:45:37.833040  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:37.747061 15521 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.068s
I20260925 16:45:37.834692  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:37.840719  8967 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260925 16:45:37.841307  9120 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:37.824968 15325 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:37.856263  8972 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:37.856920  8972 raft_consensus.cc:595] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.856660 15325 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.858016 15628 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.071s
I20260925 16:45:37.858597 14749 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.858832 15613 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:37.859297  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:37.853932 15636 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:37.813382 15356 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.850965 15631 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:37.868098 15631 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.870018 15631 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:37.874241  9043 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:37.835820 15623 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:37.877071  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:37.877236  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:37.877815  8967 raft_consensus.cc:595] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.884697  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:37.885457  9042 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:37.886761  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.872159 15588 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:37.891614  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:37.889830 15638 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:45:37.913502  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:37.877940 15421 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260925 16:45:37.911069 15544 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:37.915865 15544 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:37.916110 14749 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:37.898093 15588 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.917135  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:37.918668 15578 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:37.923223 15649 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:37.923782 15649 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.916196 15544 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:37.932421  8868 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 342) took 41249 ms (client timeout 15000 ms). Trace:
I20260925 16:45:37.933192 15584 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:37.933950 15584 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.936854 15623 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:37.937305 15623 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:37.938272 15623 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:37.932332  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:37.935055 15584 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:37.984961 15480 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:37.842444  8865 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:37.998345  8865 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:38.008739 15480 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:38.012990 15480 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:38.029701 15645 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260925 16:45:37.933147  8868 rpcz_store.cc:269] 0925 16:44:56.683003 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:56.813339 (+130336us) service_pool.cc:227] Handling call
0925 16:45:37.932142 (+41118803us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:45:36.252326 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:45:36.253446 (+  1120us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:45:36.253510 (+    64us) write_op.cc:435] Acquired schema lock
0925 16:45:36.253549 (+    39us) tablet.cc:660] Decoding operations
0925 16:45:36.254213 (+   664us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:45:36.254321 (+   108us) write_op.cc:641] Partition lock acquired for write op
0925 16:45:36.254372 (+    51us) tablet.cc:683] Acquiring locks for 2 operations
0925 16:45:36.255000 (+   628us) tablet.cc:699] Row locks acquired
0925 16:45:36.255044 (+    44us) write_op.cc:260] PREPARE: finished
0925 16:45:36.255298 (+   254us) write_op.cc:270] Start()
0925 16:45:36.255472 (+   174us) write_op.cc:276] Timestamp: P: 1790354736255211 usec, L: 0
0925 16:45:36.255515 (+    43us) op_driver.cc:331] REPLICATION: starting
0925 16:45:36.574561 (+319046us) log.cc:842] Serialized 924 byte log entry
0925 16:45:36.807672 (+233111us) op_driver.cc:444] REPLICATION: finished
0925 16:45:36.991688 (+184016us) write_op.cc:301] APPLY: starting
0925 16:45:36.991804 (+   116us) tablet.cc:1365] starting BulkCheckPresence
0925 16:45:36.994249 (+  2445us) tablet.cc:1368] finished BulkCheckPresence
0925 16:45:36.994400 (+   151us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:45:36.997136 (+  2736us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:45:36.997469 (+   333us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=4,mrs_lookups=0
0925 16:45:36.997556 (+    87us) write_op.cc:312] APPLY: finished
0925 16:45:36.997900 (+   344us) log.cc:842] Serialized 33 byte log entry
0925 16:45:36.998102 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:36.998216 (+   114us) write_op.cc:454] Released schema lock
0925 16:45:36.998287 (+    71us) write_op.cc:341] FINISH: Updating metrics
0925 16:45:37.001701 (+  3414us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:37.001738 (+    37us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":964785,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":182237,"apply.run_cpu_time_us":6159,"apply.run_wall_time_us":10353,"cfile_cache_hit":10,"cfile_cache_hit_bytes":12475,"num_ops":2,"prepare.queue_time_us":292477,"prepare.run_cpu_time_us":28057,"prepare.run_wall_time_us":437115,"raft.queue_time_us":52051,"raft.run_cpu_time_us":17016,"raft.run_wall_time_us":44983,"replication_time_us":552043,"thread_start_us":437804,"threads_started":4,"wal-append.queue_time_us":139730,"wal-append.run_cpu_time_us":7987,"wal-append.run_wall_time_us":1283968}]]}
I20260925 16:45:38.036242 15545 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.037000 15545 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:38.048691 15643 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.104s	user 0.001s	sys 0.001s
I20260925 16:45:38.054432 15391 raft_consensus.cc:1050] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:45:38.064280 15546 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:38.064831 15546 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:38.065825 15546 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.111968 15304 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.120733 15546 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:38.121104 15624 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.098680 15196 raft_consensus.cc:979] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:38.122514 15624 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:38.122748 15196 raft_consensus.cc:1067] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
W20260925 16:45:38.141592  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 392127us
W20260925 16:45:38.142069  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 209832us
I20260925 16:45:37.952052  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:38.142915  8967 raft_consensus.cc:595] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:38.143352  8967 raft_consensus.cc:603] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:38.142925  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 256260us
I20260925 16:45:38.142349  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:38.152576  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.153115  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:38.156150  8970 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:38.164523 15660 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:38.174983  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:38.167385  8969 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:38.174835  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:38.166253  8973 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:38.189459  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:38.190073  9697 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:38.000012  8865 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 15, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 15 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.190645  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:38.191252  9042 raft_consensus.cc:2362] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15. Re-sending same reply.
I20260925 16:45:38.191522  8865 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 17, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 17 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.186892  8975 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:38.187371  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.194305 14749 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.194929 14749 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.194315  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.112540 15304 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:38.203248  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50205.9us
I20260925 16:45:38.195399  9120 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:38.210512  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:38.169360 15610 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:38.211019  9120 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:38.213791  9120 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:38.203758  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.204617 15650 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:38.193181  8865 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 16 to 18, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 18 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.206322  8970 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260925 16:45:38.182397 15623 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:38.187534 15627 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:38.236498 15627 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:38.221462 14749 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.199098 15467 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.206880 15620 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260925 16:45:38.229768 15548 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:38.230556  8865 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.231770 15588 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.220384 15578 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:38.233593 15610 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:38.234164 15650 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:38.236019 15636 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:38.210357 15660 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:38.243314  9702 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:45:38.242298  9043 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:38.243122 15467 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.252909 15649 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.244270 15548 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:38.248246  8865 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.261657 15548 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.261839  8865 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 12 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.249575 15304 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.243853 15666 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
W20260925 16:45:38.263957 15661 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.107s	user 0.005s	sys 0.002s
I20260925 16:45:38.264576 15666 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:38.264221 15610 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.264992 15666 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:38.265954 15666 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.250116 15545 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.237201 15664 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.004s
I20260925 16:45:38.267297 15650 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:38.267726 15655 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.110s	user 0.002s	sys 0.000s
I20260925 16:45:38.269965 15624 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:38.270694 15624 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:38.267612 15666 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:38.274941 15344 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.276613 15344 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.283576 14749 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.284248 14749 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.286338 14749 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.287855 15588 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.288472 15588 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.215051 15584 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260925 16:45:38.291052 15588 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.291160  9043 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260925 16:45:38.257516 15467 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.257141 15660 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.258334 15578 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:45:38.287914 15304 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.293561 15304 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.247044  9120 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:38.256434 15663 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260925 16:45:38.297212  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:38.298947  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.299226 15578 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:38.296108  9120 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:38.300006  9049 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:38.299893 15578 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:38.295529 15304 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.302779  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:38.303555  9049 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:45:38.306666  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 137103us
I20260925 16:45:38.309719  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:38.311496  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:38.312566  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:38.313261  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.314093  9702 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:38.316318  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.311484  9049 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:45:38.368705  9043 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
W20260925 16:45:38.370083  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71216.1us
I20260925 16:45:38.370965  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:38.381384  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 207720us
W20260925 16:45:38.384394  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 189856us
I20260925 16:45:38.392087  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.395411  9702 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:38.401502  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:38.403617  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85487.8us
I20260925 16:45:38.413102  9045 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:38.415987 15344 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.373970 15624 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.268847  8865 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 10 to 14, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 14 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:38.419929  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.419737  8865 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 12, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 12 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:38.421106  9700 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:38.394721 15544 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.423684 15544 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.424376  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.425329 15391 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 8, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:38.429278  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43526.8us
I20260925 16:45:38.411824  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.430732  9697 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:38.411721  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.391990 15631 raft_consensus.cc:979] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:38.431660  9698 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:38.385895 15578 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:38.388191 15196 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.421671  8865 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 19 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.392285 15364 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.394304 15584 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:38.450116  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.451251  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:38.447145  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45411.9us
I20260925 16:45:38.460382  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:38.461035  9044 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:38.461452  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.461755  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.462447  9124 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:38.456408 15487 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260925 16:45:38.464936 15671 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.465480 15671 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.467402 15671 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.459046 15674 raft_consensus.cc:1067] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:38.469537  8865 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 16, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:38.472529  8865 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 14, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 14 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:38.474151  8865 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 14, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 14 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:38.480438  8865 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 6 to 15. New cstate: current_term: 15 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:45:38.484229  9044 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:38.485308  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.499538  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.500509  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:38.501667  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 318221us
I20260925 16:45:38.503927  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.504551  9116 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:38.507217  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.501148  9124 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:45:38.508307  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 50769.8us
I20260925 16:45:38.508044  9118 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:38.482390  8865 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 19, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 19 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:38.492841 15545 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:38.515738  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.518057  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.518982 15339 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:38.519382 15339 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.519783 15339 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:38.509258 15674 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.015s
I20260925 16:45:38.459131 15364 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.526980 14749 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.458447 15578 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.524113 15684 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:38.532305 14749 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.536113 14749 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.458061 15196 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.507687 15624 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:38.533277  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.538172 15196 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.540396  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.541271  9118 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:38.542604  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.535367  8865 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:38.534104 15545 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:38.548866 15545 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.550115 15339 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.550601 15649 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:38.551106 15649 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.551767 15684 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.552181 15684 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:38.553016 15649 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.553364 15578 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.553768 15676 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:38.554203 15676 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:38.554559 15676 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:38.556308  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 167272us
I20260925 16:45:38.558073  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.558224 15627 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.559005  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:38.559168 15666 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:38.558519 15623 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:38.561614  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:38.562036  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:38.565068  9049 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:38.568284  9044 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:38.559513 15627 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:38.571828  9122 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:38.572396  9122 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:38.572790  9122 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:38.572228  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:38.576613  9045 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:38.579097  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.579875  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.580451  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:38.553536 15649 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:45:38.582599  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.627679  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.627997  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.628391  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:38.650810  8968 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:38.628620  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.629220  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.655481  8970 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:38.655643  8967 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:38.655468  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 260365us
I20260925 16:45:38.656921  8970 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260925 16:45:38.628391  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.657693  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.569379 15620 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:45:38.571975 15551 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:38.638386  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.579521  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:38.659667 15551 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:38.660065  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 80623.5us
I20260925 16:45:38.660202 15551 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:38.661227  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:38.662182 15467 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:38.662691 15467 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:38.663077 15467 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:38.666599 14749 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:38.667114 14749 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:38.667512 14749 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:38.575031 15584 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:38.674824  8972 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:45:38.678396  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.680943  8973 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:38.677491  9117 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:38.583396 15649 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:38.631840 15521 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.690249  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:38.742673  8966 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260925 16:45:38.744436  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 84522.2us
I20260925 16:45:38.545300  8865 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 17 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.692957 15679 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.693346 15584 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.679659 15350 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:38.637537 15196 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.635324 15674 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:38.635583 15364 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.705518  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:38.740628  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:38.705906  8971 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:38.765084  8973 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:45:38.744231 15620 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:38.743134  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.679309 15339 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.678342 15588 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.691039 14749 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.785079  9697 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:38.773974 15663 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260925 16:45:38.787004  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 86385.9us
I20260925 16:45:38.772643 15421 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.800230 14749 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.775516 15546 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:38.804775  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61719.8us
I20260925 16:45:38.805595  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.782184 15674 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:38.808604 14749 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:38.809242 14749 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.822909 14749 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:38.824360 15686 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:45:38.826483 15467 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:38.827246 15687 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:45:38.858378  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:38.799093 15196 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.807292 15545 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:38.802850 15610 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:38.833294  8865 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 8 to 9, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 9 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:38.806988 15421 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.766901 15521 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.814365 15674 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:38.836508 15620 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:38.840443  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 202170us
W20260925 16:45:38.873145  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 88645.8us
I20260925 16:45:38.875111  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.841977  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.843804  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:38.878211  9696 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:38.877130 15696 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:38.860291 15363 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:38.801806 15339 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:38.860244  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.885550  9116 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:38.860848  9700 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:38.782264 15350 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.867197  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:38.871392  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:38.891129  8975 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:38.799234 15588 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.821012  9122 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.880548  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:38.857724 15449 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260925 16:45:38.879364  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 189200us
I20260925 16:45:38.884939  9043 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260925 16:45:38.885849  8974 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:45:38.887907  9118 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260925 16:45:38.888224  9044 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260925 16:45:38.901625  9122 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:38.860069 15621 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.026s
I20260925 16:45:38.906075  9124 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
W20260925 16:45:38.901906  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62158us
I20260925 16:45:38.902814  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:38.902951  9045 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:45:38.903083  9119 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:38.895394  8973 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:38.850965 15546 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.851330 15684 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:38.776538 15679 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:38.909723  8966 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:38.865023 15650 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260925 16:45:38.909652  8971 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:38.912241  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:38.916898 15480 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:45:38.915508  9696 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:38.883279 15623 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.029s
I20260925 16:45:38.927423  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:38.874095 15610 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:39.020581  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 108492us
W20260925 16:45:39.021526  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 111576us
I20260925 16:45:38.911680 15339 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:38.902861 15548 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
W20260925 16:45:39.022315  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 113659us
I20260925 16:45:39.040118  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:39.042137  8966 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:39.048024  9697 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:38.899574 15696 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.145s
I20260925 16:45:39.059859  9116 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:39.044092 15631 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.080415 15631 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.082552 15631 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.085547 15701 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.107s
I20260925 16:45:39.086791 15678 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:39.088485 15487 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.089056 15678 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:39.089807 15709 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.200s
I20260925 16:45:39.089157 15487 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.091130 15588 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.089489 15678 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:39.092765 15679 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.093725 15521 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.094205 15704 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:39.094583 15704 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:39.094714 15350 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.052007 15673 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:39.100513 15673 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:39.100900 15673 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:39.106408  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 193657us
I20260925 16:45:39.108757  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:39.110716  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.113458 14749 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:39.113935 14749 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:39.114683 14749 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.146727  9697 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:39.095588 15704 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.161885 15704 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:39.133587 15676 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.563s	user 0.010s	sys 0.000s
I20260925 16:45:39.116520 15344 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.060992 15628 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260925 16:45:39.201853  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:39.210451  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.211072  8966 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:39.211194  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:39.212057  9047 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:45:39.213737  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 310976us
I20260925 16:45:39.155298 15545 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:45:39.219296  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 322815us
I20260925 16:45:39.214947  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:39.222219  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:39.222694  9042 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:39.224392  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.198967 15701 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:39.191318 15467 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.147121 15548 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260925 16:45:39.227381  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:39.227967  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.228905  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.227538  8975 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:45:39.212929 15631 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.230790  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:39.233204  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:39.218287 15421 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:38.976089  8865 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 15, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 15 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:39.222208 15196 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.213122 15344 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.202112 15676 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.240304 15706 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:39.250528 15688 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.206s
I20260925 16:45:39.252768 15356 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260925 16:45:39.259735  9699 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:39.259989  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:39.260972  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.261790  9694 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:39.262883  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.254648 15545 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.264187 15545 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.258965  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.266021 15545 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.275180 15676 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.247817 15467 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:39.241894 15631 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.283171 15631 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.190754 15339 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.234709 15546 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.237849 15701 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:39.257906 15196 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260925 16:45:39.258134 15551 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.597s	user 0.007s	sys 0.004s
I20260925 16:45:39.258230  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.235152 15703 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:39.315733 15551 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.316604 15701 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.317754 15551 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.244760 15684 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.319255 15546 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:39.285257 15344 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.286449  8865 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 17 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:39.321378 15650 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.321224  8865 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 7, term changed from 13 to 16, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to <none>, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 16 committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:45:39.294049  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:39.322034 15650 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.323438 15703 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:39.294593 15487 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.329020  8865 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 12, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 12 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:39.297849  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 120658us
I20260925 16:45:39.352774  8865 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:39.355149  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.356685  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.357089  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:39.357445  9115 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:39.298020  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:39.301301  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:39.358693  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60774.1us
I20260925 16:45:39.359347  9042 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
W20260925 16:45:39.303848  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59647.7us
I20260925 16:45:39.360031 15702 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:39.360412  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:39.361065  9049 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:39.362365 15356 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:39.362607  9042 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:39.362934 15356 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:39.363248  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.304494  9121 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:39.363926  9047 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:45:39.305001 15651 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:39.304116  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.330317  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.297259 15610 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.332399 15196 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:39.345206  9696 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:39.346580 15636 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:39.358192  9045 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260925 16:45:39.359433 15666 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:39.363395 15356 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:39.341866 15649 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.365500  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.358217  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:39.366047  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.367036  9119 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:39.364940  9117 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:39.373893  9116 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:45:39.374171  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.372310  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:39.384091  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 65101.6us
I20260925 16:45:39.492081  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:39.493196  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:39.494194  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:39.385859  9043 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:39.360426 15702 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:39.402915 15674 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.503s	user 0.003s	sys 0.005s
W20260925 16:45:39.489408  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83960.2us
I20260925 16:45:39.488659  9115 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:39.489492  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79387.1us
I20260925 16:45:39.496424  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:39.496563  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 130597us
W20260925 16:45:39.496831  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 124587us
I20260925 16:45:39.498898  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.500226  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.505966  9044 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:45:39.515643  8972 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:39.384495 15636 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:39.425447 15703 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:39.522336  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:39.508293  9665 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:39.516574  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.523051  8970 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:39.516832  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.523599  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:39.517354 14749 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.524212  8972 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:39.524433 14749 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.514647  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.523293  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:39.526217  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:39.526427  9045 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:45:39.528810  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.487497 15664 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.489221 15721 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.488564 15714 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.529505  8971 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 11.
I20260925 16:45:39.509076 15702 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:45:39.536899  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 496838us
I20260925 16:45:39.537870  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:39.520069 15649 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:39.540550  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.545046  8970 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
W20260925 16:45:39.542534  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.008s	sys 0.008s
I20260925 16:45:39.541332 14749 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:39.546168  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.008s	sys 0.008s
I20260925 16:45:39.553368  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.519598 15704 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.556612  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.557283  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:39.477825 15196 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.456766 15678 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.446339 15666 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:45:39.567617  9045 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:45:39.570693  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:39.570897  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:39.504873 15325 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260925 16:45:39.541417 15344 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:39.559820 15433 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.581703  9121 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:39.575332  8972 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:39.591814  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.592509  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:39.591879  9121 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:39.586185 14749 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:39.595618 14749 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:39.596071 14749 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:39.586712  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.550688 15487 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:45:39.541368 15684 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:39.530035 15548 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260925 16:45:39.552789 15701 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.598672  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:39.542168 15660 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260925 16:45:39.518230 15674 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.589965 15344 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:39.534386 15688 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260925 16:45:39.594414  9121 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.680656  9121 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:39.616480  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:39.597751 15726 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:39.620422  9694 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:39.572057 15704 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.582031 15650 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.681702  9699 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:39.616639  9698 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEARNER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
W20260925 16:45:39.618079 15627 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.040s	user 0.002s	sys 0.008s
W20260925 16:45:39.686012  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60158us
I20260925 16:45:39.539987 15664 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.622658 15720 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.068s
I20260925 16:45:39.614854 15636 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.598042 15584 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:39.720270  9044 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:39.624974 15709 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260925 16:45:39.692044 15695 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:39.614777 15716 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:39.693439  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.615404 15487 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:39.537046 15714 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.622982 15689 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:39.707871  8968 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:39.712376  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:39.716794  9043 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:45:39.685500 15339 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:39.677222 15684 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:39.696702 15673 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.595s	user 0.010s	sys 0.000s
I20260925 16:45:39.732316  9120 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:39.536688 15721 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.686789 15344 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:39.739931  9041 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:39.740564  9015 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:39.743188  9044 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260925 16:45:39.708849 15624 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.706560 15613 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.680097 15623 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260925 16:45:39.709942 15688 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.767071 14749 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.729089 15708 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:39.774947  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.681161 15701 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.615680 15433 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.757234 15487 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:39.822605  9121 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260925 16:45:39.825654  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85205.1us
I20260925 16:45:39.752619 15325 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:39.757813 15695 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:39.823719  9694 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:45:39.878389 15196 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.878897 15695 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.752907 15716 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:39.880893 15716 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:39.850207  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 277605us
I20260925 16:45:39.832608 15671 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:39.851364 14749 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.891007 14749 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.845224 15678 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.833400 15710 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260925 16:45:39.858202 15718 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:39.842144 15676 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:39.768563 15339 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:39.872229 15714 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.832836 15624 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.839534 15613 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.802644 15673 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.871192 15666 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:39.876734 15731 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
W20260925 16:45:39.877537 15733 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260925 16:45:39.870497 15325 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:39.854321  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:39.893229  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 294608us
I20260925 16:45:39.837919 15725 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:39.763639 15689 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:39.899511 14749 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.858520 15705 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:39.941927  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:39.849684 15688 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.897966 15722 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:39.955681  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54569.7us
I20260925 16:45:39.951107  9119 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:39.967996  8971 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:39.973235 15433 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.973734 15673 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.973912  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:39.945557 15666 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.029s
I20260925 16:45:39.974720  9695 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:39.973739 15722 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:39.975888 15674 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:39.976997 15722 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.977294 15729 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:39.952823 15684 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:39.978003 15739 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.226s	user 0.002s	sys 0.000s
I20260925 16:45:39.978507  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.979833 15704 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.951597 15689 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:39.911837 15671 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:39.976933  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:39.971226  9115 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:39.946247 15325 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:39.861331 15715 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.445s
I20260925 16:45:39.976833 15701 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:39.893774 15364 consensus_queue.cc:1159] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 16 status { last_received { term: 15 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:39.993850 14749 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:39.980263  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:39.912487 15548 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260925 16:45:39.997562  8967 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:45:40.001902  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.003490  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.004020  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:40.004848  9049 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:40.002712  9119 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:39.963531 15714 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:40.004225  9116 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:40.010111  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.015178  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:40.015789  8974 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:40.016294  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:40.010916  9115 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:39.943672 15339 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:40.027648  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:40.029495  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:40.030645  9049 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:40.030124  9701 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:39.950852 15676 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:39.981428 15623 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.054s
I20260925 16:45:39.933046 15718 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.040036  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:40.044064  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 202707us
I20260925 16:45:40.057533  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.061589  9049 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260925 16:45:40.020386 15714 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.036085 15664 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:40.067268  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:40.068892  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.069577  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:40.075383  9041 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260925 16:45:40.044713 15545 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:40.035823 15680 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:40.098426 15680 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.099097 15680 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:45:40.076540 15356 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.001s
I20260925 16:45:40.084479  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:40.061484 15304 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:40.103538 15664 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.021s
W20260925 16:45:40.082630 15732 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260925 16:45:40.108781  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.073262  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.035888 15752 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.119s
I20260925 16:45:40.111627 14749 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:40.068378 15720 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.037s
W20260925 16:45:40.114989  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 145902us
I20260925 16:45:40.112824  9115 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:40.113485  9046 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:40.068866 15704 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:40.118495  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:40.117406  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:40.117192 14749 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.113631  9116 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
W20260925 16:45:40.109151 15737 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.276s	user 0.001s	sys 0.000s
W20260925 16:45:40.109449 15751 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260925 16:45:40.119526  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:40.132369  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.156368  9122 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:40.120970  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:40.142256  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:40.107424 15545 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:40.106906 15721 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.110335 15304 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.072898 15710 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260925 16:45:40.086799 15301 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.053s
I20260925 16:45:40.162529  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.163579 14749 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.166796  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:40.163465  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:40.139542 15624 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:40.132335 15623 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:40.171677  8967 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:40.174196  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.069483 15671 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.177678  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:40.170812  9046 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:40.119633 15720 consensus_queue.cc:1225] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 15.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260925 16:45:40.176298  9047 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
W20260925 16:45:40.176463  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 158483us
I20260925 16:45:40.179586 15701 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader election won for term 12
I20260925 16:45:40.180218  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:40.194164  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:40.168502 15746 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:40.163686  9014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.195:32851 timed out after 1.626s (SENT) [suppressed 10 similar messages]
I20260925 16:45:40.199395  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.110870 15356 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.196775  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.198037  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:40.162231 15674 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:40.190831 15755 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
I20260925 16:45:40.170257 15304 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:40.132093 15704 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.114210 15745 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.263s
I20260925 16:45:40.180171 15721 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:40.215961  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:40.205103 15757 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:40.220252  9042 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:40.221037 15746 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:40.221277 15710 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:40.221555 15746 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.221896 15710 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.222077 15746 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:40.222448 15710 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:40.231762  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.232452  9122 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
W20260925 16:45:40.232872  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 362258us
I20260925 16:45:40.205658 15623 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:40.205251 15701 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:40.235424  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:40.211018 15729 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:40.179484 15647 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.201s
W20260925 16:45:40.244598 15753 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260925 16:45:40.226001 15301 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:40.220283 15757 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:40.217679 15688 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.241150 15623 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:40.253032  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:40.212342 15674 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:40.278766  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 115096us
I20260925 16:45:40.279407  9695 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:45:40.281737  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.281841  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.282147  9700 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260925 16:45:40.278738  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71686.8us
I20260925 16:45:40.283401  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.251435 15301 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.288694  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:40.288844  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:40.286862  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:40.290355  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:40.262459 15676 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.272327 15714 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.299855  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.300482  9124 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:40.300695  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:40.264514 15756 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.078s
I20260925 16:45:40.301846  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:40.301452  9701 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 13: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:40.301416  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:40.295923 15754 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260925 16:45:40.290163 15301 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:40.308127 15747 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:40.310130 15762 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.104s	user 0.000s	sys 0.001s
W20260925 16:45:40.296831  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61524.1us
W20260925 16:45:40.298946 15649 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.748s	user 0.010s	sys 0.001s
I20260925 16:45:40.242352 15545 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.331189  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:40.331744  9122 raft_consensus.cc:1203] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Deduplicated request from leader. Original: 11.7->[13.8-16.10]   Dedup: 13.8->[14.9-16.10]
I20260925 16:45:40.332195  9122 pending_rounds.cc:76] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 8
I20260925 16:45:40.332412  9122 pending_rounds.cc:97] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 15.9
I20260925 16:45:40.332624  9122 raft_consensus.cc:2866] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:40.295616 15748 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:40.304242 15740 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.270s	user 0.000s	sys 0.001s
W20260925 16:45:40.320734 15702 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.768s	user 0.008s	sys 0.003s
I20260925 16:45:40.349049  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:40.321749 15703 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:40.321682  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:40.306365 15714 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:40.323980 15776 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:40.358295  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:40.324302 15773 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260925 16:45:40.328368  9041 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260925 16:45:40.316666  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:40.337565  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:40.365844  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:40.310905 15718 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:40.378841  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:40.343681 15729 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:40.330945 15688 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:40.417470  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 80006.1us
I20260925 16:45:40.381853  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:40.340116 15748 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.457402  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:40.464823  8966 raft_consensus.cc:595] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:40.465297  8966 raft_consensus.cc:603] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:40.456045  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 84509.3us
I20260925 16:45:40.360482 15714 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.370728 15671 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:40.469710  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 119921us
I20260925 16:45:40.359550 15703 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:40.372802 15776 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.475565  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:40.302683 15701 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.371730 15702 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.506225 15768 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:40.506913 15760 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.109s	user 0.001s	sys 0.000s
I20260925 16:45:40.311267 15623 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.378230 15356 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.475904 15714 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:40.348601 15551 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.130s
I20260925 16:45:40.513844  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:40.536109  8966 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:40.486119  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:40.513170  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 206228us
I20260925 16:45:40.469774 15704 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:40.541775  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 66365.6us
I20260925 16:45:40.542759  8974 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:40.472747 15718 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:40.546368  8969 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:45:40.476478 15748 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:40.492497 15776 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:40.349201 15747 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.570883  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.521183 15768 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.582276 15768 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:40.587390  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 446518us
I20260925 16:45:40.592830 15775 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:40.593395 15775 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:40.594218 15775 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:40.596380 15770 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.119s	user 0.000s	sys 0.000s
I20260925 16:45:40.599853 15670 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
W20260925 16:45:40.602458 15487 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.740s	user 0.008s	sys 0.000s
I20260925 16:45:40.604732 15703 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.608058 15674 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:40.608574 15769 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.248s	user 0.001s	sys 0.000s
I20260925 16:45:40.555166 15676 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:40.613765 15304 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.615334  9050 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:40.615846 15747 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:40.616303 15704 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:40.602852 15487 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.472613 15688 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.316886 15757 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.608006 15717 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:40.560169 15726 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:40.563791 15745 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:40.629005 15620 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:40.629547  9123 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
W20260925 16:45:40.630007 15774 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.305s	user 0.000s	sys 0.001s
I20260925 16:45:40.634301  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:40.647670  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 281874us
W20260925 16:45:40.637128  8969 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2335) took 1936 ms (client timeout 2024 ms). Trace:
W20260925 16:45:40.688102  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 380239us
W20260925 16:45:40.626613 15689 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.628s	user 0.009s	sys 0.000s
I20260925 16:45:40.712348 15689 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:40.713078  9120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3686) took 2263 ms (client timeout 1626 ms). Trace:
I20260925 16:45:40.713224 15703 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:40.713469  9120 rpcz_store.cc:269] 0925 16:45:38.449688 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:38.449833 (+   145us) service_pool.cc:227] Handling call
0925 16:45:40.712865 (+2263032us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b5400010254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:40.712960 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2912655616}
I20260925 16:45:40.714375 15689 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:40.682240  8969 rpcz_store.cc:269] 0925 16:45:38.700984 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:38.701138 (+   154us) service_pool.cc:227] Handling call
0925 16:45:40.636967 (+1935829us) spinlock_profiling.cc:243] Waited 1.58 s on lock 0x7b54001c4654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:40.637051 (+    84us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3626094976}
I20260925 16:45:40.707862  9697 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:40.653344  8966 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:45:40.719189  8975 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:40.717106  9045 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:40.647420 15726 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.710937 15620 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.561272 15718 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.720409  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:40.624018 15793 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:40.641019 15745 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:40.756268  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:40.759686  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:40.727247  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:40.760572  9120 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:40.762892  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:40.716149 15760 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260925 16:45:40.727352  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:40.727475  9701 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEARNER]: Advancing to term 18
I20260925 16:45:40.798089  9044 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:40.622334 15704 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:40.714985 15304 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:40.798666  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:40.820562  8969 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [17.12-19.13]
W20260925 16:45:40.821580  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106173us
I20260925 16:45:40.822057  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2343) took 1108 ms. Trace:
I20260925 16:45:40.822412  8969 rpcz_store.cc:276] 0925 16:45:39.713501 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.816180 (+1102679us) service_pool.cc:227] Handling call
0925 16:45:40.820246 (+  4066us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:40.821809 (+  1563us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:40.822006 (+   197us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:40.835983  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 247676us
W20260925 16:45:40.840122  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111363us
I20260925 16:45:40.845290  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:40.846022  9116 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:40.847622  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1962) took 1262 ms. Trace:
I20260925 16:45:40.848132  9702 rpcz_store.cc:276] 0925 16:45:39.572399 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.572713 (+   314us) service_pool.cc:227] Handling call
0925 16:45:40.798504 (+1225791us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e6c1b0 00007f71a0e6ba94 00007f719a553c04 00007f719a553b92
0925 16:45:40.834490 (+ 35986us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2475776}
I20260925 16:45:40.726778 15783 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:40.896039  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133746us
I20260925 16:45:40.765275 15745 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:45:40.926503  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 199316us
I20260925 16:45:40.907070  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:40.971319  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 311323us
I20260925 16:45:40.982044  9116 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
W20260925 16:45:40.886543 15680 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.787s	user 0.003s	sys 0.008s
I20260925 16:45:40.992516  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:40.988137  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 164500us
W20260925 16:45:40.897246 15325 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.883s	user 0.010s	sys 0.001s
I20260925 16:45:40.884889 15671 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:45:41.005312  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.017504  9124 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:41.017390  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:41.020442  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 113492us
I20260925 16:45:41.026259  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:41.028831  9124 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260925 16:45:40.638988 15729 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.991762 15747 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:41.107460  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59562.9us
I20260925 16:45:41.107931  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.109957  9120 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:41.110035  8969 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:40.998399 15702 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.119158  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2344) took 1391 ms. Trace:
I20260925 16:45:41.119773  8969 rpcz_store.cc:276] 0925 16:45:39.728133 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.838996 (+1110863us) service_pool.cc:227] Handling call
0925 16:45:40.908615 (+ 69619us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.118620 (+210005us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.119086 (+   466us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:41.104612 15710 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.882s	user 0.011s	sys 0.000s
I20260925 16:45:41.044109 15684 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:41.109251 15671 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:41.043150 15765 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:41.151825  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 136733us
I20260925 16:45:41.022079 15325 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.020329 15680 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.144076 15613 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.138188 15684 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:41.127543 15301 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.802s	user 0.017s	sys 0.002s
I20260925 16:45:41.108703 15714 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.122221 15747 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:41.294687 15344 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.400s	user 0.012s	sys 0.000s
W20260925 16:45:41.321215  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 168464us
W20260925 16:45:41.113088 15795 consensus_queue.cc:1159] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8dc3391062084f45a6ba62d28d340722" responder_term: 15 status { last_received { term: 13 index: 8 } last_committed_idx: 8 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: [14.9-14.9]" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:41.297844 15799 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:41.328053  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260925 16:45:41.299163 15688 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.144433 15710 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.304342 15684 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:40.979382 15783 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.301738 15620 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.295889 15801 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.338783 15779 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:41.355036 15779 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:41.354871 15801 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.339187 15782 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.355862 15782 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.357013 15801 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.331164 15487 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.357774 15782 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.323818 15344 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.359014 15782 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.359436 15344 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.353798 15814 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260925 16:45:41.360126 15811 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.362664 15802 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.362537 15811 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.362200 15712 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Committing config change with OpId 17.10: config changed from index 7 to 10, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:41.363227 15802 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.364774 15811 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.365365 15802 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.365456 15196 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:41.366093 15196 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.367224 15325 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.367811 15325 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.368315 15325 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:40.765429 15793 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.308696 15803 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:41.352654 15792 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.512s	user 0.000s	sys 0.001s
I20260925 16:45:41.330448 15785 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.352783 15680 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:41.353675 15784 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.345s	user 0.000s	sys 0.001s
I20260925 16:45:41.353758  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2340) took 1640 ms. Trace:
I20260925 16:45:41.355405 15779 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:41.360695 15711 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.339905 15822 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.305670 15790 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.350988 15809 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.337s
I20260925 16:45:41.329661 15718 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.264307 15765 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.334031 15704 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:41.394285  9701 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.000s
W20260925 16:45:41.383235  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 356867us
I20260925 16:45:41.333271 15356 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.392436  8970 rpcz_store.cc:276] 0925 16:45:39.712913 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.713026 (+   113us) service_pool.cc:227] Handling call
0925 16:45:39.738454 (+ 25428us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:39.860027 (+121573us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:39.860071 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:39.860580 (+   509us) log.cc:842] Serialized 26 byte log entry
0925 16:45:40.083105 (+222525us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:40.135843 (+ 52738us) log.cc:842] Serialized 14 byte log entry
0925 16:45:40.136111 (+   268us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.340338 (+1204227us) spinlock_profiling.cc:243] Waited 11.9 ms on lock 0x7b18002ccb60. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:41.352580 (+ 12242us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b18002ccb60. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9
0925 16:45:41.353397 (+   817us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b540020ec54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:41.353450 (+    53us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:41.353494 (+    44us) raft_consensus.cc:1671] finished
0925 16:45:41.353514 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.353689 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":49918,"prepare.queue_time_us":50106,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":1209,"raft.queue_time_us":17875,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":87,"spinlock_wait_cycles":327790848,"thread_start_us":213837,"threads_started":1,"wal-append.queue_time_us":309435}
W20260925 16:45:41.409498  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.006s	sys 0.004s
I20260925 16:45:41.308064 15301 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.370165 15304 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.422307  9701 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:41.395969 15671 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:41.382232 15802 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:41.435060  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.006s	sys 0.004s
W20260925 16:45:41.437503  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 818321us
I20260925 16:45:41.436388  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2345) took 1680 ms. Trace:
I20260925 16:45:41.438835  8970 rpcz_store.cc:276] 0925 16:45:39.756077 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.433320 (+1677243us) service_pool.cc:227] Handling call
0925 16:45:41.435911 (+  2591us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.436068 (+   157us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.436093 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.436140 (+    47us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:41.436177 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.436225 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.436338 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:41.435091  8974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.552s	user 0.010s	sys 0.010s
I20260925 16:45:41.448093  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2346) took 1686 ms. Trace:
W20260925 16:45:41.435299 15339 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.396s	user 0.004s	sys 0.008s
I20260925 16:45:41.448500  8970 rpcz_store.cc:276] 0925 16:45:39.761723 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.440085 (+1678362us) service_pool.cc:227] Handling call
0925 16:45:41.444521 (+  4436us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.447797 (+  3276us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.447824 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.447863 (+    39us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:41.447890 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.447947 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.448042 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2829}
I20260925 16:45:41.452021  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:41.446511  8974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.010s	sys 0.011s
I20260925 16:45:41.450472  9118 raft_consensus.cc:2354] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16.
I20260925 16:45:41.454439  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:41.335336 15799 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.394593 15782 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.456557  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:41.460954  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:41.434774 15718 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.447950 15487 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.475898 15718 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.476086 15487 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.476574  9044 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:41.477840 15718 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.478000 15487 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.479539 15782 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.480436  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.484263  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2331) took 2842 ms. Trace:
I20260925 16:45:41.484611  8968 rpcz_store.cc:276] 0925 16:45:38.641946 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:38.651376 (+  9430us) service_pool.cc:227] Handling call
0925 16:45:38.651648 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:39.763556 (+1111908us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.484048 (+1720492us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b54001c4b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:41.484191 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2428694400}
I20260925 16:45:41.485602  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:41.486272  8968 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 12: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:41.487439  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.488379  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2361) took 1432 ms. Trace:
I20260925 16:45:41.488704  9042 rpcz_store.cc:276] 0925 16:45:40.056084 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.056580 (+   496us) service_pool.cc:227] Handling call
0925 16:45:40.056827 (+   247us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:40.220748 (+163921us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.488182 (+1267434us) spinlock_profiling.cc:243] Waited 163 ms on lock 0x7b54002a3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:41.488332 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":375445888}
I20260925 16:45:41.489216  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.489310  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.490828  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.491472  9117 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:41.495589 15820 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:41.486991  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:41.503675  9042 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260925 16:45:41.504652 15834 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:41.507218 15700 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:45:41.461302 15801 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.508339 15801 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.509042 15782 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.509645 15782 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.456380 15802 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.511528  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2339) took 1798 ms. Trace:
I20260925 16:45:41.511895  8971 rpcz_store.cc:276] 0925 16:45:39.712617 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.712817 (+   200us) service_pool.cc:227] Handling call
0925 16:45:39.752234 (+ 39417us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:39.968438 (+216204us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.511241 (+1542803us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b54003e7e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:41.511459 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":495807872}
I20260925 16:45:41.513000  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:41.466998 15808 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.514078 15808 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:41.526422  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.005s	sys 0.007s
W20260925 16:45:41.526857  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.005s	sys 0.007s
W20260925 16:45:41.527151  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 643278us
I20260925 16:45:41.498832  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:41.530911  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.532829  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.533548  9124 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 9.
I20260925 16:45:41.463553  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.451983 15196 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.432950 15356 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.460614 15339 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.465588 15301 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.466012 15747 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.412083 15803 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.466601 15813 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.418684 15822 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.466150 15671 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.467092 15800 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.450754 15304 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.468253 15793 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.468596 15811 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:45:41.470265 15783 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.471832  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:41.472271 15710 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.472448 15715 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.472829  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.473620  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1258) took 1296 ms. Trace:
I20260925 16:45:41.474030 15829 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.474083 15765 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.433270 15711 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.474747 15325 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.513576  8971 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:41.463376  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:41.554566  9116 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:41.560647  9043 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260925 16:45:41.419917 15785 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.544206 15722 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:41.575187  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:41.572157  9047 rpcz_store.cc:276] 0925 16:45:40.176972 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.204396 (+ 27424us) service_pool.cc:227] Handling call
0925 16:45:40.217677 (+ 13281us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:40.218021 (+   344us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:40.218046 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:40.225998 (+  7952us) log.cc:842] Serialized 26 byte log entry
0925 16:45:40.536543 (+310545us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:40.536595 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:40.536683 (+    88us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:41.473390 (+936707us) raft_consensus.cc:1671] finished
0925 16:45:41.473410 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.473550 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":16203,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":1602,"thread_start_us":282429,"threads_started":1,"wal-append.queue_time_us":515558}
I20260925 16:45:41.419625 15790 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.543092 15628 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.568132 15700 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:41.560585 15809 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:41.568965 15714 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.594153  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:45:41.601759  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.004s	sys 0.022s
W20260925 16:45:41.602068  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.567s	user 0.004s	sys 0.022s
I20260925 16:45:41.579348 15708 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.577059 15793 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.604503  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:41.605166  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:41.599972 15745 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.570s	user 0.008s	sys 0.002s
W20260925 16:45:41.606765  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 143506us
I20260925 16:45:41.588176 15722 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:41.606769  8971 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
W20260925 16:45:41.602653  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 567403us
I20260925 16:45:41.593362 15835 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:41.629667  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:41.644331  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.605257 15799 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.646456  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:41.650518  9694 raft_consensus.cc:2354] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:41.647910  9701 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260925 16:45:41.605096 15827 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:41.653906  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.620545 15714 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:41.605690 15808 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.653271  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.654520  9693 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:41.666026  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.623860 15801 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.594872 15829 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.669391  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:41.672207  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.585893 15715 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.679414  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:41.680289  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2341) took 1967 ms. Trace:
I20260925 16:45:41.672282  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.622510 15711 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.577631 15813 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.663093 15350 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:41.600137 15809 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.667766 15710 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:41.676369  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2342) took 1963 ms. Trace:
I20260925 16:45:41.609611 15793 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.625224 15745 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.672851  8971 raft_consensus.cc:2362] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23. Re-sending same reply.
I20260925 16:45:41.597110 15700 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.680632  8974 rpcz_store.cc:276] 0925 16:45:39.713186 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.710916 (+997730us) service_pool.cc:227] Handling call
0925 16:45:40.711269 (+   353us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:40.727811 (+ 16542us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:40.727839 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:40.762180 (+ 34341us) log.cc:842] Serialized 26 byte log entry
0925 16:45:41.453099 (+690919us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:41.453136 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.453201 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:41.680111 (+226910us) raft_consensus.cc:1671] finished
0925 16:45:41.680131 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.680239 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39705,"raft.queue_time_us":16113,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":39701,"thread_start_us":569729,"threads_started":1,"wal-append.queue_time_us":785772}
I20260925 16:45:41.585290 15800 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.686909  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.771741  9116 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:41.757874  8966 rpcz_store.cc:276] 0925 16:45:39.713352 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.719745 (+1006393us) service_pool.cc:227] Handling call
0925 16:45:40.720377 (+   632us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:40.728149 (+  7772us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:40.728201 (+    52us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:40.728758 (+   557us) log.cc:842] Serialized 26 byte log entry
0925 16:45:40.893979 (+165221us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:40.894686 (+   707us) log.cc:842] Serialized 14 byte log entry
0925 16:45:41.033794 (+139108us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.033894 (+   100us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:41.676164 (+642270us) raft_consensus.cc:1671] finished
0925 16:45:41.676185 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.676313 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7386,"prepare.queue_time_us":208,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":493273,"raft.run_cpu_time_us":363,"raft.run_wall_time_us":56323,"thread_start_us":209952,"threads_started":2,"wal-append.queue_time_us":814441}
W20260925 16:45:41.759473  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 190569us
I20260925 16:45:41.662806 15714 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:41.595817 15628 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.714476  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.675745 15802 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.715546  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:41.787330  9701 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:41.668062 15702 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260925 16:45:41.662447 15827 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:41.753435  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 143885us
I20260925 16:45:41.759363  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.763540  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.776086  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.778015  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3069) took 1906 ms. Trace:
I20260925 16:45:41.783206  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.776494  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:41.620858 15708 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.800374  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3071) took 1928 ms. Trace:
I20260925 16:45:41.800809  8966 rpcz_store.cc:276] 0925 16:45:39.872125 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.780616 (+1908491us) service_pool.cc:227] Handling call
0925 16:45:41.799904 (+ 19288us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.800069 (+   165us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.800093 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.800131 (+    38us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:45:41.800158 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.800211 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.800321 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:41.795516  8974 rpcz_store.cc:276] 0925 16:45:39.871513 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.777318 (+1905805us) service_pool.cc:227] Handling call
0925 16:45:41.777583 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.777745 (+   162us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.777767 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.777804 (+    37us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:41.777834 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.777879 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.777963 (+    84us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:41.780947 15651 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.456s	user 0.007s	sys 0.019s
I20260925 16:45:41.757614 15824 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.782119 15714 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:41.769407 15782 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.645120 15835 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.793701  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3328) took 3229 ms. Trace:
I20260925 16:45:41.818284  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.764354 15339 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.800379  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:41.780108 15746 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.557s	user 0.008s	sys 0.004s
I20260925 16:45:41.794611  9117 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:41.794303  9698 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:41.806250  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:41.806804  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:41.830871  8971 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:41.808583  8968 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:41.795245  9694 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:41.812594  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:41.799633  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.817567  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.821395  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.787245 15815 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:41.802670 15827 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:41.673329 15722 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.755784 15350 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.769304 15710 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:41.860353  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54184.3us
I20260925 16:45:41.818549  9123 rpcz_store.cc:276] 0925 16:45:38.555960 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:38.559944 (+  3984us) service_pool.cc:227] Handling call
0925 16:45:38.573572 (+ 13628us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:40.706579 (+2133007us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.784917 (+1078338us) spinlock_profiling.cc:243] Waited 2.06 s on lock 0x7b54001eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:41.785053 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4727607168}
I20260925 16:45:41.820540  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3073) took 1947 ms. Trace:
I20260925 16:45:41.861189  8966 rpcz_store.cc:276] 0925 16:45:39.872648 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.802556 (+1929908us) service_pool.cc:227] Handling call
0925 16:45:41.819936 (+ 17380us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.820138 (+   202us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.820178 (+    40us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.820228 (+    50us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:41.820269 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.820337 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.820477 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:41.808166 15651 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.483s	user 0.007s	sys 0.019s
I20260925 16:45:41.862236 14749 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:41.804584 15356 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.865149  9045 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260925 16:45:41.793268 15702 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.822660 15782 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:41.823630  8941 leader_election.cc:398] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:41.878394  8941 leader_election.cc:401] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
W20260925 16:45:41.844043  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61143.5us
I20260925 16:45:41.852630  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.879179  9116 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:41.847910 15803 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.824928 15822 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:41.805365 15776 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.208s	user 0.011s	sys 0.000s
I20260925 16:45:41.863657  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:41.823477 15610 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.800925 15304 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.805190 15802 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260925 16:45:41.869078  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:41.846491  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.879989  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.792102 15779 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.859097  9701 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:41.880973  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.896306  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.896934  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.866314 15711 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:41.897533  9116 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:41.901342  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:41.901921  9116 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:41.891523 15610 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.905366 15610 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.891460 15776 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.896364  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:41.898989  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.881042 15702 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:41.879383 15790 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.883796 15841 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:41.914378 15776 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:41.914659 15836 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260925 16:45:41.847784 15746 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.922363  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:41.923826 15350 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.916057  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.844831 15824 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.944535  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.945073 15636 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:41.946183  9117 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260925 16:45:41.946271 15824 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.925158 15700 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.947681  9120 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 12
I20260925 16:45:41.929380  9116 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:41.896978 15782 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.922263 15841 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.956061 15841 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:41.957101 15817 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.662s	user 0.003s	sys 0.000s
W20260925 16:45:41.931151  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3058) took 2432 ms (client timeout 1805 ms). Trace:
W20260925 16:45:41.958115  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 428039us
W20260925 16:45:41.958038  8975 rpcz_store.cc:269] 0925 16:45:39.498508 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.498663 (+   155us) service_pool.cc:227] Handling call
0925 16:45:41.930913 (+2432250us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b54003e8d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:41.931050 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2759247232}
I20260925 16:45:41.958655 15793 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.959821  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3076) took 1756 ms. Trace:
I20260925 16:45:41.889945 15855 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:41.960266  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.960170  8975 rpcz_store.cc:276] 0925 16:45:40.203898 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.959027 (+1755129us) service_pool.cc:227] Handling call
0925 16:45:41.959303 (+   276us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.959500 (+   197us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.959522 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.959558 (+    36us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:41.959603 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.959650 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:41.959769 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:41.960820 15855 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:41.963164 15835 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.942133 15715 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:41.965023 15628 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.965849 15620 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:41.966251 15620 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:41.931380  8970 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:41.934054 15721 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:41.934185 15829 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.983412  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.938908  8971 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:41.943338  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:41.954290 15782 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.957662 15813 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.972065  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.936087 15708 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.975814 15721 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:41.975714  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:41.976043  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.960036 15745 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.963485 15855 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.977377 15779 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:41.978127 15809 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:41.967060 15620 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:41.980561  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 84269.4us
I20260925 16:45:41.986254  9123 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:41.984213  9702 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
W20260925 16:45:42.015065 15778 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.695s	user 0.000s	sys 0.005s
I20260925 16:45:42.015429 15790 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.015981 15790 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:41.989277  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.019376  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:42.019815  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:41.991022  8971 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:41.987627 15631 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15.
I20260925 16:45:41.992519 15800 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.030396  9693 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:45:42.030400  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:41.992858  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:41.994202  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:42.032447  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1255) took 1869 ms. Trace:
I20260925 16:45:41.996480  9700 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:41.997141  9045 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:41.974607 15715 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:41.998528 15822 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260925 16:45:42.001348 15748 consensus_meta.cc:287] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.416s	user 0.005s	sys 0.007s
I20260925 16:45:42.002915 15746 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.003031  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1985) took 1097 ms. Trace:
I20260925 16:45:41.987840 15548 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:42.020681  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.086393  9701 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:41.993770 15803 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:42.069132  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.033871  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:42.036334  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 1960) took 2472 ms (client timeout 1711 ms). Trace:
I20260925 16:45:42.021286  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3081) took 1603 ms. Trace:
I20260925 16:45:42.011432 15749 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
W20260925 16:45:42.099354  9697 rpcz_store.cc:269] 0925 16:45:39.552098 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.553159 (+  1061us) service_pool.cc:227] Handling call
0925 16:45:42.024093 (+2470934us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400537fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.024268 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2544693504}
I20260925 16:45:42.017920 15790 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:42.081369  9698 rpcz_store.cc:276] 0925 16:45:40.906007 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.906183 (+   176us) service_pool.cc:227] Handling call
0925 16:45:40.906483 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.845261 (+938778us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.002808 (+157547us) spinlock_profiling.cc:243] Waited 884 ms on lock 0x7b540071d4d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:42.002955 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2033324928}
I20260925 16:45:42.095201  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:42.096045  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.099645  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.100354  8971 rpcz_store.cc:276] 0925 16:45:40.417848 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.990097 (+1572249us) service_pool.cc:227] Handling call
0925 16:45:41.990651 (+   554us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.021046 (+ 30395us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.021224 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:42.098865  9042 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:42.125427  9048 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
I20260925 16:45:42.132360  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.133019  9042 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:42.135792  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.136492  9045 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 16
I20260925 16:45:42.073887 15433 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:45:42.007572 15702 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:42.148546  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53435.2us
I20260925 16:45:42.156576 15325 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:42.156999 15325 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.157374 15325 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:42.159899 15339 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:42.160951  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.161629 15339 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:42.161978  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.147244 15610 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:42.162618 15728 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.164872  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.171713  9120 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:45:42.172640  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.128701 15759 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:42.189168  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.190016  8971 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
W20260925 16:45:42.286437  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 97363.3us
I20260925 16:45:42.286846 15759 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.287376 15759 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:42.191397  8972 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:42.163218 15728 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:42.144667 15749 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:42.162667 15610 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:42.148177 15803 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:42.072347 15748 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:42.301156 15749 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:42.302400  8967 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:42.302577 15749 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:42.303136 15748 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.161979 15339 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:42.304629 15339 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.305905 15339 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:42.122447 15548 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.307793 15548 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.308977 15610 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.311254 15610 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:42.173897 15842 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:42.287547  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1301) took 1763 ms. Trace:
I20260925 16:45:42.288182 15705 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:42.128506 15715 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.294459  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:55034 (request call id 1239) took 1911 ms. Trace:
I20260925 16:45:42.362474  8971 rpcz_store.cc:276] 0925 16:45:40.523797 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.126735 (+1602938us) service_pool.cc:227] Handling call
0925 16:45:42.129090 (+  2355us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.286720 (+157630us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.287316 (+   596us) spinlock_profiling.cc:243] Waited 60.7 ms on lock 0x7b54002fe754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:42.287491 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":139566976}
I20260925 16:45:42.301067 15803 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.363804 15705 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:42.364202 15705 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:42.363998 15842 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.294049 15793 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:42.296538 15196 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:42.319131 15858 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260925 16:45:42.032799  9049 rpcz_store.cc:276] 0925 16:45:40.163099 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.168450 (+  5351us) service_pool.cc:227] Handling call
0925 16:45:40.168839 (+   389us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:40.169257 (+   418us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:40.169292 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:40.169843 (+   551us) log.cc:842] Serialized 26 byte log entry
0925 16:45:40.225091 (+ 55248us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:40.225143 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:40.225223 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:42.014359 (+1789136us) spinlock_profiling.cc:243] Waited 7.03 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:42.029683 (+ 15324us) raft_consensus.cc:1671] finished
0925 16:45:42.029702 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.032395 (+  2693us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":823,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":3148,"spinlock_wait_cycles":16178944,"thread_start_us":14715,"threads_started":1,"wal-append.queue_time_us":112313}
I20260925 16:45:42.374224  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.374970 15793 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.335350  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.376145 15790 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.376626 15790 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:42.376888  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.377024 15715 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.377427  9047 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:42.377521 15793 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:42.378883 15790 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:42.380164 15196 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.381034  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.350664  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.382869  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:42.384302 15714 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.557s	user 0.007s	sys 0.003s
I20260925 16:45:42.384701 15714 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.386584 15714 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.352452 15728 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.357561 15702 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:42.229861 15684 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.852s	user 0.013s	sys 0.001s
I20260925 16:45:42.362664  9046 rpcz_store.cc:276] 0925 16:45:40.319116 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.326756 (+  7640us) service_pool.cc:227] Handling call
0925 16:45:42.220102 (+1893346us) spinlock_profiling.cc:243] Waited 243 ms on lock 0x7b54002616d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.230636 (+ 10534us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":559508352}
I20260925 16:45:42.366005  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:42.393445  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:42.394940  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:42.396198  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:42.375425  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.348523  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3352) took 2278 ms. Trace:
I20260925 16:45:42.385000 15689 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:42.372154  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:42.367434 15842 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:42.401955  9119 rpcz_store.cc:276] 0925 16:45:40.074733 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.075022 (+   289us) service_pool.cc:227] Handling call
0925 16:45:40.075344 (+   322us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:40.236839 (+161495us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:40.236884 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:40.236939 (+    55us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:40.236982 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.348218 (+2111236us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b54001ee1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:42.348284 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.348451 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":370882816}
I20260925 16:45:42.402871  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.402694  9047 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:42.408334  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.409230  9694 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:42.417196  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.397912 15548 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:42.403717 15689 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:42.418097  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.400615 15767 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:42.365761 15721 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.427531  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.402679 15714 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260925 16:45:42.429695  8966 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.012s	sys 0.004s
W20260925 16:45:42.430075  8966 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.012s	sys 0.004s
I20260925 16:45:42.410588 15670 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:45:42.413898 15768 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:42.419581 15728 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260925 16:45:42.443220  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.004s	sys 0.013s
I20260925 16:45:42.445997  9045 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
W20260925 16:45:42.447594  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.009s	sys 0.009s
I20260925 16:45:42.391068 15684 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.427094 15689 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:42.451103  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.004s	sys 0.014s
I20260925 16:45:42.442993 15714 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:42.456576  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:42.469403  9042 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:42.449928 15728 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:42.449977 15767 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:42.427413 15793 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
W20260925 16:45:42.460920  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 850811us
W20260925 16:45:42.461213  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.010s	sys 0.009s
I20260925 16:45:42.458847 15670 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:42.466441  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3078) took 2231 ms. Trace:
W20260925 16:45:42.457940 15701 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.153s	user 0.003s	sys 0.013s
W20260925 16:45:42.508833  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 823150us
I20260925 16:45:42.509403  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:42.468616 15651 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.013s	sys 0.014s
W20260925 16:45:42.536172 15651 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.013s	sys 0.015s
W20260925 16:45:42.537093  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2337) took 2825 ms (client timeout 2226 ms). Trace:
W20260925 16:45:42.537520  8972 rpcz_store.cc:269] 0925 16:45:39.712014 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.712142 (+   128us) service_pool.cc:227] Handling call
0925 16:45:42.536941 (+2824799us) spinlock_profiling.cc:243] Waited 2.4 s on lock 0x7b5400135e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.537030 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5517158144}
W20260925 16:45:42.538800  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2350) took 2452 ms (client timeout 1699 ms). Trace:
I20260925 16:45:42.539166  8972 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260925 16:45:42.511825  8975 rpcz_store.cc:276] 0925 16:45:40.235026 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.961521 (+1726495us) service_pool.cc:227] Handling call
0925 16:45:41.978471 (+ 16950us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.978623 (+   152us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.978645 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.978688 (+    43us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:41.978718 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:41.978769 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.466267 (+487498us) spinlock_profiling.cc:243] Waited 10.5 ms on lock 0x7b54003c46d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.466378 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":24188800}
I20260925 16:45:42.456485 15768 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:42.519651  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.521512  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:42.587972  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66566.4us
I20260925 16:45:42.589906  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:42.470975 15714 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:42.463274 15816 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260925 16:45:42.523439 15715 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:42.524516 15790 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:45:42.528631  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3361) took 1043 ms. Trace:
I20260925 16:45:42.600813  9042 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
W20260925 16:45:42.601099  9044 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.026s	sys 0.043s
W20260925 16:45:42.601583  9044 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.741s	user 0.026s	sys 0.043s
I20260925 16:45:42.528714 15196 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:42.535419  9050 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2362) took 2455 ms (client timeout 1750 ms). Trace:
W20260925 16:45:42.603149  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.024s	sys 0.110s
W20260925 16:45:42.603341  9050 rpcz_store.cc:269] 0925 16:45:40.057179 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.057296 (+   117us) service_pool.cc:227] Handling call
0925 16:45:42.511662 (+2454366us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54000a7dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.512051 (+   389us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1280472832}
I20260925 16:45:42.600978  9115 rpcz_store.cc:276] 0925 16:45:41.485126 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.490153 (+  5027us) service_pool.cc:227] Handling call
0925 16:45:41.490424 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.601312 (+110888us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.601340 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:41.601382 (+    42us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:41.601410 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.528414 (+927004us) spinlock_profiling.cc:243] Waited 111 ms on lock 0x7b540007d354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:42.528455 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.528556 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":254585728}
I20260925 16:45:42.547628  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2347) took 2777 ms. Trace:
W20260925 16:45:42.519506 15827 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.656s	user 0.005s	sys 0.005s
I20260925 16:45:42.605525  8970 rpcz_store.cc:276] 0925 16:45:39.770307 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.457484 (+1687177us) service_pool.cc:227] Handling call
0925 16:45:41.931217 (+473733us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.973623 (+ 42406us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.547404 (+573781us) spinlock_profiling.cc:243] Waited 471 ms on lock 0x7b54003e8d50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.547565 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1082212736}
I20260925 16:45:42.555287  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:42.606956  9120 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:42.608697  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.609707  9697 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 12: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:42.541657 15757 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:42.612087  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.511420 15670 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.537123 15684 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:42.585089  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:42.589931  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:42.539258  8967 rpcz_store.cc:269] 0925 16:45:40.086570 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.179910 (+ 93340us) service_pool.cc:227] Handling call
0925 16:45:42.538561 (+2358651us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b5400137754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.538715 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4836667136}
I20260925 16:45:42.592772  9119 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:42.585629  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3083) took 1072 ms. Trace:
I20260925 16:45:42.504241 15728 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:42.596709  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:42.517238 15701 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.003s	sys 0.014s
W20260925 16:45:42.603852  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.024s	sys 0.110s
I20260925 16:45:42.473923 15325 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:42.459051 15834 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.013s	sys 0.029s
I20260925 16:45:42.612824  9045 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:45:42.550515 15721 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:42.600210 15756 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 2.292s	user 0.020s	sys 0.030s
W20260925 16:45:42.582935  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63776.9us
I20260925 16:45:42.544384 15710 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:42.617771  9702 raft_consensus.cc:2354] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17.
I20260925 16:45:42.618067  8972 rpcz_store.cc:276] 0925 16:45:41.513427 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.538447 (+1025020us) service_pool.cc:227] Handling call
0925 16:45:42.538789 (+   342us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.585180 (+ 46391us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.585475 (+   295us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:42.541146 15726 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.600764 15746 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:42.620046  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.620769  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.603391 15779 raft_consensus.cc:2741] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
W20260925 16:45:42.623898  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 800368us
I20260925 16:45:42.653920  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:42.654251  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.655061  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:42.652474  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.656646  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:42.450709 15712 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.772s	user 0.010s	sys 0.009s
I20260925 16:45:42.624025  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:42.618489 15671 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.703s	user 0.015s	sys 0.013s
I20260925 16:45:42.671113  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.636034  9120 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:42.636938  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.617141 15670 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:42.643002  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:42.613564 15827 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.624023 15793 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260925 16:45:42.629014 15834 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.776s	user 0.014s	sys 0.029s
W20260925 16:45:42.638556 15756 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 2.331s	user 0.020s	sys 0.030s
I20260925 16:45:42.626204 15715 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:42.656847  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:42.650902  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.834s	user 0.006s	sys 0.025s
W20260925 16:45:42.688581  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.007s	sys 0.025s
I20260925 16:45:42.655364  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:42.689215  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:42.671264  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.673514  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.658845  9119 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:42.686354 15800 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:42.690994 15715 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:42.695644 15800 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:42.695891 15866 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:42.696103 15800 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:42.674273  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.697619  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.698697  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.699288  8975 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:42.700573  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:42.701519  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.701874  8969 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:42.660820  9016 leader_election.cc:398] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17.
I20260925 16:45:42.702394  9016 leader_election.cc:401] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260925 16:45:42.678220  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.674573 15842 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:42.677559  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:42.677053 15673 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260925 16:45:42.658906 15695 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.019s	sys 0.002s
I20260925 16:45:42.672816  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.657984 15721 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:42.658493 15712 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.980s	user 0.010s	sys 0.009s
I20260925 16:45:42.691243  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.669921 15726 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260925 16:45:42.684512 15746 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260925 16:45:42.658100 15768 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.657994 15767 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:42.651381  8968 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.008s	sys 0.025s
W20260925 16:45:42.676379 15671 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.761s	user 0.015s	sys 0.014s
I20260925 16:45:42.671768 15797 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:42.669555 15848 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:42.694971  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.677536 15678 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
W20260925 16:45:42.703655  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48189.4us
I20260925 16:45:42.674247  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:42.870919  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 196732us
I20260925 16:45:42.675503  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:42.872727  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:42.873529  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 198083us
I20260925 16:45:42.874372  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:42.704845  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44134.2us
W20260925 16:45:42.757306 15830 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.087s	user 0.005s	sys 0.000s
I20260925 16:45:42.678360 15704 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:42.705267 15793 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:42.710397  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:42.838337 14749 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.971s	user 0.006s	sys 0.015s
W20260925 16:45:42.847645  8968 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.008s	sys 0.029s
I20260925 16:45:42.733263 15796 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:42.838138  8974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.005s	sys 0.013s
W20260925 16:45:42.912621  8974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.048s	user 0.005s	sys 0.013s
W20260925 16:45:42.912802  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 202487us
I20260925 16:45:42.695932 15715 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:42.860875  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.786s	user 0.012s	sys 0.064s
W20260925 16:45:42.913458  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.838s	user 0.012s	sys 0.065s
W20260925 16:45:42.702988 15775 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.389s	user 0.011s	sys 0.017s
I20260925 16:45:42.866420  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.787230  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.794281 15325 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:42.858075  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1303) took 1401 ms. Trace:
I20260925 16:45:42.674945 15674 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:42.880084  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:42.918044  8972 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:42.917984  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:42.918771  8970 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:42.918869  8972 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:42.919448  8972 raft_consensus.cc:595] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:42.919828  8972 raft_consensus.cc:603] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:45:42.736711  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.717s	user 0.015s	sys 0.017s
W20260925 16:45:42.838449 15716 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.000s	sys 0.017s
I20260925 16:45:42.881565  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:42.847955 15695 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.020s	sys 0.007s
I20260925 16:45:42.705457 15344 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17.
I20260925 16:45:42.732120  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.928356  9120 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:42.892853  9049 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:42.711406 15673 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:42.706594 15842 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.721113 15866 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:42.936097  9124 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:42.708457  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:42.759159 15710 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:42.754354 15705 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:42.904978 15864 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260925 16:45:42.930936 15826 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:42.756108 15827 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:42.865324 15797 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:42.952085 15826 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:42.952569 15797 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:42.926626 15728 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:42.954869 15826 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:42.711408 15868 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260925 16:45:42.955894  9700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1455) took 2654 ms (client timeout 1750 ms). Trace:
I20260925 16:45:42.956009 15728 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.900764 15790 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:42.956316  9700 rpcz_store.cc:269] 0925 16:45:40.301012 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.301625 (+   613us) service_pool.cc:227] Handling call
0925 16:45:42.955655 (+2654030us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b5400534154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:42.955833 (+   178us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3866899840}
I20260925 16:45:42.900996 15749 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:42.899755 15779 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:42.957448  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.957581 15779 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:42.958631  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:42.958449 15779 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.867977  9115 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:45:42.945185 15842 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:42.960341  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.961320  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.956084 15868 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:42.962208 15868 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:42.962430  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:42.963131  9698 raft_consensus.cc:2354] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
W20260925 16:45:42.926661 15716 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.001s	sys 0.019s
I20260925 16:45:42.965850  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1262) took 2245 ms. Trace:
I20260925 16:45:42.966187  9043 rpcz_store.cc:276] 0925 16:45:40.720064 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.720809 (+   745us) service_pool.cc:227] Handling call
0925 16:45:40.721077 (+   268us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:41.585253 (+864176us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.965604 (+1380351us) spinlock_profiling.cc:243] Waited 833 ms on lock 0x7b54002a2454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:42.965776 (+   172us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1915385600}
I20260925 16:45:42.923254  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.969077 15710 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.970932  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.961359  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.924389 15796 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:42.924290  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:42.925935  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.926115  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3079) took 2586 ms. Trace:
I20260925 16:45:42.924484  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.977092  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.867532 15848 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.931556  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.933179  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:42.901628 14749 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.039s	user 0.008s	sys 0.015s
I20260925 16:45:42.959594  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:42.940562  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:42.917317 15775 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.611s	user 0.012s	sys 0.018s
I20260925 16:45:42.935523 15673 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:42.950181  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:42.984912  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.950198  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.951146 15705 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:42.956454  8975 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:42.972045  9115 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:42.985551  8970 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:42.989207  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:42.989464  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:42.979288 15325 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260925 16:45:42.972537  9697 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:42.991181 15325 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:42.978175  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:42.991557 15325 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:42.992498  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:42.992456 15325 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.993207  9045 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:42.993714 15325 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:42.993914  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:42.978657  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1650) took 1203 ms. Trace:
I20260925 16:45:42.980823 14749 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:42.928128  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1684159689998523s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22260000000000002s for a response
I20260925 16:45:42.995609  8941 leader_election.cc:398] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:42.998210  8941 leader_election.cc:401] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:45:42.948194  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:42.995842  9121 rpcz_store.cc:276] 0925 16:45:41.767355 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.767569 (+   214us) service_pool.cc:227] Handling call
0925 16:45:41.784798 (+ 17229us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:41.785144 (+   346us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.785185 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:41.785719 (+   534us) log.cc:842] Serialized 26 byte log entry
0925 16:45:42.689051 (+903332us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:42.689105 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.689189 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:42.970496 (+281307us) raft_consensus.cc:1671] finished
0925 16:45:42.970517 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.970676 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3560,"raft.queue_time_us":22364,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":6803,"thread_start_us":872137,"threads_started":1,"wal-append.queue_time_us":1174319}
I20260925 16:45:42.999761  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1304) took 1520 ms. Trace:
I20260925 16:45:42.982931  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.000118  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.000145  8969 rpcz_store.cc:276] 0925 16:45:41.478874 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.526625 (+1047751us) service_pool.cc:227] Handling call
0925 16:45:42.526924 (+   299us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.702240 (+175316us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.996392 (+294152us) spinlock_profiling.cc:243] Waited 175 ms on lock 0x7b5400137254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:42.999683 (+  3291us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":401962752}
I20260925 16:45:43.001159  9043 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:42.990007  9115 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 9 FOLLOWER]: Advancing to term 10
W20260925 16:45:42.923557  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.040s	user 0.015s	sys 0.029s
I20260925 16:45:42.983002  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:43.003909  9695 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:43.020744 15785 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.000919 14749 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.021786  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.027804  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.029006  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:43.029742 15837 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 1.276s	user 0.003s	sys 0.005s
I20260925 16:45:43.031152  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.034405 15649 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:43.034766 15746 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:43.035254 15746 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.035972 15673 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.037590 15746 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.037938 15673 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.038045  9045 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:43.038565 15673 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:45:43.038848  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:43.023607 15868 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.041512 15610 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Stepping down as leader of term 9
I20260925 16:45:43.041868 15610 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:43.042236  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:43.042989 15868 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:43.042621 15610 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.022464  9119 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:43.043537 15548 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:43.044010  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.044286 15548 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:43.044588  9119 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:43.045575 15548 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:42.982901 15728 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:42.979240 15710 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:42.982174 15749 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:43.054557  9121 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:42.982558 15848 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:43.029783  9116 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:42.928706 15674 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.034454  9115 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 10.
I20260925 16:45:43.061439  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:43.062048  9042 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:43.062224  9119 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 9. Current term is 10. Ops: []
I20260925 16:45:43.055302  9120 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:43.057528  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:43.050463  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:43.073326  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.073019 15749 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.027279 15842 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.075811 15842 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:43.001187 15790 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:43.076938 15797 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.077208 15790 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.078842 15797 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.078970 15790 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:43.048293 15752 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:43.082269 15752 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.083818 15725 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:43.086849 15748 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:43.087415 15805 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:43.088310 15725 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:43.088053 15805 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.089635 15725 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.091998 15764 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:43.092083 15712 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:43.093070 15827 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:43.093258  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:43.093426 15827 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:43.093816  8969 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:43.093732  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:43.094192 15827 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.087288 15748 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.095400 15827 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:43.096664 15748 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.047636 15728 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.098747 15728 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.060540 15721 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:43.101073 15848 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.103756 15848 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:43.105430  9046 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.026s	sys 0.082s
I20260925 16:45:43.106240  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:43.106837  9046 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.026s	sys 0.083s
I20260925 16:45:43.106951  9700 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260925 16:45:43.070431  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:43.110342  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 1994) took 1255 ms. Trace:
I20260925 16:45:43.110796  9693 rpcz_store.cc:276] 0925 16:45:41.855216 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.855369 (+   153us) service_pool.cc:227] Handling call
0925 16:45:42.024978 (+169609us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.030842 (+  5864us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.105597 (+1074755us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b5400537fd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:43.110274 (+  4677us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":389338880}
I20260925 16:45:43.114506  8969 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260925 16:45:43.011770 15803 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:43.119868  8972 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:43.090838 15805 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.125414  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:43.125979  8969 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:43.119580  9042 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:45:43.128059  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.126386  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:43.140509  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:43.111503 15610 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 9 FOLLOWER]: Advancing to term 10
I20260925 16:45:42.915872  8971 rpcz_store.cc:276] 0925 16:45:41.456808 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.368796 (+911988us) service_pool.cc:227] Handling call
0925 16:45:42.374950 (+  6154us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.375135 (+   185us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:42.375402 (+   267us) log.cc:842] Serialized 14 byte log entry
0925 16:45:42.857611 (+482209us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:42.857680 (+    69us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:42.857744 (+    64us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.857842 (+    98us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.858008 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":18590,"prepare.queue_time_us":503,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":28181,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":28054,"thread_start_us":463190,"threads_started":1}
I20260925 16:45:43.156345  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2338) took 3444 ms. Trace:
I20260925 16:45:43.159711  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.163371  9116 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:43.167363  8972 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:43.171916  8971 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:43.172531  8971 raft_consensus.cc:595] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:43.174378  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:43.175140  9700 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:43.189616  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:43.150632 15759 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.852s	user 0.003s	sys 0.008s
I20260925 16:45:43.201990  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.152858 15674 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.141911 15721 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:43.176271 15821 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:45:43.247164  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.142532 15673 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.094s
I20260925 16:45:43.185439 15752 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.160518  8973 rpcz_store.cc:276] 0925 16:45:39.712313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:39.712459 (+   146us) service_pool.cc:227] Handling call
0925 16:45:39.738896 (+ 26437us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:40.127588 (+388692us) raft_consensus.cc:1520] Early marking committed up to index 16
0925 16:45:40.356502 (+228914us) log.cc:842] Serialized 14 byte log entry
0925 16:45:40.566987 (+210485us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:40.567494 (+   507us) log.cc:842] Serialized 26 byte log entry
0925 16:45:40.567638 (+   144us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:45:40.567890 (+   252us) log.cc:842] Serialized 14 byte log entry
0925 16:45:40.572728 (+  4838us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.559440 (+1986712us) spinlock_profiling.cc:243] Waited 5.63 ms on lock 0x7b1800438d00. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:43.156038 (+596598us) spinlock_profiling.cc:243] Waited 213 ms on lock 0x7b54003561d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:43.156095 (+    57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:43.156148 (+    53us) raft_consensus.cc:1671] finished
0925 16:45:43.156164 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.156286 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":117305,"prepare.queue_time_us":63152,"prepare.run_cpu_time_us":76,"prepare.run_wall_time_us":1658,"raft.queue_time_us":125003,"raft.run_cpu_time_us":383,"raft.run_wall_time_us":55836,"spinlock_wait_cycles":502845696,"thread_start_us":538009,"threads_started":3,"wal-append.queue_time_us":349517,"wal-append.run_cpu_time_us":3956,"wal-append.run_wall_time_us":1749803}
I20260925 16:45:43.147971 15848 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.099s
I20260925 16:45:43.254171  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:43.256250  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:43.257066  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:43.260673  9050 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:43.125996 15803 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.195745 15759 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.263206  9048 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:43.152529  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:43.282464  9121 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 7 to 10, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:43.273984  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:43.285050  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.151100 15670 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.289428  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:43.290967  9047 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.846s	user 0.051s	sys 0.062s
I20260925 16:45:43.260411 15821 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:43.291417  9047 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.051s	sys 0.062s
I20260925 16:45:43.295326  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:43.295864 15759 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.310554 15677 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:43.313278 15715 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:43.326565  9701 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.821s	user 0.032s	sys 0.025s
W20260925 16:45:43.327280  9701 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.033s	sys 0.025s
I20260925 16:45:43.328027  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.329023  9045 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:43.333158  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:43.334041  9697 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:45:43.333685  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.825s	user 0.010s	sys 0.046s
W20260925 16:45:43.334712  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.010s	sys 0.046s
I20260925 16:45:43.248983 15721 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.338064  9119 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:43.361608 15623 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:43.363265  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.364866  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.366057  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.367105  8967 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:43.367031 15821 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.368335  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:43.369735  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.368264  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3530) took 1585 ms. Trace:
I20260925 16:45:43.372291  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.370270  9044 rpcz_store.cc:276] 0925 16:45:41.782414 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.786123 (+  3709us) service_pool.cc:227] Handling call
0925 16:45:41.786530 (+   407us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:41.786988 (+   458us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.787027 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:41.811274 (+ 24247us) log.cc:842] Serialized 26 byte log entry
0925 16:45:42.602177 (+790903us) raft_consensus.cc:1631] Marking committed up to 8
0925 16:45:42.602215 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.602310 (+    95us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:43.367985 (+765675us) raft_consensus.cc:1671] finished
0925 16:45:43.368013 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.368189 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2116,"raft.queue_time_us":128,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":13399,"thread_start_us":741469,"threads_started":1,"wal-append.queue_time_us":1536709}
I20260925 16:45:43.383153  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.384701  8967 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:43.357981 15689 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.891s	user 0.016s	sys 0.000s
I20260925 16:45:43.370718  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3730) took 1503 ms. Trace:
W20260925 16:45:43.373742 15756 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.019s	sys 0.028s
I20260925 16:45:43.390877  9117 rpcz_store.cc:276] 0925 16:45:41.867336 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.947064 (+ 79728us) service_pool.cc:227] Handling call
0925 16:45:41.947325 (+   261us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:41.988184 (+ 40859us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.988227 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:41.988700 (+   473us) log.cc:842] Serialized 26 byte log entry
0925 16:45:42.913786 (+925086us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:42.913824 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.913879 (+    55us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:43.370462 (+456583us) raft_consensus.cc:1671] finished
0925 16:45:43.370490 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.370653 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32844,"raft.queue_time_us":33152,"raft.run_cpu_time_us":89,"raft.run_wall_time_us":2687,"thread_start_us":838602,"threads_started":1,"wal-append.queue_time_us":1311898}
W20260925 16:45:43.383826 15800 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.687s	user 0.010s	sys 0.000s
I20260925 16:45:43.417900  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.420023  8971 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
W20260925 16:45:43.417948  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.622s	user 0.037s	sys 0.079s
W20260925 16:45:43.421298  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.037s	sys 0.079s
I20260925 16:45:43.424263  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:43.425493  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:43.426429 15433 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:43.427124 15664 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:43.427942 15664 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.430658 15664 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.431272 15620 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:43.432371  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.434026 15815 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:43.434772  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:43.417403 15756 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.019s	sys 0.028s
I20260925 16:45:43.435526  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3549) took 1051 ms. Trace:
I20260925 16:45:43.435602  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.437285 15722 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:42.976409  8968 rpcz_store.cc:276] 0925 16:45:40.339645 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.978656 (+1639011us) service_pool.cc:227] Handling call
0925 16:45:41.979028 (+   372us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.979205 (+   177us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:45:41.979473 (+   268us) log.cc:842] Serialized 14 byte log entry
0925 16:45:42.925812 (+946339us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:42.925865 (+    53us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:42.925908 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:42.925970 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:42.926067 (+    97us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":33077,"prepare.queue_time_us":564,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":2465,"raft.queue_time_us":24911,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":3563,"thread_start_us":921867,"threads_started":1,"wal-append.queue_time_us":987192}
I20260925 16:45:43.455386  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1641) took 2472 ms. Trace:
I20260925 16:45:43.539963  8969 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:43.446426 15872 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:43.442708  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3370) took 1908 ms. Trace:
I20260925 16:45:43.461781  9050 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:43.465975 15702 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:43.476256  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:43.454339  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3715) took 3173 ms (client timeout 1548 ms). Trace:
I20260925 16:45:43.498411  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:43.540841  9124 rpcz_store.cc:276] 0925 16:45:41.534708 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.535475 (+   767us) service_pool.cc:227] Handling call
0925 16:45:41.535813 (+   338us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.945251 (+1409438us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.442431 (+497180us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b5400163d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:43.442643 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3219913600}
I20260925 16:45:43.505965  9120 raft_consensus.cc:2354] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:43.543711  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.388010 15715 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:43.508069  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 85228.5us
I20260925 16:45:43.517766  9048 rpcz_store.cc:276] 0925 16:45:42.383821 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.400282 (+ 16461us) service_pool.cc:227] Handling call
0925 16:45:42.423034 (+ 22752us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:43.263607 (+840573us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.435257 (+171650us) spinlock_profiling.cc:243] Waited 840 ms on lock 0x7b54002526d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:43.435463 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1931767680}
I20260925 16:45:43.501462  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.552208  9117 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:43.538594  9122 rpcz_store.cc:276] 0925 16:45:40.982780 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.982932 (+   152us) service_pool.cc:227] Handling call
0925 16:45:41.007049 (+ 24117us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:41.599614 (+592565us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:45:41.815205 (+215591us) log.cc:842] Serialized 14 byte log entry
0925 16:45:42.039927 (+224722us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:42.039996 (+    69us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:42.040053 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.455113 (+1415060us) spinlock_profiling.cc:243] Waited 592 ms on lock 0x7b54003bf6d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:43.455176 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.455324 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7869,"prepare.queue_time_us":75426,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":794,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":15955,"spinlock_wait_cycles":1362228608,"thread_start_us":429531,"threads_started":2,"wal-append.queue_time_us":637413,"wal-append.run_cpu_time_us":1092,"wal-append.run_wall_time_us":1018271}
W20260925 16:45:43.541951  9118 rpcz_store.cc:269] 0925 16:45:40.280941 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:40.281509 (+   568us) service_pool.cc:227] Handling call
0925 16:45:43.454067 (+3172558us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:43.454249 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2685406464}
W20260925 16:45:43.551481  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 75316.7us
I20260925 16:45:43.554600  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.560701  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:43.561976  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:43.562201  9118 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:43.550558 15791 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:43.563818  9119 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:43.568133  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.397352 15689 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:43.541795 15872 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:43.542002 15756 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:43.564463 15670 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.583756  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.583214  9118 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260925 16:45:43.606601  9118 pending_rounds.cc:76] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 8
I20260925 16:45:43.560889 15709 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:43.605542  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.582170  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:43.606283  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44391.2us
I20260925 16:45:43.606659  9124 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:45:43.607313  9118 pending_rounds.cc:97] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260925 16:45:43.624617  9118 raft_consensus.cc:2866] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:43.503046 15800 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.628772  8970 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:43.625293  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.626322  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.629994  9122 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:43.600560 15879 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.233s	user 0.001s	sys 0.000s
I20260925 16:45:43.614720  9117 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:45:43.539450 15815 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.648782  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.657398  9120 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
W20260925 16:45:43.607718 15883 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260925 16:45:43.610351 15714 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.998s	user 0.009s	sys 0.002s
I20260925 16:45:43.563678 15791 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.624747 15816 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:43.665692  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:43.669343  9694 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:43.622207 15709 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:43.677572  9014 leader_election.cc:398] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:43.688031  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:43.687503  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 82320.1us
I20260925 16:45:43.688633  9014 leader_election.cc:401] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:45:43.691994 15344 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:43.695858  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:43.702952  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:43.608058 15756 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.685714 15816 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:43.720975  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:43.722684  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:43.724004  9089 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.022s	sys 0.032s
W20260925 16:45:43.724367  9089 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.726s	user 0.022s	sys 0.032s
I20260925 16:45:43.724633  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:43.724699  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 726659us
I20260925 16:45:43.727639  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.727778  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.728369  9045 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:43.727118  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.730587  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:43.731263  9042 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:43.731326  9045 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
I20260925 16:45:43.607939 15872 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.694381 15673 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260925 16:45:43.702934 15880 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:43.758773  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:43.759315  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:43.709607 15799 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:43.678068 15714 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.724097 15803 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.733945 15782 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:43.769356  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75141.1us
I20260925 16:45:43.771418  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:43.773933  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.712s	user 0.005s	sys 0.030s
W20260925 16:45:43.774387  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.006s	sys 0.030s
I20260925 16:45:43.717701 15721 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.724957 15816 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:43.702410 15684 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260925 16:45:43.733031 15765 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:43.755741 15805 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:43.800817  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:43.801419  9042 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:43.793105 15799 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:43.806460  9702 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22. Ops: []
W20260925 16:45:43.808063  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48822.9us
I20260925 16:45:43.808992  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:43.788723 15702 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:43.794099 15800 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:43.872332  9042 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
W20260925 16:45:43.787750 15837 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.012s	sys 0.017s
I20260925 16:45:43.864884  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.768941 15880 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.757349 15709 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:43.885154 15887 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260925 16:45:43.886768 15886 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260925 16:45:43.887817  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1473) took 1411 ms. Trace:
I20260925 16:45:43.888163  9701 rpcz_store.cc:276] 0925 16:45:42.476636 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.476897 (+   261us) service_pool.cc:227] Handling call
0925 16:45:42.504743 (+ 27846us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:42.505005 (+   262us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:42.505064 (+    59us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:42.505577 (+   513us) log.cc:842] Serialized 26 byte log entry
0925 16:45:43.328097 (+822520us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:43.328139 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.328205 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:43.887590 (+559385us) raft_consensus.cc:1671] finished
0925 16:45:43.887616 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.887760 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":822170,"threads_started":1,"wal-append.queue_time_us":1251959}
I20260925 16:45:43.892060  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1300) took 3716 ms. Trace:
I20260925 16:45:43.892416  8966 rpcz_store.cc:276] 0925 16:45:40.175714 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.862364 (+1686650us) service_pool.cc:227] Handling call
0925 16:45:41.882063 (+ 19699us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:42.430448 (+548385us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:42.430492 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:42.450572 (+ 20080us) log.cc:842] Serialized 26 byte log entry
0925 16:45:43.335075 (+884503us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:43.335115 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.335182 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:43.891860 (+556678us) raft_consensus.cc:1671] finished
0925 16:45:43.891878 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.892002 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":20215,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"thread_start_us":1374728,"threads_started":2,"wal-append.queue_time_us":1310017}
W20260925 16:45:43.834231 15779 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.760s	user 0.017s	sys 0.026s
I20260925 16:45:43.831800 15712 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Leader election won for term 10
I20260925 16:45:43.865065 15689 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:43.896687 15837 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.012s	sys 0.018s
W20260925 16:45:43.895323 15862 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:43.817468 15799 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:43.921898  8974 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.973s	user 0.014s	sys 0.031s
W20260925 16:45:43.924965  8974 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.976s	user 0.014s	sys 0.031s
I20260925 16:45:43.841341 15759 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260925 16:45:43.925122  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:43.930613  9042 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:43.902362 15848 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:43.937460  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1299) took 3767 ms. Trace:
W20260925 16:45:43.918746 15779 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.018s	sys 0.028s
I20260925 16:45:43.940543  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2017) took 1031 ms. Trace:
I20260925 16:45:43.902545 15815 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.944307  9702 rpcz_store.cc:276] 0925 16:45:42.908934 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.913619 (+  4685us) service_pool.cc:227] Handling call
0925 16:45:42.913875 (+   256us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:43.816802 (+902927us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.940264 (+123462us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:43.940477 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2037243136}
W20260925 16:45:43.945115  9696 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.976s	user 0.035s	sys 0.022s
W20260925 16:45:43.945530  9696 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.977s	user 0.035s	sys 0.022s
W20260925 16:45:43.943502  9699 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.792s	user 0.044s	sys 0.023s
W20260925 16:45:43.946048  9699 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.795s	user 0.044s	sys 0.023s
I20260925 16:45:43.920998 15709 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:43.953619  9698 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:43.954356  9115 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.034s	sys 0.017s
W20260925 16:45:43.954757  9115 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.831s	user 0.034s	sys 0.017s
I20260925 16:45:43.920102 15791 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:43.950515  9116 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.010s	sys 0.040s
I20260925 16:45:43.842183 15688 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
W20260925 16:45:43.864183 15725 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.008s	sys 0.029s
I20260925 16:45:43.923812 15712 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:43.949213 15433 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260925 16:45:43.969440 14749 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.942s	user 0.013s	sys 0.031s
W20260925 16:45:43.975472 14749 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.948s	user 0.013s	sys 0.031s
W20260925 16:45:43.961959  9116 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.010s	sys 0.040s
I20260925 16:45:43.937278 15677 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:43.966980 15725 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.870s	user 0.008s	sys 0.030s
I20260925 16:45:43.955973 15756 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:43.969439 15714 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:43.951189 15848 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:43.978914 15688 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:44.011598  9015 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.026s	sys 0.033s
W20260925 16:45:44.015803  9015 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.026s	sys 0.033s
W20260925 16:45:44.012971  9046 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.012s	sys 0.040s
I20260925 16:45:43.968057 15684 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.041s
W20260925 16:45:44.017351  9046 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.012s	sys 0.040s
W20260925 16:45:44.013029  9693 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.015s	sys 0.038s
W20260925 16:45:44.024845  9693 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.828s	user 0.015s	sys 0.038s
W20260925 16:45:44.014293  9047 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.710s	user 0.023s	sys 0.044s
W20260925 16:45:44.026499  9047 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.023s	sys 0.044s
I20260925 16:45:44.028385  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1285) took 1629 ms. Trace:
W20260925 16:45:44.016247  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 816532us
W20260925 16:45:44.013410 15767 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.653s	user 0.002s	sys 0.035s
W20260925 16:45:44.016623 15768 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.014s	sys 0.024s
I20260925 16:45:44.012305 15670 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:43.983970 15888 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.033s
I20260925 16:45:43.997633 15677 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.061025 15816 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.064713  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:44.065320 15880 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.067005 15578 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:44.067488 15578 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:44.068559 15578 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.032780  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:44.034850  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.648s	user 0.012s	sys 0.027s
W20260925 16:45:44.073731  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.687s	user 0.012s	sys 0.027s
I20260925 16:45:44.039237 15670 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:44.035230 15767 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.002s	sys 0.036s
W20260925 16:45:44.037577 15768 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.671s	user 0.014s	sys 0.025s
I20260925 16:45:44.080156 15545 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:44.080410 15670 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:44.080576 15623 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.718s	user 0.011s	sys 0.000s
I20260925 16:45:44.081296 15794 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:44.081668 15794 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:44.082453 15794 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.082990  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3737) took 2167 ms. Trace:
I20260925 16:45:44.041432  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.041559 15688 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.043079 15726 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:44.047354 15620 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.000s
W20260925 16:45:44.050995 15722 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.501s	user 0.010s	sys 0.001s
I20260925 16:45:44.065361  9117 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:44.028921  9047 rpcz_store.cc:276] 0925 16:45:42.399105 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.406373 (+  7268us) service_pool.cc:227] Handling call
0925 16:45:42.422678 (+ 16305us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.422970 (+   292us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:45:43.303831 (+880861us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.027967 (+724136us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.028033 (+    66us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:44.028091 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.028173 (+    82us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.028323 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":27979,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":59,"thread_start_us":1572587,"threads_started":2}
I20260925 16:45:44.040702 15848 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.085425  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1718) took 1128 ms. Trace:
I20260925 16:45:44.098770  9698 rpcz_store.cc:276] 0925 16:45:42.957455 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.963664 (+  6209us) service_pool.cc:227] Handling call
0925 16:45:42.974774 (+ 11110us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:43.958979 (+984205us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.085182 (+126203us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:44.085374 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2250587392}
I20260925 16:45:44.088131  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.095954  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3547) took 1798 ms. Trace:
I20260925 16:45:44.100063  9118 raft_consensus.cc:2396] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:45:43.937810  8974 rpcz_store.cc:276] 0925 16:45:40.169695 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.802848 (+1633153us) service_pool.cc:227] Handling call
0925 16:45:41.803222 (+   374us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:41.804847 (+  1625us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:41.804892 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:41.811081 (+  6189us) log.cc:842] Serialized 26 byte log entry
0925 16:45:42.912998 (+1101917us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:43.925369 (+1012371us) log.cc:842] Serialized 14 byte log entry
0925 16:45:43.937158 (+ 11789us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.937247 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:43.937289 (+    42us) raft_consensus.cc:1671] finished
0925 16:45:43.937300 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:43.937414 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10739,"raft.queue_time_us":12254,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":14547,"thread_start_us":2024495,"threads_started":2,"wal-append.queue_time_us":1508433}
I20260925 16:45:44.106962  9117 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
I20260925 16:45:44.063601 15816 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:44.083400  9123 rpcz_store.cc:276] 0925 16:45:41.915184 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.014021 (+ 98837us) service_pool.cc:227] Handling call
0925 16:45:42.014293 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:44.081389 (+2067096us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:44.081421 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.081462 (+    41us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:44.081491 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.082782 (+  1291us) spinlock_profiling.cc:243] Waited 2.07 s on lock 0x7b5400164254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:44.082824 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.082940 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":99,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":60,"spinlock_wait_cycles":4753060736}
I20260925 16:45:44.110940  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:44.083631 15794 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:44.110339 15759 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.088639 15889 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:44.080606 15545 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:44.107488 15842 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.108569 15671 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:44.125108  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.123097 15759 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.128427 15759 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.129104 15842 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.107918 15775 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.131763  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.140832  9118 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:44.100106  9046 rpcz_store.cc:276] 0925 16:45:42.297915 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.390482 (+ 92567us) service_pool.cc:227] Handling call
0925 16:45:42.390766 (+   284us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.391422 (+   656us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:42.414185 (+ 22763us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.024485 (+1610300us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.095335 (+ 70850us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.095553 (+   218us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.095600 (+    47us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:44.095658 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.095754 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.095891 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20026,"prepare.queue_time_us":517768,"prepare.run_cpu_time_us":144,"prepare.run_wall_time_us":2544,"raft.queue_time_us":44050,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":3928,"spinlock_wait_cycles":101380864,"thread_start_us":1609369,"threads_started":2,"wal-append.queue_time_us":1147039}
I20260925 16:45:44.114705 15670 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:44.143573  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:44.123268 15834 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:45:44.142356  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:44.107661 15726 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.139528 15689 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.145955 15848 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:44.149557 15749 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.070s	user 0.019s	sys 0.046s
W20260925 16:45:44.208128 15749 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.132s	user 0.021s	sys 0.046s
W20260925 16:45:44.211717 15882 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.670s	user 0.000s	sys 0.002s
I20260925 16:45:44.215898 15841 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:44.216526 15841 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260925 16:45:44.217217 15677 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.229545 15716 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:44.229251 15545 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.230063 15716 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:44.230657 15545 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:44.231802 15791 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.232930 15820 raft_consensus.cc:979] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:44.233529 15820 raft_consensus.cc:1067] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:44.099599 15712 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.238080  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3371) took 1639 ms. Trace:
I20260925 16:45:44.232422 15791 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.238570  9121 rpcz_store.cc:276] 0925 16:45:42.598669 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.119144 (+520475us) service_pool.cc:227] Handling call
0925 16:45:43.122713 (+  3569us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:43.282322 (+159609us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:43.386907 (+104585us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.074147 (+687240us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.074197 (+    50us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:44.074242 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.237833 (+163591us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b540007d854. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:44.237891 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.238021 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":473,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":1722,"spinlock_wait_cycles":366580480,"thread_start_us":686904,"threads_started":1}
I20260925 16:45:44.131467 15722 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.049s
I20260925 16:45:44.245855 15803 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.157502 15880 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260925 16:45:44.249521  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.682s	user 0.007s	sys 0.027s
W20260925 16:45:44.250977  8967 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.013s	sys 0.007s
I20260925 16:45:44.250548 14749 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:44.251684 14749 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:44.124667 15889 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:44.251138  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.008s	sys 0.027s
W20260925 16:45:44.258314  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 690537us
I20260925 16:45:44.147495 15775 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:44.251533  8967 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.013s	sys 0.007s
W20260925 16:45:44.267374  9697 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.663s	user 0.004s	sys 0.017s
W20260925 16:45:44.270853  9697 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.004s	sys 0.018s
I20260925 16:45:44.264235  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.151309 15670 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:44.249982  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.008s	sys 0.044s
I20260925 16:45:44.249645 15880 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:44.249919 15803 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.262454  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2020) took 1155 ms. Trace:
I20260925 16:45:44.231137 15716 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:44.262774 15884 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.639s	user 0.004s	sys 0.000s
I20260925 16:45:44.264492  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:44.282358  9699 rpcz_store.cc:276] 0925 16:45:43.106885 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.109770 (+  2885us) service_pool.cc:227] Handling call
0925 16:45:43.125370 (+ 15600us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:43.125613 (+   243us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:43.125660 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:43.150858 (+ 25198us) log.cc:842] Serialized 26 byte log entry
0925 16:45:43.946388 (+795530us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:43.946441 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:43.946530 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:44.262221 (+315691us) raft_consensus.cc:1671] finished
0925 16:45:44.262239 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.262396 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":795134,"threads_started":1,"wal-append.queue_time_us":1023787}
I20260925 16:45:44.254603 14749 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.289721  9118 pending_rounds.cc:76] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 10
I20260925 16:45:44.290071  9118 pending_rounds.cc:97] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260925 16:45:44.290367  9118 raft_consensus.cc:2866] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:44.282053 15880 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:44.298527 15768 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.299180 15768 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.301550 15768 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:44.304896 15803 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.304781 15880 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.307364 15872 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:44.308281  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.308808  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.309604  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.310362 15880 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.206398 15689 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.312446  9700 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:44.313596 15689 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:44.313824 15896 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260925 16:45:44.311589  9701 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260925 16:45:44.275365 15677 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
W20260925 16:45:44.276983  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.008s	sys 0.044s
I20260925 16:45:44.358222  9041 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:45:44.360787  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:44.365455  9121 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 20
I20260925 16:45:44.366442  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:44.352224 15548 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.789s	user 0.010s	sys 0.021s
I20260925 16:45:44.371901  9695 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:44.355816 15677 consensus_queue.cc:1225] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 14.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
W20260925 16:45:44.356937  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 797340us
I20260925 16:45:44.394212  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:44.355892 15671 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:44.359217 15716 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:44.423326  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.424574  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.425148  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:44.425277  9117 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:44.428970 15842 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:44.396561  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.433346  9695 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
W20260925 16:45:44.371769 15548 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.011s	sys 0.021s
I20260925 16:45:44.399966 15433 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:44.400882  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:44.416910  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.434362  9701 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:44.417727 15725 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.420059  9700 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:45:44.436131  9117 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:45:44.439167  9123 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:44.446600  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45795.3us
I20260925 16:45:44.448720  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:44.456929  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:44.396697 15898 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
W20260925 16:45:44.459995  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1269) took 2610 ms (client timeout 2444 ms). Trace:
W20260925 16:45:44.445982 15884 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
W20260925 16:45:44.462476  9041 rpcz_store.cc:269] 0925 16:45:41.849483 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:41.849603 (+   120us) service_pool.cc:227] Handling call
0925 16:45:44.454621 (+2605018us) spinlock_profiling.cc:243] Waited 2.47 s on lock 0x7b5400126e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:44.459910 (+  5289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5671505792}
I20260925 16:45:44.460757  9121 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:45:44.445194 15433 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:44.397011 15726 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:44.430546 15671 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:44.470099  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:44.420063 15889 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:44.472380 15433 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:44.478868 15752 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:44.458135 15768 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:44.480604 15775 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.476310 15791 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:44.483927 15670 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.490887  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.491935  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:44.507042 15905 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.147s	user 0.000s	sys 0.000s
I20260925 16:45:44.461521 15767 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:44.520490  9121 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
W20260925 16:45:44.521873  9122 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.017s	sys 0.059s
I20260925 16:45:44.519986  9117 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:44.473155 15714 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:44.459002 15842 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.063s
W20260925 16:45:44.527508  9122 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.702s	user 0.018s	sys 0.059s
I20260925 16:45:44.452540 15725 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.515985 15722 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:44.528882  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:44.516261 15752 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:44.525542 15893 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.191s	user 0.000s	sys 0.001s
W20260925 16:45:44.535598  9116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.026s	sys 0.038s
W20260925 16:45:44.538280  9116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.026s	sys 0.038s
I20260925 16:45:44.518604 15610 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.017s
I20260925 16:45:44.537719  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:44.539892  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.012s	sys 0.032s
W20260925 16:45:44.541988  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.012s	sys 0.033s
W20260925 16:45:44.542346  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 590154us
W20260925 16:45:44.550027  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.584s	user 0.017s	sys 0.029s
I20260925 16:45:44.529923 15767 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:44.532155 15827 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.871s	user 0.030s	sys 0.012s
I20260925 16:45:44.556730  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.557132 15752 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.555891 15775 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:44.558439 15752 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:44.558482 15775 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:44.559094 15775 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:44.559370 15767 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.560269 15822 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:44.560668 15822 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:44.555891 15623 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:44.561590 15767 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:45:44.561470 15822 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.561645 15623 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.563270 15803 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:44.563737 15803 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:44.564731 15623 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.564566 15803 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.565799 15803 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:44.550741  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3372) took 1929 ms. Trace:
I20260925 16:45:44.553537 14749 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:45:44.533375 15821 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.000s	sys 0.039s
W20260925 16:45:44.538089 15709 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.577s	user 0.009s	sys 0.002s
I20260925 16:45:44.538990 15759 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:44.539125 15722 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:44.586220  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:44.586875  9694 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:44.572302  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:44.550518  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.017s	sys 0.029s
W20260925 16:45:44.587874  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 622049us
I20260925 16:45:44.588156  9695 raft_consensus.cc:2396] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:45:44.569823  9116 rpcz_store.cc:276] 0925 16:45:42.620992 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.164468 (+543476us) service_pool.cc:227] Handling call
0925 16:45:43.164759 (+   291us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:43.164996 (+   237us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:45:43.977505 (+812509us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.539241 (+561736us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.550140 (+ 10899us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.550335 (+   195us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.550381 (+    46us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:44.550479 (+    98us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.550581 (+   102us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.550696 (+   115us) inbound_call.cc:173] Queueing success response
0925 16:45:44.558379 (+  7683us) spinlock_profiling.cc:243] Waited 5.4 ms on lock 0x7b18005238a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:44.562338 (+  3959us) spinlock_profiling.cc:243] Waited 5.95 ms on lock 0x7b18005238a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
Metrics: {"prepare.queue_time_us":1102247,"prepare.run_cpu_time_us":90,"prepare.run_wall_time_us":94,"raft.queue_time_us":1949,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":2120,"spinlock_wait_cycles":26100864,"thread_start_us":1255490,"threads_started":2}
I20260925 16:45:44.608928  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.611819  9119 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:45:44.616382  9694 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
W20260925 16:45:44.574994 15821 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.808s	user 0.000s	sys 0.040s
I20260925 16:45:44.647110  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.647156  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.647888  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:44.651252  9698 raft_consensus.cc:2362] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20. Re-sending same reply.
W20260925 16:45:44.575070 15827 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.030s	sys 0.012s
I20260925 16:45:44.656849 15433 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.681623  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.662973 15722 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.584695 15759 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:44.703406  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.711675  9694 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:44.718196  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:44.720135  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 64069.8us
I20260925 16:45:44.724786  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.727326  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.726403 15889 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.728850  9702 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:44.729107 15889 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.729962 15433 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:44.732580 15671 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.734963 15671 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:44.645867 15689 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.687637 15716 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:44.719102 15623 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:44.763031  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.777894  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:44.778522  9119 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:44.731479 15889 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:44.723773 15759 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:44.686833 15842 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:44.759502 15673 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.928s	user 0.016s	sys 0.033s
I20260925 16:45:44.726054 15709 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260925 16:45:44.780153  9115 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.029s	sys 0.022s
I20260925 16:45:44.757411 15344 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:44.780288  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:44.791716  9115 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.779s	user 0.030s	sys 0.022s
I20260925 16:45:44.794843 14749 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:44.799988 14749 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:44.787217 15799 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.023s	sys 0.029s
W20260925 16:45:44.807534  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.977s	user 0.020s	sys 0.024s
W20260925 16:45:44.810649  9696 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.047s	sys 0.043s
W20260925 16:45:44.791180 15673 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.963s	user 0.017s	sys 0.033s
I20260925 16:45:44.782332 15848 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:44.783160 15716 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:44.785101 15578 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:44.815989  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.988s	user 0.023s	sys 0.022s
I20260925 16:45:44.937237 15822 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:45:44.839682 15894 thread.cc:636] apply [worker] (thread pool) Time spent creating pthread: real 0.753s	user 0.015s	sys 0.030s
W20260925 16:45:44.925761  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 451006us
W20260925 16:45:44.954686 15911 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260925 16:45:44.938570  9697 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.006s	sys 0.014s
W20260925 16:45:44.955132  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.025s	sys 0.030s
I20260925 16:45:44.957542  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3750) took 2376 ms. Trace:
W20260925 16:45:44.913713  9120 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.008s	sys 0.010s
I20260925 16:45:44.815485  9119 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
W20260925 16:45:44.954494  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 227254us
W20260925 16:45:44.876088  9118 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.579s	user 0.011s	sys 0.003s
W20260925 16:45:44.873739  9693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.836s	user 0.018s	sys 0.058s
I20260925 16:45:44.800593 14749 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:44.964092  9693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.938s	user 0.018s	sys 0.065s
W20260925 16:45:44.961197  9697 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.667s	user 0.006s	sys 0.014s
W20260925 16:45:44.846647  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.680s	user 0.008s	sys 0.007s
W20260925 16:45:44.963619  9118 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.015s	sys 0.006s
I20260925 16:45:44.961410  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:44.965595  9120 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.009s	sys 0.014s
I20260925 16:45:44.963214  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:44.962548  9696 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.016s	user 0.048s	sys 0.052s
W20260925 16:45:44.966224  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.799s	user 0.008s	sys 0.010s
W20260925 16:45:44.967454  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 800929us
W20260925 16:45:44.955502  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.127s	user 0.029s	sys 0.027s
W20260925 16:45:44.968648  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.15965e+06us
I20260925 16:45:44.969636  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.970709  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.816062 15872 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:44.962283  9115 rpcz_store.cc:276] 0925 16:45:42.581344 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.080070 (+498726us) service_pool.cc:227] Handling call
0925 16:45:43.080355 (+   285us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:43.118686 (+ 38331us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:43.957948 (+839262us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.794389 (+836441us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:44.804688 (+ 10299us) log.cc:842] Serialized 26 byte log entry
0925 16:45:44.804857 (+   169us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:44.804901 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.804990 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:44.957352 (+152362us) raft_consensus.cc:1671] finished
0925 16:45:44.957376 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.957492 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":57157,"prepare.queue_time_us":1121912,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":28,"raft.queue_time_us":43365,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":17211,"thread_start_us":1616193,"threads_started":2,"wal-append.queue_time_us":954294}
I20260925 16:45:44.794183 15623 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:44.974995 14749 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:44.860225 15712 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.009s	sys 0.007s
I20260925 16:45:44.964964  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1477) took 1808 ms. Trace:
I20260925 16:45:44.974995  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:44.958343 15909 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.103s	user 0.000s	sys 0.001s
I20260925 16:45:45.018986  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.030756 15910 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260925 16:45:45.018651 15842 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.013s
I20260925 16:45:45.032480 15842 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:45:45.032796 15842 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:45.033540 15842 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.034608 15842 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:45.018923 15913 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:45.036178 15913 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:45.036590 15913 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:45.040546 15926 raft_consensus.cc:979] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:45.040875 15716 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:45.041019 15926 raft_consensus.cc:1067] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:45:44.975144 15921 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:44.792625 15889 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.228s
W20260925 16:45:45.018076 15922 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260925 16:45:44.965751  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.16057e+06us
I20260925 16:45:45.018775 15620 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:45.019570  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.003s	sys 0.023s
W20260925 16:45:45.048156  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.003s	sys 0.023s
W20260925 16:45:44.955076  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.022s	sys 0.046s
I20260925 16:45:45.021744  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:45.014339  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43702.3us
W20260925 16:45:45.051474  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.025s	sys 0.053s
W20260925 16:45:45.022586  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47675us
I20260925 16:45:44.876698 15888 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:44.764197 15689 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.019858 15918 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:45.024009 15912 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.003s
I20260925 16:45:45.024834 15810 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:44.961954 15894 thread.cc:602] apply [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.019s	sys 0.034s
I20260925 16:45:45.045260 15931 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:44.878954 15545 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:45.074988  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:44.945982 15917 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:44.854812 15834 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.612s	user 0.000s	sys 0.013s
W20260925 16:45:45.022132 15712 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.785s	user 0.009s	sys 0.009s
I20260925 16:45:44.974851 15325 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:44.807463 15775 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.019651 15872 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.120460 15794 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.120924 15872 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.121490 15931 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:45.121774 15872 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.122382 15872 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.124624 15689 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.124835 15548 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.125308 15548 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.125749  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.126175 15765 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:45.126516 15765 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:45.127389 15548 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:44.960337 15799 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.892s	user 0.030s	sys 0.040s
W20260925 16:45:44.921241 15749 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.011s	sys 0.007s
I20260925 16:45:45.048105  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:44.971194  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1721) took 2012 ms. Trace:
I20260925 16:45:45.055899  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.057061 15888 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.057806 15918 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.042954 15848 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:45.076929 15889 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:44.847496 15725 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:45.070861  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:45.122531 15620 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:45.052439 15921 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:45.109560  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.162081  9122 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 10.
I20260925 16:45:45.110877 15768 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:45.113293 15911 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:45:45.114207 15805 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:45.116427  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:45.118922 15775 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.122444 15931 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.127908  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.018245 15709 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:45.065053 15752 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:45.134948  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:45.134776 15913 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.022181  9693 rpcz_store.cc:276] 0925 16:45:43.156210 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.157768 (+  1558us) service_pool.cc:227] Handling call
0925 16:45:43.158104 (+   336us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:43.158338 (+   234us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:45:44.026048 (+867710us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.964546 (+938498us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.964636 (+    90us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:44.964676 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.964810 (+   134us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.964921 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1088211,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":76,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":45041,"thread_start_us":1767796,"threads_started":2,"wal-append.queue_time_us":912763}
I20260925 16:45:45.108810 15803 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.082443 15545 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:44.991458  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:45.139984 15688 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.740s	user 0.015s	sys 0.055s
W20260925 16:45:45.147914  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 99898us
I20260925 16:45:45.147579  9696 rpcz_store.cc:276] 0925 16:45:42.958425 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:42.967735 (+  9310us) service_pool.cc:227] Handling call
0925 16:45:42.968091 (+   356us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:42.968346 (+   255us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:45:43.945904 (+977558us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.970914 (+1025010us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:44.970963 (+    49us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:44.971002 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.971057 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:44.971149 (+    92us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3521,"prepare.queue_time_us":1189929,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":2321,"raft.queue_time_us":3680,"raft.run_cpu_time_us":98,"raft.run_wall_time_us":44519,"thread_start_us":1998235,"threads_started":2,"wal-append.queue_time_us":951325}
W20260925 16:45:45.110608 15922 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:45.120981 15794 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.230434 15545 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.209856 15752 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.231462 15794 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.048188 15759 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.231789  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2030) took 1629 ms. Trace:
W20260925 16:45:45.140407 15834 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.902s	user 0.006s	sys 0.017s
I20260925 16:45:45.074795  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:45.147387 15749 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.825s	user 0.017s	sys 0.008s
W20260925 16:45:45.153852  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83114.5us
I20260925 16:45:45.083225 15623 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:45.210014 15688 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.810s	user 0.015s	sys 0.056s
I20260925 16:45:45.149667 15926 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:45.163514 15578 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:45.206334 15872 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.110428 15917 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.076040 15810 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.232291  9697 rpcz_store.cc:276] 0925 16:45:43.602879 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.603075 (+   196us) service_pool.cc:227] Handling call
0925 16:45:43.603793 (+   718us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:44.271330 (+667537us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:44.271373 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:44.282138 (+ 10765us) log.cc:842] Serialized 527 byte log entry
0925 16:45:44.966048 (+683910us) raft_consensus.cc:1631] Marking committed up to 7
0925 16:45:44.966083 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.966142 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:45.231522 (+265380us) raft_consensus.cc:1671] finished
0925 16:45:45.231549 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:45.231723 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":65973,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":12762,"thread_start_us":1338905,"threads_started":2,"wal-append.queue_time_us":879599}
W20260925 16:45:45.216388  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.631s (SENT) [suppressed 9 similar messages]
I20260925 16:45:45.155017 15848 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.236619  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.232795 15752 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.237201  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.266767  8939 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:45.235809 15834 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:45.127254 15765 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.156458 15889 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.271073  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:45.276834  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:45.210534 15803 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.228506 15670 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:45.170122 15620 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.260118  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3103) took 1895 ms. Trace:
I20260925 16:45:45.261664 15578 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:45.211476  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 220101us
I20260925 16:45:45.265956  9696 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:45.203858 15805 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.193931 15768 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.280839  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:45.297408  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:45.275019 15926 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:45.305848  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:45.307415  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.303000 15841 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:45.312247 15917 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.278805 15688 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:45:45.312851 15688 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:45.313179 15688 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:45:45.316197 15940 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:45.318946 15842 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.282186 15872 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260925 16:45:45.252595 15623 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.275713 15759 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.266938 15749 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260925 16:45:45.281689 15765 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:45.326547  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:45.350489  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.338861  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.161548 15921 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:45.249542 15545 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.049s
I20260925 16:45:45.281939 15752 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:45.394403  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.356153  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.355755  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.284264  8967 rpcz_store.cc:276] 0925 16:45:43.364480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:43.385432 (+ 20952us) service_pool.cc:227] Handling call
0925 16:45:43.385700 (+   268us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:43.415285 (+ 29585us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:43.415319 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:43.496871 (+ 81552us) log.cc:842] Serialized 26 byte log entry
0925 16:45:44.266998 (+770127us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:44.284082 (+ 17084us) log.cc:842] Serialized 14 byte log entry
0925 16:45:44.284393 (+   311us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:44.284484 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:44.417480 (+132996us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b1800459820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:45.237746 (+820266us) raft_consensus.cc:1671] finished
0925 16:45:45.259892 (+ 22146us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:45.260046 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10669,"prepare.queue_time_us":25436,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":11141,"raft.run_cpu_time_us":259,"raft.run_wall_time_us":20894,"spinlock_wait_cycles":7275904,"thread_start_us":702727,"threads_started":1,"wal-append.queue_time_us":1286851}
I20260925 16:45:45.391260  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.392951  8970 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:45.392644  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66162.2us
I20260925 16:45:45.414201  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.414423  8966 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:45.415742  8969 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:45.419662  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:45.415058  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.421531  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.422735  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:45.303491 15673 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:45.419664  8973 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
W20260925 16:45:45.414088  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 338533us
I20260925 16:45:45.425031  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.331629 15930 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:45.419935  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 310319us
I20260925 16:45:45.429167  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.303653 15827 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:45.326979 15578 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:45.431875  8972 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:45.436302  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.455960  8968 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:45.430661  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:45.437134  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.457492  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.458019  8969 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:45.458830  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.459295  8969 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:45.460364  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.460959  9042 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:45.460364  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:45.464926  8970 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:45.433424  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:45.440752  9046 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:45.432013  8975 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:45.444578  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.441465  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:45.466905  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.449774  8974 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:45.451002  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:45.340425 15931 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:45.465219  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.412156 15722 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:45.480166 14749 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.480610 14749 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.469313  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.471937  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.476946  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.478003  8966 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:45.484135  9047 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:45.488719  8969 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:45.490051  8969 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:45.490999  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.492938  9049 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:45.493089  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.493868  8973 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:45.498705  8972 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:45.453500  9696 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:45.434163 15759 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:45.430562 15794 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:45.371666 15842 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.504647  8975 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
W20260925 16:45:45.505924  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 289391us
I20260925 16:45:45.507567  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.524137  8974 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:45.524411  8969 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:45.524940  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.509215  9047 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:45.510860  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.442469 15918 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.442647 15888 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.544672  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.545115  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.513088  8967 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: [23.14-23.14]
W20260925 16:45:45.501698  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71109.8us
I20260925 16:45:45.515251 14749 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.516662  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:45.519762  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.519956  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.547286  8971 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:45.491719 15714 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260925 16:45:45.549916  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.551162  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:45.521009  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.521660  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.532109  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:45.547266  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:45.552210  9042 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:45.532264  9048 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:45:45.536414  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.354616 15939 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.151s
I20260925 16:45:45.544353  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.554456  8975 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:45.526082  9049 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:45.546831  8973 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:45:45.556491  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.517606 15689 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:45.557148  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.557602  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.440848 15344 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.083s
I20260925 16:45:45.554147  9702 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:45.558215  8971 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:45.559562  8974 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260925 16:45:45.557621  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.561798  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.559644  9693 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:45.570976 15610 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:45.512293 15913 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:45.571425  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.426432 15834 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.573042  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.573734  8971 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:45.574606  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:45.576939  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 302509us
I20260925 16:45:45.577509  9124 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:45.578328  9115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:45:45.578912  9115 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:45.579290  9115 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:45.580093  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.562398  8967 raft_consensus.cc:2362] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14. Re-sending same reply.
I20260925 16:45:45.584415  9699 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:45.576911  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.587941  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:45.591667  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.599879  8972 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:45.580479  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.595108  9115 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.615080  9115 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:45.606576  9042 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
W20260925 16:45:45.621538  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 74453.1us
I20260925 16:45:45.624590  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:45.593940 15893 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260925 16:45:45.616513  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.559013 15714 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:45.636305  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.638863  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.660398  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.661705  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:45.620774 15325 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.509s	user 0.010s	sys 0.000s
I20260925 16:45:45.664754  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.676502  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.677417  9120 raft_consensus.cc:2396] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:45:45.678051  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.611605 15752 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:45.680308  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.685045  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.685324  9699 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:45:45.634016 15610 consensus_queue.cc:1225] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:45:45.704779  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:45.709355  9046 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
W20260925 16:45:45.673954 15932 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260925 16:45:45.656677 15913 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:45.715344  9120 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:45.715771  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.709791  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.718055  9041 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:45.657073 15714 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:45.712023  9049 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260925 16:45:45.721046  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.723446  9115 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
W20260925 16:45:45.723555  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 200611us
I20260925 16:45:45.723990  9115 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
W20260925 16:45:45.724231  9015 connection.cc:232] RPC call timeout handler was delayed by -1.2662169909999648s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2941s for a response
I20260925 16:45:45.724438  9115 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:45.717307  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.729879  9122 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:45.684132 15325 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:45.731691  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.735839  9049 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:45.538894 15921 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.684110 15872 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:45.680382 15848 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.681209 15344 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:45.709640 15930 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:45.746558  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.744030  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.679661 15548 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.058s
I20260925 16:45:45.716110 15803 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:45.735895 15935 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:45:45.726465 15620 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.770552  9115 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.773567  9120 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:45.773866  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.779510  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.776572  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.744493 15805 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.784027  9115 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:45.712754 15752 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:45.745467 15913 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:45.751930 15768 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:45.800858  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:45.801342  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.805866  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:45.807403 15955 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260925 16:45:45.807796 15880 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260925 16:45:45.809929 15958 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:45:45.812227  9043 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:45.812587  9049 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
W20260925 16:45:45.817967  9075 heartbeater.cc:644] Failed to heartbeat to 127.7.158.254:39187 (4 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.158.254:39187 timed out after 15.000s (SENT)
I20260925 16:45:45.761605 15670 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.058s
W20260925 16:45:45.799592 15709 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.590s	user 0.007s	sys 0.002s
I20260925 16:45:45.820092 15709 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:45.821844  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.823764 15939 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:45.823915  9121 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:45.824342 15842 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:45.792719  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.802158  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:45.782831  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 194925us
I20260925 16:45:45.787647  9115 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:45.787984  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.828370  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:45.831745  9124 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:45.748967 15872 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:45.789062  9044 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:45:45.789052  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.752396 15889 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:45.764863 15921 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:45.757292 15735 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:45.855937  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.857486  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.857684  8975 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:45.840919  9119 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:45.848294  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.849378  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.861398  9041 raft_consensus.cc:2354] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:45:45.863292  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.824303 15939 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:45.790236 15810 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:45.879232  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:45.879869  9050 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:45.879884  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.839349 15872 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:45.855624 15794 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:45.883955  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:45.884620  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 208156us
I20260925 16:45:45.849354 15775 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:45.887470  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:45.849869 15805 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:45.891546  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.893705  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:45.894568  9046 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:45.893723  9119 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:45.896535  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:45.897716  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.900911  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.901808  9045 raft_consensus.cc:2396] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260925 16:45:45.904749  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.876196 15926 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260925 16:45:45.921417  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72125.8us
W20260925 16:45:45.921547  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 58373.1us
I20260925 16:45:45.923101  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.883464 15735 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:45.875856 15709 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:45.982352  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59331.9us
I20260925 16:45:45.884555 15689 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:46.032407 15963 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.233s	user 0.000s	sys 0.001s
W20260925 16:45:45.979995  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83580.3us
I20260925 16:45:45.893011 15794 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:46.033192 15944 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:46.033416 15794 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:46.035033 15805 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.032353 15960 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:46.036315 15960 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.038313 15960 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.040910  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.041453  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:46.042011  8974 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:46.042284  8974 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:46.042757  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.042891  8974 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.043521 15977 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:46.044050 15977 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.044669 15939 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.044925 15977 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.046444 15623 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.000219 15610 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:46.047222 15610 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:46.047595 15610 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:46.049240  8974 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:46.050681  9050 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:45.988256  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:45.999488  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:45.998430  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:45.985378  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62277.3us
W20260925 16:45:46.052495  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54182.7us
I20260925 16:45:46.054070  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:45.924105  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:45.886060 15673 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.093s
W20260925 16:45:46.021968  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 164587us
I20260925 16:45:45.922406 15926 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:45.979277 15827 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:46.023408  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.025542  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.027158 15709 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.028005 15889 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:45.984501 15966 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:46.021162 15765 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.626s	user 0.009s	sys 0.000s
W20260925 16:45:45.994670 15964 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.130s	user 0.000s	sys 0.000s
W20260925 16:45:45.993948 15967 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260925 16:45:46.051436  9047 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:46.019977  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:45.882869 15913 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.024442  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.058936  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:46.061180  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.031024 15689 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.061892  8974 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:46.063087  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.066358  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:45.988384 15722 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:45.997174 15810 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:46.070652  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 129000us
I20260925 16:45:46.087165  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.054723  9045 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:45:46.075923  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51607.4us
I20260925 16:45:46.076064  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:46.072615  8968 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:46.077649  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:46.035506 15805 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.062536 15926 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:46.075634  8969 raft_consensus.cc:595] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.089128  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.064225 15945 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:46.091315  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:46.092617  9695 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:46.096375  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.098748  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.099849 15671 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:46.071347 15827 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:46.094798  9699 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:46.064174 15973 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:46.102707  9089 leader_election.cc:398] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:45:46.103920  9045 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:46.104686  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.079522 15735 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260925 16:45:46.108340  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48274.9us
I20260925 16:45:46.109925  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.116043  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:46.082108 15946 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:46.107465 15775 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:46.102300 15930 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:45:46.179972  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56582.3us
I20260925 16:45:46.184491 15775 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:46.184787  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:46.185458 15775 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.168435 15671 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:46.190644 15671 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.200574  9117 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:45:46.204924  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.201324  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:46.203274  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 129140us
I20260925 16:45:46.204144  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.206070  8974 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:46.108556 15623 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:46.206947  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.208081  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:46.208323  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:46.209072  8974 raft_consensus.cc:2362] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15. Re-sending same reply.
I20260925 16:45:46.210059  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.209496  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.109257 15735 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:46.230844 15735 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:46.120203 15960 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:46.128222 15939 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:46.125407 15971 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:46.224385 15970 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.097s
I20260925 16:45:46.199402 15973 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260925 16:45:46.228744 15794 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.248494  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.125073 15810 raft_consensus.cc:2741] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260925 16:45:46.235608  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:46.199106 15433 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.236275  8972 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:46.211555  8974 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:46.091408 15722 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.120163 15982 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.111s
W20260925 16:45:46.233223 15688 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.920s	user 0.009s	sys 0.002s
I20260925 16:45:46.081750 15981 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.141s
W20260925 16:45:46.308460  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72938.5us
I20260925 16:45:46.306648  8971 raft_consensus.cc:2362] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15. Re-sending same reply.
I20260925 16:45:46.297142  8974 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:46.236734 15946 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:46.301931 15709 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.129019 15827 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.123s
W20260925 16:45:46.251173 15974 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
W20260925 16:45:46.307489  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 59112.3us
I20260925 16:45:46.325497  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:46.234133 15752 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.311121  8974 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.247051 15921 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260925 16:45:46.305013 15765 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.305548 15971 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.309021 15939 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:46.322150 15970 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260925 16:45:46.322758 15578 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.005s
I20260925 16:45:46.255410 15714 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.316677 15946 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.356025  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.333961 15981 consensus_queue.cc:1225] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 13.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260925 16:45:46.375650  9698 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:46.352089 15709 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:46.308171 15872 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.380833  9702 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260925 16:45:46.314860 15688 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.309216 15433 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.357751 15970 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.355958 15765 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.372237 15946 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:46.381315 15709 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:46.388041 15970 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:46.368469 15578 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.391578 15918 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:46.402174 15712 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:46.402096 15972 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:45:46.402501 15841 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.092s	user 0.005s	sys 0.005s
I20260925 16:45:46.399045 15767 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:46.401407 15794 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.401552  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:46.377056 15945 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
W20260925 16:45:46.404660  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 343528us
I20260925 16:45:46.408200  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:46.395396 15709 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:46.411983  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.398000 15805 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:46.445825 15942 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.409s	user 0.002s	sys 0.002s
I20260925 16:45:46.449298 15709 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.402637 15765 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.429664 15688 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:46.454885  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 128631us
I20260925 16:45:46.430200 15722 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:46.402633 15712 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:46.404034 15767 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.413040  9116 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:46.419039 15975 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:46.451552 15889 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:46.423223  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:46.413573 15972 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:46.460052  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:46.404280 15971 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.463614  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:46.473004 15714 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:45:46.473081  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:46.491621  9695 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:46.458962 15548 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:46.476132 15872 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:46.482077 15759 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.959s	user 0.008s	sys 0.002s
I20260925 16:45:46.492601 15548 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:46.493079 15759 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:46.493136 15548 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:46.483615  9122 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 10 FOLLOWER]: Advancing to term 11
W20260925 16:45:46.487159  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64011.5us
I20260925 16:45:46.496071 15712 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.488142 15325 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:46.497120 15325 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.497397 15712 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:46.497856 15325 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.466526 15578 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.500053 15767 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.500665  9122 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 11.
I20260925 16:45:46.501101 15767 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:46.487990 15735 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.496716  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.450409 15610 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.507747  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:46.467639 15950 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:46.529870  9694 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:46.528275 15433 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:46.510423 15988 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:46.512540 15714 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:46.511308 15950 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:46.502580 15926 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.533705 15841 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55034 (request call id 1204) took 11170 ms. Trace:
I20260925 16:45:46.542250 15841 rpcz_store.cc:276] 0925 16:45:35.358769 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:36.012679 (+653910us) service_pool.cc:227] Handling call
0925 16:45:36.376795 (+364116us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b58008cffb0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf25a7a 00007f719bf26ada 00007f719bf25c8b 00007f719bf31084 00007f719bf30743 00007f719bf28c1a 00007f71a0e6c6d9 00007f719a556184
0925 16:45:36.442587 (+ 65792us) log.cc:842] Serialized 501 byte log entry
0925 16:45:46.529588 (+10087001us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":66,"raft.queue_time_us":242,"raft.run_cpu_time_us":984,"raft.run_wall_time_us":13730,"spinlock_wait_cycles":576522624,"thread_start_us":67981,"threads_started":1,"wal-append.queue_time_us":134963,"wal-append.run_cpu_time_us":2380,"wal-append.run_wall_time_us":1122981}
I20260925 16:45:46.544889 15926 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:46.546100 15893 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.762s	user 0.003s	sys 0.000s
I20260925 16:45:46.546288 15610 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:46.547029 15950 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.548096 15950 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:46.559168 15709 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.561674 15548 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.563278 15888 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:46.572005 15888 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:46.572844 15735 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.573010 15888 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.574329 15888 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:46.587284 15548 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.597867 15810 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:46.598397 15810 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:46.602051 15952 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.944s	user 0.000s	sys 0.002s
I20260925 16:45:46.599378 15810 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:46.692304  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.008s	sys 0.007s
W20260925 16:45:46.693367  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.008s	sys 0.008s
W20260925 16:45:46.693840  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 635041us
I20260925 16:45:46.702445  8970 raft_consensus.cc:2354] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 13.
W20260925 16:45:46.715950  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.010s	sys 0.007s
W20260925 16:45:46.716497  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.602s	user 0.011s	sys 0.007s
I20260925 16:45:46.718572  9042 raft_consensus.cc:2396] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:45:46.442297  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:46.722720  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 280270us
I20260925 16:45:46.722944  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:46.726698  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:46.729715  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2058) took 1284 ms. Trace:
I20260925 16:45:46.730850  9699 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22.
I20260925 16:45:46.731420  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:46.737106 15548 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.740319 15433 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.740227 15578 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:46.741356 15610 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.742303 15767 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.745105 15714 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.746793  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:46.726801  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1687) took 1645 ms. Trace:
I20260925 16:45:46.793193 15433 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.793566 15767 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.795840 15610 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.797012  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3411) took 1132 ms. Trace:
W20260925 16:45:46.797839  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 441749us
I20260925 16:45:46.798959 15610 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.799196 15548 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.802058 15548 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.804687  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:46.806500 16007 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Leader election won for term 11
I20260925 16:45:46.807116 16007 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.808363  9124 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:46.810787  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:46.813540  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:46.816569  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:46.818111 15954 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:46.818454  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:46.818773 15954 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:46.820290 15973 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:46.820515 15954 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.821157 15973 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.822502  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2360) took 1464 ms. Trace:
I20260925 16:45:46.823282  8967 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: [10.8-12.9]
I20260925 16:45:46.825083  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3122) took 1274 ms. Trace:
I20260925 16:45:46.824962  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:46.825488  8967 rpcz_store.cc:276] 0925 16:45:45.550391 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.581602 (+ 31211us) service_pool.cc:227] Handling call
0925 16:45:46.822465 (+1240863us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:46.823754 (+  1289us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:46.824827 (+  1073us) spinlock_profiling.cc:243] Waited 1.24 s on lock 0x7b54003570d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.825016 (+   189us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2844287360}
I20260925 16:45:46.827600  9044 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
W20260925 16:45:46.830534  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 108052us
I20260925 16:45:46.832283  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:46.833173  9048 raft_consensus.cc:2354] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21.
I20260925 16:45:46.834920  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2362) took 1476 ms. Trace:
I20260925 16:45:46.835388  9121 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:46.836328 15972 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:46.836793 15972 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:46.837158 15972 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:46.837643  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3117) took 1288 ms. Trace:
I20260925 16:45:46.651978 15970 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.835147  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.797461  9120 rpcz_store.cc:276] 0925 16:45:45.664852 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.735336 (+ 70484us) service_pool.cc:227] Handling call
0925 16:45:45.735649 (+   313us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:45.774101 (+ 38452us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:46.796512 (+1022411us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400040954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:46.796804 (+   292us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":86681344}
I20260925 16:45:46.837579  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:46.846158 15889 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:46.846958  9043 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:46.848102 15921 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:46.848666 15921 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:46.778748  9118 rpcz_store.cc:276] 0925 16:45:45.080853 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.080976 (+   123us) service_pool.cc:227] Handling call
0925 16:45:45.081265 (+   289us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:45.081482 (+   217us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:45.081506 (+    24us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:45.081875 (+   369us) log.cc:842] Serialized 26 byte log entry
0925 16:45:45.395960 (+314085us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:45.396010 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:45.396093 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:46.601376 (+1205283us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:46.726064 (+124688us) raft_consensus.cc:1671] finished
0925 16:45:46.726107 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:46.726563 (+   456us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30589824,"thread_start_us":241093,"threads_started":1,"wal-append.queue_time_us":366923}
I20260925 16:45:46.850137 15921 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.835407  8968 rpcz_store.cc:276] 0925 16:45:45.358716 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.477568 (+118852us) service_pool.cc:227] Handling call
0925 16:45:46.834559 (+1356991us) spinlock_profiling.cc:243] Waited 579 ms on lock 0x7b54002cbfd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.834732 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1331319680}
I20260925 16:45:46.827651  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:46.856498  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:46.857197  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.838162  8966 rpcz_store.cc:276] 0925 16:45:45.549185 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.580534 (+ 31349us) service_pool.cc:227] Handling call
0925 16:45:46.835841 (+1255307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:46.836469 (+   628us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:46.836496 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:46.836556 (+    60us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:45:46.836603 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:46.836694 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:46.837310 (+   616us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54002cbfd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.837463 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2811093888}
I20260925 16:45:46.859144  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:46.866325  9115 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 10. Current term is 11. Ops: []
I20260925 16:45:46.866509 15767 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:46.866755 15966 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:46.868067 15966 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.868575 15975 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:46.869141 15975 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:46.870966 15966 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.872341 15433 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.873569 15810 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:46.822953  8970 rpcz_store.cc:276] 0925 16:45:45.358115 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.469034 (+110919us) service_pool.cc:227] Handling call
0925 16:45:46.822229 (+1353195us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003570d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.822414 (+   185us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2802788736}
W20260925 16:45:46.872416  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1330) took 1321 ms (client timeout 1655 ms). Trace:
I20260925 16:45:46.799116  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:46.883852  9119 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:46.889217  9047 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:46.889413  9116 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:46.891336 15970 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.892515  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2401) took 1104 ms. Trace:
I20260925 16:45:46.892999  9049 rpcz_store.cc:276] 0925 16:45:45.788339 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.805607 (+ 17268us) service_pool.cc:227] Handling call
0925 16:45:46.892063 (+1086456us) spinlock_profiling.cc:243] Waited 6.06 ms on lock 0x7b540008e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.892253 (+   190us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13926656}
I20260925 16:45:46.892515  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.894724 15610 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:46.895334 15610 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:46.896189  8973 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:46.771312  9696 rpcz_store.cc:276] 0925 16:45:45.444941 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.445129 (+   188us) service_pool.cc:227] Handling call
0925 16:45:45.453033 (+  7904us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:45.453291 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:45.555518 (+102227us) log.cc:842] Serialized 14 byte log entry
0925 16:45:46.393647 (+838129us) spinlock_profiling.cc:243] Waited 25.3 ms on lock 0x7b18003d40e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:45:46.537079 (+143432us) log.cc:842] Serialized 14 byte log entry
0925 16:45:46.728669 (+191590us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:46.728792 (+   123us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:46.728947 (+   155us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:46.729111 (+   164us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:46.729377 (+   266us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":35394,"prepare.queue_time_us":539522,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":225247,"raft.run_cpu_time_us":518,"raft.run_wall_time_us":17733,"spinlock_wait_cycles":58212224,"thread_start_us":143242,"threads_started":1}
I20260925 16:45:46.896803 15610 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.808976 15714 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.898254  8968 pending_rounds.cc:76] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 12
I20260925 16:45:46.898540  8968 pending_rounds.cc:97] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 13.13
I20260925 16:45:46.898783  8968 raft_consensus.cc:2866] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:45:46.874894  8975 rpcz_store.cc:269] 0925 16:45:45.550881 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.580142 (+ 29261us) service_pool.cc:227] Handling call
0925 16:45:46.872068 (+1291926us) spinlock_profiling.cc:243] Waited 252 ms on lock 0x7b54001e2654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.872248 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":578616576}
I20260925 16:45:46.896601  8973 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:46.903934  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:46.906944  8972 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:46.909933  8972 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:46.911190 16000 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:46.911870 15970 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:46.912503 15970 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.914868 15970 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:46.894755  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3582) took 1273 ms. Trace:
I20260925 16:45:46.915972  9042 rpcz_store.cc:276] 0925 16:45:45.621752 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.623087 (+  1335us) service_pool.cc:227] Handling call
0925 16:45:46.894470 (+1271383us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b54001707d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:46.894691 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2511588224}
I20260925 16:45:46.917268  8969 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:46.918581  8974 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:46.928177 15944 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:46.929963 15943 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Stepping down as leader of term 10
I20260925 16:45:46.929737  8973 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.930481 15943 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:46.931205  8973 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:46.932192 15943 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.935107  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:46.948854  9121 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:45:46.960110  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:46.960939  9042 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:46.964922 15970 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:46.957523  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:46.936249 15973 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:46.965691 15970 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:46.808938 16007 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:46.983065  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:46.968259 15548 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:46.997476  8970 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 22
I20260925 16:45:46.995980  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:46.994392 15921 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:47.000365  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:47.009847  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.534s	user 0.002s	sys 0.010s
I20260925 16:45:47.012940  9122 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:47.016055  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.016418 15991 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
W20260925 16:45:47.017156  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44499us
W20260925 16:45:47.017508  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 82494.9us
W20260925 16:45:47.019943 15939 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.660s	user 0.011s	sys 0.006s
I20260925 16:45:47.020398 15939 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:47.020835 15970 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:47.022291 15946 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.624s	user 0.000s	sys 0.014s
I20260925 16:45:47.022850 15946 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.023854  9120 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:47.028120  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.029542  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.030710  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.031102  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.032266  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1691) took 1447 ms. Trace:
I20260925 16:45:47.032637  9116 rpcz_store.cc:276] 0925 16:45:45.584670 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.657776 (+ 73106us) service_pool.cc:227] Handling call
0925 16:45:47.032023 (+1374247us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540009e554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:47.032171 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1627400960}
I20260925 16:45:47.033402 15972 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.036561  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.037179 15943 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 10 FOLLOWER]: Advancing to term 11
I20260925 16:45:47.037657  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:47.039713  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 240803us
I20260925 16:45:47.044811  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:47.045622  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.045993  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:47.046748  8971 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:47.007764 15433 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:47.048243  9043 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:45:47.048015 15433 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.050419 15433 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:47.051222  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:47.051890 15578 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:47.052448 15578 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:47.053601 15578 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.055285 15973 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:47.055908 15889 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:47.032307  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.057994  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:47.054102  9044 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260925 16:45:47.032676  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.030712  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.055421  9695 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:47.070154  9115 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260925 16:45:47.033442  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.073153  8973 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:47.073096  9042 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:45:47.064924  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
W20260925 16:45:47.077955 15827 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260925 16:45:47.080312  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.035576 15972 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.084060  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2383) took 1206 ms. Trace:
I20260925 16:45:47.071329 15889 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:47.089855 15889 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:47.090328 15889 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:47.091853  8967 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
W20260925 16:45:47.087877  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69419us
I20260925 16:45:47.087919  8973 rpcz_store.cc:276] 0925 16:45:45.877829 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:45.878012 (+   183us) service_pool.cc:227] Handling call
0925 16:45:46.895736 (+1017724us) spinlock_profiling.cc:243] Waited 88.9 ms on lock 0x7b5400343120. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2deff 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86
0925 16:45:47.084003 (+188267us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":204565888}
I20260925 16:45:47.097605  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.099234  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.101727  8974 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:45:47.102870  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:47.106665  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.081709 15954 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:47.114727  9119 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:47.085057 15991 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:47.116159  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.125973  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
W20260925 16:45:47.125463  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67640.4us
W20260925 16:45:47.120376  8921 auto_rebalancer.cc:663] Could not move replica: Not found: Couldn't find leader for tablet 12359c2bff0b46de91daa934c219103c
W20260925 16:45:47.132875  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Not found: Couldn't find leader for tablet 12359c2bff0b46de91daa934c219103c
I20260925 16:45:47.133006  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.133922  9041 raft_consensus.cc:2354] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:45:47.124785  9043 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:47.116918 15946 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:47.128746  8970 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:45:47.135661  9666 leader_election.cc:398] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21.
I20260925 16:45:47.130466  9695 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEARNER]: Advancing to term 19
I20260925 16:45:47.139492  9047 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:47.118252 15939 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.144255  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.151144 15996 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.151690  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:47.152076 15996 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:47.154577 15888 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.580s	user 0.015s	sys 0.001s
I20260925 16:45:47.155030 15996 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.156000 15954 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.158126 15954 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:47.159039  9117 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:47.159299  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.164673  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.167335  8973 raft_consensus.cc:2354] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 13.
I20260925 16:45:47.169338  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.165074  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:47.173254  8941 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22.
I20260925 16:45:47.173656  8941 leader_election.cc:401] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:45:47.186389  9043 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:47.187531  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:47.188315 15714 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:47.189517 15714 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:47.189879 15714 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:47.190428 16025 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.162s	user 0.003s	sys 0.000s
I20260925 16:45:47.190830 15714 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.191964 16009 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:47.193411  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.196473  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.196375 15971 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260925 16:45:47.199244 16027 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.183s	user 0.001s	sys 0.000s
I20260925 16:45:47.199884  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.214148  9050 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:47.200104  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.200492 16024 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:47.203531  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.204515  9118 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:45:47.205325 15775 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.205402  8969 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260925 16:45:47.207334 16029 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.157s	user 0.004s	sys 0.000s
I20260925 16:45:47.227005  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.228358  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:47.209092  9045 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:47.228850  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:47.229054  9699 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:47.180181  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:47.212025  8970 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:45:47.229983  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 67758.4us
I20260925 16:45:47.210624  9695 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEARNER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:47.203627  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:47.217527  9042 raft_consensus.cc:2354] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22.
I20260925 16:45:47.219759  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:47.224107  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.225047  8967 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260925 16:45:47.224696 16009 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.225611  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:47.213814 15991 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.223847 15775 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.234493  8971 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:47.237146  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.237810  9696 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:47.239138 15775 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.239899  9046 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:45:47.241077  9041 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 10. (term mismatch)
I20260925 16:45:47.241405  9041 pending_rounds.cc:76] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 9
I20260925 16:45:47.241631  9041 pending_rounds.cc:97] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 15.10
I20260925 16:45:47.241834  9041 raft_consensus.cc:2866] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:47.241995  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.243258  9041 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:47.230702 15939 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.243990  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.244573  9694 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:47.246011 15939 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:47.248138  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.249142 15889 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.241842  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.252180  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.216778 15996 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:47.254236  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50716.8us
I20260925 16:45:47.255249 15545 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22.
I20260925 16:45:47.256177  9121 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:47.256484 15972 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:47.257046 15972 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:47.257711 15994 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260925 16:45:47.257968 15972 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.260281 15722 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260925 16:45:47.233453  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 64307.8us
I20260925 16:45:47.253809 15996 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.285823  9696 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:45:47.276057  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.232496 15943 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:47.293440  9694 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:47.312640  9041 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260925 16:45:47.274887 15889 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.306087 15714 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:47.323949  9050 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:47.363233  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:47.374236  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.382690 15993 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:47.383478 15841 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:47.384200 15841 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.386075  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:47.412258  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.413421  8971 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:47.414719  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:47.415630  8975 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:47.417192 16009 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.420198  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:47.421293  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50907.6us
I20260925 16:45:47.421677  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.422164  8940 leader_election.cc:398] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22.
I20260925 16:45:47.422539  8973 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:47.423923 15545 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:45:47.424985 15991 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.377275  9124 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:45:47.314414  8969 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:47.438400  8969 raft_consensus.cc:595] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:47.438818  8969 raft_consensus.cc:603] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:47.430474  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:47.447741  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 100024us
I20260925 16:45:47.449263  9122 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:47.450027  9089 leader_election.cc:398] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:45:47.450394  9089 leader_election.cc:401] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
W20260925 16:45:47.456723  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 224525us
I20260925 16:45:47.469189  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:47.475375  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.504894  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:47.505352  9120 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260925 16:45:47.493871 15971 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.507215 15971 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.508358 15684 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:47.508801 15684 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:47.509888 15971 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:47.509747 15684 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.510694  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:47.511487 15937 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:47.511922 15937 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:47.512037  8967 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:47.512867 15937 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.514161 15937 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:47.506691  9123 pending_rounds.cc:76] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 13
I20260925 16:45:47.516140  9123 pending_rounds.cc:97] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 23.14
I20260925 16:45:47.516461  9123 raft_consensus.cc:2866] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:47.501137  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:47.521711  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 156333us
I20260925 16:45:47.478312 16009 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260925 16:45:47.493871 15673 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.032s
I20260925 16:45:47.530068  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:47.530656  8973 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:47.484609 15827 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:47.535279  8974 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:47.433103 15943 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.548471  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:47.549476 15921 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:45:47.558007 15841 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.501042 15954 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.568578  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:47.569010  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133137us
I20260925 16:45:47.574103  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.566497 15996 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.584527  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:47.588809  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 159069us
W20260925 16:45:47.585052  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 177688us
I20260925 16:45:47.590430  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.592291  8975 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:47.595453  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:47.602401  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 101370us
W20260925 16:45:47.579512 15810 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.697s	user 0.012s	sys 0.000s
I20260925 16:45:47.605715  8966 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: [17.12-20.14]
I20260925 16:45:47.617347  9043 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:45:47.617506 15978 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:47.618202 15978 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:47.618588  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:47.618716 15978 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.619421 15943 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.620060 15943 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:47.620656 15943 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.621731 15548 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:47.621945  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:47.622982 15954 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.623314  9016 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:47.623549  9042 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:47.623960  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:47.624752 16009 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:47.625041 15954 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.625377 16009 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:47.625620 15954 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:47.626113 15954 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:47.626760  9122 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:47.624778 16007 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:47.627507 16007 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:47.626124  9119 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:45:47.619155 15827 raft_consensus.cc:979] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:45:47.628466 16007 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.629674 15827 raft_consensus.cc:1067] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:45:47.630355 16007 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:47.632081  8971 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:47.622990 15548 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.010s
I20260925 16:45:47.633008  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.626533 16009 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.633771  8971 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:47.631978 15978 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.634706  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:47.635813 15545 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.636351 15545 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.638523 15545 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.611994  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:47.588501 16024 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:47.588492 15944 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:47.648818  9696 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 12. Current term is 13. Ops: []
I20260925 16:45:47.651026  8968 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 13.
W20260925 16:45:47.655638  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 66087.4us
I20260925 16:45:47.656925  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:47.662052  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:47.670626  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:47.621186 15943 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.681056  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:47.682188  9121 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:47.602200 15971 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.068s
I20260925 16:45:47.654842 16024 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:47.659272 15978 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.686276  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:47.669977 15972 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:47.688622  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:47.626932 15954 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.693250  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:47.655380 15944 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:47.676148 15673 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:47.691320 15975 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.822s	user 0.016s	sys 0.000s
I20260925 16:45:47.714079  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:47.719750  8975 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:47.700573 16024 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:47.720417 15939 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:47.707858 15972 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:47.772773  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85076.2us
I20260925 16:45:47.777065 15325 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:47.777101 15939 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:47.777523 16030 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.181s	user 0.000s	sys 0.000s
I20260925 16:45:47.778581 15939 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.781628 15939 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.781831  8966 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:47.785982 15684 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:47.748500 15841 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.789055 15841 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.799367 15943 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.800534 15827 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:47.802907 16044 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.803618 16044 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.806018 16044 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.720750 15610 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.090s
I20260925 16:45:47.783499  8966 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:47.811388  8970 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260925 16:45:47.796801  8967 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:47.791544 15841 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.774475 15972 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:47.819624  8974 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:47.710690 15944 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:47.821751  8973 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:47.718185 15975 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.827103  8975 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260925 16:45:47.716629 15978 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.819949 15433 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:47.823135 15973 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.838131  9700 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:47.811841 15994 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.018s
I20260925 16:45:47.843225 15433 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.846285 15975 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.722092 15673 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.853248  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:47.858073 15433 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.839840 15973 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.887287 15325 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.002s
I20260925 16:45:47.861932 16042 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:45:47.892998 15325 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:47.886484 15433 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:47.900909 15978 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.903982 15673 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:47.905678 15433 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:47.906724 15433 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.908663  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:47.909531 15325 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:47.909829 15325 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:47.909958  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:47.910199 15325 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:47.894649 16042 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:47.919193 15973 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:47.914904 15548 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:47.911630 16042 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:47.961007 15973 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:47.977717  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:47.981066  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:47.981834  8967 raft_consensus.cc:595] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:47.982214  8967 raft_consensus.cc:603] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:47.923389 15972 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:47.984602  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:47.982986  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:47.994578  9121 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260925 16:45:47.994737  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 319720us
W20260925 16:45:47.997056  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 319909us
I20260925 16:45:47.999990  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.002183  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:47.977146 15975 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:47.980365 15610 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:48.006847  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 301934us
I20260925 16:45:47.988263 15978 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.013976  9121 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:45:48.017186 15975 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.017639  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.019333 15975 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:48.020851 16039 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260925 16:45:48.021256  9118 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:48.023214  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:48.024049 15937 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.509s	user 0.005s	sys 0.009s
I20260925 16:45:48.024667 15937 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:48.026036 15937 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:45:48.027570 15610 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.029752 15610 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:48.030561  9695 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:48.031487  9116 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:48.037123 15673 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.037652 15673 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:48.044117 16045 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.179s	user 0.000s	sys 0.001s
I20260925 16:45:48.045919 15978 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:48.048410 15978 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:48.049839 15325 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.050269 15978 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:47.999188 15578 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:48.045673  9118 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:45:48.056617 15889 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:45:48.006959 15943 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:45:48.068114  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65624.7us
I20260925 16:45:48.062454 15325 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:48.039690 15673 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:48.074764 15325 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:45:48.080900  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:48.081342  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 74650.8us
I20260925 16:45:48.010366 15973 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.085559 15993 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260925 16:45:48.089037  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.089931  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:48.010756 15996 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260925 16:45:48.085075 15325 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.007s
I20260925 16:45:48.091930  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.086119 15722 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.109565  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:48.110342  8967 raft_consensus.cc:595] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:48.106635 15973 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:48.092376 16024 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:48.127722  9123 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.029s	sys 0.014s
W20260925 16:45:48.135340  9123 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.029s	sys 0.014s
I20260925 16:45:48.122570 16009 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:48.140472  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 426429us
I20260925 16:45:48.143819 16009 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:48.145833  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.146278 16009 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:48.146884 16043 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:48.146970  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.147802 16043 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:48.148329  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.149525  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.150118  9045 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:48.150349 16043 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:48.150991  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.152084  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.152997  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.167431 15973 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.168259 15973 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:48.169374 15944 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.170671 15973 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:48.155604 15714 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.812s	user 0.003s	sys 0.008s
I20260925 16:45:48.109624 15722 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.174731 15722 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:48.139645 15921 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:45:48.178681  9702 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:48.180049 15578 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:48.180505 15578 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:48.181636 15578 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.183290 15578 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:48.188786 16042 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:45:48.192314 15954 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.193089  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:48.201036  8866 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 16 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 17 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:45:48.204805 15775 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.209086  9693 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:48.194633  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:48.237996  9045 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:48.238350  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.219180  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:48.212119 15972 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:48.253250  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:48.261497  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 276475us
W20260925 16:45:48.258620  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64076.5us
W20260925 16:45:48.263188  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 252187us
I20260925 16:45:48.265201  8967 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:45:48.266009  8967 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:45:48.266439  8967 raft_consensus.cc:603] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:45:48.247068 15944 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:48.287743  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.285845  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:48.271061 15714 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:48.302580  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.305116  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.309882  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.270270 16056 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:48.243022 15954 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.320221  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:48.324667  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 201893us
I20260925 16:45:48.252156 15775 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.382748  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.379769  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.383471  9120 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:45:48.383999  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 287620us
W20260925 16:45:48.382275  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 171812us
W20260925 16:45:48.382385  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66104.9us
I20260925 16:45:48.392099  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.393566  9700 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:45:48.396833  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:48.398057  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 88266.5us
I20260925 16:45:48.408573  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.399435  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:48.411660  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.413748  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.415285  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.414558  9116 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:48.415310  8967 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:45:48.399582  9699 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:45:48.418807  9699 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:48.419206  9699 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:48.387442 15971 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:48.412328  8975 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:48.410027  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:45:48.420641  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.430146  8973 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:48.421254  8972 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:45:48.421344  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.422209  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.423156  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.397176 15993 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.424417 15775 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:48.424347 16024 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:48.393277 16068 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260925 16:45:48.447324  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50685.7us
I20260925 16:45:48.425732 16055 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:48.393447 16056 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.426879 15921 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:48.384284 15714 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:48.416296  9694 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
W20260925 16:45:48.398627 15684 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.612s	user 0.014s	sys 0.000s
I20260925 16:45:48.440541  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:48.473755  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77010us
W20260925 16:45:48.446132 16038 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:45:48.425257  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.459105  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.460882  8974 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260925 16:45:48.463670  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:48.469266  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.480760  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.468034  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.464876  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:48.394500 15944 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:48.440995 15971 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:48.477037  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.524482  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.526165  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:48.479436  9121 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:48.482772  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.443854 15972 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:48.465126 16068 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:48.530218  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.525282  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.531033  8966 raft_consensus.cc:2362] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22. Re-sending same reply.
I20260925 16:45:48.533113  8968 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:48.534816  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:48.535218  8969 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260925 16:45:48.535631  8969 pending_rounds.cc:76] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 9
I20260925 16:45:48.536082  8969 pending_rounds.cc:97] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260925 16:45:48.536442  8969 raft_consensus.cc:2866] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:48.534832  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.537812  9698 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260925 16:45:48.538319  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70739.9us
I20260925 16:45:48.539537  9701 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:45:48.483848 15994 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:48.541285  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:48.541433  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 60435.7us
I20260925 16:45:48.459254 15991 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.547456  8972 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:48.530339 15971 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:48.576109  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:48.529577 15433 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.018s	sys 0.014s
I20260925 16:45:48.475744 15921 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:45:48.481593 16055 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:48.633672  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54576.4us
W20260925 16:45:48.648874  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 263417us
I20260925 16:45:48.535312 16024 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:48.532827 16068 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:48.635973  9702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1757) took 1350 ms (client timeout 1590 ms). Trace:
I20260925 16:45:48.538129 16044 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.541373 15889 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.666859  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.667860  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:48.545202 15673 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.660151  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.648155  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:48.660758  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 81457.8us
I20260925 16:45:48.450232 15993 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:48.633606 15433 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.609s	user 0.019s	sys 0.015s
I20260925 16:45:48.481724 16056 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:48.545362 15994 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:48.647665 15972 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:48.535790 15944 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:48.686121  9698 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:45:48.662364  9702 rpcz_store.cc:269] 0925 16:45:47.226546 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:47.226678 (+   132us) service_pool.cc:227] Handling call
0925 16:45:48.576815 (+1350137us) spinlock_profiling.cc:243] Waited 944 ms on lock 0x7b5400333454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:48.576909 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2171494656}
I20260925 16:45:48.652778 16055 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:48.647814 15684 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:48.693070  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 229505us
W20260925 16:45:48.653098  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 113749us
I20260925 16:45:48.576373 15991 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:48.688571 16067 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
I20260925 16:45:48.711237  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:48.730161  8967 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:48.730849  9118 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:48.720702  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:48.727876  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78173.4us
I20260925 16:45:48.654982 15975 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260925 16:45:48.737387  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:48.735364  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.739255  9116 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:45:48.735198  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.697548 15994 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:48.736660 16070 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.251s	user 0.000s	sys 0.001s
I20260925 16:45:48.746626  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.747920  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:48.669705 16009 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.065s
I20260925 16:45:48.666369 15841 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.063s
I20260925 16:45:48.748116  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.710238 15810 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.720644 15973 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.671514 16044 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.751385  9116 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
W20260925 16:45:48.866010 16086 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260925 16:45:48.807001 15993 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:48.840039  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 261608us
W20260925 16:45:48.859990 16091 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260925 16:45:48.791759  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:48.901253  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:48.842142 15973 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:48.794559  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64972.7us
W20260925 16:45:48.941375  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 181498us
I20260925 16:45:48.742650 15972 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.789240 15684 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:48.831902 16067 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260925 16:45:48.806730 16066 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.172s
I20260925 16:45:48.844383  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:48.806128 16049 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:48.808648 16082 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.148s	user 0.000s	sys 0.000s
I20260925 16:45:48.691045 15673 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.808264 15841 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:48.858409 16096 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:48.804759 16080 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.098s
I20260925 16:45:48.706365 15714 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.748613 15954 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:48.690802 15889 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.732937 15775 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
W20260925 16:45:48.868369 16075 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
W20260925 16:45:48.870672 16062 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.379s	user 0.001s	sys 0.000s
I20260925 16:45:48.837893 16077 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.323s
I20260925 16:45:48.918715 16102 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.891590  9699 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:48.921314  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 183572us
I20260925 16:45:48.793540 15810 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:48.901053 16072 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:48.940621  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:48.984218  9693 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:48.985244  9696 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:48.942042  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:48.807811 16063 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260925 16:45:48.935480  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.949052  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:48.992684  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43864.8us
I20260925 16:45:48.993402 15325 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:48.949038 15993 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:45:48.993975 15993 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:48.994333 15993 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:48.950150 15975 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:48.999020 15975 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:48.999405 15975 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:48.976256 15684 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:48.978205 16060 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.370s	user 0.001s	sys 0.000s
W20260925 16:45:49.004264  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68879.9us
I20260925 16:45:49.006816  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:49.007910  9699 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:49.005550  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:48.977785 15954 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:48.952491 16024 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260925 16:45:49.010824  8968 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
W20260925 16:45:49.008553  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66588.5us
I20260925 16:45:49.003831 16084 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:48.965945 16049 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.009995  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:48.999162 15993 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.014773 16097 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:48.983121 16072 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:49.024803  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82153.6us
I20260925 16:45:48.980690 16096 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:49.015187  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 271736us
I20260925 16:45:49.002120 15944 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.061586  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:49.067304  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61846.2us
I20260925 16:45:49.077909  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:49.067862  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 57980.2us
W20260925 16:45:49.067122  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43880.1us
I20260925 16:45:49.071190  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.009217 16098 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:49.015326 16056 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:49.068243 16069 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.313s	user 0.000s	sys 0.001s
I20260925 16:45:49.084656  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:49.079227  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.084851  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:49.066813 16009 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:49.025488 15991 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.059720 16077 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:49.070417 16085 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260925 16:45:49.101432  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 107722us
I20260925 16:45:49.103029  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.107620  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.109004 15991 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:49.109622 15991 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.103734  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:45:49.162583  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55032.3us
W20260925 16:45:49.166356  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62707.1us
I20260925 16:45:49.169432  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:49.169199  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 177877us
I20260925 16:45:49.170316  9696 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:49.001168 16102 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.172986  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3810) took 1523 ms. Trace:
I20260925 16:45:49.068982 15954 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.095s
I20260925 16:45:49.104581 16077 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:49.182989  9119 rpcz_store.cc:276] 0925 16:45:47.649383 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:47.651402 (+  2019us) service_pool.cc:227] Handling call
0925 16:45:47.668698 (+ 17296us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:47.708713 (+ 40015us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:47.708747 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:47.769102 (+ 60355us) log.cc:842] Serialized 26 byte log entry
0925 16:45:48.093455 (+324353us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:48.093494 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:48.093560 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:49.172731 (+1079171us) raft_consensus.cc:1671] finished
0925 16:45:49.172758 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:49.172919 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3728,"raft.queue_time_us":8520,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"thread_start_us":270790,"threads_started":1,"wal-append.queue_time_us":656787}
W20260925 16:45:49.206451  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 97771.2us
I20260925 16:45:49.091102 15944 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:49.189538  9702 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:45:49.233855  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:49.167728 15545 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:49.100401 15996 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:45:49.101698 16044 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.106739 16085 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:49.107234 15943 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:49.115952 15937 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:45:49.110136 15991 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:49.105983 16098 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:49.250417  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:49.266820  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:49.264246  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 179496us
I20260925 16:45:49.186334 16100 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:49.070613 16084 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:49.251049  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 175214us
I20260925 16:45:49.077072 16097 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.274883  9119 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:49.287576  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:49.116647 15921 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:49.097682 16093 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.175s
I20260925 16:45:49.252974 15972 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.258188 16085 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:49.104471 16096 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.263800 16092 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:49.296900  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1716) took 1325 ms. Trace:
I20260925 16:45:49.271029 15944 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:49.276139 16044 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:49.293505 16078 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
W20260925 16:45:49.301008  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 135389us
W20260925 16:45:49.302476  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 69174.4us
I20260925 16:45:49.273070 15973 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.305323  9122 rpcz_store.cc:276] 0925 16:45:47.971578 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:47.971710 (+   132us) service_pool.cc:227] Handling call
0925 16:45:47.983778 (+ 12068us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:47.998638 (+ 14860us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:45:47.998670 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:48.004279 (+  5609us) log.cc:842] Serialized 26 byte log entry
0925 16:45:48.265650 (+261371us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:48.265710 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:48.265879 (+   169us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:49.296719 (+1030840us) raft_consensus.cc:1671] finished
0925 16:45:49.296738 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:49.296851 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":368,"raft.queue_time_us":3410,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":4717,"thread_start_us":244672,"threads_started":1,"wal-append.queue_time_us":504475}
I20260925 16:45:49.261037 16066 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.038s
I20260925 16:45:49.316079  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:45:49.320909  9698 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.600s	user 0.005s	sys 0.005s
I20260925 16:45:49.321694  9698 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:45:49.324517 15325 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:45:49.329427 16089 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.364s	user 0.000s	sys 0.002s
I20260925 16:45:49.330848  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1326) took 1252 ms. Trace:
I20260925 16:45:49.331200  9043 rpcz_store.cc:276] 0925 16:45:48.078538 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.078648 (+   110us) service_pool.cc:227] Handling call
0925 16:45:48.085834 (+  7186us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:48.397277 (+311443us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.397658 (+   381us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:48.415597 (+ 17939us) log.cc:842] Serialized 26 byte log entry
0925 16:45:48.577310 (+161713us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:48.577359 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:48.577444 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:49.328609 (+751165us) spinlock_profiling.cc:243] Waited 87.5 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:49.330525 (+  1916us) raft_consensus.cc:1671] finished
0925 16:45:49.330549 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:49.330773 (+   224us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22433,"raft.queue_time_us":87119,"raft.run_cpu_time_us":58,"raft.run_wall_time_us":59,"spinlock_wait_cycles":201213312,"thread_start_us":388451,"threads_started":2,"wal-append.queue_time_us":461028}
W20260925 16:45:49.327530 16101 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.323s	user 0.001s	sys 0.000s
I20260925 16:45:49.310415 15673 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.318815 16024 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:49.359171 16116 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:49.376300  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:49.376506  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:49.310132 15944 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:49.381561  9048 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:49.310559 15889 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.306421 15684 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.304080 15810 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.304865 16056 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:49.297801 16009 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.076s
I20260925 16:45:49.389211  9121 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:49.388574 16116 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.418213 16116 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:49.393654 15971 consensus_meta.cc:287] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.745s	user 0.010s	sys 0.000s
I20260925 16:45:49.303970 16104 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.321s
I20260925 16:45:49.394062 15671 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.010s
I20260925 16:45:49.296142 16100 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.393684 16118 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:49.421530 16118 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.422777 16100 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.381220 15993 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.393672 16102 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:49.396857 16105 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260925 16:45:49.428093 15991 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.397958 16084 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.397996 15975 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.388027 15944 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:49.430533 15975 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:49.431639  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46051us
I20260925 16:45:49.393247 16094 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:49.400638 15978 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:49.431834 15325 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.432719 15978 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:49.433056 15921 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:49.431767 16118 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.433109 15325 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:49.397550 16042 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.155s	user 0.005s	sys 0.006s
I20260925 16:45:49.436513  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:49.404664  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 131724us
W20260925 16:45:49.437412  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 128093us
I20260925 16:45:49.464262  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:49.445003  9049 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:49.520025  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:49.320331 16044 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.521989 15325 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.466123  9121 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:45:49.419158 15971 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.526443  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:49.523737  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 355372us
I20260925 16:45:49.285034 16098 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.518369 15722 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.515153 15545 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:49.550299  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 104766us
W20260925 16:45:49.550370  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 102844us
I20260925 16:45:49.300031 16077 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:49.521973 16118 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.522419 15889 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:49.587256  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.519209 16049 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:49.598766  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 154410us
I20260925 16:45:49.606369  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.604699  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3609) took 1491 ms. Trace:
W20260925 16:45:49.608325  9124 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.658s	user 0.009s	sys 0.016s
W20260925 16:45:49.653044  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53095.7us
W20260925 16:45:49.663017  9124 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.009s	sys 0.026s
W20260925 16:45:49.661334  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 107552us
I20260925 16:45:49.669953  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:49.603320 15994 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.003s
I20260925 16:45:49.671132  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:49.737087  9697 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
W20260925 16:45:49.737555  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.019s	sys 0.020s
W20260925 16:45:49.739049  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.020s	sys 0.020s
I20260925 16:45:49.663440 16074 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:49.738230 16108 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.737489 16115 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:49.747049  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:49.582857 15722 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.749815  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:49.753049  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:49.684615 15994 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.754261  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:49.754994 15794 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:49.676853 15991 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:49.609184 16009 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.126s
W20260925 16:45:49.756639  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.813s	user 0.020s	sys 0.047s
W20260925 16:45:49.773078  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.022s	sys 0.047s
W20260925 16:45:49.773350  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 103499us
W20260925 16:45:49.773558  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 831579us
W20260925 16:45:49.749101 16069 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260925 16:45:49.744805 15578 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.511s	user 0.009s	sys 0.003s
I20260925 16:45:49.662251 16118 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.667862  9044 rpcz_store.cc:276] 0925 16:45:48.113689 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.113850 (+   161us) service_pool.cc:227] Handling call
0925 16:45:48.122501 (+  8651us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:48.122788 (+   287us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.122813 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:48.123195 (+   382us) log.cc:842] Serialized 26 byte log entry
0925 16:45:48.397659 (+274464us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:48.397791 (+   132us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:48.398165 (+   374us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:49.604463 (+1206298us) raft_consensus.cc:1671] finished
0925 16:45:49.604492 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:49.604633 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":55407,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":104,"thread_start_us":256941,"threads_started":1,"wal-append.queue_time_us":838768}
I20260925 16:45:49.779193 15994 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.781118  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:49.781562  9702 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:49.783212  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:49.783957  9696 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:49.777249  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:49.756775 16063 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260925 16:45:49.786238  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:49.777601  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 106546us
I20260925 16:45:49.787384  9123 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:49.782994 15971 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:49.791090  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:49.795838 16119 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.798130  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:49.770140 16097 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:49.773150 16074 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:49.808321  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:49.971007  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 162762us
W20260925 16:45:49.809041  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 150334us
I20260925 16:45:49.973037 15325 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:49.973367 15325 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:49.786538 16118 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.870811  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:49.790375 15578 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:49.787781 15993 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.170s
I20260925 16:45:49.933601  9696 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:49.773618 15794 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:49.879022  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:49.986656  8968 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:49.986970  8968 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:49.987218 16099 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.035s	sys 0.059s
W20260925 16:45:49.987576 16099 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.035s	sys 0.060s
W20260925 16:45:49.941839  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 335542us
I20260925 16:45:49.931738 16102 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:49.956698  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:49.930670  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:49.959812  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:49.973652 15325 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:49.960918  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 167415us
W20260925 16:45:49.896467 15714 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.040s	sys 0.091s
I20260925 16:45:49.772746 16108 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:49.810038 16096 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:49.984340  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 113626us
I20260925 16:45:49.976302 16074 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:49.977105 16093 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:49.988543  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:49.996071  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 396454us
I20260925 16:45:49.998572  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:49.987732  8968 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.004423  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.004525  9044 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:49.776618 15991 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.784760 15921 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:50.004657  8968 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:50.005692  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:49.995790  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 204839us
I20260925 16:45:49.979193 15978 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:49.988826 15794 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:49.980324 15578 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.014810  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:50.000806 15714 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.040s	sys 0.091s
I20260925 16:45:49.770685 16115 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:49.995743 15810 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.036653  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:49.883119 16119 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.037346  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.038178  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.040303  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:49.999189 16044 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.007038 16074 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:50.000356 16102 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.043413  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.034031 15972 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
I20260925 16:45:50.069607  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:50.073616  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60698.8us
I20260925 16:45:50.075205  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.076875  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.003072 16049 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:50.074296 16068 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.369s	user 0.009s	sys 0.000s
I20260925 16:45:50.013794 16093 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.103668 16108 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.041030 15578 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:50.035423 16096 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:50.093175  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.106832  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.033717 15433 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:50.105727  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:50.112166  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.114815  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.116287  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.079174 15973 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.099908 15978 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260925 16:45:50.123306  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 194456us
I20260925 16:45:50.030208 15921 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.120428  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.118342  9123 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 24. Current term is 25. Ops: []
I20260925 16:45:50.079924 16098 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.122099 15973 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.099771 15714 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.120428  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.118095 15673 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.126071  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:50.126645  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 135560us
W20260925 16:45:50.120491 15944 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.691s	user 0.009s	sys 0.000s
I20260925 16:45:50.104142 16093 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:50.074790 15810 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.136346  9699 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:50.134375 16098 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:50.123824 15978 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:50.102643 16068 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.180303  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3835) took 1008 ms. Trace:
I20260925 16:45:50.180872  9119 rpcz_store.cc:276] 0925 16:45:49.171878 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:49.293697 (+121819us) service_pool.cc:227] Handling call
0925 16:45:49.304953 (+ 11256us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:49.582785 (+277832us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:49.587100 (+  4315us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:49.603234 (+ 16134us) log.cc:842] Serialized 26 byte log entry
0925 16:45:49.991410 (+388176us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:49.991760 (+   350us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:49.992192 (+   432us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:50.180024 (+187832us) raft_consensus.cc:1671] finished
0925 16:45:50.180053 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.180232 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6109,"raft.queue_time_us":90823,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":34926,"thread_start_us":477786,"threads_started":2,"wal-append.queue_time_us":350493}
I20260925 16:45:50.139184  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:50.152781  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1362) took 1415 ms. Trace:
I20260925 16:45:50.109562 15971 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.031s
I20260925 16:45:50.149158 15714 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:50.157994  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57836.4us
I20260925 16:45:50.158730 16110 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:50.164021 16131 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260925 16:45:50.163898 16103 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:50.164537 16121 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:50.165042 16137 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260925 16:45:50.163028 16129 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:50.200968 16129 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:50.162854 16134 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.219s	user 0.000s	sys 0.001s
I20260925 16:45:50.201296 16129 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:50.144311 15673 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.191639 16110 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.165273 16132 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:50.203883 16132 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:50.204267 16132 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:50.205327 16110 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.206050  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1722) took 1628 ms. Trace:
I20260925 16:45:50.206396  9124 rpcz_store.cc:276] 0925 16:45:48.578037 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.578166 (+   129us) service_pool.cc:227] Handling call
0925 16:45:48.653702 (+ 75536us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:48.917971 (+264269us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.918015 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:48.920804 (+  2789us) log.cc:842] Serialized 26 byte log entry
0925 16:45:49.663511 (+742707us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:49.663553 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:49.663635 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:50.205832 (+542197us) raft_consensus.cc:1671] finished
0925 16:45:50.205854 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.205989 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":193890,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":86,"thread_start_us":802521,"threads_started":2,"wal-append.queue_time_us":857851}
I20260925 16:45:50.207557 16068 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.166316 16119 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.143443 15944 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.208364  8971 raft_consensus.cc:2354] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17.
I20260925 16:45:50.180516 15972 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:50.209698 16102 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:50.210031 15944 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.108189 16049 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:50.210758 16125 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.323s	user 0.001s	sys 0.001s
I20260925 16:45:50.210991  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:50.172149 16141 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.211s	user 0.000s	sys 0.001s
I20260925 16:45:50.211362 16158 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:50.212132 16153 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.212479 16049 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.181854 15978 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:50.159004 15325 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.120312 15433 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:50.213886 16085 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.895s	user 0.009s	sys 0.000s
I20260925 16:45:50.214262 16085 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.214709 15325 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.215148 15433 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:50.163225 16087 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260925 16:45:50.212427  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3451) took 1137 ms. Trace:
I20260925 16:45:50.216336 16121 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.218321 16121 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.218858 15673 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.185091  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:50.161033 16135 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:50.220930 16135 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:50.221259 16135 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:50.195564  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.224020  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.184366  8967 rpcz_store.cc:276] 0925 16:45:48.737413 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.738289 (+   876us) service_pool.cc:227] Handling call
0925 16:45:48.738589 (+   300us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:48.989684 (+251095us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.989718 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:48.989754 (+    36us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:48.989808 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.151891 (+1162083us) spinlock_profiling.cc:243] Waited 251 ms on lock 0x7b54003575d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:50.152611 (+   720us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.152730 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":577050496}
I20260925 16:45:50.224886  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.225358  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:50.225968  8967 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:50.226289  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.226850  9047 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:45:50.215802  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.225987  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.229347 15944 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:50.229754 15944 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.230089 15944 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:50.230893 15973 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.198412 16098 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:50.231951 16098 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.233002 16103 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:50.201545 15810 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.233942 16103 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.236346 16115 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.162599 16156 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.237023  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.237095 16156 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.238881  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.239198  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.212641 16158 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:45:50.240876 16158 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:50.241734 16158 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.243153 16158 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:45:50.208400  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1358) took 1667 ms. Trace:
I20260925 16:45:50.244026  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1363) took 1492 ms. Trace:
I20260925 16:45:50.244431  8969 rpcz_store.cc:276] 0925 16:45:48.751605 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.758841 (+  7236us) service_pool.cc:227] Handling call
0925 16:45:48.805337 (+ 46496us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:48.965921 (+160584us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.965963 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:48.966017 (+    54us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:48.966059 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.243790 (+1277731us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:50.243841 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.243965 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":368817920}
I20260925 16:45:50.245872  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:50.246385  8969 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:50.246789 15714 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.247056  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:50.162767 16055 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.430s	user 0.009s	sys 0.001s
I20260925 16:45:50.199249 16109 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:50.208194 16147 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
W20260925 16:45:50.210410 16122 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.490s	user 0.001s	sys 0.000s
I20260925 16:45:50.247586  9124 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:50.210124  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:45:50.162706 16114 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.478s	user 0.000s	sys 0.001s
I20260925 16:45:50.160910  9696 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:50.212641 16153 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.124439 16096 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.216562  9120 rpcz_store.cc:276] 0925 16:45:49.075131 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:49.075302 (+   171us) service_pool.cc:227] Handling call
0925 16:45:49.095312 (+ 20010us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:49.166965 (+ 71653us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:49.166998 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:49.186053 (+ 19055us) log.cc:842] Serialized 26 byte log entry
0925 16:45:49.381307 (+195254us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:49.381369 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:49.381467 (+    98us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:50.212233 (+830766us) raft_consensus.cc:1671] finished
0925 16:45:50.212252 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.212376 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":57749,"raft.queue_time_us":60322,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":22247,"thread_start_us":109135,"threads_started":1,"wal-append.queue_time_us":365994}
I20260925 16:45:50.198228 16145 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:50.159857 16154 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:50.244067  8966 rpcz_store.cc:276] 0925 16:45:48.540769 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.540881 (+   112us) service_pool.cc:227] Handling call
0925 16:45:48.547260 (+  6379us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:48.925495 (+378235us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.925994 (+   499us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:48.949205 (+ 23211us) log.cc:842] Serialized 52 byte log entry
0925 16:45:49.446066 (+496861us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:49.446125 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:49.446216 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:50.208174 (+761958us) raft_consensus.cc:1671] finished
0925 16:45:50.208201 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.208349 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":138502,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":8120,"thread_start_us":734578,"threads_started":2,"wal-append.queue_time_us":588620}
I20260925 16:45:50.268290  9701 raft_consensus.cc:2362] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15. Re-sending same reply.
I20260925 16:45:50.189585  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:50.187106  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55500.8us
I20260925 16:45:50.270109  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.256304  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.257395  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:50.237046  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1364) took 1443 ms. Trace:
W20260925 16:45:50.248385  8975 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3153) took 1802 ms (client timeout 2188 ms). Trace:
W20260925 16:45:50.336800  8975 rpcz_store.cc:269] 0925 16:45:48.445639 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.445760 (+   121us) service_pool.cc:227] Handling call
0925 16:45:50.247879 (+1802119us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b54002ff9a8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1ea3434 00007f71a0e6c437 00007f71a0e6bbc8 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86
0925 16:45:50.248323 (+   444us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":103264512}
I20260925 16:45:50.263422  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.255829  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:50.187520  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48425.8us
I20260925 16:45:50.338717  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.335155  9043 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:45:50.340026  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:50.320927  8968 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
W20260925 16:45:50.340729  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 83417.3us
W20260925 16:45:50.161695 16133 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260925 16:45:50.254788 16064 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.859s	user 0.003s	sys 0.004s
W20260925 16:45:50.379432  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 278680us
I20260925 16:45:50.359839  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.383368  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:50.381682  9698 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260925 16:45:50.360280  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:50.362176  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 172708us
I20260925 16:45:50.345844  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.346573  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.394122  9116 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
W20260925 16:45:50.319041  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.668s (SENT) [suppressed 20 similar messages]
I20260925 16:45:50.394826  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:50.395170  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 76186.2us
I20260925 16:45:50.395490  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.198536 15991 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.335795  8972 rpcz_store.cc:276] 0925 16:45:48.793543 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.793669 (+   126us) service_pool.cc:227] Handling call
0925 16:45:48.804848 (+ 11179us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:49.006494 (+201646us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:49.006528 (+    34us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:49.006563 (+    35us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:49.006593 (+    30us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.236838 (+1230245us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54002ff654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:50.236883 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.236993 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":463318784}
I20260925 16:45:50.341776  9695 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:50.391058  9119 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:50.409564  9089 leader_election.cc:398] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 11. Current term is 13.
I20260925 16:45:50.215848 16127 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:50.239253 16156 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.400938  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.382309 16159 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:50.402448 15972 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:50.402257 16147 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:45:50.402853 16110 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.404168  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.263522 15921 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.405776  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.406556  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.250231 15978 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.189035 16044 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:50.416291  8975 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260925 16:45:50.386071  8969 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:50.478614  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2416) took 2089 ms. Trace:
I20260925 16:45:50.427910  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.429438  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:50.333228 16102 raft_consensus.cc:465] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Not starting pre-election -- already a leader
I20260925 16:45:50.251284 15722 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.233927 16098 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.431844  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.431918  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.433584  9121 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:50.379864 16051 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:50.393077 15973 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:50.388477 15775 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:50.467427  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.466883  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:50.458108  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 445887us
I20260925 16:45:50.411224  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:50.476373  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.475483  9701 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:50.159595 16146 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.362s
I20260925 16:45:50.431028 15943 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:45:50.496460 15943 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:50.491287  8972 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:45:50.478147  9043 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:45:50.475162  8966 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
W20260925 16:45:50.464285 16114 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:45:50.479530  8974 rpcz_store.cc:276] 0925 16:45:48.389671 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.389807 (+   136us) service_pool.cc:227] Handling call
0925 16:45:48.410757 (+ 20950us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:48.479872 (+ 69115us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.478358 (+1998486us) spinlock_profiling.cc:243] Waited 49.7 ms on lock 0x7b54002ffb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:50.478556 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":114339584}
I20260925 16:45:50.474877 16085 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.500952  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.475003 16162 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.247634 16055 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.484298  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.485427  9120 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:50.486915  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.487250 16049 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:50.488698  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3832) took 1544 ms. Trace:
I20260925 16:45:50.501791  8975 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:50.476722 15972 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.423324  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:50.469729 16154 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:50.498941  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:50.530681  9119 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 18
I20260925 16:45:50.499521  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:50.483289  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55517.9us
I20260925 16:45:50.502353  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.532143  9045 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:50.333096 16109 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:50.501080  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 101142us
I20260925 16:45:50.505510  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.506976  9047 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:50.496856 15943 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:50.521299  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.521445  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:50.539978  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 149423us
I20260925 16:45:50.519196  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.532560  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.537899  9121 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:50.490990 15722 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.540534  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.541879  8972 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:50.536711  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:50.542865  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.490967 15775 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.539582  9043 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:50.552299  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.553335  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.519028  9117 rpcz_store.cc:276] 0925 16:45:48.943935 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.944037 (+   102us) service_pool.cc:227] Handling call
0925 16:45:48.944282 (+   245us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:49.078976 (+134694us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:49.079018 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:49.100673 (+ 21655us) log.cc:842] Serialized 26 byte log entry
0925 16:45:49.298821 (+198148us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:49.298873 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:49.300384 (+  1511us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:50.488487 (+1188103us) raft_consensus.cc:1671] finished
0925 16:45:50.488506 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.488628 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5083,"raft.queue_time_us":153425,"raft.run_cpu_time_us":220,"raft.run_wall_time_us":58620,"thread_start_us":210192,"threads_started":2,"wal-append.queue_time_us":355316}
I20260925 16:45:50.546502  8966 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:50.557322 16115 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:50.557101 16136 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.087s
I20260925 16:45:50.518899 16049 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.558156 16136 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:50.558591 16136 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:50.560098 15972 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:50.560308 16131 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:45:50.544412 15971 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:50.519948 16084 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:50.561045 15971 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.561548 15971 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:50.567437 16166 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:50.482045 16110 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.553155  9041 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:50.434821 16127 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.568029 16166 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.575909 16166 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.576774  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.578222  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.580210  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.583043  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:50.538693 16156 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:50.587169  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:50.588613  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 178415us
I20260925 16:45:50.589673  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:50.590729  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:50.584277  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117485us
I20260925 16:45:50.558151 16049 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:50.561446 16084 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:50.597359  8966 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:50.570428 15775 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:50.602063  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.604068  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.603830  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.605011  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.519348 16132 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.559525 16136 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.573026 15722 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.658407  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.685734  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1768) took 2191 ms. Trace:
I20260925 16:45:50.685549  9699 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
W20260925 16:45:50.680338  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 102180us
W20260925 16:45:50.635120  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 94259.2us
I20260925 16:45:50.666189  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:50.689713  8972 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:45:50.690618  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.686964  9693 rpcz_store.cc:276] 0925 16:45:48.471142 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.471302 (+   160us) service_pool.cc:227] Handling call
0925 16:45:48.485286 (+ 13984us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:48.988927 (+503641us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.662172 (+1673245us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b5400691754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:50.662358 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1146925312}
I20260925 16:45:50.698769  9119 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:50.691184  8972 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:50.519502 16162 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.658957  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:50.713583  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3447) took 2250 ms (client timeout 1530 ms). Trace:
W20260925 16:45:50.714017  9118 rpcz_store.cc:269] 0925 16:45:48.418238 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.418621 (+   383us) service_pool.cc:227] Handling call
0925 16:45:50.668046 (+2249425us) spinlock_profiling.cc:243] Waited 299 ms on lock 0x7b54003bf1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:50.668173 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":687458176}
I20260925 16:45:50.594784 16115 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:50.693931 15794 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.629s	user 0.006s	sys 0.003s
I20260925 16:45:50.718987  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.605904 15972 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:50.744472  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:50.743115  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53623.5us
W20260925 16:45:50.762979  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104095us
I20260925 16:45:50.646478 16145 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:50.773257  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.603823 15673 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:50.648926 16009 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:50.791369  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:50.744943 16129 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.543s	user 0.003s	sys 0.007s
I20260925 16:45:50.795288  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.795994  9699 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:45:50.796578  9699 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:50.801054  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.801824  9047 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:50.647001 16156 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:50.765229 16115 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:50.704064 16098 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:50.789198  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:50.704300 16096 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.820082  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:50.820986 16127 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.821830 16080 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:50.822144 15722 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.822314 16080 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:50.822687 16080 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:50.823122 16110 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:50.806770  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:45:50.825165  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:45:50.825460 16074 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.725s	user 0.004s	sys 0.005s
I20260925 16:45:50.825965 16074 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.826028 16084 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.828349 16162 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.805686  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:50.788311  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69602.3us
I20260925 16:45:50.807358  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.769301 15972 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:50.808367  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.774012 16136 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:45:50.811899 16169 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
W20260925 16:45:50.864081  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63433.7us
I20260925 16:45:50.864825  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:50.865024  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:50.814301 16174 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260925 16:45:50.874042  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.821913 16145 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.735562 16153 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.832535  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:50.810703  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:50.820916 16170 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260925 16:45:50.792318 16118 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
W20260925 16:45:50.872462  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78760.6us
I20260925 16:45:50.873138  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.884635  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:50.886073  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.893796  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.905509  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:50.776753 15794 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.834429 15978 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.829139 16115 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:50.921553  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1370) took 1129 ms. Trace:
I20260925 16:45:50.922449 15794 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:50.892309 15722 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:50.899663  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:50.928918  9696 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:50.858593 15972 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:50.933027 16154 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:50.937100 16074 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:50.937994  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:50.921897  8968 rpcz_store.cc:276] 0925 16:45:49.791909 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.379753 (+587844us) service_pool.cc:227] Handling call
0925 16:45:50.380059 (+   306us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:50.393476 (+ 13417us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:50.393548 (+    72us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:50.434626 (+ 41078us) log.cc:842] Serialized 26 byte log entry
0925 16:45:50.537386 (+102760us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:50.552401 (+ 15015us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.552477 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:50.921359 (+368882us) raft_consensus.cc:1671] finished
0925 16:45:50.921377 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:50.921502 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13018,"raft.queue_time_us":13126,"raft.run_cpu_time_us":182,"raft.run_wall_time_us":264,"thread_start_us":43282,"threads_started":1,"wal-append.queue_time_us":103261}
I20260925 16:45:50.940158  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:50.941418  8968 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:45:50.884799 16024 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:50.942006 16024 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:50.942385 16024 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:50.942490  8968 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260925 16:45:50.944016 16118 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:50.909909  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.945312 16118 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.947028  8941 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.804929 16161 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.085s
I20260925 16:45:50.948098 16161 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:50.948396 16161 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:50.949167 16161 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.950405 15978 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:50.950989 15978 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:50.911921 16188 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:50.951967 16188 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:50.952394 16188 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:50.952840 16179 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260925 16:45:50.910928  9047 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:50.957830  9696 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:45:50.920254 16127 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:50.936705 15972 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.844296 16098 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:50.959726  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.960412  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:50.798436 15673 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.972231  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.975685  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:50.978324  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:50.983260  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:50.972304 15578 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.849s	user 0.011s	sys 0.000s
I20260925 16:45:50.809301 16129 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.994922  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.004124  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:51.004311  9047 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:50.963234 16109 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.009065  8968 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:51.010780  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.012987 16094 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:51.009413  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:50.990257 15921 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:51.025995  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:51.031100  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 268691us
I20260925 16:45:50.987301 16175 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:51.037484  9122 raft_consensus.cc:2354] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17.
I20260925 16:45:50.990576 16127 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:50.991132 16162 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:51.033492  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.045876  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.048369  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.022850 15971 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:50.981024 16103 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.049s
I20260925 16:45:51.013101 16110 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:51.053175  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.055181  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:51.059237  9124 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.000s
I20260925 16:45:51.059837  9124 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:51.062332  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.038321 16168 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:51.030298 15921 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.040859 16175 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:51.047349 16009 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:51.009966 15578 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.061604 16166 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:51.054536 16110 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.041342 16192 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.051584 16132 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:51.087613  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85730us
I20260925 16:45:51.084555  9047 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:51.045045 16162 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.052800 16186 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:51.065186 16044 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260925 16:45:51.124837  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 149243us
I20260925 16:45:51.082181 15722 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:51.003598 16156 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.082120 15921 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:51.133906  9118 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
W20260925 16:45:51.132656  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 135349us
I20260925 16:45:51.051762 16115 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.087271 16175 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:51.128296 16110 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:51.141464  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:51.143137  9045 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.611s	user 0.007s	sys 0.002s
I20260925 16:45:51.171933  9045 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:51.172803  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.085855 16074 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
W20260925 16:45:51.136250  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133108us
I20260925 16:45:51.118701 16094 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.155930  9041 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
I20260925 16:45:51.128017 16044 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:51.130188 16162 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:51.139978 16135 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.918s	user 0.004s	sys 0.008s
I20260925 16:45:51.173874  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:51.149600  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.070334 15943 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.193887  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.194510  9696 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:51.175614  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.085736 15794 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.058s
I20260925 16:45:51.179965  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.204970  9043 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:45:51.190712  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1373) took 1321 ms. Trace:
I20260925 16:45:51.205936  8969 rpcz_store.cc:276] 0925 16:45:49.868992 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.529355 (+660363us) service_pool.cc:227] Handling call
0925 16:45:50.556781 (+ 27426us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:50.570249 (+ 13468us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:50.570300 (+    51us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:50.570738 (+   438us) log.cc:842] Serialized 26 byte log entry
0925 16:45:50.962983 (+392245us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:50.963008 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:50.963051 (+    43us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:51.190359 (+227308us) raft_consensus.cc:1671] finished
0925 16:45:51.190399 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.190640 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":21357,"raft.queue_time_us":13173,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":10468,"thread_start_us":309812,"threads_started":1,"wal-append.queue_time_us":506992}
I20260925 16:45:51.208042  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.210062  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.210352  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.210911  8969 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:51.198942  9041 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:51.203305  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:51.222785  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48791.8us
I20260925 16:45:51.225641  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.177335 16206 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:45:51.179737 15714 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:51.233249  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.177544 16193 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:51.236888  8967 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260925 16:45:51.236995  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:51.192622 16044 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:51.189944 15972 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.129211 16192 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.246603  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.269330  9041 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:51.245003 15943 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.135632 16194 consensus_queue.cc:1046] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.099s
W20260925 16:45:51.232847 15944 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.998s	user 0.008s	sys 0.003s
I20260925 16:45:51.174821 16024 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.235220 16098 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.239866 16121 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:51.290603  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.232712 16186 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:51.168797 16127 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.328203  9695 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:51.329396 16024 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:51.245277 16187 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260925 16:45:51.224289 16135 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.235914 16206 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.317975  8969 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:45:51.336263  9696 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:45:51.357978  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.189148 16080 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.239631 15673 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.329730 16207 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.189854 16204 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.118s
I20260925 16:45:51.268595 16129 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.359421  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.361179  9015 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:51.361439  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 135873us
I20260925 16:45:51.292033 15972 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:51.386983  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.342480 15971 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.379590  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.388582  9120 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:51.380297  9043 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:51.393532  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.347523 16121 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:51.382318 16201 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:51.382633 16192 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.330144 15944 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:51.384008 16199 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.240s	user 0.002s	sys 0.002s
I20260925 16:45:51.384804  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.385349 16194 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:51.400691  9045 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:51.396642  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.411980  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.329721 16191 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260925 16:45:51.407619 15972 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.408914  8969 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:51.408357  9120 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:51.412225  9117 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:51.394972 15578 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.416667  9121 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:51.416741  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.403582 16121 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:51.362025 16206 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:51.417470  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:51.418421  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:51.418460  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 242903us
I20260925 16:45:51.400043 16052 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:51.413398  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.424613  8975 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:51.409138 16201 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.429380 16201 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.367350 16094 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.405175 16200 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:51.430461 16200 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:51.430811 16200 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:51.432000 15943 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:51.432505 15943 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:51.433364 15943 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.435309 16115 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.442034  9041 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:45:51.440259  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:51.440896  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:51.449378 15972 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.452028 16208 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.446728 16129 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:51.452723 16129 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.452554 16208 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.453564 16129 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.454638 16208 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.408223 16207 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.458645 16207 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.461313  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:51.439420 15775 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.716s	user 0.005s	sys 0.006s
I20260925 16:45:51.460915 16044 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.466673 16044 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.468938 16080 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:51.473703 16158 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.230s	user 0.011s	sys 0.003s
I20260925 16:45:51.474089 16135 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:51.476328 16188 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.523s	user 0.006s	sys 0.003s
I20260925 16:45:51.476821 16188 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.479147  9698 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:51.441828 15578 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260925 16:45:51.483373  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.492089  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.495141  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.492877 15775 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.499830  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3829) took 2738 ms. Trace:
I20260925 16:45:51.500624 15775 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.501224  9042 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:51.500216  9115 rpcz_store.cc:276] 0925 16:45:48.755293 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.755862 (+   569us) service_pool.cc:227] Handling call
0925 16:45:48.800693 (+ 44831us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:48.974362 (+173669us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.974403 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:48.974440 (+    37us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:48.974468 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.492996 (+2518528us) spinlock_profiling.cc:243] Waited 173 ms on lock 0x7b54001a04d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:51.493047 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.493183 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":398885120}
I20260925 16:45:51.467607 15722 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:51.506502 16072 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:51.507429 16136 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.623s	user 0.005s	sys 0.005s
I20260925 16:45:51.508930  9119 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260925 16:45:51.509270  9119 pending_rounds.cc:76] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 15
I20260925 16:45:51.509480  9119 pending_rounds.cc:97] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260925 16:45:51.509696  9119 raft_consensus.cc:2866] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:51.512390 16072 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:51.513976 16156 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:45:51.514139  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73274.5us
I20260925 16:45:51.514642 16156 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.515228  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:51.515126 16156 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:51.515071  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 100303us
I20260925 16:45:51.517351  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:51.467073 16110 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.518261 16204 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
W20260925 16:45:51.523881 16155 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.359s	user 0.005s	sys 0.000s
I20260925 16:45:51.525687 15971 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:51.526192 15971 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:51.529651  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.527141 15971 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.529259  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.536507  9695 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:51.541312  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.561865 15921 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.566454  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:51.568357  9696 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:51.537147 16188 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.577171  9695 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
W20260925 16:45:51.574959  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 196132us
I20260925 16:45:51.582931  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:51.594113  9090 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.597183  9043 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
W20260925 16:45:51.585189 16049 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.948s	user 0.005s	sys 0.006s
I20260925 16:45:51.599159  9123 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:51.599799  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.601204  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.603222  8969 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:51.612525  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.613379  9047 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:51.614166 16219 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.039s
I20260925 16:45:51.615108 16219 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:51.615435 16219 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:51.616302 16219 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.617511 16219 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:51.617115 16175 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.619304 16175 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.619907 16216 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:51.578151 16220 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.043s
I20260925 16:45:51.621043  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.579097 16132 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:51.621809  9047 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:51.622548  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.622622 16118 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:45:51.623061 16118 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:51.623970  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.623962 16118 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.624858  9043 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:51.625589  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.626220  9043 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:51.628068  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.626880  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.630335  8969 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:45:51.630626  9043 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:45:51.635754 16136 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:51.636301 16136 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.637367 16206 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.638198 16136 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.638474  9124 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:51.640054 16218 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:51.640703 16156 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.640587 16218 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.642676 16218 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.585404 16129 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260925 16:45:51.644332  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.631484  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.648736  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:51.649665  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66511.3us
I20260925 16:45:51.615563 16162 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:51.652488  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 74034.2us
I20260925 16:45:51.661417  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.664081  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.665630  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.666335  9045 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:51.629505 16049 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.668910  8968 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:51.670174 16049 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.672039 16229 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.672693 16229 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.675000 16229 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.679050  9048 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:51.679589 16110 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.634343 16222 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:51.681025 16222 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.682000 16222 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.686434  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.690137  8969 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:51.693145 16121 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.694228  9693 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:51.695149 16121 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.667464  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.693893  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.698729  8969 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:51.706210  9043 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:45:51.711069  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.711328 16230 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.712298 16229 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:45:51.712343 16230 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.713172 16229 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:51.714640 16230 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.714516 16229 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.715147  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1377) took 1377 ms. Trace:
I20260925 16:45:51.712960 16206 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.717859  8967 rpcz_store.cc:276] 0925 16:45:50.338074 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.529832 (+191758us) service_pool.cc:227] Handling call
0925 16:45:50.530153 (+   321us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:51.247317 (+717164us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.714921 (+467604us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54001e2654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:51.715095 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1614536064}
I20260925 16:45:51.718526  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.721176  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.724326  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.724723  9116 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:51.725617  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.727053  8969 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:45:51.727828  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.728225  8969 raft_consensus.cc:2362] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22. Re-sending same reply.
I20260925 16:45:51.726332  9043 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:51.730124  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.730861  8967 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:51.725378  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.735272  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.655905 16200 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.741762  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.745040 15827 raft_consensus.cc:979] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:45:51.745484 15827 raft_consensus.cc:1067] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Signalling peer e3a3bc92ca0a4efa913eca1800a1550d to start an election
I20260925 16:45:51.746441 16162 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.746388 16050 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:51.747377 16050 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:45:51.747720 16050 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:51.748459 16200 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.748788  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:51.749540  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1774) took 1717 ms (client timeout 2205 ms). Trace:
W20260925 16:45:51.749876  9694 rpcz_store.cc:269] 0925 16:45:50.032383 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.748524 (+1716141us) service_pool.cc:227] Handling call
0925 16:45:51.749485 (+   961us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:51.737100 16206 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:51.751077 16206 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:51.751430 16206 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:51.753666  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3160) took 1218 ms. Trace:
I20260925 16:45:51.748461 16050 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.755165 16050 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:51.757792 16077 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:51.760584  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.761401  8969 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:51.762362  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.762948  8969 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:45:51.736328  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.781706  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.782136  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3639) took 1559 ms. Trace:
I20260925 16:45:51.784152  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.784381  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:51.754076  8972 rpcz_store.cc:276] 0925 16:45:50.535480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.705530 (+170050us) service_pool.cc:227] Handling call
0925 16:45:50.706418 (+   888us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:51.130539 (+424121us) raft_consensus.cc:1520] Early marking committed up to index 9
0925 16:45:51.130573 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:51.136062 (+  5489us) log.cc:842] Serialized 26 byte log entry
0925 16:45:51.206908 (+ 70846us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:51.206949 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.753274 (+546325us) spinlock_profiling.cc:243] Waited 293 ms on lock 0x7b54001e3554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:51.753328 (+    54us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:51.753377 (+    49us) raft_consensus.cc:1671] finished
0925 16:45:51.753392 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.753612 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22817,"raft.queue_time_us":115046,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":5831,"spinlock_wait_cycles":674151680,"thread_start_us":131603,"threads_started":2,"wal-append.queue_time_us":185838}
I20260925 16:45:51.786944  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.788148  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.782959  9044 rpcz_store.cc:276] 0925 16:45:50.223208 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.224706 (+  1498us) service_pool.cc:227] Handling call
0925 16:45:51.756044 (+1531338us) spinlock_profiling.cc:243] Waited 6.37 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:51.781493 (+ 25449us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.781721 (+   228us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:51.781760 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:51.781815 (+    55us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:51.781859 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.781927 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.782070 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14643584}
I20260925 16:45:51.794312  8967 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:45:51.794983  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.795408  8967 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:51.741106 15921 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:45:51.797093 16232 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
I20260925 16:45:51.804905  8969 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:51.808790  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.809477  8967 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:51.811620  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:51.812294  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 136249us
I20260925 16:45:51.808292 15827 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:51.815567  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.816674  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.816748  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.817415  8967 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:51.817324  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.818379  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.818931  9116 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:51.820281  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.820817  9694 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:51.824091 15921 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:51.824608 15921 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.825734  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3158) took 1290 ms. Trace:
I20260925 16:45:51.825445 15921 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.826059  8975 rpcz_store.cc:276] 0925 16:45:50.534875 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.585535 (+ 50660us) service_pool.cc:227] Handling call
0925 16:45:51.825566 (+1240031us) spinlock_profiling.cc:243] Waited 733 ms on lock 0x7b54003575d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:51.825683 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1686201088}
I20260925 16:45:51.827149  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.828534 16055 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.819914 16093 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.009s
I20260925 16:45:51.829824  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.829991 16093 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:51.809665 15673 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:51.831939  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:51.846158  9049 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1323) took 3761 ms (client timeout 1716 ms). Trace:
W20260925 16:45:51.846653  9049 rpcz_store.cc:269] 0925 16:45:48.077314 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.078129 (+   815us) service_pool.cc:227] Handling call
0925 16:45:51.838452 (+3760323us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b5400262ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:51.838537 (+    85us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3102687488}
I20260925 16:45:51.845402  8967 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:51.848377  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.849181  8967 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:51.850157  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.844302  8972 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:45:51.837282  8921 placement_policy_util.cc:244] tablet 12359c2bff0b46de91daa934c219103c: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260925 16:45:51.853421  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.854597  9044 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:51.851809  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.819865 15973 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:51.856043 15944 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.860378  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.860667  9699 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9"
dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:42256
I20260925 16:45:51.861218  9699 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:45:51.861467  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.861600  9699 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:51.862707  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.863803  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.864785  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.867497  9694 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:51.868412  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.868788  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.870486  8972 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 14: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:51.869668  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.852130 16094 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.026s
I20260925 16:45:51.864603  9116 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:51.840476 16093 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:51.881371  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 94693.7us
I20260925 16:45:51.884447  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:51.885082  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.886875  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:51.888837  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.896864  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:51.897469  9699 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.878880  8972 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:51.900321  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:51.902222  9699 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:51.878028 16218 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:51.903885  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:51.908254  9702 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:51.909242  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:51.907887  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73746.7us
I20260925 16:45:51.893360 16200 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:51.856587 15673 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.912642  8975 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:51.913184  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.900295 16055 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.906162 16230 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:51.900061 16094 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:51.908778 16162 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:45:51.919862 16055 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.926151  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3171) took 1042 ms. Trace:
I20260925 16:45:51.930450  8966 rpcz_store.cc:276] 0925 16:45:50.883364 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.135168 (+251804us) service_pool.cc:227] Handling call
0925 16:45:51.173015 (+ 37847us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.342661 (+169646us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:51.358127 (+ 15466us) log.cc:842] Serialized 14 byte log entry
0925 16:45:51.577133 (+219006us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:51.577183 (+    50us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:51.577245 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.925924 (+348679us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54003e7954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:51.925969 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.926094 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":15829,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":5149,"raft.queue_time_us":828,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":8232,"spinlock_wait_cycles":389604608,"thread_start_us":218681,"threads_started":1,"wal-append.queue_time_us":273829}
I20260925 16:45:51.934721  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:51.907418 16211 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:51.936314  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:51.937036  8975 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:51.937462  8975 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:51.940336  9044 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:51.941529  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.910485 16218 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.943003 15545 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260925 16:45:51.957283 16206 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.957800  9121 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:51.938349  8975 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.914950 16096 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:51.962000  9117 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:51.929569 16230 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.952723 16094 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.955259 16200 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:51.962692  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:51.966560 16094 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.963027 16172 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:51.963238 16206 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:51.957476 16165 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:51.968595 16172 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.968791 16165 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.970886 16165 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.970534 16218 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.972553  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:51.973117  9115 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:51.973316 16172 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.964363  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.963754 16156 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:51.942639 15972 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:51.974097 16156 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:51.974314  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1372) took 2181 ms. Trace:
I20260925 16:45:51.975279  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:51.976835 16165 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:51.977218 16165 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.960441  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1367) took 2169 ms. Trace:
I20260925 16:45:51.977573 16165 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:51.977708  8973 rpcz_store.cc:276] 0925 16:45:49.791078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:49.791216 (+   138us) service_pool.cc:227] Handling call
0925 16:45:49.791501 (+   285us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:49.932129 (+140628us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:49.932264 (+   135us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:51.760909 (+1828645us) spinlock_profiling.cc:243] Waited 25.7 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:45:51.761396 (+   487us) log.cc:842] Serialized 26 byte log entry
0925 16:45:51.808345 (+ 46949us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:51.808382 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.808451 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:51.960145 (+151694us) raft_consensus.cc:1671] finished
0925 16:45:51.960162 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.960369 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16546,"raft.queue_time_us":87142,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":34171,"spinlock_wait_cycles":59219328,"thread_start_us":46565,"threads_started":1,"wal-append.queue_time_us":117688}
I20260925 16:45:51.979096  9041 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:51.979669  8973 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:51.980841  8973 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260925 16:45:51.942790 16211 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.981890  8973 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260925 16:45:51.982028 16211 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:51.982867  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:51.983106  8973 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:51.983378  8969 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17. Re-sending same reply.
I20260925 16:45:51.984025  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.984462  8969 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260925 16:45:51.952502 16233 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260925 16:45:51.958223 16162 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:51.975947  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:51.965644 16230 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:51.986199 16090 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:51.976159  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3650) took 1551 ms. Trace:
I20260925 16:45:51.974946 16156 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:51.986148 16162 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:51.987071  9050 rpcz_store.cc:276] 0925 16:45:50.424898 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.425148 (+   250us) service_pool.cc:227] Handling call
0925 16:45:50.464797 (+ 39649us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.967059 (+1502262us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:51.967088 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:51.967127 (+    39us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:51.967153 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.975968 (+  8815us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b5400251cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:51.976016 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.976112 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3453388160}
I20260925 16:45:51.975534 16200 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:51.991547 16202 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:51.991998 16202 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:51.956502 15954 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260925 16:45:51.992487 16202 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:51.993582 16177 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:51.993971 16177 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:51.994272 16177 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:51.994486 16055 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:51.977581  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:51.974699  8974 rpcz_store.cc:276] 0925 16:45:49.792416 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.500694 (+708278us) service_pool.cc:227] Handling call
0925 16:45:51.968012 (+1467318us) spinlock_profiling.cc:243] Waited 1.24 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:51.968206 (+   194us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.974008 (+  5802us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:51.974040 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:51.974075 (+    35us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:51.974111 (+    36us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.974171 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:51.974266 (+    95us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5510,"raft.queue_time_us":8092,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"spinlock_wait_cycles":2849664}
I20260925 16:45:51.960716 15545 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:52.008872  8975 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:52.010237  8966 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:52.010396  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:52.009590  9041 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:52.014214  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.018232  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.018501  9124 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:52.018846  9115 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:52.025264  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:52.025939  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:52.028615  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.030032  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.035058 16208 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:52.035480 16208 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:52.035885 16208 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:52.039938 15975 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:52.041961 16103 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:52.043457 16099 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:52.046273 15973 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:52.046922 15973 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.031121 15944 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:52.004371 15545 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:52.022852 16092 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.860s	user 0.012s	sys 0.029s
I20260925 16:45:52.049813 16230 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:52.061764  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 18 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:52.061538 15973 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.062772 16230 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.019289 16090 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:52.002516 16121 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
W20260925 16:45:52.067782  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53669.1us
I20260925 16:45:52.068527  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.070058  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.070689  9124 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:52.072182  9115 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260925 16:45:52.067123 16092 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.905s	user 0.012s	sys 0.030s
I20260925 16:45:52.012002 16110 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.057s
I20260925 16:45:52.018186 16175 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.053s
I20260925 16:45:52.080341 15954 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:52.081282 16121 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
W20260925 16:45:52.082816  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9a92341cf5104c9eba99c812ba97c735, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:52.115437  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9a92341cf5104c9eba99c812ba97c735, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.072019 16191 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:52.026692 16207 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260925 16:45:52.079134  8975 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:52.111045  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:52.112697  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 82772.8us
I20260925 16:45:52.112815  9124 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:52.120052  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:52.073853 16096 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:52.121572  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3146) took 3729 ms. Trace:
I20260925 16:45:52.121797  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.018095 16165 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.032424 15972 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260925 16:45:52.123265  8970 rpcz_store.cc:276] 0925 16:45:48.392350 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.397506 (+  5156us) service_pool.cc:227] Handling call
0925 16:45:48.397786 (+   280us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:48.743379 (+345593us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:48.743429 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:48.744036 (+   607us) log.cc:842] Serialized 26 byte log entry
0925 16:45:48.842782 (+ 98746us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:45:48.922894 (+ 80112us) log.cc:842] Serialized 14 byte log entry
0925 16:45:48.923105 (+   211us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:49.326745 (+403640us) spinlock_profiling.cc:243] Waited 65.1 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:50.158570 (+831825us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b18004d4940. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9
0925 16:45:52.121293 (+1962723us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b54002cbfd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:52.121337 (+    44us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:52.121391 (+    54us) raft_consensus.cc:1671] finished
0925 16:45:52.121406 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:52.121522 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":79468,"prepare.run_cpu_time_us":75,"prepare.run_wall_time_us":4788,"raft.queue_time_us":4095,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":7358,"spinlock_wait_cycles":952947456,"thread_start_us":46173,"threads_started":1,"wal-append.queue_time_us":188655,"wal-append.run_cpu_time_us":5405,"wal-append.run_wall_time_us":1426601}
I20260925 16:45:52.101378 16103 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:52.124989 16222 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260925 16:45:52.113535 16099 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.023s
I20260925 16:45:52.122778 15545 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.137203 15545 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:52.137400 16165 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.138583 16093 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.139647 16093 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:52.141263 16103 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:45:52.144426 15972 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:52.144616 16103 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.144835 15972 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.145160  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2092) took 3203 ms. Trace:
I20260925 16:45:52.145561  9697 rpcz_store.cc:276] 0925 16:45:48.941741 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.941873 (+   132us) service_pool.cc:227] Handling call
0925 16:45:48.952269 (+ 10396us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:49.747212 (+794943us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:52.144938 (+2397726us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b5400532354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:52.145105 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1374150528}
I20260925 16:45:52.145637 15972 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.146867 15972 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:52.140936 16156 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:52.148926 16110 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:52.149456 16110 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.150214 16110 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.151372 16110 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:45:52.152189 16055 consensus_queue.cc:1159] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8dc3391062084f45a6ba62d28d340722" responder_term: 15 status { last_received { term: 14 index: 11 } last_committed_idx: 11 error { code: PRECEDING_ENTRY_DIDNT_MATCH status { code: ILLEGAL_STATE message: "Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:45:52.153295  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3170) took 1270 ms. Trace:
I20260925 16:45:52.153669  8968 rpcz_store.cc:276] 0925 16:45:50.883037 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.032123 (+149086us) service_pool.cc:227] Handling call
0925 16:45:51.050793 (+ 18670us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.669268 (+618475us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:52.153052 (+483784us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b54003c50d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:52.153236 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1421036416}
I20260925 16:45:52.139807 16202 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.156756 16202 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:52.156610 16096 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.157203  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1752) took 1167 ms. Trace:
I20260925 16:45:52.157567  9118 rpcz_store.cc:276] 0925 16:45:50.989931 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.991726 (+  1795us) service_pool.cc:227] Handling call
0925 16:45:52.157057 (+1165331us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:52.157153 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":281415040}
I20260925 16:45:52.158524 16096 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:52.161815 16211 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:52.162925  9122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3460) took 2065 ms (client timeout 1786 ms). Trace:
W20260925 16:45:52.163302  9122 rpcz_store.cc:269] 0925 16:45:50.097287 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.097833 (+   546us) service_pool.cc:227] Handling call
0925 16:45:52.162747 (+2064914us) spinlock_profiling.cc:243] Waited 924 ms on lock 0x7b540010bb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:52.162863 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2124670208}
I20260925 16:45:52.118855 15810 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:52.115090 16121 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:52.145565 16103 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.129998  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.176735  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.177371  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:52.179574  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111127us
I20260925 16:45:52.181002  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.187812  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.188995  9116 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:52.191298  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.194186  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.194980  9697 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:45:52.197132  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.197870  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:52.166105 16136 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:52.163674 16211 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:52.199455  8972 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:52.204649  9116 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:52.187958 16156 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:52.204746  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.208005 15433 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:52.190508 16090 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.208935 15973 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:45:52.211617  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 81711.9us
I20260925 16:45:52.207259 16218 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:52.164125 15810 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.222311 15810 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:52.208555 15954 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:52.196345 16094 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:52.223910  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:52.218597 16211 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:52.234062  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 860370us
I20260925 16:45:52.211997  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:52.223183  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.237643  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.238832  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.240634  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.199406 16136 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.210697 16162 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:52.205400 16096 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:52.251636  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.252856  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.251739  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.227495 16230 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.025s
I20260925 16:45:52.241477 15433 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:52.234838 16177 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.259009  9117 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:52.260371  9115 raft_consensus.cc:2354] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:52.294925  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.298071  8973 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:52.299149  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:52.302320 16156 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.303231 15684 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:52.303609 15684 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:52.304373 15684 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.305570 15684 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:52.305354 16136 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.306371 16136 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:52.308370  8969 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:52.308876 16208 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.309399  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.309966  8969 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:52.310223  8974 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:45:52.310779 16208 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.311262  8974 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:52.312849 16256 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:52.312768  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.315353  8975 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:52.253047 16162 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:52.319550  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.320451  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.323076  9116 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:52.287382 15973 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:52.296073 16106 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:52.322199  8969 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:52.325784  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.308888 16216 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:52.330700  9120 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:52.337230  8975 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:52.220506 16090 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.333714  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:52.341104  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.348299  9116 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:52.354388  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:52.258095 16121 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.327386 16177 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.364648  9120 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:45:52.366153  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:52.342406 16216 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:52.341969 16162 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:52.325944 15954 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.029s
I20260925 16:45:52.326488 16094 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.035s
I20260925 16:45:52.344585 16218 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:52.352413 16207 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
W20260925 16:45:52.380411 16244 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260925 16:45:52.384375 16248 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260925 16:45:52.324996 16249 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.074s
I20260925 16:45:52.419415  8967 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:52.391127 16230 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:52.381071 16121 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:52.368892 16259 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
W20260925 16:45:52.426689  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 133365us
I20260925 16:45:52.444859  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:52.446875  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:52.445452 16056 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:52.448995 15810 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:52.429591 16218 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.427446 16207 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.379839 15433 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.455518 16110 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:52.454952 16259 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.467474 16211 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:52.451586 16230 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:45:52.480374  9700 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1776) took 2447 ms (client timeout 2107 ms). Trace:
I20260925 16:45:52.466177 15545 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:52.487500 16126 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260925 16:45:52.489693 15545 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.491780 15545 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.469319 16056 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:52.482919  9700 rpcz_store.cc:269] 0925 16:45:50.033011 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:52.480183 (+2447172us) service_pool.cc:214] Skipping call since client already timed out
0925 16:45:52.480299 (+   116us) inbound_call.cc:173] Queueing failure response
Metrics: {}
I20260925 16:45:52.496516  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.497357  9121 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 14: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:52.480971 16093 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:52.500844 16218 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.501163 16093 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.501866 16230 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.501060 16056 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.503207 16093 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.503356 16056 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:52.505180  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3475) took 1608 ms. Trace:
I20260925 16:45:52.505599  9119 rpcz_store.cc:276] 0925 16:45:50.896927 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.897074 (+   147us) service_pool.cc:227] Handling call
0925 16:45:50.897468 (+   394us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.510072 (+612604us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:52.504957 (+994885us) spinlock_profiling.cc:243] Waited 611 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:52.505119 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1405373824}
I20260925 16:45:52.501092 16207 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:52.507252  9048 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3638) took 2284 ms (client timeout 2081 ms). Trace:
W20260925 16:45:52.507632  9048 rpcz_store.cc:269] 0925 16:45:50.222899 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.223784 (+   885us) service_pool.cc:227] Handling call
0925 16:45:52.507080 (+2283296us) spinlock_profiling.cc:243] Waited 1.45 s on lock 0x7b54001bfdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:52.507190 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3344787712}
I20260925 16:45:52.475317 16110 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.510404  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.538177  8975 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260925 16:45:52.558041 16129 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:52.558490 16129 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:52.559296 16129 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:52.562709 16221 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.985s	user 0.001s	sys 0.000s
I20260925 16:45:52.565496 16110 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:52.566502  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3154) took 4107 ms (client timeout 1525 ms). Trace:
W20260925 16:45:52.566910  8971 rpcz_store.cc:269] 0925 16:45:48.460574 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:48.460804 (+   230us) service_pool.cc:227] Handling call
0925 16:45:52.566274 (+4105470us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b540020e254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:52.566396 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3838198016}
I20260925 16:45:52.567203 16110 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:52.568603  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1790) took 1390 ms. Trace:
I20260925 16:45:52.568969  9701 rpcz_store.cc:276] 0925 16:45:51.177813 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.177978 (+   165us) service_pool.cc:227] Handling call
0925 16:45:51.225513 (+ 47535us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:51.244512 (+ 18999us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:51.244542 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:51.244931 (+   389us) log.cc:842] Serialized 26 byte log entry
0925 16:45:51.420277 (+175346us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:45:51.420325 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:51.420399 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:52.562157 (+1141758us) spinlock_profiling.cc:243] Waited 6.93 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:52.568290 (+  6133us) raft_consensus.cc:1671] finished
0925 16:45:52.568316 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:52.568549 (+   233us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":36013,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":10273,"spinlock_wait_cycles":15939968,"thread_start_us":174941,"threads_started":1,"wal-append.queue_time_us":271793}
I20260925 16:45:52.573108  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1386) took 1007 ms. Trace:
I20260925 16:45:52.573468  8972 rpcz_store.cc:276] 0925 16:45:51.565955 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.906389 (+340434us) service_pool.cc:227] Handling call
0925 16:45:51.906667 (+   278us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:52.205791 (+299124us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:52.572902 (+367111us) spinlock_profiling.cc:243] Waited 291 ms on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:52.573059 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":670374656}
I20260925 16:45:52.574698 16216 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.576131 16263 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:52.585877  9119 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:52.491487 16259 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.523927 16256 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260925 16:45:52.592775 16175 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.017s
I20260925 16:45:52.600203 16263 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.617327 16216 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.617995 16162 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.618382  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:52.620353 15673 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:52.611114 16250 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.005s
I20260925 16:45:52.617355 16263 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.622481 16162 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:52.624464 16132 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:52.624909 16132 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:52.627585  9120 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:52.628988  9116 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:52.634435  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:52.635234  9701 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:52.637897  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:52.646191  9115 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:52.647236  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.656829 16260 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:52.664535 16260 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:52.664981 16260 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:52.674032 16161 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:52.676661  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1341) took 2156 ms (client timeout 1829 ms). Trace:
W20260925 16:45:52.677165  9042 rpcz_store.cc:269] 0925 16:45:50.520166 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:50.538300 (+ 18134us) service_pool.cc:227] Handling call
0925 16:45:52.676450 (+2138150us) spinlock_profiling.cc:243] Waited 920 ms on lock 0x7b540008e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:52.676580 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2116211072}
I20260925 16:45:52.689393  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3857) took 1328 ms. Trace:
I20260925 16:45:52.689919  9123 rpcz_store.cc:276] 0925 16:45:51.360666 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.360764 (+    98us) service_pool.cc:227] Handling call
0925 16:45:51.361035 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.602672 (+241637us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:52.689184 (+1086512us) spinlock_profiling.cc:243] Waited 235 ms on lock 0x7b5400143f54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:52.689344 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":540448512}
I20260925 16:45:52.701115  8968 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260925 16:45:52.657124 16093 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260925 16:45:52.669715 16164 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:52.750222  9702 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:52.755899 15943 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:52.726462 16218 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260925 16:45:52.733697 16093 consensus_queue.cc:1225] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
W20260925 16:45:52.773825  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 117249us
I20260925 16:45:52.793309 16260 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.796499  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:52.804988  9693 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:52.815634 16194 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:52.816082  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.39928e+06us
I20260925 16:45:52.816655 16194 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.815201  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1352) took 1659 ms. Trace:
I20260925 16:45:52.819736  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.820078  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:52.820510  8972 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:52.820380  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.820928  8975 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:52.821841  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:52.822683  8969 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:52.833163  9700 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:52.835729  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:52.805876 16178 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:52.805320 16260 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:52.844583  9700 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:52.848045  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:52.819916  9046 rpcz_store.cc:276] 0925 16:45:51.155853 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.168993 (+ 13140us) service_pool.cc:227] Handling call
0925 16:45:51.191605 (+ 22612us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:51.191870 (+   265us) raft_consensus.cc:1520] Early marking committed up to index 16
0925 16:45:51.245807 (+ 53937us) log.cc:842] Serialized 14 byte log entry
0925 16:45:51.413359 (+167552us) log.cc:842] Serialized 14 byte log entry
0925 16:45:52.613937 (+1200578us) spinlock_profiling.cc:243] Waited 4.62 ms on lock 0x7b18004f2820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:52.814760 (+200823us) spinlock_profiling.cc:243] Waited 2.35 ms on lock 0x7b18004f2820. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:52.814908 (+   148us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:52.814953 (+    45us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:45:52.814998 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:52.815055 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:52.815151 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":676,"prepare.queue_time_us":47173,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":73,"raft.queue_time_us":1205,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":6708,"spinlock_wait_cycles":16018048,"thread_start_us":166744,"threads_started":1,"wal-append.queue_time_us":266341,"wal-append.run_cpu_time_us":1351,"wal-append.run_wall_time_us":1009132}
I20260925 16:45:52.833297 16156 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:52.852018  9700 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:52.843915 15722 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:52.840924 15775 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:52.860339 15722 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.860845 15775 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.837278 16044 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:52.863272 15775 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.863318 15722 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:52.877635  9697 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:52.882143  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.888171  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:52.871832  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:52.869772  9121 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:45:52.878588  9124 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:52.877490  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.895483  9041 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:45:52.890221  9701 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:52.902649  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:52.904088  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.911855 16260 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:52.913854  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.914646  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.914791  9048 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:52.915517  9049 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:52.876761 16077 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:52.874411 16153 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:52.892658 16181 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:52.875545 16117 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:52.841869 16178 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.874214 16052 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:52.917788  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.921448  9014 leader_election.cc:398] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:52.922190  9041 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:52.876015 15993 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.045s
I20260925 16:45:52.928932  9014 leader_election.cc:401] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260925 16:45:52.882413 16132 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.936007 15993 consensus_queue.cc:1225] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 19.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260925 16:45:52.936738  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.937028  9048 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:52.937911  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.937995  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.938649  9048 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:52.939162  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.921972 16084 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:52.910058 16140 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260925 16:45:52.940297 16084 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.918764 16042 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260925 16:45:52.910445 15775 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.016s
I20260925 16:45:52.941129 16042 consensus_queue.cc:1225] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260925 16:45:52.941284 16084 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.941679 16042 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:45:52.876451 16053 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260925 16:45:52.942224 16042 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:52.942873 16053 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:52.943264 16053 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:52.944228  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.929996  9043 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:52.941634 15775 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:52.920082 16077 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:52.946594  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.940419 16140 consensus_queue.cc:1225] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260925 16:45:52.933393  9042 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:52.923738 16118 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:52.961755  8968 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:52.962428  9123 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:52.964828 15993 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:52.965865 15993 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:52.966203 15993 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:52.966626  9045 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260925 16:45:52.967612  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.967180 15993 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.968757 15993 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:52.972290 16284 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260925 16:45:52.923025 16135 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:52.924016 16153 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.980255  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.918984 15671 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260925 16:45:52.982180  9116 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:52.925411 16181 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.934644 16052 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.952852 15722 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:52.954276  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:52.955312  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.956120 16132 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:52.959489  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:52.969100 16267 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.385s	user 0.000s	sys 0.002s
I20260925 16:45:52.944608 16204 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:53.028765  9120 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:52.969798 16251 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:52.926895 16117 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.970594 16208 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:52.971273 16216 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:52.974740  9124 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:52.974911  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:52.968760  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.920802 16260 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.930682  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.942998 16042 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:52.979120  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.986148  9043 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:45:53.045500  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 66487us
I20260925 16:45:53.045739  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.046970  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.047017  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:52.947625 15775 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:53.047655 15673 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:52.986794 16202 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260925 16:45:53.048286 15775 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.049649 15775 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:53.049683  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.053522  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.056198  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:53.059940 16117 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:53.034569 16156 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260925 16:45:53.062247 16094 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:53.063880 16136 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:53.064522 16153 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.028429 16204 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:53.064543 16136 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.027861  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.040171 16181 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.042896  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.059901 15972 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260925 16:45:53.060652 16222 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:53.041951 16135 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:52.965655 16077 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.075775  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.987047  9048 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:45:53.062929 16094 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:52.989676  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:52.993129  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:52.980166 16049 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260925 16:45:53.032001 16251 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:53.080389  8971 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:53.081077  8969 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:45:53.082269  8972 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:45:53.082420  9046 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:53.082815  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.079962  9045 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
W20260925 16:45:53.083364  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 93801.7us
I20260925 16:45:53.086547  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.086668  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.082207  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.087131  9702 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:45:53.091180  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:53.092844  9043 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:53.094060  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.040164 16052 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.093711  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:53.095121  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:53.088052  9120 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:53.118675  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:53.096690  9041 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:53.104218  9043 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:53.130573  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:53.105878 16251 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.027688 16053 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.084764 15578 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:53.109323 16135 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.146966  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:53.149149  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:53.111472 16194 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:53.149859  9050 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:53.151881 16136 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:53.112329 16222 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
W20260925 16:45:53.113389 16274 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.441s	user 0.004s	sys 0.000s
I20260925 16:45:53.065549 16204 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.114092 16218 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260925 16:45:53.115458 16291 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260925 16:45:53.120731  8939 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:53.123266 16181 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:53.127581  9702 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:45:53.129902  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.173825 16152 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:53.174038  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44204us
I20260925 16:45:53.126117  9701 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:53.104543 15722 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15.
I20260925 16:45:53.123059  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.177018  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:53.177380  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 54465.8us
I20260925 16:45:53.178198 16152 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:53.131233  9120 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:53.135123 16106 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:45:53.135457  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:53.139266  9046 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:53.089242 16154 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:53.090086 16153 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:53.084044 16132 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:53.201593  9042 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:53.095764 16042 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:45:53.099592 16178 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:53.122591 16117 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.204408 16117 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.206436 16117 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.207993  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.208621  9701 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:53.101547  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1540) took 1281 ms. Trace:
I20260925 16:45:53.209371  9693 rpcz_store.cc:276] 0925 16:45:51.820235 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:51.820511 (+   276us) service_pool.cc:227] Handling call
0925 16:45:53.101382 (+1280871us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b540071e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:53.101483 (+   101us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2120418176}
I20260925 16:45:53.127076 15993 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:53.167604  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 47005us
I20260925 16:45:53.141450 16128 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:45:53.149916 16194 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:53.230242  9043 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:45:53.231138  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.232237  8970 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:53.233083  9046 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260925 16:45:53.231165  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:53.149793 16094 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.312124  9043 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260925 16:45:53.313323  9120 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:53.318454  9046 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260925 16:45:53.180804  9050 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:45:53.116587 16207 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.050s
I20260925 16:45:53.193382 16260 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.159148 15578 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.144456 16052 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260925 16:45:53.176613  9116 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:53.186420  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:53.338761  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 152447us
I20260925 16:45:53.339905  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.340108  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:53.227586  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:53.325383  9049 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:53.179601 16222 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:53.180981 16256 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:53.187165 16251 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:53.343731  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:53.185317 16154 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:53.346690 16230 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:53.359684  9123 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:45:53.347355  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.361503  9693 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:53.228420 16128 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:53.350574  9116 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:45:53.327596 16094 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.326061 16092 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.353195  8939 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:53.179941 16136 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.164s
I20260925 16:45:53.366596 16106 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
W20260925 16:45:53.389816  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 162327us
I20260925 16:45:53.304088 16162 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.123s
I20260925 16:45:53.226649 16181 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.297159 15993 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.363893 16128 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:53.358814 16230 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:53.361027 16154 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:53.383852 15673 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:53.365154 16256 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:53.407037  9050 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260925 16:45:53.394114 16113 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:53.389586 16080 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.354226 16090 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.050s
W20260925 16:45:53.419801  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 324764us
W20260925 16:45:53.396777 16109 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.012s	sys 0.013s
I20260925 16:45:53.405316 16106 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:53.410193 16157 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:53.391160 16092 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.411563 16230 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:53.426868 16109 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.013s	sys 0.013s
I20260925 16:45:53.393018 16158 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.028s
I20260925 16:45:53.416507 16113 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:53.407878 16117 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260925 16:45:53.430073 16218 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.013s
I20260925 16:45:53.394717 16094 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.416507 16211 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:53.452549 16211 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:53.400616 16159 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260925 16:45:53.461733 16181 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.462883 16106 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.467759 16162 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:53.468426 16162 consensus_queue.cc:1225] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 22.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:45:53.470790 15993 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.471334 15993 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:53.471670 15993 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:45:53.467779 16292 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260925 16:45:53.472144 16207 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:53.472419 15993 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.473968 15578 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.475260  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.477133  9700 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:45:53.450508 16218 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:53.475917  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:53.364303 16194 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.441461 16157 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:53.506681  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:45:53.508973  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 185515us
I20260925 16:45:53.514925  9116 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 13. (term mismatch)
I20260925 16:45:53.515334  9116 pending_rounds.cc:76] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 12
I20260925 16:45:53.515599  9116 pending_rounds.cc:97] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 20.13
I20260925 16:45:53.515887  9116 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:53.526048  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.526713  9050 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:53.527114  9050 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:53.428000 16080 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:53.508808 15944 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.460s	user 0.005s	sys 0.050s
I20260925 16:45:53.537710  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.502547 15578 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:53.502369 16099 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.572152  9049 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:53.504348 16109 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.501533 16218 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:53.561200  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.GetConsensusState from 127.0.0.1:43368 (request call id 2) took 1414 ms. Trace:
I20260925 16:45:53.547106  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:53.527872  9050 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:53.578181  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 215116us
I20260925 16:45:53.517908 16157 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:53.513085 16162 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:53.583472  9118 rpcz_store.cc:276] 0925 16:45:52.146345 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.057385 (+911040us) service_pool.cc:227] Handling call
0925 16:45:53.560565 (+503180us) spinlock_profiling.cc:243] Waited 61.5 ms on lock 0x7b540019bed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a0e6fc6e 00007f719a566807 00007f719a566792 00007f719a5666c1 00007f719a56663c 00007f719a5658f2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:53.561121 (+   556us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":141484416}
I20260925 16:45:53.586709  9049 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:45:53.587111  9700 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 16. (term mismatch)
I20260925 16:45:53.588838  9700 pending_rounds.cc:76] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 15
I20260925 16:45:53.589087  9700 pending_rounds.cc:97] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260925 16:45:53.589308  9700 raft_consensus.cc:2866] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:45:53.558377 16272 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.891s	user 0.006s	sys 0.001s
W20260925 16:45:53.593169  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46169.1us
I20260925 16:45:53.615037  9049 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:53.541800 16055 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:53.581985 15944 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.532s	user 0.005s	sys 0.053s
I20260925 16:45:53.565358 16056 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:45:53.615821  9049 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:53.561757 16092 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.561430 16094 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:53.616251  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.617128  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.536813 15993 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:53.651083  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 423818us
I20260925 16:45:53.655679  9697 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:53.649744 16056 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:53.657562  9118 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:53.663090  9120 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260925 16:45:53.658473  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:53.618940 16042 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:53.637395 16178 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.616641 16192 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:53.619846 16162 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:53.653967  9049 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.662722  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:53.588011 15578 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.557492 16297 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.101s
I20260925 16:45:53.636880 15944 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:53.557137 16256 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.586663 16109 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.675379 16056 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:53.649839 15943 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.043s
I20260925 16:45:53.710891 16096 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:53.721208 15578 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.714771 16259 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:53.676755 16152 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:53.724045  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.685910 15673 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:53.649998 16055 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.696602 16132 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:45:53.655864 16211 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.745520 16109 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:53.675036 16218 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.745971 16211 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:53.746129 16230 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.746644 16218 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:53.568409 16113 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.677212 16208 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260925 16:45:53.748571 16073 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:45:53.748694 16113 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:53.749212 16073 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260925 16:45:53.749333 16117 consensus_queue.cc:1159] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "225d3432101a4758bb9a6b0efeae09c5" responder_term: 19 status { last_received { term: 19 index: 11 } last_committed_idx: 9 last_received_current_leader { term: 19 index: 11 } }
I20260925 16:45:53.749908 16073 consensus_queue.cc:1225] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 19.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
W20260925 16:45:53.750293 16300 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260925 16:45:53.750396 16073 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:53.750805 16073 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:53.751109  9697 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:53.693843 16192 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.728942 16259 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:53.753270 16259 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.688804 16178 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.754226 16259 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:53.755290  9043 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:45:53.755491 16178 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:53.741475 16162 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.743548  9120 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:45:53.585603 16099 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.731547 15673 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:53.749570 16042 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:45:53.768054  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:53.771652  9046 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:53.766268 15673 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:53.726291 16128 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.789047  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:53.733956 16096 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.725065 16154 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:53.789196  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 282564us
W20260925 16:45:53.831986 16298 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
I20260925 16:45:53.833425  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.834040  9698 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
W20260925 16:45:53.835028 16302 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
I20260925 16:45:53.837085  9042 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:53.751483 16073 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.838142  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:53.770277 15972 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:53.838616  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 42b301336d224f89acb2543ae4e24a12, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.833581 16056 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:53.852289  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 42b301336d224f89acb2543ae4e24a12, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.823143  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.806680 16092 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:53.882072 16092 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.774735 16109 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260925 16:45:53.877157  9120 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:53.842438 16297 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.886514 16297 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.887194 16251 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:53.887854 16251 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.888563 16297 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.888839 16096 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.889129 16297 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:53.875270 16192 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.890298 16251 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.890655 16158 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:53.891101 16158 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.894287 16154 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.785637 15944 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.897408  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.838405 16080 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.899262  9700 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:53.913669  8970 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:53.913913 16092 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.900437 16297 consensus_queue.cc:1225] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:45:53.847786 15943 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:53.917531  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:53.921386  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.921962 16056 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.923269 15943 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:53.924894 16055 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.913038  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:53.925933 15943 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:53.926599 16204 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:53.932785  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:53.934410  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.981478  8975 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:53.934607 16099 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:53.935887  8970 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260925 16:45:53.936546  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.899712 16230 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:53.938055  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.986307  8967 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:53.939535  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:53.987300  8971 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:53.939569  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.988217  8972 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:53.920321  9042 raft_consensus.cc:2354] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24.
I20260925 16:45:53.940701  9701 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:53.944068 16073 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:53.925854  9698 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:45:53.944969 16181 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:53.956189  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.978020  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:53.994484  9700 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:53.995258  8974 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:53.873522 15972 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:53.998207  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:54.000381  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet e7e6790e980f40f8aeb12986a2ac7ed6, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:54.000685  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet e7e6790e980f40f8aeb12986a2ac7ed6, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.001983  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.002493  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.002983  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:54.003507  9666 leader_election.cc:334] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.829s (SENT)
W20260925 16:45:53.992417  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 376249us
I20260925 16:45:54.004606  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.004670  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.005478  9117 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:54.006829 16106 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:54.007560  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.009183  9123 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:54.010192 16055 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:54.003535  8968 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:54.012138 16128 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.012784  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.013236  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:53.994169 16181 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:54.014097 16055 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:54.014784 16181 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.016232 16181 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:53.976358 16147 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.024540 16147 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.026945 16147 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.030051  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:53.976611 15993 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.036080  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:54.037856  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.038111  9700 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:54.039263  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.042389  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.042786  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.044263  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.044845  9701 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:54.047506  9699 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:54.050616  8973 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260925 16:45:54.052629  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.053601  8972 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:45:54.054777  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.034917 16128 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:54.058125  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.037271 16173 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.056870  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.059942  8973 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260925 16:45:54.062184  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:54.063457  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.060393 16207 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:54.048527 16106 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:54.064291 16207 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.066329 16207 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.069423  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.075356  9698 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:54.031806 16168 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.026s
I20260925 16:45:54.092110  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:54.099310  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:54.102201  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.103282  9698 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:45:54.105577  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:54.107084  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.109805  9699 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260925 16:45:54.119810  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.042927 15993 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.127590  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:54.129473  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55982.2us
I20260925 16:45:54.123266  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.095551 16055 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:54.138398  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.110733 16093 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:54.149755  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.119036 16207 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:45:54.142017 16162 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:54.121655 16109 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:54.156118  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 432138us
I20260925 16:45:54.067682 16173 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.169462  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.151527 16093 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:54.143246 16157 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.526s	user 0.010s	sys 0.000s
I20260925 16:45:54.139086 16172 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.181633  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.184821  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.197093  8974 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:54.197177  9118 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 22 index: 15. (term mismatch)
I20260925 16:45:54.197654  9118 pending_rounds.cc:76] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 14
I20260925 16:45:54.146555 16106 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:54.197891  9118 pending_rounds.cc:97] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 21.15
I20260925 16:45:54.133894 16092 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:54.190380  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.175562 16207 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:54.149051 16230 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260925 16:45:54.118906 15937 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.056s
I20260925 16:45:54.198232  9118 raft_consensus.cc:2866] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:54.198474  8975 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:54.179141 16109 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:54.195792  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:54.147228 16056 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.043s
I20260925 16:45:54.175379 15684 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:54.208845  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.149204 16297 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260925 16:45:54.189630 16319 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 11, Time since last communication: 0.032s
I20260925 16:45:54.193670 16093 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:54.210840 16207 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:54.211100 16153 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:54.214545  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.215845 16109 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:54.216116  9117 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:54.227367  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.192978 16052 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.254343  9701 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260925 16:45:54.193424 16168 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:54.256333  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:54.228701 16277 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.443s	user 0.006s	sys 0.013s
W20260925 16:45:54.216512 16307 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260925 16:45:54.216166 16312 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260925 16:45:54.202286 16092 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:54.217653 16316 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260925 16:45:54.226939 16308 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:54.219928 15972 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:54.216490 16106 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:45:54.287163  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1376) took 1248 ms. Trace:
I20260925 16:45:54.318614  9046 rpcz_store.cc:276] 0925 16:45:53.038712 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.336940 (+298228us) service_pool.cc:227] Handling call
0925 16:45:53.771269 (+434329us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:53.772123 (+   854us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:54.286967 (+514844us) spinlock_profiling.cc:243] Waited 422 ms on lock 0x7b540008e650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:54.287109 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":970587904}
W20260925 16:45:54.255738 16311 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260925 16:45:54.242511 16309 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.257496 15994 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:54.310650  9700 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:45:54.274693 16113 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:54.315410  8971 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:54.208792 16172 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.217232 15673 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.228609 16319 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.063s
I20260925 16:45:54.201624 16157 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.280550 16163 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260925 16:45:54.320365  9045 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260925 16:45:54.272035 16052 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.350232  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:54.333093  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 186201us
I20260925 16:45:54.332029  8973 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:45:54.336539  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.331588  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.291039 16092 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:54.318192 16106 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:54.337360 16113 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:54.364050  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.360020  9046 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:54.368650  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.369853  9046 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:45:54.372298  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.374516  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.375805  9046 raft_consensus.cc:2362] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22. Re-sending same reply.
I20260925 16:45:54.361332  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:54.378053  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.383419  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.378908  9046 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:45:54.389763  9048 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:45:54.393533  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:54.395027  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.340605 15972 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.388206  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.344877 15993 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.407513  9046 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:45:54.408116  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:54.348544 16173 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.380026 16113 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:54.416505  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.414723  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1548) took 1050 ms. Trace:
I20260925 16:45:54.414129 16308 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:54.346812 16090 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.056s
I20260925 16:45:54.417344  9693 rpcz_store.cc:276] 0925 16:45:53.364790 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.365956 (+  1166us) service_pool.cc:227] Handling call
0925 16:45:53.397155 (+ 31199us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:53.397472 (+   317us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:53.397501 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:53.404023 (+  6522us) log.cc:842] Serialized 26 byte log entry
0925 16:45:53.760757 (+356734us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:45:53.760977 (+   220us) log.cc:842] Serialized 14 byte log entry
0925 16:45:53.768283 (+  7306us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:53.768356 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:54.414466 (+646110us) raft_consensus.cc:1671] finished
0925 16:45:54.414486 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:54.414652 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6960,"prepare.queue_time_us":1733,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":10042,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":5738,"spinlock_wait_cycles":27772800,"thread_start_us":342654,"threads_started":1,"wal-append.queue_time_us":590262}
I20260925 16:45:54.395897 15994 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:54.422740  9124 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:54.331722 16309 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.398874 15937 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:45:54.443041  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.455961  9046 raft_consensus.cc:2362] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16. Re-sending same reply.
I20260925 16:45:54.456904  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.458022  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.458185  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.458666  9046 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:54.409262 16153 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:54.418956 16230 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:54.413338 16337 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:54.413759 16320 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:54.470270  9124 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260925 16:45:54.465204 16302 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:45:54.427783 15684 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election won for term 24
W20260925 16:45:54.493498 16329 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.152s	user 0.000s	sys 0.000s
I20260925 16:45:54.493796 15684 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:54.495182  8967 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:54.494858 15684 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.478972  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.498248  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.455052 15994 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.492744 16230 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:54.500324 16230 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.501709 15994 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:54.502377 16322 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
W20260925 16:45:54.503791 16334 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
W20260925 16:45:54.504535 16324 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260925 16:45:54.504884  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.505915 16093 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.514395 16309 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.515199  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.489355 16336 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.028s
I20260925 16:45:54.512003 16172 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.512130 15545 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260925 16:45:54.512504 16335 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260925 16:45:54.517266  9120 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:45:54.408378 15972 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.519404  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:54.522044  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.522208 16093 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:54.526783 16052 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.529510 16113 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.530896 16157 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:54.531390 16323 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260925 16:45:54.517781 16055 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260925 16:45:54.533078 15673 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.468714 16154 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.521154  9046 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
W20260925 16:45:54.526305 16181 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.510s	user 0.002s	sys 0.007s
I20260925 16:45:54.561923  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.535399 16109 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:54.560969  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 144870us
W20260925 16:45:54.578097  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91536.2us
W20260925 16:45:54.578642  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 179432us
I20260925 16:45:54.580822  9117 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:45:54.482780 16153 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.561304 16211 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:54.584569  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.609934  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.515998 16320 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.535375 16207 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.431223 16106 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.616189  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.582671 16094 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:54.612417  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:54.571233  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 163213us
W20260925 16:45:54.585884 16204 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.001s
I20260925 16:45:54.617774  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:54.626356  9700 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:54.599222 16113 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.630847  9702 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260925 16:45:54.627607  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:54.628033  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.628257  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.632406  9699 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:54.624178  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:54.633116  8972 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:54.637578 16320 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.639602 16153 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.608608 16162 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:45:54.594832 15972 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:54.650125  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:54.653870  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.591466  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.654836  9117 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:54.654888  9046 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:54.585650 16154 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.631960  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.617360 15673 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:54.669843  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.670028  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:54.653870  8972 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:54.690393  9046 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:54.691780 16361 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.691993  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.692306 16361 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.693583  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.694015 16361 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:54.694366  9046 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:54.674115  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.630084  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:54.704577  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 74828.1us
I20260925 16:45:54.705001  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:54.678339  9699 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:54.705127  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.697681  9698 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260925 16:45:54.695484 16158 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.700642 16207 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:54.674011  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49853.3us
I20260925 16:45:54.706019  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:45:54.705926  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104677us
I20260925 16:45:54.706591  9046 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:54.708117  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:54.727421  9699 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:54.667233 16353 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:54.746194  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.628201 16094 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.753855  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.822744  9117 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:45:54.755084  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.755399  9118 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 14. (term mismatch)
W20260925 16:45:54.823449  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 102456us
I20260925 16:45:54.823916  9118 pending_rounds.cc:76] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 13
I20260925 16:45:54.824338  9118 pending_rounds.cc:97] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 19.14
I20260925 16:45:54.824618  9118 raft_consensus.cc:2866] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:54.824829  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.757205  9699 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:45:54.769999  9046 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:54.827147  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:54.827838  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81753.1us
I20260925 16:45:54.821429  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.828917  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.827839  9046 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:54.666558 16204 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
I20260925 16:45:54.840656  9046 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:54.847806  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.848603  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.858353  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.858994  9046 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:54.859798  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.744045 15684 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:54.740849 15673 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:54.741408 16230 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:54.854009  8968 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:54.820667 16361 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.867513  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:54.871796  9046 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:54.742206 15937 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.125s
I20260925 16:45:54.849527 16320 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:45:54.862587 16337 raft_consensus.cc:2741] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election decision vote started in defunct term 22: won
I20260925 16:45:54.863020 16113 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.862097 16173 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:45:54.820237 16092 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.883826  9046 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:45:54.892468 16230 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:54.911595 16230 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.912364 16370 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:54.913537 16230 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:54.886286 15684 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:45:54.918269  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3503) took 2330 ms. Trace:
I20260925 16:45:54.917366  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:54.906172 16355 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
I20260925 16:45:54.922994  8969 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:54.921360  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.918658  9121 rpcz_store.cc:276] 0925 16:45:52.587411 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:52.587521 (+   110us) service_pool.cc:227] Handling call
0925 16:45:52.587970 (+   449us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:52.891528 (+303558us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:54.918034 (+2026506us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:54.918215 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":647349632}
I20260925 16:45:54.829260 16353 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.921258 16109 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:54.928136  9046 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:54.932574  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.933514  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:54.929510  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 223537us
I20260925 16:45:54.843259 16349 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.094s
I20260925 16:45:54.934669 15684 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:45:54.935051  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 111846us
I20260925 16:45:54.935182 15684 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:54.936473  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:45:54.936414  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 115074us
I20260925 16:45:54.937440 16204 raft_consensus.cc:2741] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election decision vote started in defunct term 16: won
I20260925 16:45:54.937670  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:54.938066 15684 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.939361  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:54.942719  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:54.942962  8968 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: [10.8-14.10]
I20260925 16:45:54.943121  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:54.944777  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.946390 15684 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:54.888628 16361 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.957909  9046 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:54.959494  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:54.958884  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:54.960767  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:54.961385  8972 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:54.907724 16113 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:54.973888  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:54.976028 16230 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:54.975510  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:54.950887 15954 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:55.001536  9117 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:55.003822 16361 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.004451 16361 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:55.004871 16361 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:55.005242 16361 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:55.006742 16376 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.008042 16094 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.008792 16094 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.009224 16094 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.011132 16094 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.012573 16092 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:54.977030  8972 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:54.962297  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:54.959465 16204 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:54.932389 15673 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:55.028411  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 66175.4us
I20260925 16:45:55.029433  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:54.996966 16154 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.032547  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:55.034521  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.036070  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:55.037169 16372 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
W20260925 16:45:55.037823  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 209004us
I20260925 16:45:55.028450 16369 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:55.007318 16376 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.020895  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3686) took 1399 ms. Trace:
I20260925 16:45:55.030014 16347 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:54.994350 15954 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.025491 16158 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:55.053447  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:55.084461 16158 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:55.084709 15991 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:55.085160  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:55.086018 15991 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:55.086371  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.086918 15954 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.087343 15991 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:55.030104 16094 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:55.087929 15991 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:55.088080 16094 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:55.088667  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:55.089062 16094 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.089576 16349 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:55.089418 15991 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.090618  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:55.091300 16349 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:55.091650 16349 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:55.075562 16353 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.031517 16204 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:55.079339  9699 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:55.073676 16369 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.091718 16376 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.072096  9046 rpcz_store.cc:276] 0925 16:45:53.621217 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.019978 (+1398761us) service_pool.cc:227] Handling call
0925 16:45:55.020335 (+   357us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.020529 (+   194us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:55.020565 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:55.020615 (+    50us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:55.020657 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.020721 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:55.020833 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:55.097347  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:55.092223 16349 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:55.101814  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:55.109378  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 149982us
I20260925 16:45:55.110770  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.096204 16181 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:55.124547 16181 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.126477 16181 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.126958 16136 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:45:55.114715 16362 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.127526 16136 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:55.127652 16362 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.103710 16376 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:55.128604 16376 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:55.128443 16136 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.123894  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.103102 15684 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.019s
I20260925 16:45:55.119321 16318 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260925 16:45:55.120187 16204 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.120647 16158 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.122116 16369 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.123474 16090 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:55.129014 16376 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:55.116251  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1386) took 1079 ms. Trace:
I20260925 16:45:55.156626  9048 rpcz_store.cc:276] 0925 16:45:54.037005 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.148452 (+111447us) service_pool.cc:227] Handling call
0925 16:45:55.116090 (+967638us) spinlock_profiling.cc:243] Waited 193 ms on lock 0x7b54002a2454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:55.116196 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":443548544}
I20260925 16:45:55.137377  9699 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260925 16:45:55.140589 16113 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.142875 16362 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.144320 16347 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:55.145000  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1372) took 2169 ms. Trace:
W20260925 16:45:55.147491  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 111494us
W20260925 16:45:55.168540  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 188786us
I20260925 16:45:55.168740  9045 rpcz_store.cc:276] 0925 16:45:52.975509 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.316449 (+340940us) service_pool.cc:227] Handling call
0925 16:45:54.240864 (+924415us) spinlock_profiling.cc:243] Waited 1.42 ms on lock 0x7b5800004298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:54.241131 (+   267us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.345495 (+104364us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.144741 (+799246us) spinlock_profiling.cc:243] Waited 78.8 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:55.144935 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":184535168}
W20260925 16:45:55.174384  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 195310us
I20260925 16:45:55.175506  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:55.158229  9046 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:55.153613 16090 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:55.162654 16222 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:55.163522  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1793) took 2093 ms. Trace:
I20260925 16:45:55.159670 16172 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.177263  9122 rpcz_store.cc:276] 0925 16:45:53.070177 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.070669 (+   492us) service_pool.cc:227] Handling call
0925 16:45:53.091828 (+ 21159us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:53.122985 (+ 31157us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:53.123044 (+    59us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:53.132499 (+  9455us) log.cc:842] Serialized 26 byte log entry
0925 16:45:54.995008 (+1862509us) spinlock_profiling.cc:243] Waited 3.83 ms on lock 0x7b18005399e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:45:55.099105 (+104097us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:55.099145 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.099211 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:55.163244 (+ 64033us) raft_consensus.cc:1671] finished
0925 16:45:55.163262 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:55.163468 (+   206us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":30782,"raft.queue_time_us":40663,"raft.run_cpu_time_us":91,"raft.run_wall_time_us":91,"spinlock_wait_cycles":8801024,"thread_start_us":103943,"threads_started":1,"wal-append.queue_time_us":2026998}
I20260925 16:45:55.179854  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.175860  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:55.159917 16369 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.204879  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:55.170107 16362 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:55.207736  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.207955  9046 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:55.213421  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:55.214193  9045 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:55.167402 15993 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260925 16:45:55.216410 16055 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:55.217092 16395 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:55.217660  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:55.217770  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.218741  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:55.202822 16172 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.219280  9695 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:55.227070  9695 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:55.218313  9046 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:55.229868  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:55.179155 16222 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:55.234846  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:55.230499  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:55.233626  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.178285 16178 raft_consensus.cc:465] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Not starting pre-election -- already a leader
I20260925 16:45:55.239892  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:55.240304  9122 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260925 16:45:55.240919 16352 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:55.241631  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:55.244228  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:55.255726  9045 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:45:55.256857  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:55.227881 16395 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:55.261943  9046 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:55.263046  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:55.265069  9122 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:55.263756  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:55.266074  9048 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:55.269124  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.269224  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.269840  9117 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:55.270059  8971 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:55.271934  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.209913 16369 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.273527  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.288687  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.279002 15991 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:45:55.281785  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:55.241621 16352 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:55.293689 16352 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.285162  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.294749  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:55.295151  8970 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:45:55.296218 15991 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:55.296604 15991 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:55.296921 15991 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:55.285153  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:55.302713  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.303972  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:55.268230 16395 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:55.308092  9123 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:55.312961  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.314643  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:55.322029  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:55.322198  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.322623  9124 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:45:55.322712  8970 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:55.284991 16094 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.326516  9045 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:55.367365 16397 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.367280 16384 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.122s
I20260925 16:45:55.370644 16397 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.371235 16386 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.371873 16386 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.319087 15684 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:55.369555  9048 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:55.336016 16207 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.335567 16381 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:55.389016  9048 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:55.391836  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.392953  9697 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260925 16:45:55.393973 15684 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:55.394591 15684 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.394901 16369 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.395485 16369 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:45:55.396189 16369 consensus_queue.cc:1225] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260925 16:45:55.397189 16106 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:55.397455 16172 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.399190 16386 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.402073  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.403216  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.403653  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3687) took 1782 ms. Trace:
I20260925 16:45:55.404225  9048 rpcz_store.cc:276] 0925 16:45:53.621530 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.388432 (+1766902us) service_pool.cc:227] Handling call
0925 16:45:55.388753 (+   321us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.389675 (+   922us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.403571 (+ 13896us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:55.405121  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.408041  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2472) took 1247 ms. Trace:
I20260925 16:45:55.408483  8973 rpcz_store.cc:276] 0925 16:45:54.160935 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.161072 (+   137us) service_pool.cc:227] Handling call
0925 16:45:54.331802 (+170730us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.363261 (+ 31459us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.407820 (+1044559us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b540020ec50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:55.407978 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":391875328}
I20260925 16:45:55.271095 16090 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.373456 16397 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.418473 16090 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:55.395162 15684 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.421861 16163 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:55.422425 15578 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:55.439867 15578 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.436094 16163 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.440378 15578 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:55.440575 16163 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:55.420280 16385 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:45:55.428596  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3688) took 1806 ms. Trace:
I20260925 16:45:55.364009 16094 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.447194  9048 rpcz_store.cc:276] 0925 16:45:53.621826 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.405311 (+1783485us) service_pool.cc:227] Handling call
0925 16:45:55.427844 (+ 22533us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.428006 (+   162us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:55.428236 (+   230us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:55.428281 (+    45us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:55.428322 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.428391 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:55.428522 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:55.431463  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:55.449294 16392 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:55.456990 16390 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.457509 16390 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:55.458011 16399 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260925 16:45:55.450873  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:55.392338 16207 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.471948  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.473214  8973 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260925 16:45:55.316038 16222 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.476754 16222 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:45:55.477813  9089 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 1.644s (SENT) [suppressed 16 similar messages]
I20260925 16:45:55.479126  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.459499 16390 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.467263 15684 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.480564  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.457940 16365 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.449617 16263 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.484447 16053 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:55.524595 16378 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:45:55.526733 16376 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.527648 16365 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.455508 16349 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.539606  9124 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
W20260925 16:45:55.521325 16361 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.516s	user 0.011s	sys 0.000s
I20260925 16:45:55.545469 16398 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:55.546034 16398 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.517108 16390 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:55.556380  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 241806us
I20260925 16:45:55.557821 16256 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:55.558327 16256 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.558749  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.559337  8973 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:55.540319 16395 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.560516 16256 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.561161  9120 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260925 16:45:55.563431  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.564630  8973 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:45:55.567556  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:55.553458  8968 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:55.483306 15991 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.589618  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:55.548328 16378 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:55.529207 16263 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.581003 16108 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.581313 16157 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.598953 15684 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:55.599566 16320 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:55.705960 16320 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:55.706408 16320 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:55.709985 15684 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:55.710549 15684 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:55.549847 16361 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.712918 16392 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.713472 16392 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.714378 16361 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.715149  9121 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:55.718205  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:55.718986  9123 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:55.718624 15578 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.722450 16263 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.725031 16395 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.661639 16108 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.729808 15991 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:55.731228 16407 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260925 16:45:55.582324 16390 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.732831 16094 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.725811 16084 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:55.733981 16084 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.734344 16390 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.735476 16376 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.704957 16157 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.737231 16157 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.737387 16349 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.739253 16365 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.740223  9699 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:55.741231  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.742334 16207 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.742426  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.743680  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.749986  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:55.750584  8973 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:55.762971  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.765595  9696 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260925 16:45:55.767747  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:55.769549  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.776060  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:55.778465 15673 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:45:55.779181 15578 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.779842 15673 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:55.780201 15673 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:55.781737  9116 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 16. (term mismatch)
I20260925 16:45:55.782104  9116 pending_rounds.cc:76] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 15
I20260925 16:45:55.782292  9116 pending_rounds.cc:97] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 21.16
I20260925 16:45:55.782490  9116 raft_consensus.cc:2866] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:55.715518 16392 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.786623  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:55.806504 16208 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.027s	sys 0.023s
W20260925 16:45:55.807029 16208 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.517s	user 0.027s	sys 0.023s
W20260925 16:45:55.811785  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.001s	sys 0.022s
W20260925 16:45:55.813910  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 528894us
I20260925 16:45:55.817518  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:55.821007 16219 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:55.821967  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:55.815886 16208 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.822763 16219 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:55.814813 15993 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:55.822842 16090 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:55.823321 16219 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:55.823401 15993 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.823756 16090 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.824646 16219 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.825559 15993 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.823062 16208 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.833985 16208 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:55.835274  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:55.822789  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:55.836558  8972 raft_consensus.cc:2396] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260925 16:45:55.836932 16391 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:55.837483 16391 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:55.838279 16391 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 16.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:55.847007  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.518s	user 0.009s	sys 0.038s
W20260925 16:45:55.848351  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.519s	user 0.010s	sys 0.038s
W20260925 16:45:55.849808  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 520680us
I20260925 16:45:55.793124 16163 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:55.656505 16398 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:55.731230 16108 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:55.875379  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 101322us
I20260925 16:45:55.599248 16378 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:55.881326  8972 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260925 16:45:55.872416  8973 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:55.783272 16320 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:55.865489 16222 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:55.874958 16084 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:55.999665  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 114699us
I20260925 16:45:55.900008 15937 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:56.002872  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.012943  9123 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:45:56.015810  9693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.566s	user 0.015s	sys 0.047s
W20260925 16:45:56.021359  9693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.015s	sys 0.047s
I20260925 16:45:56.038836  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.039619  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:56.043576  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 80128.4us
W20260925 16:45:56.039490  9701 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.715s	user 0.044s	sys 0.081s
I20260925 16:45:56.045029  9015 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:56.045466  9701 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.044s	sys 0.081s
I20260925 16:45:56.047297  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.040791  9696 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:55.973352 16256 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:56.051214 16050 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:45:55.989527 16090 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:55.780944 15673 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.16, Last appended by leader: 16, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.060266  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.056686  8970 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:56.048417 16352 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.058974  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:56.044363 16354 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:45:56.059911  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:56.011617 15937 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:56.099924  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:56.092760  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:56.102964  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.136883  9695 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260925 16:45:56.135833  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.583s	user 0.010s	sys 0.009s
W20260925 16:45:56.138967  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.010s	sys 0.009s
I20260925 16:45:56.062403 15578 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:56.102735 16204 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.012s	sys 0.059s
I20260925 16:45:56.017556 16222 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:56.148075  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 103153us
W20260925 16:45:56.158341  9118 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.685s	user 0.000s	sys 0.030s
W20260925 16:45:56.162212  9118 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.689s	user 0.000s	sys 0.030s
I20260925 16:45:56.162298  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:56.152060  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.153733  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:56.160175  9089 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.009s	sys 0.063s
W20260925 16:45:56.164736  9089 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.654s	user 0.009s	sys 0.064s
W20260925 16:45:56.165036  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 687197us
I20260925 16:45:56.165500  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.166325  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.167578  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:56.059762 16256 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.172995  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.174820  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:56.158011 16204 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.733s	user 0.012s	sys 0.060s
I20260925 16:45:56.147508 15673 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:56.185698  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:56.048738 16410 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.147s
I20260925 16:45:56.185767  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:56.193950  8973 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:45:56.194985  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:56.195667  8973 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:56.190410  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.182775  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:56.186563  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:56.198244  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 95690.4us
I20260925 16:45:56.200762  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.201362  8974 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:45:56.177156 16207 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:56.218922 16207 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.205294  9697 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:56.205597  8966 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:45:56.209791 16256 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.159497 15578 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.160334 16347 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.044s
I20260925 16:45:56.182425 16419 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:56.230785 15578 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.230854 16419 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.236058  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.239179  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:56.240001  9118 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:56.239434 16378 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.240789  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.241792  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.242327  9118 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:56.242914 15722 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:56.243067  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.243642 15722 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:56.244108 15722 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:56.244402  9123 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:56.244947 15722 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.248592  8939 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.250010  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:56.251816  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 113392us
I20260925 16:45:56.253705  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.180956 16084 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:56.193579 15684 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.203816 16376 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:45:56.197132 15937 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.258693 15937 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:45:56.259204 15684 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.258965 16353 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260925 16:45:56.207122 16428 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260925 16:45:56.208635 16417 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:45:56.263562 16417 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:56.264513  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3542) took 1005 ms. Trace:
I20260925 16:45:56.209771 16438 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.106654 16352 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.216691 16184 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:45:56.217859 16053 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.682s	user 0.008s	sys 0.001s
I20260925 16:45:56.176694 16206 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:56.221194 16222 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.186041 16379 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.223438 16109 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:45:56.224207 16421 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260925 16:45:56.224756 16420 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260925 16:45:56.225751  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2475) took 1617 ms. Trace:
I20260925 16:45:56.252629  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.255671  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.264925  9117 rpcz_store.cc:276] 0925 16:45:55.259622 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.259807 (+   185us) service_pool.cc:227] Handling call
0925 16:45:55.260165 (+   358us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.276677 (+ 16512us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.264302 (+987625us) spinlock_profiling.cc:243] Waited 9.49 ms on lock 0x7b54003becd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.264464 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":21825408}
I20260925 16:45:56.306594  8969 rpcz_store.cc:276] 0925 16:45:54.608545 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.608699 (+   154us) service_pool.cc:227] Handling call
0925 16:45:54.609030 (+   331us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.924085 (+315055us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.225535 (+1301450us) spinlock_profiling.cc:243] Waited 314 ms on lock 0x7b5400355cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.225701 (+   166us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":721488128}
W20260925 16:45:56.307161  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54602.8us
I20260925 16:45:56.307920  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.308524  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:56.308889  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.309422  9117 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:45:56.314037  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.195151 16163 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.267597  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:56.252878 16362 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.041s	user 0.013s	sys 0.006s
I20260925 16:45:56.251590 16207 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:56.294902  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:56.265650 16256 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:56.326294 16256 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.326566 16129 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:56.326730 16256 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:56.312305 16222 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:56.327615 16363 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:56.328785 16222 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:56.328953 16443 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.329157 16222 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:56.329530 16443 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.266070 16347 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:56.330016 16222 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.305689 16379 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.332315  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:56.333041  8969 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:56.255261 16437 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:56.314777  9117 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
W20260925 16:45:56.321300  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53794.3us
I20260925 16:45:56.297458 16206 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:56.325444 15578 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:45:56.341636 16206 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:56.264464 16417 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.344165  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.345608  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1817) took 1056 ms. Trace:
W20260925 16:45:56.346066 16430 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.090s	user 0.000s	sys 0.001s
I20260925 16:45:56.345949  9116 rpcz_store.cc:276] 0925 16:45:55.289631 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.294133 (+  4502us) service_pool.cc:227] Handling call
0925 16:45:55.294368 (+   235us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.782834 (+488466us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.345348 (+562514us) spinlock_profiling.cc:243] Waited 487 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.345544 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1120004864}
I20260925 16:45:56.331439 16443 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.349339  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3690) took 2727 ms. Trace:
I20260925 16:45:56.349818  9048 rpcz_store.cc:276] 0925 16:45:53.622389 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.448983 (+1826594us) service_pool.cc:227] Handling call
0925 16:45:55.501742 (+ 52759us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:55.502318 (+   576us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:55.502361 (+    43us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:55.511044 (+  8683us) log.cc:842] Serialized 52 byte log entry
0925 16:45:56.139365 (+628321us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:56.139417 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.139509 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:56.349069 (+209560us) raft_consensus.cc:1671] finished
0925 16:45:56.349097 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:56.349273 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":116,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":6364,"thread_start_us":586848,"threads_started":1,"wal-append.queue_time_us":672230}
I20260925 16:45:56.336476  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:56.336900  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.294902 16184 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.268832 16392 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260925 16:45:56.353135  9696 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:56.354064  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.358750  8969 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:56.360289  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:45:56.362195  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2456) took 2719 ms (client timeout 1826 ms). Trace:
W20260925 16:45:56.362735  9042 rpcz_store.cc:269] 0925 16:45:53.642666 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.837861 (+195195us) service_pool.cc:227] Handling call
0925 16:45:56.361998 (+2524137us) spinlock_profiling.cc:243] Waited 67.3 ms on lock 0x7b54002a2e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:56.362131 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":154735488}
I20260925 16:45:56.363660  9044 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:56.368378  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3185) took 2316 ms. Trace:
I20260925 16:45:56.368762  8967 rpcz_store.cc:276] 0925 16:45:54.051972 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.052098 (+   126us) service_pool.cc:227] Handling call
0925 16:45:54.495009 (+442911us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.495599 (+   590us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.368206 (+1872607us) spinlock_profiling.cc:243] Waited 431 ms on lock 0x7b54001c4150. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:56.368326 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":991699840}
I20260925 16:45:56.333863 16106 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:45:56.347731 16053 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:56.333747 16362 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:56.333201 16379 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.442034  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.456753  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:56.339735 16320 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.443261  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.473428  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:56.448024 16360 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.524s	user 0.020s	sys 0.010s
W20260925 16:45:56.448458  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 286217us
I20260925 16:45:56.450083 16414 consensus_queue.cc:1046] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:56.366822 16042 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.418874 16443 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.427487 16147 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.281985 16438 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.356505 16256 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.424779 15578 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:56.570657 16392 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:56.545255 16352 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.544730 16325 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:45:56.574978  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:56.575258 16042 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.575656 16379 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:56.576051  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 294655us
W20260925 16:45:56.544826 16429 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.353s	user 0.000s	sys 0.002s
I20260925 16:45:56.425967 16106 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:56.549528  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1828) took 1948 ms. Trace:
I20260925 16:45:56.579516  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:56.583299 16360 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.661s	user 0.021s	sys 0.011s
I20260925 16:45:56.577526  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.604677  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.604815  8972 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:56.582397 15578 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:45:56.472136 16421 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:45:56.582224  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:56.581418 16444 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.527688  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.629549  9048 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:45:56.576830 16419 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.471303 16378 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:56.630198  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3552) took 1253 ms. Trace:
I20260925 16:45:56.549443 16433 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:56.578822 16440 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.583346 16392 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.500641  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.614164  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.594808 16325 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:56.625471  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1562) took 2156 ms. Trace:
I20260925 16:45:56.617458 16184 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.626132  8973 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 16. Preceding OpId from leader: term: 18 index: 16. (term mismatch)
I20260925 16:45:56.626329  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.645896  8973 pending_rounds.cc:76] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 15
I20260925 16:45:56.646255  8973 pending_rounds.cc:97] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 17.16
I20260925 16:45:56.456050 16090 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.647868 16090 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.649158 16256 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.649938 16090 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.630487  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.630596  9122 rpcz_store.cc:276] 0925 16:45:55.376969 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.377105 (+   136us) service_pool.cc:227] Handling call
0925 16:45:55.390790 (+ 13685us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:55.391103 (+   313us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:55.391129 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:55.407499 (+ 16370us) log.cc:842] Serialized 26 byte log entry
0925 16:45:55.809416 (+401917us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:45:55.809670 (+   254us) log.cc:842] Serialized 14 byte log entry
0925 16:45:55.876147 (+ 66477us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:55.876236 (+    89us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:56.629982 (+753746us) raft_consensus.cc:1671] finished
0925 16:45:56.630006 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:56.630110 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":107033,"prepare.queue_time_us":462,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":81237,"raft.run_cpu_time_us":300,"raft.run_wall_time_us":64319,"thread_start_us":401640,"threads_started":1,"wal-append.queue_time_us":646583}
I20260925 16:45:56.650862  9048 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:56.651233  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.651798  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:56.652370  9048 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:56.641279 16440 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.653493  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.654239 16440 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.645232 16433 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.656232  8973 raft_consensus.cc:2866] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:56.657388 16433 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:56.636301  9119 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260925 16:45:56.658360 16314 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.658830 16314 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.661242 16419 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:56.661711 16419 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.662137 16419 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:56.665313  9048 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:45:56.613179 15578 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:56.600322  9693 rpcz_store.cc:276] 0925 16:45:54.601257 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.601414 (+   157us) service_pool.cc:227] Handling call
0925 16:45:54.621469 (+ 20055us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:54.621802 (+   333us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:54.621836 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:55.447062 (+825226us) spinlock_profiling.cc:243] Waited 995 us on lock 0x7b2c00168008. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:45:55.449207 (+  2145us) log.cc:842] Serialized 26 byte log entry
0925 16:45:56.021718 (+572511us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:56.021776 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.021901 (+   125us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:56.549178 (+527277us) raft_consensus.cc:1671] finished
0925 16:45:56.549204 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:56.549462 (+   258us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":41079,"raft.queue_time_us":3165,"raft.run_cpu_time_us":156,"raft.run_wall_time_us":10797,"spinlock_wait_cycles":2288000,"thread_start_us":572160,"threads_started":1,"wal-append.queue_time_us":1007850}
I20260925 16:45:56.640044  9042 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:56.581869 16443 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.592446 16147 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.625010  8969 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 16
I20260925 16:45:56.643896  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.602959 16379 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.642424  9698 rpcz_store.cc:276] 0925 16:45:54.468807 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.469885 (+  1078us) service_pool.cc:227] Handling call
0925 16:45:54.470269 (+   384us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:54.709551 (+239282us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.617945 (+1908394us) spinlock_profiling.cc:243] Waited 227 ms on lock 0x7b540079e5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.625399 (+  7454us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":522413312}
I20260925 16:45:56.605288 16106 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:45:56.657455  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1357) took 3731 ms (client timeout 1682 ms). Trace:
W20260925 16:45:56.695881  9044 rpcz_store.cc:269] 0925 16:45:52.925783 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:52.926131 (+   348us) service_pool.cc:227] Handling call
0925 16:45:56.657312 (+3731181us) spinlock_profiling.cc:243] Waited 3.35 s on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:56.657397 (+    85us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7701946624}
I20260925 16:45:56.697229  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.698046  9044 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:56.609372 16386 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:45:56.657610  9050 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:56.666399  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.631624  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1368) took 3693 ms. Trace:
I20260925 16:45:56.675395  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:56.677609  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.679081 16451 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.014s
I20260925 16:45:56.637933 16453 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.052s
I20260925 16:45:56.704934  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.682646 16438 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.684384  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1550) took 3237 ms. Trace:
I20260925 16:45:56.684648 16392 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:56.684859 16206 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.685652  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3553) took 1254 ms. Trace:
I20260925 16:45:56.686718  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2474) took 1514 ms. Trace:
I20260925 16:45:56.716876  9046 rpcz_store.cc:276] 0925 16:45:55.171863 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.234619 (+ 62756us) service_pool.cc:227] Handling call
0925 16:45:56.686558 (+1451939us) spinlock_profiling.cc:243] Waited 26.3 ms on lock 0x7b54002c0954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:56.686662 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":60407680}
I20260925 16:45:56.718181  8974 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:56.718321  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:56.719213  9046 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:56.646516 16325 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:56.704110  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.726933  9044 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:56.704253  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.728065  9048 raft_consensus.cc:2396] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 21 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
I20260925 16:45:56.728475  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2477) took 1112 ms. Trace:
I20260925 16:45:56.728760  9048 rpcz_store.cc:276] 0925 16:45:55.616543 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.704013 (+1087470us) service_pool.cc:227] Handling call
0925 16:45:56.728423 (+ 24410us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:56.699455  9041 rpcz_store.cc:276] 0925 16:45:52.931852 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.142731 (+210879us) service_pool.cc:227] Handling call
0925 16:45:53.143115 (+   384us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:53.415629 (+272514us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:53.415659 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:53.415718 (+    59us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:53.415746 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.618382 (+3202636us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b54002526d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.624946 (+  6564us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:56.625069 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":626305280}
I20260925 16:45:56.711208  9702 rpcz_store.cc:276] 0925 16:45:53.447351 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.447574 (+   223us) service_pool.cc:227] Handling call
0925 16:45:53.450216 (+  2642us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.631201 (+1180985us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.684084 (+2052883us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.684309 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2714463616}
I20260925 16:45:56.716765  9120 rpcz_store.cc:276] 0925 16:45:55.431355 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.441079 (+  9724us) service_pool.cc:227] Handling call
0925 16:45:55.441417 (+   338us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:55.561515 (+120098us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.685326 (+1123811us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b540007d354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:56.685566 (+   240us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":274802048}
I20260925 16:45:56.700606  9042 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:56.730571  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:56.731178  9120 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:56.735663  9041 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:56.734400 16438 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 17, Time since last communication: 0.004s
W20260925 16:45:56.704152 16456 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:45:56.737709 15943 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:56.744381  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.744632  9117 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:56.740180  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1384) took 2703 ms. Trace:
I20260925 16:45:56.745595  9041 rpcz_store.cc:276] 0925 16:45:54.036362 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.735199 (+2698837us) service_pool.cc:227] Handling call
0925 16:45:56.735482 (+   283us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:56.739927 (+  4445us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.740125 (+   198us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:56.637126 16444 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.746610  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.726137 16156 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:56.740887  8969 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
W20260925 16:45:56.771668  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 125864us
I20260925 16:45:56.775736  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:56.773362  9044 raft_consensus.cc:1203] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Deduplicated request from leader. Original: 20.14->[21.15-21.15]   Dedup: 21.15->[]
I20260925 16:45:56.765990  9041 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:45:56.777906  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2460) took 2661 ms. Trace:
I20260925 16:45:56.761330  9120 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:45:56.756955 16438 consensus_queue.cc:1225] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 21.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 17
I20260925 16:45:56.764355  9050 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260925 16:45:56.780413  9041 rpcz_store.cc:276] 0925 16:45:54.116248 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.765382 (+2649134us) service_pool.cc:227] Handling call
0925 16:45:56.765655 (+   273us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:56.777662 (+ 12007us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.777850 (+   188us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:56.781273  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:56.780928  9044 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
W20260925 16:45:56.784742  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 139297us
I20260925 16:45:56.788686  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2459) took 2672 ms. Trace:
I20260925 16:45:56.783092 16444 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.789305  9044 rpcz_store.cc:276] 0925 16:45:54.115944 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.757181 (+2641237us) service_pool.cc:227] Handling call
0925 16:45:56.773244 (+ 16063us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:56.788401 (+ 15157us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.788623 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:56.783762 16417 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:56.785228  9050 pending_rounds.cc:76] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 13
I20260925 16:45:56.792688  9050 pending_rounds.cc:97] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260925 16:45:56.794872  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.800194 16206 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:56.801530 16147 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.791725  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.804513  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:56.794178  9050 raft_consensus.cc:2866] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:56.804565  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.805644  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1381) took 3647 ms. Trace:
I20260925 16:45:56.805883  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.802425 16362 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.808300  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.812405  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.813273  8970 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:56.814301  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.789357  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.761330  9046 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:45:56.794947 16417 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:56.821425 16211 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.810484 16162 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260925 16:45:56.822314  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:56.821966 16211 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.821252 16417 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.793507 16090 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:56.835103  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.836457  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.806030  9050 rpcz_store.cc:276] 0925 16:45:53.157990 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.482180 (+324190us) service_pool.cc:227] Handling call
0925 16:45:53.526580 (+ 44400us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:56.657072 (+3130492us) spinlock_profiling.cc:243] Waited 1.41 s on lock 0x7b58006329b0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:45:56.805396 (+148324us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.805582 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3246437120}
I20260925 16:45:56.839241 16128 raft_consensus.cc:3032] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:56.839653 16128 raft_consensus.cc:729] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:56.840670 16211 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.840507 16128 consensus_queue.cc:260] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.843601 16453 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:56.777308 16156 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.845912  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:56.847599  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:56.848073  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.850910  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:56.811084 16293 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 19 current term: 19 is higher.
I20260925 16:45:56.846503  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.860690  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.851576  8969 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:45:56.818202  9042 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:45:56.826728  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.864800  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:56.854712  9050 raft_consensus.cc:2379] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:56.856860 16379 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.817046 16352 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:45:56.858059 16454 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.123s	user 0.000s	sys 0.001s
I20260925 16:45:56.854427 16090 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:56.823513 16450 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.021s
I20260925 16:45:56.828285  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:56.885299  9046 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:56.871091  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.869254  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3691) took 2749 ms. Trace:
I20260925 16:45:56.874861  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.886458  9041 rpcz_store.cc:276] 0925 16:45:54.119985 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.868470 (+2748485us) service_pool.cc:227] Handling call
0925 16:45:56.868745 (+   275us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:56.868926 (+   181us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:56.868954 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:56.868994 (+    40us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:56.869029 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.869083 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:56.869202 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:56.887212  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:56.887532  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.878225 16377 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.863210  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.888408  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:56.892516 16352 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.895313  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:56.905232  9050 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: [20.15-21.16]
I20260925 16:45:56.905910  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2467) took 2786 ms. Trace:
I20260925 16:45:56.906121  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:56.834877 16438 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:56.850698 16346 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:56.844236 16453 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.896660 16352 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.896842 16206 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:56.898859 16194 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:56.898540 16090 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.845299 16443 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.810541 16362 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.860098 16181 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:56.902366 16156 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.794296 16207 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:56.943828 16469 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260925 16:45:56.945756 16207 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.869521 16440 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:56.911886 16162 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:56.929399 16377 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.933653 16178 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:45:56.904750 16211 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:45:56.904574 16379 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:56.952731 16377 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.953766 16358 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:56.912968 16438 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.929270 16206 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:56.958877 16211 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:56.949506 16181 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.956969 16379 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:56.960937 16453 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:56.967669 16325 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.970721 16362 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.973577 16301 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:45:56.975719 16358 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:56.984272 16358 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:56.977438 16379 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:56.976158 16206 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:56.978683 16468 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260925 16:45:56.975965 16438 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:56.977043 16211 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:56.983012 16301 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:57.006330 16301 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.008458 16301 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:56.982457 16325 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:56.975644 16419 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.018705 16419 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.033576 16206 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.060581 16379 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.042842 16358 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.069706 16358 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:57.118120  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:57.120353  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:56.906767  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:57.142946  8970 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260925 16:45:57.144909  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:57.214835  9042 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:45:57.215984 16206 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:57.145169  8974 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260925 16:45:57.217185  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:56.908164  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:57.152678  9047 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:45:57.218916  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3191) took 3150 ms. Trace:
I20260925 16:45:57.219432  8975 rpcz_store.cc:276] 0925 16:45:54.068644 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:54.068781 (+   137us) service_pool.cc:227] Handling call
0925 16:45:54.101371 (+ 32590us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.215405 (+114034us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.218274 (+3002869us) spinlock_profiling.cc:243] Waited 96.9 ms on lock 0x7b54003e7954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.218686 (+   412us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":222828288}
I20260925 16:45:57.221813  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2448) took 4290 ms. Trace:
I20260925 16:45:57.221920 16184 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:57.153944  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2457) took 3510 ms. Trace:
I20260925 16:45:57.181668  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:57.186432  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:57.188001  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:57.188405  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:57.189100  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:56.903596 15578 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.192018  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:57.193092  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:57.072551 16379 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.059499 16438 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:56.906122  9050 rpcz_store.cc:276] 0925 16:45:54.119653 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.866062 (+2746409us) service_pool.cc:227] Handling call
0925 16:45:56.904956 (+ 38894us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:56.905725 (+   769us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.905869 (+   144us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:57.197854  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:57.222247  9047 rpcz_store.cc:276] 0925 16:45:52.931099 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.121569 (+190470us) service_pool.cc:227] Handling call
0925 16:45:53.121880 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.218292 (+4096412us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.221464 (+  3172us) spinlock_profiling.cc:243] Waited 4.03 s on lock 0x7b540008dc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.221736 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9267821312}
I20260925 16:45:57.223023 16250 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:57.241719 15994 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:57.257345  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:57.280256  9122 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:45:57.280336 16219 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.229s	user 0.006s	sys 0.010s
I20260925 16:45:57.280885 16432 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:57.281126 16219 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.229s	user 0.006s	sys 0.010s
I20260925 16:45:57.281925 16432 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.282616 16372 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:57.280104 16250 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.283067 16372 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:57.283536 16372 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:45:57.292426  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 384220us
I20260925 16:45:57.295763  9041 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:57.283635  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3704) took 2172 ms. Trace:
W20260925 16:45:57.296459 16485 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260925 16:45:57.232806  9048 rpcz_store.cc:276] 0925 16:45:53.642938 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.735827 (+3092889us) service_pool.cc:227] Handling call
0925 16:45:56.763401 (+ 27574us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:56.763838 (+   437us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:56.763879 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:56.767316 (+  3437us) log.cc:842] Serialized 26 byte log entry
0925 16:45:56.912742 (+145426us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:56.912796 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.912859 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:57.153327 (+240468us) raft_consensus.cc:1671] finished
0925 16:45:57.153374 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:57.153689 (+   315us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":575,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":7371,"thread_start_us":126082,"threads_started":1,"wal-append.queue_time_us":115006}
I20260925 16:45:57.285425 16250 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.299301  9045 rpcz_store.cc:276] 0925 16:45:55.110873 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.256572 (+145699us) service_pool.cc:227] Handling call
0925 16:45:57.283213 (+2026641us) spinlock_profiling.cc:243] Waited 67.9 ms on lock 0x7b54002c0454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:57.283433 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":156197632}
I20260925 16:45:57.327399 15578 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.331053  9050 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: [21.13-21.13]
I20260925 16:45:57.331801  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3692) took 3211 ms. Trace:
I20260925 16:45:57.332103  9050 rpcz_store.cc:276] 0925 16:45:54.120234 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.319347 (+3199113us) service_pool.cc:227] Handling call
0925 16:45:57.330490 (+ 11143us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.331500 (+  1010us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.331731 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:57.258136 16184 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.313223  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1784) took 4726 ms. Trace:
I20260925 16:45:57.314939  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1827) took 1076 ms. Trace:
I20260925 16:45:57.315820 16414 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:57.316028 16443 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260925 16:45:57.337117 16414 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.335388  9120 rpcz_store.cc:276] 0925 16:45:56.238167 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.847972 (+609805us) service_pool.cc:227] Handling call
0925 16:45:56.848217 (+   245us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.152535 (+304318us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.152584 (+    49us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:57.152662 (+    78us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:57.152697 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.314508 (+161811us) spinlock_profiling.cc:243] Waited 304 ms on lock 0x7b54001c8754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.314555 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:57.314748 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":698573056}
I20260925 16:45:57.316622  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3549) took 1981 ms. Trace:
I20260925 16:45:57.339213  9124 rpcz_store.cc:276] 0925 16:45:55.335412 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.335546 (+   134us) service_pool.cc:227] Handling call
0925 16:45:55.335930 (+   384us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.541529 (+205599us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.316095 (+1774566us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b5400164254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.316384 (+   289us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":467902848}
I20260925 16:45:57.339825  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:57.281113 16315 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:57.341888 16050 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:57.342599 16414 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:57.318157 15994 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.321138  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3543) took 2060 ms. Trace:
I20260925 16:45:56.984551 16106 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.304314 16164 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:57.310753  9693 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:57.324987  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:45:57.341984  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 150356us
I20260925 16:45:57.334813  9042 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:57.342221 16315 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:57.326133  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 208553us
I20260925 16:45:57.319593  9049 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:57.346309  9121 rpcz_store.cc:276] 0925 16:45:55.260402 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.260595 (+   193us) service_pool.cc:227] Handling call
0925 16:45:55.260866 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:55.715603 (+454737us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.320551 (+1604948us) spinlock_profiling.cc:243] Waited 454 ms on lock 0x7b5400040954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.320929 (+   378us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1044190464}
I20260925 16:45:57.343391  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:57.335057  9119 rpcz_store.cc:276] 0925 16:45:52.586678 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:52.589254 (+  2576us) service_pool.cc:227] Handling call
0925 16:45:52.589586 (+   332us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:56.658143 (+4068557us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.312647 (+654504us) spinlock_profiling.cc:243] Waited 4.04 s on lock 0x7b540010c054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.312997 (+   350us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":9296800128}
I20260925 16:45:57.342661 16050 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:45:57.354738  9047 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:57.356842 16164 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.358845 16106 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:57.359748  9118 raft_consensus.cc:2354] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17.
I20260925 16:45:57.360008  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:57.361088  9121 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:45:57.361423  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3904) took 1354 ms. Trace:
I20260925 16:45:57.361869  9118 rpcz_store.cc:276] 0925 16:45:56.007422 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.294625 (+287203us) service_pool.cc:227] Handling call
0925 16:45:57.361147 (+1066522us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54001c8c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:57.361322 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2390804736}
W20260925 16:45:57.363041  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56322.2us
I20260925 16:45:57.374557 16325 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:57.375816 16384 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:57.377105 16384 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:57.377564 16384 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:57.379897  9120 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:45:57.367723  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:57.386593 16438 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:57.390201  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 93930us
I20260925 16:45:57.383008 16360 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:57.390023  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:57.401029  9118 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 21. Current term is 22. Ops: []
I20260925 16:45:57.402594  9045 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
W20260925 16:45:57.388862 16416 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.100s	user 0.035s	sys 0.093s
I20260925 16:45:57.406770 16442 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:57.409253 16310 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:45:57.406822  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1828) took 1166 ms. Trace:
I20260925 16:45:57.411089  9118 rpcz_store.cc:276] 0925 16:45:56.238407 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.363152 (+1124745us) service_pool.cc:227] Handling call
0925 16:45:57.363575 (+   423us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.402470 (+ 38895us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.404734 (+  2264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:57.389314 16325 consensus_queue.cc:1225] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 18.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260925 16:45:57.378899 16384 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.391726 16360 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:57.407361 16368 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.009s
I20260925 16:45:57.415102  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3697) took 3109 ms. Trace:
I20260925 16:45:57.417758  9045 rpcz_store.cc:276] 0925 16:45:54.301491 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.329204 (+3027713us) service_pool.cc:227] Handling call
0925 16:45:57.352257 (+ 23053us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.406301 (+ 54044us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.410478 (+  4177us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:57.406770 16416 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.236s	user 0.035s	sys 0.094s
I20260925 16:45:57.421612 16415 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:45:57.421783  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3515) took 4202 ms. Trace:
I20260925 16:45:57.430420  9124 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:57.431254  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1829) took 1192 ms. Trace:
I20260925 16:45:57.431826  9124 rpcz_store.cc:276] 0925 16:45:56.238676 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.397320 (+1158644us) service_pool.cc:227] Handling call
0925 16:45:57.430054 (+ 32734us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.431013 (+   959us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.431193 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:57.418749 16360 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:57.422298  9115 rpcz_store.cc:276] 0925 16:45:53.219233 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.219393 (+   160us) service_pool.cc:227] Handling call
0925 16:45:53.227868 (+  8475us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:53.357385 (+129517us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:53.357420 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:53.357820 (+   400us) log.cc:842] Serialized 26 byte log entry
0925 16:45:53.727248 (+369428us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:45:53.739063 (+ 11815us) log.cc:842] Serialized 14 byte log entry
0925 16:45:53.739262 (+   199us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.268516 (+2529254us) spinlock_profiling.cc:243] Waited 21.9 ms on lock 0x7b18003a19e0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9
0925 16:45:57.421227 (+1152711us) spinlock_profiling.cc:243] Waited 127 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.421304 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:57.421378 (+    74us) raft_consensus.cc:1671] finished
0925 16:45:57.421398 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:57.421632 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2027,"prepare.queue_time_us":12426,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":3101,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":7834,"spinlock_wait_cycles":342729856,"thread_start_us":369126,"threads_started":1,"wal-append.queue_time_us":529228,"wal-append.run_cpu_time_us":1796,"wal-append.run_wall_time_us":1001830}
I20260925 16:45:57.417169  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:57.422092 16415 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:57.437930 16184 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:57.437849  9123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3901) took 1488 ms (client timeout 1777 ms). Trace:
I20260925 16:45:57.438948 16432 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:57.442179  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62991.4us
I20260925 16:45:57.442955 16090 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:57.449841  9123 rpcz_store.cc:269] 0925 16:45:55.949338 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.185384 (+236046us) service_pool.cc:227] Handling call
0925 16:45:57.437512 (+1252128us) spinlock_profiling.cc:243] Waited 53.7 ms on lock 0x7b54001ee1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:57.437703 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":123416960}
I20260925 16:45:57.444790 16415 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.451758 16077 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:57.451496  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:57.444772 16315 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.454092 16347 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:57.453828  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:57.456643 16132 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:57.457134 16132 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:57.457548  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:57.457547 16132 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:57.461344 16309 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:45:57.462428  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:57.462483  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:57.473958  8970 raft_consensus.cc:1226] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:57.475273  8966 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:57.478055  8968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2487) took 2002 ms (client timeout 1971 ms). Trace:
I20260925 16:45:57.478263  8971 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:57.478464  8968 rpcz_store.cc:269] 0925 16:45:55.475412 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:55.475585 (+   173us) service_pool.cc:227] Handling call
0925 16:45:57.477627 (+2002042us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:57.477806 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":91249920}
I20260925 16:45:57.480629  9048 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:57.486585  9043 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:45:57.489209 16168 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:57.489684 16168 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:57.491221 16463 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.708s	user 0.001s	sys 0.000s
I20260925 16:45:57.489704  8972 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:45:57.493744 16168 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:57.501621 16132 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.506819  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2469) took 3158 ms. Trace:
I20260925 16:45:57.507328  9048 rpcz_store.cc:276] 0925 16:45:54.348299 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.394774 (+3046475us) service_pool.cc:227] Handling call
0925 16:45:57.460031 (+ 65257us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.506518 (+ 46487us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.506752 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:57.485311  9016 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:57.510308  9047 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:57.513538  9041 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.512677 16132 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.517632 16384 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:57.526872  8966 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:45:57.540293  9121 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:45:57.539950  9693 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
W20260925 16:45:57.543860  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 124463us
I20260925 16:45:57.549203 16077 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:45:57.550575  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:57.553088  9046 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.664s	user 0.015s	sys 0.005s
I20260925 16:45:57.553539  9046 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:45:57.557282  9050 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:57.557344 16293 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:57.558313 16293 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.559049  9047 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:57.560415  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1400) took 2462 ms. Trace:
I20260925 16:45:57.561112  9047 rpcz_store.cc:276] 0925 16:45:55.097750 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.525736 (+2427986us) service_pool.cc:227] Handling call
0925 16:45:57.558539 (+ 32803us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.559978 (+  1439us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.560312 (+   334us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:57.565428 16077 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:57.566431 16077 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.568495  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:57.568813 16077 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.569451  8969 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:57.569905 16360 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.571388  9119 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:57.551465  9702 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:57.555195 15954 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:57.584741 15954 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.585918 15994 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.593112 16042 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.596453  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:57.596979  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.448s	user 0.027s	sys 0.027s
I20260925 16:45:57.597139 15991 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:57.603758  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:57.604403 15991 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:45:57.627646 15991 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:45:57.628469  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:57.629153 15991 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.599298  9119 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260925 16:45:57.598207  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3563) took 1545 ms. Trace:
I20260925 16:45:57.631919 16314 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.632079  9117 rpcz_store.cc:276] 0925 16:45:56.053221 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.427832 (+374611us) service_pool.cc:227] Handling call
0925 16:45:56.428154 (+   322us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:56.754446 (+326292us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.597730 (+843284us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b540019bed4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:57.598026 (+   296us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":727367424}
I20260925 16:45:57.604732 16181 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.605325 16042 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:45:57.634766 16042 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:57.635222 16042 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:57.607899  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3698) took 3302 ms. Trace:
I20260925 16:45:57.639822  8866 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 10 to 15, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:57.641389 16442 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:45:57.643826 16049 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:45:57.644326 16222 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:57.645231 16208 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
W20260925 16:45:57.645618 16481 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260925 16:45:57.645615 16208 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:57.648088 16164 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.647157 16208 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:57.648916  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76434.3us
I20260925 16:45:57.608001  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:57.605654 16372 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.610178  9121 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
W20260925 16:45:57.611166  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 229643us
I20260925 16:45:57.613047  9123 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:57.568827 16293 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:57.615348 16449 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.973s	user 0.003s	sys 0.000s
I20260925 16:45:57.675836 16208 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:57.676034  9117 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:57.678107 16360 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.679988 16393 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:57.680469 16393 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:57.618295 16128 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:45:57.621265  9043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2455) took 3984 ms (client timeout 1644 ms). Trace:
I20260925 16:45:57.626564  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:57.670560  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 213887us
I20260925 16:45:57.639868  9050 rpcz_store.cc:276] 0925 16:45:54.305011 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.332930 (+3027919us) service_pool.cc:227] Handling call
0925 16:45:57.554240 (+221310us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:57.558022 (+  3782us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.607627 (+ 49605us) spinlock_profiling.cc:243] Waited 220 ms on lock 0x7b54001af750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:57.607827 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":505541888}
I20260925 16:45:57.650978  8866 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 12 to 15, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:57.673982  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2462) took 3425 ms. Trace:
I20260925 16:45:57.674333  8967 raft_consensus.cc:2932] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Committing config change with OpId 10.8: config changed from index 5 to 8, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:45:57.687228  9043 rpcz_store.cc:269] 0925 16:45:53.642349 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.767806 (+125457us) service_pool.cc:227] Handling call
0925 16:45:57.621048 (+3853242us) spinlock_profiling.cc:243] Waited 3.71 s on lock 0x7b54000a87d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:57.621183 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8536263936}
I20260925 16:45:57.694489  9049 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260925 16:45:57.699407  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.028s	sys 0.028s
W20260925 16:45:57.831353  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 140257us
I20260925 16:45:57.556661 16050 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.692221  9044 rpcz_store.cc:276] 0925 16:45:54.116880 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.791490 (+2674610us) service_pool.cc:227] Handling call
0925 16:45:56.814919 (+ 23429us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:56.819877 (+  4958us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:56.819908 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:56.820308 (+   400us) log.cc:842] Serialized 26 byte log entry
0925 16:45:57.385739 (+565431us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:45:57.510897 (+125158us) log.cc:842] Serialized 14 byte log entry
0925 16:45:57.518048 (+  7151us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.536561 (+ 18513us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:57.541729 (+  5168us) raft_consensus.cc:1671] finished
0925 16:45:57.541744 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:57.541851 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":157120,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":17523,"raft.run_cpu_time_us":459,"raft.run_wall_time_us":39946,"thread_start_us":588465,"threads_started":2,"wal-append.queue_time_us":556917}
I20260925 16:45:57.859787 16360 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:57.902489 16043 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:57.874920 15954 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:57.925298  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3684) took 4674 ms. Trace:
I20260925 16:45:57.936244  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:57.885545 16443 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:57.935427  9049 rpcz_store.cc:276] 0925 16:45:53.218516 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:53.614591 (+396075us) service_pool.cc:227] Handling call
0925 16:45:53.614918 (+   327us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:54.230059 (+615141us) spinlock_profiling.cc:243] Waited 542 ms on lock 0x7b18000b34c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf65856 00007f719beb7f7e 00007f719bf21367 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:45:57.318655 (+3088596us) spinlock_profiling.cc:243] Waited 1.93 s on lock 0x7b580025cdb0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:45:57.695865 (+377210us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.892378 (+196513us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5684632192}
W20260925 16:45:57.947253  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 164436us
I20260925 16:45:57.945046  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:57.966668 16230 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260925 16:45:57.966980  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:57.968680 16362 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:57.969434 16362 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:57.930042 16043 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:57.971768 16358 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:57.862334 16393 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:57.978191  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 370276us
I20260925 16:45:57.990983  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 16 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:58.001330  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3705) took 2384 ms. Trace:
I20260925 16:45:58.001766  9041 rpcz_store.cc:276] 0925 16:45:55.616880 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.973053 (+2356173us) service_pool.cc:227] Handling call
0925 16:45:58.000831 (+ 27778us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.001027 (+   196us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.001053 (+    26us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:58.001096 (+    43us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:58.001129 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.001181 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.001279 (+    98us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.003290  9041 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:58.003984  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1577) took 1674 ms. Trace:
I20260925 16:45:58.004093  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:58.004985  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:58.005450  9701 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260925 16:45:58.005571  9702 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:58.005810  9701 pending_rounds.cc:76] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 9
I20260925 16:45:58.006060  9701 pending_rounds.cc:97] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260925 16:45:58.006314  9701 raft_consensus.cc:2866] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:58.006881  9694 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:58.004540  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:45:58.016603  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51256.3us
I20260925 16:45:58.017796  9044 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:58.018281  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:58.026609  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3707) took 2409 ms. Trace:
I20260925 16:45:58.027109  9049 rpcz_store.cc:276] 0925 16:45:55.617453 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.973178 (+2355725us) service_pool.cc:227] Handling call
0925 16:45:58.025817 (+ 52639us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.026154 (+   337us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.026193 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:58.026272 (+    79us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:58.026311 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.026386 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.026542 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.032802  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3710) took 2214 ms. Trace:
I20260925 16:45:58.033196  9041 rpcz_store.cc:276] 0925 16:45:55.797003 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.002737 (+2205734us) service_pool.cc:227] Handling call
0925 16:45:58.003100 (+   363us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.010836 (+  7736us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.011122 (+   286us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.040869  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3703) took 2930 ms. Trace:
I20260925 16:45:58.041379  9044 rpcz_store.cc:276] 0925 16:45:55.110513 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.924531 (+2814018us) service_pool.cc:227] Handling call
0925 16:45:57.996010 (+ 71479us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.040577 (+ 44567us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.040804 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:58.016865  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.924e+06us
W20260925 16:45:58.090942  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 60981.1us
W20260925 16:45:58.097550  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 178646us
I20260925 16:45:58.098423  8969 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:58.044857 16372 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.105834  8975 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:58.004405  9695 rpcz_store.cc:276] 0925 16:45:56.234952 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.252217 (+ 17265us) service_pool.cc:227] Handling call
0925 16:45:56.252513 (+   296us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:56.256834 (+  4321us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:56.256877 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:56.257381 (+   504us) log.cc:842] Serialized 26 byte log entry
0925 16:45:56.516949 (+259568us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:45:56.516988 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:56.517053 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:57.614329 (+1097276us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:57.868583 (+254254us) raft_consensus.cc:1671] finished
0925 16:45:57.868611 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:57.909572 (+ 40961us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3878,"raft.queue_time_us":15591,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":16710,"spinlock_wait_cycles":52084608,"thread_start_us":259288,"threads_started":1,"wal-append.queue_time_us":351874}
W20260925 16:45:58.118741  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47581.3us
I20260925 16:45:58.106470  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:58.152002 15993 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:45:58.053007 16384 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:45:57.980119 16443 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.154629 16443 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.154759  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.081440 16042 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.181828 16042 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.178369 16154 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.183089 16154 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.166646  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:58.167138 16371 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:45:58.171360  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:58.172299 15545 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.174032  9041 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:45:58.173974 16152 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.175987  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1832) took 1381 ms. Trace:
I20260925 16:45:58.175894  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:58.176487  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.176673  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:58.025310 16140 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.116s
I20260925 16:45:58.179194  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1401) took 3081 ms. Trace:
I20260925 16:45:58.230974  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1406) took 2368 ms. Trace:
I20260925 16:45:58.232950  9041 rpcz_store.cc:276] 0925 16:45:55.838716 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.057387 (+2218671us) service_pool.cc:227] Handling call
0925 16:45:58.173673 (+116286us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.206486 (+ 32813us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.206759 (+   273us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.142009 16415 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:45:58.232101  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 140068us
I20260925 16:45:58.233980  9047 rpcz_store.cc:276] 0925 16:45:55.098025 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.562073 (+2464048us) service_pool.cc:227] Handling call
0925 16:45:57.562607 (+   534us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.563208 (+   601us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.563251 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:57.563828 (+   577us) log.cc:842] Serialized 26 byte log entry
0925 16:45:57.940555 (+376727us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:57.940690 (+   135us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.940793 (+   103us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.178970 (+238177us) raft_consensus.cc:1671] finished
0925 16:45:58.178992 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.179138 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":129,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":115,"thread_start_us":376080,"threads_started":1,"wal-append.queue_time_us":603851}
I20260925 16:45:58.185950 16393 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:58.249971  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.252066  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.253237  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.254281  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.255223  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1408) took 1657 ms. Trace:
I20260925 16:45:58.255870 16140 consensus_queue.cc:1225] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260925 16:45:58.256111 16443 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:58.256527 16140 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:58.250272  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:58.255599  9041 rpcz_store.cc:276] 0925 16:45:56.597897 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.254339 (+1656442us) service_pool.cc:227] Handling call
0925 16:45:58.254663 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.254915 (+   252us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.254942 (+    27us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:58.254998 (+    56us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:45:58.255031 (+    33us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.255081 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.255177 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.256604 16443 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:58.197814 16050 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:58.196317 16154 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.255259  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.211483 15954 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.261389  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:58.267621  9120 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:58.267797 16099 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:45:58.269680  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:58.271947  8969 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:58.231663  9118 rpcz_store.cc:276] 0925 16:45:56.794431 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.500760 (+706329us) service_pool.cc:227] Handling call
0925 16:45:57.501154 (+   394us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.502101 (+   947us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.502132 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:57.502665 (+   533us) log.cc:842] Serialized 26 byte log entry
0925 16:45:57.849515 (+346850us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:57.849554 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.849631 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.175751 (+326120us) raft_consensus.cc:1671] finished
0925 16:45:58.175769 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.175903 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":122,"raft.run_cpu_time_us":111,"raft.run_wall_time_us":111,"thread_start_us":346463,"threads_started":1,"wal-append.queue_time_us":664637}
I20260925 16:45:58.257112 16140 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:58.212908 16362 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.186724 16381 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:58.242061 16106 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:58.211231 16372 consensus_queue.cc:1046] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260925 16:45:58.274647  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1405) took 2436 ms. Trace:
I20260925 16:45:58.285908  9049 rpcz_store.cc:276] 0925 16:45:55.838218 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.072173 (+2233955us) service_pool.cc:227] Handling call
0925 16:45:58.257945 (+185772us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.274319 (+ 16374us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.274347 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:58.274389 (+    42us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:58.274421 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.274477 (+    56us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.274598 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.266124 16443 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:58.124593 16358 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.294376  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.290939  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.300506  9120 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
W20260925 16:45:58.303606  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 137095us
I20260925 16:45:58.269199 16132 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.311570  9047 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260925 16:45:58.315351  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.315992  9049 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:45:58.317656 16128 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.605s	user 0.009s	sys 0.000s
I20260925 16:45:58.317267 16132 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.319459 16132 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.320964  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.321686  9120 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:58.322470  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:58.323273 16222 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.678s	user 0.008s	sys 0.003s
I20260925 16:45:58.324230  9116 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260925 16:45:58.324537  9116 pending_rounds.cc:76] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 13
I20260925 16:45:58.324753  9116 pending_rounds.cc:97] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260925 16:45:58.324962  9116 raft_consensus.cc:2866] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:45:58.326301  9049 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:45:58.328658  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:58.330226  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:58.330300 16370 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:45:58.330979 16370 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:45:58.332051  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 96491.8us
I20260925 16:45:58.332234 16214 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:58.332751 16049 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:58.333379  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:45:58.333317 16049 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.335238  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:58.332027 16370 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.336491  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.337359 16372 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:45:58.337743 16372 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.338141 16372 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:58.327958  9049 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:45:58.339555  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2487) took 1650 ms. Trace:
I20260925 16:45:58.245090 15545 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.339892  9049 rpcz_store.cc:276] 0925 16:45:56.689320 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.327211 (+1637891us) service_pool.cc:227] Handling call
0925 16:45:58.327570 (+   359us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.339308 (+ 11738us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.339495 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.341480 15545 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.343976 15954 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.345120 16043 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.345991 15954 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.346366 16383 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:58.346716 16383 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:58.347824 16381 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.350553 16381 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.350770  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1402) took 3252 ms. Trace:
I20260925 16:45:58.268517 16152 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.352551  9049 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:45:58.351225  9046 rpcz_store.cc:276] 0925 16:45:55.098480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.577723 (+2479243us) service_pool.cc:227] Handling call
0925 16:45:57.578238 (+   515us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.579042 (+   804us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.579084 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:57.579735 (+   651us) log.cc:842] Serialized 26 byte log entry
0925 16:45:57.909791 (+330056us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:58.140344 (+230553us) log.cc:842] Serialized 14 byte log entry
0925 16:45:58.177868 (+ 37524us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.177950 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.350533 (+172583us) raft_consensus.cc:1671] finished
0925 16:45:58.350559 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.350707 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":47852,"prepare.queue_time_us":67598,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":13406,"raft.queue_time_us":37684,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":178,"thread_start_us":523272,"threads_started":2,"wal-append.queue_time_us":768415}
I20260925 16:45:58.353369 16152 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.354036  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3716) took 1481 ms. Trace:
I20260925 16:45:58.354380  9046 rpcz_store.cc:276] 0925 16:45:56.873140 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.353237 (+1480097us) service_pool.cc:227] Handling call
0925 16:45:58.353524 (+   287us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.353744 (+   220us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.353765 (+    21us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:58.353804 (+    39us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:45:58.353835 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.353883 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.353963 (+    80us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.357550  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3713) took 1525 ms. Trace:
I20260925 16:45:58.311663  8966 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:45:58.355660  9046 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:58.313086  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2485) took 1681 ms. Trace:
I20260925 16:45:58.363497  9047 rpcz_store.cc:276] 0925 16:45:56.631833 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.249223 (+1617390us) service_pool.cc:227] Handling call
0925 16:45:58.287630 (+ 38407us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.312838 (+ 25208us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.313033 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:45:58.359730  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46887.3us
I20260925 16:45:58.358870  9119 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:45:58.366434  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3718) took 1231 ms. Trace:
I20260925 16:45:58.366858  9046 rpcz_store.cc:276] 0925 16:45:57.135210 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.355224 (+1220014us) service_pool.cc:227] Handling call
0925 16:45:58.355500 (+   276us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.366156 (+ 10656us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.366374 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:45:58.364413  9049 rpcz_store.cc:276] 0925 16:45:56.831981 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.340669 (+1508688us) service_pool.cc:227] Handling call
0925 16:45:58.340976 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.352861 (+ 11885us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.357312 (+  4451us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54001afc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:58.357496 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":25920384}
I20260925 16:45:58.372398  9049 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
I20260925 16:45:58.359319  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:45:58.304076 16208 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:45:58.384959 16208 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.385442 16208 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:58.358788 16314 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.388262 16314 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.347584 16383 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.390336 16383 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:58.392073  9049 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:58.397018  9123 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: []
I20260925 16:45:58.398200  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.401652  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:45:58.402165  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.402719  9120 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260925 16:45:58.403226 16099 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.403786  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.374069 16381 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:45:58.403997 16099 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.405992 16049 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.406750 16099 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.407681 16222 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.408329 16358 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:58.408105 15714 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:45:58.408937 16404 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
I20260925 16:45:58.409610 15714 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:58.410403 16404 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:45:58.411585 16204 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:45:58.412060 16204 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:58.412096  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.412974  9118 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:45:58.413467 16204 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.399387  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.382632  8969 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:58.314497 16106 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:58.383869 16140 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.415870  9123 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:58.411624 16404 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:58.407521 16099 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:45:58.420814 16404 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:58.415263 16204 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:58.428368 16106 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.428556 16404 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.415282 16360 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:45:58.445084  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:58.422037 16415 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:58.451812 16099 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:58.452567 16099 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.455178 16099 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:58.456214 16140 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:58.456475  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 124909us
I20260925 16:45:58.455928 16443 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.457453  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:58.458367  9050 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:58.458973 16379 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:45:58.459043 16129 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:45:58.459676 16379 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:58.460206 16379 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:58.450421  9121 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:45:58.374341 16050 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.077s
I20260925 16:45:58.444289 16358 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:45:58.482285 16055 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.483349 16385 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:58.483878 16385 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:58.484894 16385 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.408353 16222 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.449620 16415 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:58.474886 16381 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:45:58.498730  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.483146 16055 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.487066 16443 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.499432  8972 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:45:58.450970 16132 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.039s
I20260925 16:45:58.492831 16099 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:58.495817 16381 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:58.518188  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:58.524236  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.499387 15954 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260925 16:45:58.516091 16099 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:58.523351 16381 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:45:58.535493  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 200370us
I20260925 16:45:58.521592 16055 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:58.544636 16496 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.214s	user 0.001s	sys 0.003s
I20260925 16:45:58.548936 15954 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:45:58.559756  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3570) took 2028 ms. Trace:
I20260925 16:45:58.560421  9124 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:45:58.561707  9122 rpcz_store.cc:276] 0925 16:45:56.531037 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.650991 (+119954us) service_pool.cc:227] Handling call
0925 16:45:58.551796 (+1900805us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b540010c554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:58.559654 (+  7858us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1414747008}
I20260925 16:45:58.563483  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:45:58.566776 16222 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:45:58.574110  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 76235.8us
I20260925 16:45:58.567327 15954 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:58.537436 16415 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.586694 15991 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:58.611748  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:58.612207 15991 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.614610 15991 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:58.615464 16494 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260925 16:45:58.617695  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1398) took 3520 ms. Trace:
W20260925 16:45:58.618253  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 361104us
I20260925 16:45:58.619418  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:58.618181  9048 rpcz_store.cc:276] 0925 16:45:55.097164 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.522008 (+2424844us) service_pool.cc:227] Handling call
0925 16:45:57.554984 (+ 32976us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.595716 (+ 40732us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.595745 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:57.596181 (+   436us) log.cc:842] Serialized 26 byte log entry
0925 16:45:57.923186 (+327005us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:58.202337 (+279151us) log.cc:842] Serialized 14 byte log entry
0925 16:45:58.232211 (+ 29874us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.232283 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.617424 (+385141us) raft_consensus.cc:1671] finished
0925 16:45:58.617449 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.617606 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":375654,"prepare.queue_time_us":135574,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":50,"raft.queue_time_us":40338,"raft.run_cpu_time_us":215,"raft.run_wall_time_us":9798,"thread_start_us":555256,"threads_started":2,"wal-append.queue_time_us":901395}
I20260925 16:45:58.620435  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1404) took 3444 ms. Trace:
I20260925 16:45:58.622054 16319 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:45:58.620909  9043 rpcz_store.cc:276] 0925 16:45:55.175890 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.929883 (+2753993us) service_pool.cc:227] Handling call
0925 16:45:57.967287 (+ 37404us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.967684 (+   397us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.967739 (+    55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:57.968204 (+   465us) log.cc:842] Serialized 26 byte log entry
0925 16:45:58.197669 (+229465us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:58.245885 (+ 48216us) log.cc:842] Serialized 14 byte log entry
0925 16:45:58.583312 (+337427us) spinlock_profiling.cc:243] Waited 4.31 ms on lock 0x7b180052a620. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:45:58.583997 (+   685us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.584094 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.620175 (+ 36081us) raft_consensus.cc:1671] finished
0925 16:45:58.620280 (+   105us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.620387 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":11396,"prepare.queue_time_us":48221,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":346357,"raft.run_cpu_time_us":329,"raft.run_wall_time_us":46250,"spinlock_wait_cycles":9921280,"thread_start_us":229094,"threads_started":1,"wal-append.queue_time_us":614058}
I20260925 16:45:58.622447 16319 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:58.622886 16319 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:45:58.624747 15684 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:58.625264 15684 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.627214 15684 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.586490 15993 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.620411 16309 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:45:58.636732  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52488.1us
I20260925 16:45:58.631297 16152 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.605195 16293 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260925 16:45:58.671082 16152 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.662472 15993 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.585026 16099 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.672524 16415 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:58.673404 16365 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:45:58.674238 16208 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.692162 16208 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.682189 15993 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.684723 16099 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:58.630663 16372 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.705773 16372 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.708097  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3700) took 4169 ms. Trace:
I20260925 16:45:58.711992  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1410) took 1530 ms. Trace:
I20260925 16:45:58.720248  9047 rpcz_store.cc:276] 0925 16:45:57.181535 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.364466 (+1182931us) service_pool.cc:227] Handling call
0925 16:45:58.396007 (+ 31541us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.711550 (+315543us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.711594 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:58.711657 (+    63us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:58.711719 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.711799 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.711929 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":268031,"raft.queue_time_us":314784}
I20260925 16:45:58.686410 16152 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.734567  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:58.708581  9045 rpcz_store.cc:276] 0925 16:45:54.538423 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.434520 (+2896097us) service_pool.cc:227] Handling call
0925 16:45:57.485806 (+ 51286us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:57.532911 (+ 47105us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.532940 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:57.548228 (+ 15288us) log.cc:842] Serialized 26 byte log entry
0925 16:45:57.885376 (+337148us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:57.919310 (+ 33934us) log.cc:842] Serialized 14 byte log entry
0925 16:45:57.938990 (+ 19680us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:57.939095 (+   105us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.354251 (+415156us) spinlock_profiling.cc:243] Waited 7.29 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:45:58.356008 (+  1757us) spinlock_profiling.cc:243] Waited 5.19 ms on lock 0x7b1800449920. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:58.573486 (+217478us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b1800449920. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:58.707821 (+134335us) raft_consensus.cc:1671] finished
0925 16:45:58.707856 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.708027 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":586776,"prepare.queue_time_us":33761,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":4346,"raft.queue_time_us":43854,"raft.run_cpu_time_us":11766,"raft.run_wall_time_us":817934,"spinlock_wait_cycles":56593152,"thread_start_us":314412,"threads_started":1,"wal-append.queue_time_us":380262}
I20260925 16:45:58.727586  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:58.721849 16365 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:58.725602 16222 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260925 16:45:58.758026 16208 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:45:58.758315 16049 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:58.739307 15954 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.759080 16208 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:58.759471 16208 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:45:58.744458 16379 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.760183  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.760819  9045 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:58.758062 16365 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.761427 16379 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.762681 16319 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.722337 16384 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.018s
I20260925 16:45:58.760524 16208 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.769503 16208 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:58.748193 16362 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:58.789433  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.791689  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.792371  9043 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:58.795109  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.795856  9048 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:58.798231  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.799059  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.799412  9045 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:45:58.800693  9043 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:58.802726  9049 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:45:58.812172  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.809803 16049 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.840396 16049 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.841341 16132 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.841800 16132 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.842329 16049 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.843446 16379 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:58.843991 16379 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.845897  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.846516  9049 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:58.777827 16381 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.853580 16381 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.853804  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.855752  8969 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
I20260925 16:45:58.812917  9048 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:45:58.865646  9049 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:45:58.868266  8972 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:45:58.868589  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:58.870281  9120 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:45:58.872762  8974 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.000s	sys 0.024s
W20260925 16:45:58.873266  8974 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.000s	sys 0.025s
I20260925 16:45:58.873914  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.874152  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.874662  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.876029  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.876032  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.876154  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:58.888051  9044 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.018s	sys 0.030s
I20260925 16:45:58.868654  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:58.900508  9044 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.018s	sys 0.030s
I20260925 16:45:58.858393 16132 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.901598  9122 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:45:58.879321 16390 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:58.879626  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:58.868328 16319 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.886439  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.875542 16099 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:58.878453  8973 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.012s	sys 0.012s
I20260925 16:45:58.896435  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:58.866878 16230 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.037s	sys 0.039s
W20260925 16:45:58.897737  9089 connection.cc:232] RPC call timeout handler was delayed by -1.5516982170001938s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19710000000000003s for a response
W20260925 16:45:58.878152  8967 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.591s	user 0.000s	sys 0.024s
W20260925 16:45:58.949967  8967 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.000s	sys 0.025s
W20260925 16:45:58.930590  8973 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.012s	sys 0.013s
I20260925 16:45:58.931946  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:58.932962  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:58.933398  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.933504 16390 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.934041 16415 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:58.932998  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.895954 16379 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.937124  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.937932 16314 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.938374 16099 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.939844  8968 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:58.952203  8972 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:58.955659  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:58.947714 16230 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.038s	sys 0.039s
I20260925 16:45:58.968005  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:58.970479  9120 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:45:58.965184  9045 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260925 16:45:58.964540 16415 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:58.975960  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.976747  8971 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:45:58.977361 16415 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.977769  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.974192  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.978490  8971 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:45:58.979183  8971 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:45:58.985224 16099 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:58.991641  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:58.992436  8975 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:58.992764 16390 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:58.993468  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:45:58.994109  8968 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:45:58.995949  9049 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260925 16:45:58.998066  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:58.999778  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:58.998898  9120 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:45:58.974488  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3234) took 1489 ms. Trace:
I20260925 16:45:59.019063  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:59.003186  8967 rpcz_store.cc:276] 0925 16:45:57.461579 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.463026 (+  1447us) service_pool.cc:227] Handling call
0925 16:45:57.466882 (+  3856us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:45:57.473060 (+  6178us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:57.473088 (+    28us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:45:57.474357 (+  1269us) log.cc:842] Serialized 553 byte log entry
0925 16:45:57.671205 (+196848us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:58.247173 (+575968us) log.cc:842] Serialized 14 byte log entry
0925 16:45:58.950515 (+703342us) log.cc:842] Serialized 14 byte log entry
0925 16:45:58.950939 (+   424us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.951064 (+   125us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:58.951125 (+    61us) raft_consensus.cc:1671] finished
0925 16:45:58.951141 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:58.951302 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":8946,"prepare.queue_time_us":361715,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":2727,"raft.run_cpu_time_us":343,"raft.run_wall_time_us":9884,"thread_start_us":840402,"threads_started":2,"wal-append.queue_time_us":776719}
I20260925 16:45:59.014217  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:59.003474 16390 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
W20260925 16:45:59.035808  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.042s	sys 0.042s
W20260925 16:45:59.038344  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.634s	user 0.042s	sys 0.042s
W20260925 16:45:59.024828 16370 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.018s	sys 0.044s
I20260925 16:45:59.040547  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:45:59.041419  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 636211us
W20260925 16:45:59.039717  8966 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.558s	user 0.008s	sys 0.040s
I20260925 16:45:59.022563 16132 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:59.050880  8966 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.009s	sys 0.040s
W20260925 16:45:59.051064 16370 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.018s	sys 0.045s
I20260925 16:45:59.033780 16360 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:45:59.051793 16132 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:59.055897  9043 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260925 16:45:59.055547  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:45:59.058779  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85891.7us
I20260925 16:45:59.050554 16390 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:45:59.052076 16106 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.601s	user 0.007s	sys 0.024s
I20260925 16:45:59.052577 16381 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:59.056707 16132 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:45:59.068679  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.012s	sys 0.021s
W20260925 16:45:59.069119  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.012s	sys 0.021s
I20260925 16:45:59.071377 16230 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:59.072010 16230 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.073979 16230 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.075488  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.076767  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.082535  8968 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
W20260925 16:45:59.066636 16106 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.008s	sys 0.024s
I20260925 16:45:59.064438 16442 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:45:59.083953 16442 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:59.084492 16442 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:45:59.083899  8866 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 10 to 18. New cstate: current_term: 18 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:59.085549  8866 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 16 to 20. New cstate: current_term: 20 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:59.087762 16381 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:58.673489  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:45:59.089771 16381 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.096704 16390 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.098929 16404 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:59.073988  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:45:59.074002 16099 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.030s
I20260925 16:45:59.104424 16099 consensus_queue.cc:1225] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:45:59.069660  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:45:59.109622  9043 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:45:59.083094  8865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 345) took 24552 ms (client timeout 15000 ms). Trace:
I20260925 16:45:59.112810  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:59.115813  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60350us
I20260925 16:45:59.113597  9120 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
W20260925 16:45:59.121937  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.011s	sys 0.030s
W20260925 16:45:59.122462  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.578s	user 0.011s	sys 0.030s
I20260925 16:45:59.131548  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:45:59.110908 16230 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:45:59.135869 16127 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:59.136354 16127 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.138384 16127 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.150426  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3566) took 2996 ms. Trace:
I20260925 16:45:59.150945  9116 rpcz_store.cc:276] 0925 16:45:56.154190 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:56.444565 (+290375us) service_pool.cc:227] Handling call
0925 16:45:56.444874 (+   309us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.325666 (+1880792us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.150077 (+824411us) spinlock_profiling.cc:243] Waited 1.88 s on lock 0x7b540010bb54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:45:59.150342 (+   265us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4320696704}
I20260925 16:45:59.165246 16385 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:59.167969 16358 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:45:59.168453 16358 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:59.168740 16389 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:59.169458 16389 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.170055  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1414) took 1481 ms. Trace:
I20260925 16:45:59.170537  9050 rpcz_store.cc:276] 0925 16:45:57.688527 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.336205 (+647678us) service_pool.cc:227] Handling call
0925 16:45:59.169813 (+833608us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:59.169989 (+   176us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":278264576}
I20260925 16:45:59.132704  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:59.117735 16106 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:45:59.212615  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3573) took 2555 ms. Trace:
I20260925 16:45:59.214607  9115 rpcz_store.cc:276] 0925 16:45:56.657049 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.445987 (+788938us) service_pool.cc:227] Handling call
0925 16:45:58.340906 (+894919us) spinlock_profiling.cc:243] Waited 9.43 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:45:59.104931 (+764025us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:59.111117 (+  6186us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:59.111160 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:59.111213 (+    53us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:45:59.111253 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.111326 (+    73us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:59.212378 (+101052us) spinlock_profiling.cc:243] Waited 764 ms on lock 0x7b540009ef50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:59.212530 (+   152us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1778287232}
I20260925 16:45:59.178988 16360 raft_consensus.cc:2741] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260925 16:45:59.173209 16230 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:59.207954 16208 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:59.219000  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.018s	sys 0.028s
W20260925 16:45:59.230213  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.019s	sys 0.029s
W20260925 16:45:59.230830  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 981902us
I20260925 16:45:59.219602  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1830) took 2614 ms. Trace:
I20260925 16:45:59.232224  9124 rpcz_store.cc:276] 0925 16:45:56.605016 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.440774 (+835758us) service_pool.cc:227] Handling call
0925 16:45:58.556783 (+1116009us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.564319 (+  7536us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.219374 (+655055us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540010c550. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:45:59.219537 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2461894912}
I20260925 16:45:59.087488  8866 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 11 to 13, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:59.218792 16106 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.237542 16208 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:59.242966 16208 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:59.243731 16106 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:59.248147 16389 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:59.251569  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1407) took 3412 ms. Trace:
I20260925 16:45:59.252005  9044 rpcz_store.cc:276] 0925 16:45:55.839160 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.055919 (+2216759us) service_pool.cc:227] Handling call
0925 16:45:58.164251 (+108332us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:58.211400 (+ 47149us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.211446 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:58.258120 (+ 46674us) log.cc:842] Serialized 26 byte log entry
0925 16:45:58.900983 (+642863us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:45:58.962448 (+ 61465us) log.cc:842] Serialized 14 byte log entry
0925 16:45:58.962719 (+   271us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:58.962810 (+    91us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:59.251314 (+288504us) raft_consensus.cc:1671] finished
0925 16:45:59.251344 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:59.251495 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32552,"prepare.queue_time_us":61254,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":41574,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":14173,"thread_start_us":580304,"threads_started":1,"wal-append.queue_time_us":929161}
W20260925 16:45:59.256189  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 138779us
I20260925 16:45:59.257916  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:59.110297  8865 rpcz_store.cc:269] 0925 16:45:34.530181 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:34.530425 (+   244us) service_pool.cc:227] Handling call
0925 16:45:59.082859 (+24552434us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:45:40.266576 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:45:40.450161 (+183585us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:45:40.457055 (+  6894us) write_op.cc:435] Acquired schema lock
0925 16:45:40.469150 (+ 12095us) tablet.cc:660] Decoding operations
0925 16:45:40.593702 (+124552us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:45:40.593754 (+    52us) write_op.cc:641] Partition lock acquired for write op
0925 16:45:40.593783 (+    29us) tablet.cc:683] Acquiring locks for 28 operations
0925 16:45:40.800372 (+206589us) tablet.cc:699] Row locks acquired
0925 16:45:40.820561 (+ 20189us) write_op.cc:260] PREPARE: finished
0925 16:45:40.848894 (+ 28333us) write_op.cc:270] Start()
0925 16:45:40.914392 (+ 65498us) write_op.cc:276] Timestamp: P: 1790354740841043 usec, L: 0
0925 16:45:40.978188 (+ 63796us) op_driver.cc:331] REPLICATION: starting
0925 16:45:41.314323 (+336135us) log.cc:842] Serialized 11027 byte log entry
0925 16:45:43.027265 (+1712942us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b1800217840. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511
0925 16:45:43.027665 (+   400us) spinlock_profiling.cc:243] Waited 4.01 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:45:44.085947 (+1058282us) op_driver.cc:444] REPLICATION: finished
0925 16:45:44.926651 (+840704us) write_op.cc:301] APPLY: starting
0925 16:45:44.926774 (+   123us) tablet.cc:1365] starting BulkCheckPresence
0925 16:45:45.200081 (+273307us) tablet.cc:1368] finished BulkCheckPresence
0925 16:45:45.200144 (+    63us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:45:46.564762 (+1364618us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:45:46.565343 (+   581us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0925 16:45:46.565416 (+    73us) write_op.cc:312] APPLY: finished
0925 16:45:46.566120 (+   704us) log.cc:842] Serialized 244 byte log entry
0925 16:45:46.922398 (+356278us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:46.923316 (+   918us) write_op.cc:454] Released schema lock
0925 16:45:46.923519 (+   203us) write_op.cc:341] FINISH: Updating metrics
0925 16:45:46.924210 (+   691us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:45:46.924264 (+    54us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":635801,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":839758,"apply.run_cpu_time_us":61632,"apply.run_wall_time_us":2093435,"cfile_cache_hit":114,"cfile_cache_hit_bytes":120999,"num_ops":28,"prepare.queue_time_us":254926,"prepare.run_cpu_time_us":54942,"prepare.run_wall_time_us":1512290,"raft.queue_time_us":1055044,"raft.run_cpu_time_us":53451,"raft.run_wall_time_us":992862,"replication_time_us":3107630,"spinlock_wait_cycles":16906752,"thread_start_us":2665870,"threads_started":5,"wal-append.queue_time_us":658556,"wal-append.run_cpu_time_us":41862,"wal-append.run_wall_time_us":4273087}]]}
I20260925 16:45:59.257848 16360 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:45:59.259439 16370 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:45:59.259941 16360 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:45:59.260319 16360 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:59.261145 16360 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.262274 16360 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:45:59.212494 16204 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:45:59.263614 16204 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.266319 16204 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.218091 16384 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260925 16:45:59.228719 16230 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:59.272639  8866 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 11 to 13, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:59.169476 16358 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.284256 16358 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:45:59.286832  9043 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:45:59.287842  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:59.180398 16132 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.283116 16442 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:59.291854  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.672s	user 0.014s	sys 0.014s
W20260925 16:45:59.295157  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.014s	sys 0.014s
I20260925 16:45:59.295332  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:45:59.296105  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.01077e+06us
I20260925 16:45:59.302661 16319 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:45:59.313936  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:59.315793  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:45:59.316512  9693 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:45:59.292083  9046 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.006s	sys 0.014s
W20260925 16:45:59.318156  9046 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.562s	user 0.006s	sys 0.014s
I20260925 16:45:59.309645  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:45:59.294654 16106 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:59.339548  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:45:59.301086 16365 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.008s	sys 0.013s
I20260925 16:45:59.313208  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:59.313409  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:59.318478 16308 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260925 16:45:59.379356  9698 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:59.395239  9695 raft_consensus.cc:2396] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
W20260925 16:45:59.347190 16365 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.008s	sys 0.014s
I20260925 16:45:59.326815 16230 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:59.327832 15775 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.007s	sys 0.022s
I20260925 16:45:59.317513  8866 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 12 to 16, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 16 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:45:59.337849  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:45:59.307137  9042 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.007s	sys 0.015s
I20260925 16:45:59.346797 16389 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260925 16:45:59.425068  9042 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.007s	sys 0.015s
I20260925 16:45:59.427829  8921 placement_policy_util.cc:244] tablet 12359c2bff0b46de91daa934c219103c: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
I20260925 16:45:59.427950  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.429165  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.411334 16381 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:59.430276 16381 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.432312 16381 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:59.417183 16451 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:45:59.433581 16451 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:59.434509 16451 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.443111  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.443881  8975 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:45:59.450783  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.451002  8971 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:45:59.411345 16106 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:59.454962  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:45:59.422394 15775 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.760s	user 0.008s	sys 0.023s
W20260925 16:45:59.453799  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 116039us
I20260925 16:45:59.460153  8970 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:45:59.325733  9699 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:45:59.474997  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.474998  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:59.454618 16370 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:45:59.460320 16293 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260925 16:45:59.490161 16370 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:45:59.491269 16370 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.487067  8968 raft_consensus.cc:2396] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 20 because replica has last-logged OpId of term: 19 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260925 16:45:59.495285  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:59.496080  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:59.460875 16451 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:59.499841  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:45:59.500977  9696 raft_consensus.cc:2396] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 15.
I20260925 16:45:59.447947 16393 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:59.502226 16393 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.426759 16389 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:45:59.486511 16308 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:45:59.513388  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:45:59.512308 16389 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:59.511437 16512 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:59.527659  9050 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:45:59.538391  9693 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:45:59.525629 16442 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.528949 16132 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:59.546351 16512 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.632867 16051 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:45:59.633515 16051 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.634064 16512 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.636310 16051 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.600220  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.601142 16393 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.604851  8866 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:59.605791  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3595) took 1065 ms. Trace:
I20260925 16:45:59.610178  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.615386  9120 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:45:59.624019 16106 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.628440 16230 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.644137  9117 rpcz_store.cc:276] 0925 16:45:58.540141 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.542478 (+  2337us) service_pool.cc:227] Handling call
0925 16:45:58.542938 (+   460us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:58.543420 (+   482us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.543477 (+    57us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:58.544119 (+   642us) log.cc:842] Serialized 26 byte log entry
0925 16:45:59.122917 (+578798us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:45:59.122972 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.123062 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:59.605503 (+482441us) raft_consensus.cc:1671] finished
0925 16:45:59.605529 (+    26us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:59.605725 (+   196us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":131,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":127,"thread_start_us":578363,"threads_started":1,"wal-append.queue_time_us":959897}
W20260925 16:45:59.651813  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.032s	user 0.039s	sys 0.144s
W20260925 16:45:59.652252  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.039s	sys 0.144s
I20260925 16:45:59.674225 16230 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:59.677429 16516 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:59.677562 16512 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:45:59.708976  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.657s	user 0.018s	sys 0.031s
W20260925 16:45:59.713320  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.018s	sys 0.031s
I20260925 16:45:59.720598  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1412) took 2538 ms. Trace:
I20260925 16:45:59.677209 16383 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
W20260925 16:45:59.724483  9047 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.024s	sys 0.015s
W20260925 16:45:59.693130 15954 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.010s	sys 0.050s
I20260925 16:45:59.717482  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1478) took 1237 ms. Trace:
W20260925 16:45:59.722476  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.10303e+06us
I20260925 16:45:59.721014  9046 rpcz_store.cc:276] 0925 16:45:57.182459 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.367646 (+1185187us) service_pool.cc:227] Handling call
0925 16:45:58.422353 (+ 54707us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:58.710850 (+288497us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:58.710894 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:58.728180 (+ 17286us) log.cc:842] Serialized 26 byte log entry
0925 16:45:58.853343 (+125163us) spinlock_profiling.cc:243] Waited 1.89 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:45:59.336513 (+483170us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:59.455831 (+119318us) log.cc:842] Serialized 14 byte log entry
0925 16:45:59.477459 (+ 21628us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.477555 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:59.720318 (+242763us) raft_consensus.cc:1671] finished
0925 16:45:59.720424 (+   106us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:59.720544 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":230246,"prepare.queue_time_us":124096,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":430869,"raft.run_cpu_time_us":2059,"raft.run_wall_time_us":130966,"spinlock_wait_cycles":4352256,"thread_start_us":579944,"threads_started":1,"wal-append.queue_time_us":979422}
W20260925 16:45:59.726490  9047 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.024s	sys 0.015s
W20260925 16:45:59.730144  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.011s	sys 0.015s
W20260925 16:45:59.743355  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.613s	user 0.011s	sys 0.015s
I20260925 16:45:59.704631 16208 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:45:59.733383  9045 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.676s	user 0.013s	sys 0.038s
W20260925 16:45:59.750895  9045 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.013s	sys 0.038s
W20260925 16:45:59.730518  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.631s	user 0.006s	sys 0.019s
W20260925 16:45:59.757534  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.658s	user 0.006s	sys 0.019s
W20260925 16:45:59.744365  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 613886us
W20260925 16:45:59.730899  8974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.767s	user 0.046s	sys 0.050s
W20260925 16:45:59.764317  8974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.835s	user 0.047s	sys 0.051s
I20260925 16:45:59.710035 16230 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:59.731007  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.027s
W20260925 16:45:59.786782  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.000s	sys 0.028s
W20260925 16:45:59.727447 15954 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.010s	sys 0.051s
I20260925 16:45:59.730780  8966 rpcz_store.cc:276] 0925 16:45:58.480215 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.480330 (+   115us) service_pool.cc:227] Handling call
0925 16:45:58.481589 (+  1259us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.481784 (+   195us) raft_consensus.cc:1520] Early marking committed up to index 16
0925 16:45:59.051391 (+569607us) log.cc:842] Serialized 14 byte log entry
0925 16:45:59.717087 (+665696us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:59.717152 (+    65us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:45:59.717211 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.717283 (+    72us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:59.717422 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2918,"prepare.queue_time_us":127972,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":3110,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":123,"thread_start_us":1231508,"threads_started":2}
I20260925 16:45:59.714025 16512 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:45:59.786679  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53995us
W20260925 16:45:59.758693 16390 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.011s	sys 0.017s
I20260925 16:45:59.765519  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1474) took 1600 ms. Trace:
I20260925 16:45:59.801369  8972 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:45:59.768615 16442 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:59.768560 16055 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:45:59.810595  8866 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 11 to 15, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:59.814215  8866 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 13 to 16. New cstate: current_term: 16 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:45:59.818053 16055 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:45:59.799057 16390 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.012s	sys 0.018s
W20260925 16:45:59.800216  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.001s	sys 0.021s
I20260925 16:45:59.748759 16365 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:45:59.820005 16365 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:45:59.822505 16365 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:45:59.828792  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.002s	sys 0.022s
I20260925 16:45:59.828896  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:45:59.829696  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 696296us
I20260925 16:45:59.832129 16510 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:45:59.833048 15714 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:45:59.833423 15714 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:59.834286 15714 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.835105  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.835525 15714 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:45:59.837653  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.838814  8966 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:45:59.841856 16512 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:59.844200 16512 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:45:59.844985 16512 consensus_queue.cc:1225] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260925 16:45:59.845732 16404 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:45:59.846138 16404 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:45:59.847395 16404 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.721928 16516 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.800974  8974 rpcz_store.cc:276] 0925 16:45:58.164994 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.201820 (+ 36826us) service_pool.cc:227] Handling call
0925 16:45:58.246379 (+ 44559us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.246562 (+   183us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:45:58.903801 (+657239us) log.cc:842] Serialized 14 byte log entry
0925 16:45:59.764990 (+861189us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:45:59.765059 (+    69us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:45:59.765118 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.765304 (+   186us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:45:59.765455 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1285,"prepare.queue_time_us":343160,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":49,"raft.queue_time_us":99,"raft.run_cpu_time_us":142,"raft.run_wall_time_us":21707,"thread_start_us":1473850,"threads_started":2}
I20260925 16:45:59.861464 16230 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.862848 16208 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:45:59.863155  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.850066 16442 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.879887  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.911041  9123 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:59.912247  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:59.915033  9116 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:45:59.919345  9014 leader_election.cc:398] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17.
I20260925 16:45:59.919929  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.920747  9122 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:59.921813  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.923091  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.924862  8974 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
I20260925 16:45:59.926532  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:45:59.927286  8973 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:45:59.926265  8866 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 7 to -1, term changed from 16 to 13, leader changed from <none> to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194), NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) evicted. New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:59.930359  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:45:59.870451  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:45:59.964322  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.965895 16516 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:45:59.966104 15714 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:45:59.966782 15714 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:45:59.967861 16442 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:45:59.965950  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.969409  9120 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [22.18-22.18]
I20260925 16:45:59.970515  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:45:59.971225  9122 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:45:59.912895 15954 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:45:59.974242  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.151s	user 0.000s	sys 0.040s
I20260925 16:45:59.969580  9118 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
W20260925 16:45:59.974610  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.151s	user 0.000s	sys 0.040s
I20260925 16:45:59.976018  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.976953  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:45:59.981622  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:45:59.983842  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.008s	sys 0.029s
I20260925 16:45:59.987206  9118 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
W20260925 16:45:59.988983  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.008s	sys 0.029s
I20260925 16:45:59.971963 16385 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:00.007970  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.009357  9693 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 25: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:00.003763  8940 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:00.004974  9120 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
W20260925 16:45:59.978632 16319 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.651s	user 0.001s	sys 0.020s
I20260925 16:45:59.979938 16208 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:00.011883  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 160206us
I20260925 16:46:00.012497  8940 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:00.017462  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.003s	sys 0.022s
W20260925 16:46:00.017828  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.511s	user 0.003s	sys 0.022s
I20260925 16:46:00.021157  9696 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:00.017939  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:45:59.978269 15954 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.002097 16512 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:00.013873 16319 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.001s	sys 0.021s
I20260925 16:46:00.036350  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.036875 16109 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:00.014191 16383 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:00.036352  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.038587  9696 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 23 because replica has last-logged OpId of term: 22 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260925 16:46:00.042464  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.037199  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.049876  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:00.051540  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.047230  9041 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
W20260925 16:46:00.052217  9042 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.012s	sys 0.015s
W20260925 16:46:00.052518  9042 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.591s	user 0.012s	sys 0.015s
I20260925 16:46:00.019390 16517 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:00.054723  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.060550  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:00.032799 16393 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:00.066510  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.067164  9041 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:00.068365  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:00.031294 16518 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:00.071309  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:00.046689 16308 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.020s	sys 0.007s
I20260925 16:46:00.069744  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3699) took 5555 ms. Trace:
I20260925 16:46:00.074412  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.045750 16383 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:00.059090 16381 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:00.058962 16390 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:00.020040 16208 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.019649 16385 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.104758  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:00.064734 16522 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:00.102525 16390 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:00.126969 16390 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:00.127977 15714 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:00.070976 16393 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:00.131202 16393 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:00.133014  9050 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260925 16:46:00.045526 16512 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.137338 16512 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:00.137667  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65794.6us
I20260925 16:46:00.137907 16381 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:00.138402 16381 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:00.139246 16381 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.139629 15714 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:00.141531 16365 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:46:00.143244 16519 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:00.143846 16404 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:46:00.126089  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 86585.4us
I20260925 16:46:00.127498  9116 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:46:00.085366  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.098351  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.080945  9042 rpcz_store.cc:276] 0925 16:45:54.514826 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:58.662160 (+4147334us) service_pool.cc:227] Handling call
0925 16:45:58.735904 (+ 73744us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:45:58.741909 (+  6005us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:45:58.742194 (+   285us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.058426 (+1316232us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.069376 (+ 10950us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:00.069438 (+    62us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:00.069495 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.069566 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:00.069689 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":5647,"prepare.run_cpu_time_us":97,"prepare.run_wall_time_us":98,"raft.queue_time_us":203281,"raft.run_cpu_time_us":208,"raft.run_wall_time_us":207,"thread_start_us":1276066,"threads_started":2,"wal-append.queue_time_us":1027632}
I20260925 16:46:00.048944 16109 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.067807 16517 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.058832 16132 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.044s
I20260925 16:46:00.021536 16389 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:00.077831 16308 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.021s	sys 0.007s
I20260925 16:46:00.145758  9122 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:00.151870  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:46:00.106611  9090 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.015s	sys 0.022s
W20260925 16:46:00.200516  9090 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.103s	user 0.015s	sys 0.023s
W20260925 16:46:00.200884  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.10405e+06us
W20260925 16:46:00.197760 16051 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.028s	sys 0.048s
W20260925 16:46:00.201706 16051 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.563s	user 0.029s	sys 0.048s
W20260925 16:46:00.202064  9090 connection.cc:232] RPC call timeout handler was delayed by -1.1007946310000989s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18330000000000002s for a response
I20260925 16:46:00.084434 16319 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:00.154151  9695 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:00.083618 16383 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:00.123129 16531 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260925 16:46:00.123854 16526 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260925 16:46:00.161566  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.164330  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.217902  8966 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:00.166056  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.123832 16534 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:00.218931 16109 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:00.125761 15954 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:00.169749  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.220157 16108 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:46:00.220304  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60264.4us
I20260925 16:46:00.220781 16389 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:00.221107  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.221524  9124 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:00.207487 16308 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:00.222029 16108 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:00.222476  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.222811 16308 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.149241 16522 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:00.180097  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.770s	user 0.002s	sys 0.032s
W20260925 16:46:00.192770  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.019s	sys 0.018s
I20260925 16:46:00.163605 16385 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:00.211092  9698 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:00.223863 16522 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:00.218969  8971 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
W20260925 16:46:00.213090  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61323us
I20260925 16:46:00.225415  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.226290 16517 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:00.215747 16532 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260925 16:46:00.223316 16108 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:00.226642  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.226821 16517 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:46:00.223922  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.002s	sys 0.033s
I20260925 16:46:00.199061 15714 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:00.227941 15714 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:00.229192  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.719s	user 0.019s	sys 0.019s
I20260925 16:46:00.229396 16393 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.230000 15714 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:00.230680  8974 raft_consensus.cc:1226] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:00.230712  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.231086  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:00.231863 15954 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:00.231961 16512 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:00.232468 16512 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:00.102106 16293 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:00.232905  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.233191 16293 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.233501  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.234313 15954 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:46:00.235121 16525 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:46:00.235234 16293 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:00.235555  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.236325 15954 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:00.237259  9698 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:00.239203  9694 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:46:00.224123 16534 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:00.214975 16319 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.240271  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.248868  8971 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260925 16:46:00.240973 16534 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.250869 16293 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:00.252044 16108 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:00.252419 16108 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:00.229406  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.253260 16108 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.254551 16108 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:00.254763 16516 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:00.255308  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.256281 16516 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:00.256690  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.256860 16516 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260925 16:46:00.245000 16529 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.143s	user 0.000s	sys 0.003s
I20260925 16:46:00.260562 16208 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:00.272739  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:46:00.195320 15775 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.072s	sys 0.091s
I20260925 16:46:00.231734  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.265508  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.266062  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.232811 16512 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:00.266575  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.214735 16132 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:00.268191  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.239676  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:00.277674  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.018s	sys 0.021s
W20260925 16:46:00.298898  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.873s	user 0.019s	sys 0.021s
I20260925 16:46:00.281062  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:00.299767  9122 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:00.300242 16442 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:00.300619 16442 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:00.300923 16442 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:00.294664  9119 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
W20260925 16:46:00.246443 16527 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.141s	user 0.000s	sys 0.000s
W20260925 16:46:00.303834  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72198.3us
I20260925 16:46:00.304559  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.296407  9694 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:46:00.305467 15714 consensus_queue.cc:1046] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:00.305639  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.307654  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:00.308368  9119 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:00.309058  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.309957  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.310041  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2505) took 1308 ms. Trace:
I20260925 16:46:00.310981  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.310675  9045 rpcz_store.cc:276] 0925 16:45:59.001993 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:59.002223 (+   230us) service_pool.cc:227] Handling call
0925 16:45:59.033349 (+ 31126us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:59.037078 (+  3729us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:59.037121 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:59.037655 (+   534us) log.cc:842] Serialized 26 byte log entry
0925 16:45:59.751839 (+714184us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:00.245645 (+493806us) spinlock_profiling.cc:243] Waited 9.86 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:00.295772 (+ 50127us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.296022 (+   250us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.296098 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:00.309660 (+ 13562us) raft_consensus.cc:1671] finished
0925 16:46:00.309781 (+   121us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:00.309981 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":59166,"prepare.queue_time_us":76248,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"raft.queue_time_us":4121,"raft.run_cpu_time_us":128,"raft.run_wall_time_us":9867,"spinlock_wait_cycles":22675200,"thread_start_us":1180483,"threads_started":2,"wal-append.queue_time_us":986860}
I20260925 16:46:00.077003 16518 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.266806 16393 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:00.315155  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.315392  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.316709  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:00.271209 16384 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.005s	sys 0.021s
I20260925 16:46:00.269874  9696 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:46:00.296306 16517 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:00.322122  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2511) took 1258 ms. Trace:
I20260925 16:46:00.322155  9122 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:00.372334  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.323984  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.325564  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.373764  9694 raft_consensus.cc:2396] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260925 16:46:00.327087  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.246222 16319 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:00.327579  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.328174 16542 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:46:00.328943  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89343.2us
I20260925 16:46:00.373050  9698 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
W20260925 16:46:00.277508 15775 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.756s	user 0.072s	sys 0.092s
I20260925 16:46:00.340291 16383 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.342756  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:00.346787 16390 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.297679 16208 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:46:00.297672 16051 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:00.298489 16132 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:00.416863 16132 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.418561 16132 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:00.316146  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:00.420125  9120 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:00.384425 16442 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.422802  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.298827  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:46:00.366496  9115 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.011s	sys 0.014s
W20260925 16:46:00.423975  9115 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.011s	sys 0.014s
I20260925 16:46:00.424408  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.424614  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.375579  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.425570  9696 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:00.426777  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.383047  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.428066  9122 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:00.428797  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:00.429503  8974 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:00.429554  9122 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260925 16:46:00.385227  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.388187  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:00.434068  9042 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [20.15-22.16]
I20260925 16:46:00.435454  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:00.436065  9702 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:00.436965  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:00.443073  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54996.1us
I20260925 16:46:00.445399  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:00.452293  9696 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:00.459213  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:00.444769  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:00.461380  9698 raft_consensus.cc:2354] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:00.463383 16516 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:46:00.465261 16546 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:00.465759 16546 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:00.466867 16546 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.468806 16546 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:00.473027  9120 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:00.473412  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:00.478817  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:00.393666  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:00.394475  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:00.371411 16384 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.005s	sys 0.022s
W20260925 16:46:00.483994  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.006s	sys 0.036s
I20260925 16:46:00.397810  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.398613  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.371289  9047 rpcz_store.cc:276] 0925 16:45:59.064113 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:59.064248 (+   135us) service_pool.cc:227] Handling call
0925 16:45:59.077324 (+ 13076us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:45:59.077717 (+   393us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:59.077746 (+    29us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:45:59.078309 (+   563us) log.cc:842] Serialized 78 byte log entry
0925 16:45:59.729272 (+650963us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:45:59.796535 (+ 67263us) log.cc:842] Serialized 14 byte log entry
0925 16:45:59.797004 (+   469us) log.cc:842] Serialized 14 byte log entry
0925 16:45:59.800996 (+  3992us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:45:59.801095 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:45:59.854437 (+ 53342us) spinlock_profiling.cc:243] Waited 2 ms on lock 0x7b1800420340. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:00.244322 (+389885us) spinlock_profiling.cc:243] Waited 9.9 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:00.321868 (+ 77546us) raft_consensus.cc:1671] finished
0925 16:46:00.321903 (+    35us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:00.322060 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2913,"prepare.queue_time_us":98504,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":72,"raft.queue_time_us":11828,"raft.run_cpu_time_us":323,"raft.run_wall_time_us":1685,"spinlock_wait_cycles":28779776,"thread_start_us":650592,"threads_started":1,"wal-append.queue_time_us":941137}
W20260925 16:46:00.485534  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.006s	sys 0.036s
I20260925 16:46:00.408447 16319 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:00.424925  9119 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260925 16:46:00.306381 15714 raft_consensus.cc:3032] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Stepping down as leader of term 18
W20260925 16:46:00.460350  8924 thread.cc:636] client-negotiator [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.015s	sys 0.019s
I20260925 16:46:00.399114 16540 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:00.482285  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.397054  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:00.494865  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 432928us
I20260925 16:46:00.406318  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:00.368274 16106 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.008s	sys 0.010s
I20260925 16:46:00.487766  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.394948 16543 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:00.400947 16051 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:00.488586 16358 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:00.444527 16208 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:00.401355 16544 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:00.392596 16370 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.099s
W20260925 16:46:00.495985  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 89746.5us
I20260925 16:46:00.525013  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:00.526242  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.497128  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.442688 16389 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:00.479382 16523 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:00.481213 16518 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:00.497771  9042 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:00.490180  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:00.506978 16051 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:00.521981  9045 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:00.502350  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.504667  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:00.492252  8924 thread.cc:602] client-negotiator [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.016s	sys 0.019s
I20260925 16:46:00.516295  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3612) took 1242 ms. Trace:
W20260925 16:46:00.498136 16106 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.009s	sys 0.010s
I20260925 16:46:00.527364  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:00.515883  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 287043us
I20260925 16:46:00.516912 16542 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
W20260925 16:46:00.532491  9048 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.724s	user 0.015s	sys 0.020s
I20260925 16:46:00.531486  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.534121  9695 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:46:00.501346  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:00.535596  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45526.7us
I20260925 16:46:00.490227 15714 raft_consensus.cc:729] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:00.491380 16522 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.539072  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.499675 16404 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:00.537746  9041 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
W20260925 16:46:00.650940  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 146394us
I20260925 16:46:00.650238  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:00.653892  9048 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.845s	user 0.024s	sys 0.027s
I20260925 16:46:00.589939  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.594439  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.591308  9043 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:00.658538  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.684175  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:00.660441  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2509) took 1600 ms. Trace:
I20260925 16:46:00.655884  9698 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:00.687206  9048 rpcz_store.cc:276] 0925 16:45:59.060490 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:59.060658 (+   168us) service_pool.cc:227] Handling call
0925 16:45:59.061056 (+   398us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:59.065074 (+  4018us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:59.065104 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:59.076717 (+ 11613us) log.cc:842] Serialized 26 byte log entry
0925 16:45:59.797187 (+720470us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:00.654298 (+857111us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.660072 (+  5774us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.660176 (+   104us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:00.660240 (+    64us) raft_consensus.cc:1671] finished
0925 16:46:00.660257 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:00.660379 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":4379,"prepare.queue_time_us":30685,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":33,"raft.queue_time_us":829,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":1118,"thread_start_us":1555935,"threads_started":2,"wal-append.queue_time_us":979157}
I20260925 16:46:00.532022 16533 raft_consensus.cc:2741] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260925 16:46:00.589359 16451 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:46:00.705318  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 260650us
I20260925 16:46:00.534929 16230 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:00.507253 16543 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:00.713526  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.008s	sys 0.032s
I20260925 16:46:00.659583 16055 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:00.654812 16537 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:00.730014  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 190972us
W20260925 16:46:00.731158  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 200212us
I20260925 16:46:00.763612  9665 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.508615 16540 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:00.660683 16535 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
I20260925 16:46:00.739398  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.740190  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:00.537361 16389 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.691726 16534 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:46:00.751392  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:00.752668  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68606.5us
I20260925 16:46:00.705567 16293 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260925 16:46:00.538919  8941 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.996s (SENT) [suppressed 4 similar messages]
W20260925 16:46:00.720209  9699 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.026s	sys 0.028s
W20260925 16:46:00.782891  9699 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.026s	sys 0.028s
I20260925 16:46:00.766426  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.770273  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.741494 16390 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:00.774646  8974 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:00.536705 16442 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:00.529279 16544 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.784977  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:00.790436  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 251472us
I20260925 16:46:00.786154  9016 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.540953 16538 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:00.681490 15714 consensus_queue.cc:260] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.752211 16230 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:00.753427 16383 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:00.799115  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.763806 16381 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:00.534849 16523 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:00.764869 16055 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:00.767354 16393 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:00.804397  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53105.7us
I20260925 16:46:00.801620  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:00.711480 16208 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:00.769240 16370 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:00.817653  9118 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:00.768435 16542 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:00.781769 16533 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:00.789450 16293 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:00.801235 16108 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.546s	user 0.011s	sys 0.001s
I20260925 16:46:00.798774 15775 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:00.788493 16451 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:00.808873 16230 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:00.799497 16573 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:00.805454 16381 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:00.771498 16537 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.817356 16106 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:00.818243 16055 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:00.845115  9700 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:00.833029 16308 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:00.809571 16523 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:00.835096 16533 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:00.801988 16319 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.042s
W20260925 16:46:00.832443 16548 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.330s	user 0.001s	sys 0.001s
I20260925 16:46:00.835261 16293 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:00.856197  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64631us
I20260925 16:46:00.850289  9698 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 7 to 10, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:00.889884  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.891678  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.846367 16381 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:00.892963  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:00.854254 16451 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:00.808553 16541 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260925 16:46:00.899286  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 110409us
I20260925 16:46:00.850718 16106 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:00.836421 16370 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.900833  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:00.916414  9043 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:00.890018 16533 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:00.924640  9702 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:46:00.927572  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.950114 16442 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:00.896041 16522 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:00.951812  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:00.932772  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:00.939086  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 105612us
I20260925 16:46:00.913270 16106 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:00.955235  9701 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
W20260925 16:46:00.946235  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53339.9us
I20260925 16:46:00.969158  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:00.850386 16575 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.079s
I20260925 16:46:00.850464 16572 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.084s
I20260925 16:46:00.950398  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.970013  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:00.937391 16109 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:00.983157  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:00.869189 16571 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.080s
W20260925 16:46:00.989799 16549 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260925 16:46:00.992583  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:00.994150  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.946451 16404 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:00.977221  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.978816  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:00.991858  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3624) took 1139 ms. Trace:
I20260925 16:46:00.997932  9047 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:00.898524 16308 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:00.974732 16544 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:00.984784  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:00.988034  9041 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:00.989032  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:00.989284 16561 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.187s	user 0.001s	sys 0.000s
W20260925 16:46:00.997351  9697 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.515s	user 0.009s	sys 0.000s
I20260925 16:46:00.999085  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.000268 16510 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:00.997943  9117 rpcz_store.cc:276] 0925 16:45:59.852228 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:59.852412 (+   184us) service_pool.cc:227] Handling call
0925 16:45:59.853145 (+   733us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:45:59.853637 (+   492us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:59.853676 (+    39us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:45:59.854360 (+   684us) log.cc:842] Serialized 52 byte log entry
0925 16:46:00.487753 (+633393us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:00.487800 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.487867 (+    67us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:00.991623 (+503756us) raft_consensus.cc:1671] finished
0925 16:46:00.991641 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:00.991806 (+   165us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1444,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":95,"thread_start_us":632117,"threads_started":1,"wal-append.queue_time_us":854760}
I20260925 16:46:01.000427 16543 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.149115  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:01.149914  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:00.954177 16538 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:01.153365  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:01.153940  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.154426  9043 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
W20260925 16:46:01.155647  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 156671us
I20260925 16:46:01.002830  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:01.157583  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.172904  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.173573  9118 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:01.171476  9701 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:01.175310  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.155195  9697 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:01.148887 16389 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:01.152495 16451 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:01.175580  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.013166 16109 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:00.993426 16108 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 24.17, Next index: 18, Last known committed idx: 15, Time since last communication: 0.165s
I20260925 16:46:01.011891  8970 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:01.178606  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.194386  9124 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260925 16:46:01.150125 16540 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.184617 16572 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:01.180244 16522 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:01.182467 16543 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:46:01.192574 16555 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
W20260925 16:46:01.233198  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 264179us
I20260925 16:46:00.948717 16542 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.214900 16572 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:01.366979  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.192428 16573 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.169s
W20260925 16:46:01.376289 16568 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.423s	user 0.000s	sys 0.000s
W20260925 16:46:01.376989 16576 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.220s	user 0.000s	sys 0.000s
W20260925 16:46:01.377332 16563 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.433s	user 0.001s	sys 0.000s
W20260925 16:46:01.377835 16051 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.724s	user 0.009s	sys 0.001s
W20260925 16:46:01.361860  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 4d5ba69a70184d858b847e046b24564c, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.368117 16390 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:01.315200 16522 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.346186 16572 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:01.385612 16370 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.414999  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:01.360554 16565 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:01.325371  9047 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:01.331276 16319 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:01.401499  9119 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
W20260925 16:46:01.398975  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 4d5ba69a70184d858b847e046b24564c, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.398414 16575 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:01.379073 16537 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.431313  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:01.394097 16358 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.878s	user 0.009s	sys 0.002s
I20260925 16:46:01.298215 16540 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:01.420954  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:01.433776  9702 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:01.405566  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.395196 16570 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:46:01.430703  9698 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.540s	user 0.010s	sys 0.001s
W20260925 16:46:01.447793  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.010s	sys 0.010s
W20260925 16:46:01.449095  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.623s	user 0.003s	sys 0.011s
W20260925 16:46:01.449249  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.011s	sys 0.010s
W20260925 16:46:01.450505  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 630313us
W20260925 16:46:01.449955  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.624s	user 0.003s	sys 0.011s
W20260925 16:46:01.432128 16546 consensus_meta.cc:287] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.963s	user 0.008s	sys 0.005s
I20260925 16:46:01.419835 16319 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:01.430949 15775 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.567s	user 0.008s	sys 0.016s
I20260925 16:46:01.373302 16451 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.453593  9124 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:01.429839 16404 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:01.398990 16051 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.437911 16358 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:46:01.452944  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.617s	user 0.016s	sys 0.011s
I20260925 16:46:01.385419 16109 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.413653 16390 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:01.466046  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 639701us
W20260925 16:46:01.456466 15775 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.603s	user 0.009s	sys 0.017s
I20260925 16:46:01.482038  9041 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:01.369319 16538 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.472023  9702 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:01.457377 16308 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.475796  9043 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260925 16:46:01.456470  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2184) took 1413 ms. Trace:
W20260925 16:46:01.478539  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.649s	user 0.016s	sys 0.011s
I20260925 16:46:01.476366  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:01.475438  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:01.492074  9043 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260925 16:46:01.492344  9122 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:01.454766 16540 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.030s
I20260925 16:46:01.492081  9042 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:01.473770 16051 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.421953 16565 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:01.465607 16132 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.047s	user 0.012s	sys 0.002s
I20260925 16:46:01.466559  9048 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260925 16:46:01.429204 16383 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260925 16:46:01.458570 16574 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:46:01.487751  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 105829us
I20260925 16:46:01.489668  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:01.491003  9693 rpcz_store.cc:276] 0925 16:46:00.042650 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.236655 (+194005us) service_pool.cc:227] Handling call
0925 16:46:00.237112 (+   457us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:00.237425 (+   313us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.237450 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:00.238331 (+   881us) log.cc:842] Serialized 501 byte log entry
0925 16:46:00.655475 (+417144us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:00.655517 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.655581 (+    64us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:01.376715 (+721134us) spinlock_profiling.cc:243] Waited 6.22 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:01.450656 (+ 73941us) raft_consensus.cc:1671] finished
0925 16:46:01.450687 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.456410 (+  5723us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":14312320,"thread_start_us":416826,"threads_started":1,"wal-append.queue_time_us":563378}
I20260925 16:46:01.454356  9047 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Committing config change with OpId 17.10: config changed from index 7 to 10, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:01.466131 16570 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:01.503990  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:01.504947  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 703343us
I20260925 16:46:01.456905 16319 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:01.509819 16390 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.484790 15775 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:01.540175  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1881) took 1204 ms. Trace:
I20260925 16:46:01.523947  9122 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
W20260925 16:46:01.524557  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 342491us
I20260925 16:46:01.540582  9698 rpcz_store.cc:276] 0925 16:46:00.335384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.704821 (+369437us) service_pool.cc:227] Handling call
0925 16:46:00.737100 (+ 32279us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:00.843147 (+106047us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:46:01.447149 (+604002us) log.cc:842] Serialized 14 byte log entry
0925 16:46:01.527194 (+ 80045us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:01.527241 (+    47us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:01.539956 (+ 12715us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:01.540019 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.540127 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10389,"raft.queue_time_us":40052,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5585,"thread_start_us":138341,"threads_started":2}
W20260925 16:46:01.522828 16106 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.523s	user 0.009s	sys 0.001s
I20260925 16:46:01.535845  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:01.537533  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.537533  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:01.544497  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:01.532295  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.474195 16404 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.547679  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1429) took 1043 ms. Trace:
W20260925 16:46:01.536414 16381 consensus_meta.cc:287] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.632s	user 0.010s	sys 0.000s
I20260925 16:46:01.554631  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:01.529019 16132 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:01.560411  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:01.552157  9050 rpcz_store.cc:276] 0925 16:46:00.504177 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.504338 (+   161us) service_pool.cc:227] Handling call
0925 16:46:00.504798 (+   460us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:00.505098 (+   300us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.505134 (+    36us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:00.515280 (+ 10146us) log.cc:842] Serialized 26 byte log entry
0925 16:46:00.769575 (+254295us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:00.799047 (+ 29472us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.802059 (+  3012us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.802130 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:01.547438 (+745308us) raft_consensus.cc:1671] finished
0925 16:46:01.547463 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.547599 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2805,"prepare.queue_time_us":87379,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":18191,"raft.queue_time_us":28649,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":13914,"thread_start_us":110069,"threads_started":1,"wal-append.queue_time_us":410103}
I20260925 16:46:01.561688  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:01.552047 15954 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.012s	sys 0.016s
I20260925 16:46:01.563597  9698 raft_consensus.cc:2362] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18. Re-sending same reply.
W20260925 16:46:01.575383  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 396864us
I20260925 16:46:01.576566  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.578342  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.580049  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:01.566787 15954 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.652s	user 0.013s	sys 0.016s
I20260925 16:46:01.610757  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.561370 16381 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.615381  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1884) took 1258 ms. Trace:
I20260925 16:46:01.624176  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.579046 16540 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:46:01.580695 16516 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:01.642340  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 104859us
I20260925 16:46:01.580861 16308 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:01.624532  9694 rpcz_store.cc:276] 0925 16:46:00.356765 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.698037 (+341272us) service_pool.cc:227] Handling call
0925 16:46:00.968367 (+270330us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:00.968735 (+   368us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.968774 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:00.968836 (+    62us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:00.968879 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.968955 (+    76us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.615193 (+646238us) spinlock_profiling.cc:243] Waited 230 ms on lock 0x7b540066dd50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:01.615320 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16506,"raft.queue_time_us":177934,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":28149,"spinlock_wait_cycles":529048832}
I20260925 16:46:01.669281  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:01.559140 16106 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.622570 16383 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:01.621032 16522 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.547500 16570 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.574261 16132 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.683110  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.695868  9119 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:01.677117 16540 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:01.647078 16541 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:01.686054  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 178406us
W20260925 16:46:01.687889  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 126281us
I20260925 16:46:01.689116  9050 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 24 index: 17. (index mismatch)
I20260925 16:46:01.641290 16517 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260925 16:46:01.686498  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 158954us
W20260925 16:46:01.690303  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 158125us
W20260925 16:46:01.691605 16559 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.456s	user 0.000s	sys 0.001s
I20260925 16:46:01.677963 16108 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:01.704875 15954 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:01.691999 16564 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.480s	user 0.001s	sys 0.000s
I20260925 16:46:01.705374 16601 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:01.691937 16594 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:01.692509 16577 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260925 16:46:01.707326  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.726526  9050 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:01.716581 16592 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:46:01.720974  8941 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:01.693296 16539 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:01.692102 16590 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:01.705915 16607 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:01.727125  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 50071.9us
W20260925 16:46:01.713310 16597 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260925 16:46:01.733362  9120 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:01.629874 15775 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.709539 16602 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:01.706612 16383 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:01.706000 16580 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:01.747464  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:01.750720  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:01.753005  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 189554us
W20260925 16:46:01.742014 16293 consensus_meta.cc:287] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.854s	user 0.010s	sys 0.002s
I20260925 16:46:01.723471 16108 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.582345 16051 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Committing config change with OpId 18.14: config changed from index 4 to 14, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:01.722726 16603 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:01.773974  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.734375 16539 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:01.752357 16365 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:01.782522  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:01.787931  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43910.3us
I20260925 16:46:01.791674  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:01.789113  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.749573 16592 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:01.783490 16512 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.460s	user 0.013s	sys 0.002s
I20260925 16:46:01.790176  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:01.793834  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3630) took 1110 ms. Trace:
I20260925 16:46:01.776623 16522 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:46:01.794869  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 76956.7us
I20260925 16:46:01.799288  9116 rpcz_store.cc:276] 0925 16:46:00.683211 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.782764 (+1099553us) service_pool.cc:227] Handling call
0925 16:46:01.793218 (+ 10454us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:01.793447 (+   229us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:01.793486 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:01.793541 (+    55us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:01.793583 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:01.793647 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.793771 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:01.800664 16585 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:01.801086 16599 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:01.801610  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3731) took 1777 ms. Trace:
I20260925 16:46:01.801568 16604 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.111s
I20260925 16:46:01.744642 15954 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
W20260925 16:46:01.795589 16055 consensus_meta.cc:287] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.932s	user 0.006s	sys 0.006s
I20260925 16:46:01.810431  9046 rpcz_store.cc:276] 0925 16:46:00.024183 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.024310 (+   127us) service_pool.cc:227] Handling call
0925 16:46:00.036678 (+ 12368us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:00.056755 (+ 20077us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.056798 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:00.057298 (+   500us) log.cc:842] Serialized 26 byte log entry
0925 16:46:00.497203 (+439905us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:00.530923 (+ 33720us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.538299 (+  7376us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.538369 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:01.801406 (+1263037us) raft_consensus.cc:1671] finished
0925 16:46:01.801428 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.801551 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14239,"prepare.queue_time_us":96799,"raft.queue_time_us":118082,"raft.run_cpu_time_us":266,"raft.run_wall_time_us":61233,"spinlock_wait_cycles":8638848,"thread_start_us":352713,"threads_started":1,"wal-append.queue_time_us":697919}
I20260925 16:46:01.810657  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.820685  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.820747  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:01.821542  8969 raft_consensus.cc:2379] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:01.821970  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.822783  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:01.787339 16565 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:01.823326  9122 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:01.823377  8969 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:01.830597  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:01.783366 16293 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.742564 16601 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.808094 16516 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:01.847540  8970 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:46:01.810817 16404 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.741588 16594 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.811285 16381 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.850072 16365 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:01.859795 16594 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:01.749581 16590 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.751315 16607 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.759989 16580 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.865425  9122 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:46:01.868403  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1428) took 1368 ms. Trace:
I20260925 16:46:01.866410 16132 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:01.866796 16610 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:01.867434  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:01.786434 16540 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.753804 16602 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.803398 16512 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.844609 16539 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:01.880885 16611 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.261s	user 0.001s	sys 0.001s
I20260925 16:46:01.880637 16592 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.881007 16108 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:01.894361  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 102752us
I20260925 16:46:01.882782 16615 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:01.872534  9045 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:01.885881  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:01.868963  9044 rpcz_store.cc:276] 0925 16:46:00.499972 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.500329 (+   357us) service_pool.cc:227] Handling call
0925 16:46:00.525754 (+ 25425us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:00.540294 (+ 14540us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.540328 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:00.652180 (+111852us) log.cc:842] Serialized 26 byte log entry
0925 16:46:00.849266 (+197086us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:01.150608 (+301342us) log.cc:842] Serialized 14 byte log entry
0925 16:46:01.150895 (+   287us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:01.150956 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:01.868162 (+717206us) raft_consensus.cc:1671] finished
0925 16:46:01.868187 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.868334 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":26303,"prepare.queue_time_us":68666,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":67777,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":9073,"spinlock_wait_cycles":130379520,"thread_start_us":357302,"threads_started":2,"wal-append.queue_time_us":479512}
I20260925 16:46:01.856258 16510 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:01.899042 16510 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:01.899348  8969 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:01.899457 16510 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:01.901896 16587 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.470s	user 0.002s	sys 0.000s
I20260925 16:46:01.854952 16106 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.902945 16106 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:01.903288 16106 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:01.887616 16381 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:01.903610  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:01.863906 16516 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.904323 16106 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.904822  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.905498 16106 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:01.890197  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.906603  8968 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:01.907361  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.907743  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.903183  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3256) took 1046 ms. Trace:
I20260925 16:46:01.828650 16055 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.787065 16603 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.870919 16584 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:01.893299 16230 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.038s	user 0.008s	sys 0.005s
I20260925 16:46:01.897487  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:01.897571  9090 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:01.910065  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:01.914052  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:01.881080 16601 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:01.914870  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:01.875108 16404 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
I20260925 16:46:01.860350 16365 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.975138  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:01.975234  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:01.951745  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:01.909313  8971 rpcz_store.cc:276] 0925 16:46:00.856496 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.856656 (+   160us) service_pool.cc:227] Handling call
0925 16:46:00.891496 (+ 34840us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:00.891833 (+   337us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.891863 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:00.901330 (+  9467us) log.cc:842] Serialized 26 byte log entry
0925 16:46:01.148499 (+247169us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:01.148543 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:01.148620 (+    77us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:01.901366 (+752746us) spinlock_profiling.cc:243] Waited 19.4 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:01.902896 (+  1530us) raft_consensus.cc:1671] finished
0925 16:46:01.902915 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:01.903130 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2808,"raft.queue_time_us":2130,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":4679,"spinlock_wait_cycles":44592896,"thread_start_us":55151,"threads_started":1,"wal-append.queue_time_us":440501}
W20260925 16:46:01.915012 16523 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.016s	user 0.007s	sys 0.005s
I20260925 16:46:01.856393 16383 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:01.895794 15954 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260925 16:46:01.921629 16533 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.983s	user 0.011s	sys 0.001s
I20260925 16:46:01.973834  8972 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:01.976193  9702 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:01.993404  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:01.895587 16570 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.914252 16539 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:01.979473  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 146991us
I20260925 16:46:01.968811 16541 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:01.971179 16623 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.080s
I20260925 16:46:01.917879 16108 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:01.913865 16585 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:01.922345 16572 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.922240 16230 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:01.973335 16516 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:01.961614 16615 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:01.987546  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 198481us
W20260925 16:46:01.990943  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 93476.2us
I20260925 16:46:01.921003 16571 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.073s
W20260925 16:46:01.972898  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 127830us
I20260925 16:46:01.925573 16584 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.082226  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1872) took 1749 ms. Trace:
W20260925 16:46:02.049057  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55972.8us
I20260925 16:46:01.974434 16308 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:01.978962 16404 consensus_queue.cc:1225] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:46:02.098485  9696 rpcz_store.cc:276] 0925 16:46:00.332537 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.539541 (+207004us) service_pool.cc:227] Handling call
0925 16:46:00.652969 (+113428us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:00.676074 (+ 23105us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.676121 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:00.676180 (+    59us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:00.676240 (+    60us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:02.082023 (+1405783us) spinlock_profiling.cc:243] Waited 22.8 ms on lock 0x7b54004a0e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:02.082066 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:02.082177 (+   111us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":52480768}
I20260925 16:46:02.098467  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.100638  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.105072  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:02.099551  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.109416  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:02.110818  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:02.017925 16629 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.134s	user 0.001s	sys 0.000s
W20260925 16:46:02.000128 16621 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.204s	user 0.000s	sys 0.001s
I20260925 16:46:02.113619 16584 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.114140 16614 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:02.077802 16602 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.116011  8971 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:46:02.117125  9695 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:02.078784 16603 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.073037 16590 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.079684 16580 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.118614  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:02.118775 16574 consensus_meta.cc:287] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.601s	user 0.009s	sys 0.001s
I20260925 16:46:02.186115  9702 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:02.010146 16539 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:02.014348 16319 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.097865 16108 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:02.071794 16620 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:02.062196 16633 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:01.994035 15954 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:02.015100 16293 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.070314 16605 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:02.120388  9090 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:02.016264 16543 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:02.016418 16370 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:02.114538 16638 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:02.194243 16574 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:02.131083  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:02.105170 16516 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:02.184333  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:02.067761 16612 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.128s
I20260925 16:46:02.190979  9694 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
W20260925 16:46:02.192591  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 412521us
I20260925 16:46:01.988128 16523 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.260008 16607 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.260725 16523 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:02.187772  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53610.2us
I20260925 16:46:02.263057  8974 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:02.016767 16512 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:02.270424  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.271623  9050 pending_rounds.cc:76] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 12
I20260925 16:46:02.271546  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:02.272007  9050 pending_rounds.cc:97] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260925 16:46:02.272235  9044 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:00.539505  9121 rpcz_store.cc:276] 0925 16:45:59.274267 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:59.276887 (+  2620us) service_pool.cc:227] Handling call
0925 16:45:59.277307 (+   420us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:45:59.277714 (+   407us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:45:59.277751 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:45:59.278227 (+   476us) log.cc:842] Serialized 26 byte log entry
0925 16:45:59.989485 (+711258us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:00.514881 (+525396us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.515859 (+   978us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:00.516030 (+   171us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:00.516075 (+    45us) raft_consensus.cc:1671] finished
0925 16:46:00.516089 (+    14us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:00.516237 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":78313,"raft.run_cpu_time_us":225,"raft.run_wall_time_us":60112,"thread_start_us":1207719,"threads_started":2,"wal-append.queue_time_us":1071053}
I20260925 16:46:02.275545  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:02.276037  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.276245 16370 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:46:02.276723  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:02.197208  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:02.278239  9702 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:02.132576 16636 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.212513  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.185128 16602 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:46:02.219867  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 99554.3us
I20260925 16:46:02.119417 16308 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.218395  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:02.110566 16618 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.079s
I20260925 16:46:01.998979 16533 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.227332  9048 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
W20260925 16:46:02.225068  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 231733us
I20260925 16:46:02.232270  9116 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
W20260925 16:46:02.233217 16624 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.192s	user 0.001s	sys 0.000s
W20260925 16:46:02.292984  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 80589.8us
I20260925 16:46:02.293298  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:02.218883 15954 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:02.295332  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77038us
W20260925 16:46:02.244489 16628 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260925 16:46:02.101346 16541 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.207876 16108 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:02.194968  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:02.272305  9050 raft_consensus.cc:2866] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:02.233623 16589 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:02.278038  9121 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260925 16:46:02.300002  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.300671  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:02.292088 16575 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:02.305310  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 9a92341cf5104c9eba99c812ba97c735, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:02.321720  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 9a92341cf5104c9eba99c812ba97c735, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.322304  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.223687 16543 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:02.227463 16638 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:02.335064 16638 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:02.335927  9043 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:02.336908 16541 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.337514 16541 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.337942 16541 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.338955  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:02.340480 16633 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:02.341214 16633 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:02.341635 16633 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:02.342183 16319 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.342816 16319 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:02.343549 16590 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:02.344156  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43588us
I20260925 16:46:02.318641  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:02.320432  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125561us
I20260925 16:46:02.325062  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.345115  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.327459  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.340569 16541 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.328708  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:02.321802 16603 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.330111  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:02.330350 16634 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:02.330572  9693 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:02.331816  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.360432  9041 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:02.331836  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:02.361501  9047 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:02.333700 16575 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.334631 16543 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:02.327658  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.328130 16308 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.304312 16642 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:02.352880  9044 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:02.356798  9121 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:02.368969  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:02.223364 16539 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.285233 16055 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.307924 16404 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:02.362507  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:02.367352  8966 pending_rounds.cc:76] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 13
I20260925 16:46:02.387995  8966 pending_rounds.cc:97] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260925 16:46:02.388502  8966 raft_consensus.cc:2866] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:02.388808  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:02.389889  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:02.390628  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45669.8us
I20260925 16:46:02.394462  8975 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:02.398372  9044 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:46:02.220805 16620 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.344118 16590 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.401104  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.401425  8941 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:02.411926  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:02.400321  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52512.1us
I20260925 16:46:02.414788  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:02.418887  8971 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:02.416296  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.420085  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:02.286553 16516 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.359826 16607 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:02.369518 16574 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.360745 16570 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:02.279393 16370 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.113s
I20260925 16:46:02.456648  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.366154 16589 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:02.391863 16404 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:02.467479  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 66125us
I20260925 16:46:02.470376  8968 raft_consensus.cc:2396] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 20 because replica has last-logged OpId of term: 18 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260925 16:46:02.399856 16579 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:02.478474  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56579.5us
I20260925 16:46:02.418429 16544 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:02.482708  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.481467  9047 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:02.368426 16584 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.090s
W20260925 16:46:02.485558  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 384956us
I20260925 16:46:02.301666 16636 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.366864 16603 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.488685  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:02.497598  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:02.461063 16230 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.477676 16404 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:02.399560 16542 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.078s
I20260925 16:46:02.250300 16615 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.499740  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.415800 16389 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260925 16:46:02.478708 16639 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.477810 16109 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:02.529032  9697 raft_consensus.cc:2362] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18. Re-sending same reply.
I20260925 16:46:02.400763  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:57624
W20260925 16:46:02.534233  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45646.3us
I20260925 16:46:02.534884  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.543867  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.546339  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:02.506037 16618 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:46:02.501063 16572 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.551265  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:02.505753 16602 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.500610 16055 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:02.555967  9041 raft_consensus.cc:595] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:02.574483  9041 raft_consensus.cc:603] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:02.561084  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:02.469580 16574 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.376044 16634 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.543275 16640 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:02.540556 16542 consensus_queue.cc:1225] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:46:02.549101 16370 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:02.544603 16230 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:02.525059 16649 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:02.575560 16598 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260925 16:46:02.643491  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:02.667903  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.609373 16055 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.613950 16570 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:46:02.613437 16604 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:02.621923 16617 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:02.550475 16109 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.659929 16596 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:02.662750 16590 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.663820 16601 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:46:02.574651 16643 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:02.664790 16603 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:02.579233 16602 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:02.666546  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 167256us
I20260925 16:46:02.660460 16645 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.656539 16648 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:02.544207 16390 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.078s
I20260925 16:46:02.499557 16579 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.622182 16230 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:02.619961 16572 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:02.672575 16598 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:02.732826 16653 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260925 16:46:02.580191 16589 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:02.734593 16566 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.328s	user 0.000s	sys 0.006s
I20260925 16:46:02.554509 16639 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.736353 16602 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.706113 16570 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:02.739013 16644 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260925 16:46:02.697913 16596 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:02.739188  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.777563  9046 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:02.740620 16055 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.740863  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.742668  9044 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:02.665874 16533 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:02.747385  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 178342us
I20260925 16:46:02.711011 16539 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.751096  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.791677  8969 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:02.791949  8940 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:02.731608 16601 consensus_queue.cc:1225] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 20.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260925 16:46:02.753911  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:02.732713  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.795311  8975 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:02.771919  8971 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
W20260925 16:46:02.775988  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 224384us
I20260925 16:46:02.778707  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:02.754460 16230 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:02.757617 16598 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:02.801853 16557 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:02.781487 16596 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:02.820744 16358 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:02.821554 16358 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:02.822062 16358 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:02.779598 16516 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.824100 16570 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.826682  8973 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
W20260925 16:46:02.827204 16051 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.980s	user 0.012s	sys 0.000s
I20260925 16:46:02.670948 16534 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:02.797456  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.798748  9090 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:02.799073  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:02.833207  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:02.759049 16540 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:02.624964 16649 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:02.854214 16648 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:02.830299  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:02.839085  8975 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:02.845050 16370 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:02.807070  9046 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:02.843127 16639 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.846801 16109 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:02.853225 16651 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.377s	user 0.001s	sys 0.000s
I20260925 16:46:02.849274 16579 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.840809 16543 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.802289 16575 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.854792 16675 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:02.850847  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2524) took 1367 ms. Trace:
I20260925 16:46:02.767458 16620 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.845556 16636 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:02.844159 16572 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:02.836122 16534 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.963589  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:02.856936 16677 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:46:02.964876  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:02.965071 16534 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:02.965538  9046 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:02.853257 16602 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:02.889685 16604 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:02.890106 16666 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260925 16:46:02.890736 16617 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:02.891186 16634 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.746397 16645 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.892650  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1865) took 1408 ms. Trace:
I20260925 16:46:02.880921  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:02.899878  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 137706us
I20260925 16:46:02.842267 16516 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:02.896045  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3939) took 1742 ms. Trace:
I20260925 16:46:02.939036  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.979960  9119 rpcz_store.cc:276] 0925 16:46:01.484582 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.484739 (+   157us) service_pool.cc:227] Handling call
0925 16:46:01.485033 (+   294us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:01.705761 (+220728us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:02.892382 (+1186621us) spinlock_profiling.cc:243] Waited 211 ms on lock 0x7b54003bfbd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:02.892591 (+   209us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":484294400}
W20260925 16:46:02.882550 16510 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.982s	user 0.010s	sys 0.000s
I20260925 16:46:02.943774  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:02.984480  9122 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:02.877043 15954 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.507s	user 0.007s	sys 0.000s
W20260925 16:46:02.879956 16106 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.974s	user 0.005s	sys 0.009s
I20260925 16:46:02.963624  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:02.929386 16574 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:02.842465 16108 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.974393  9042 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:02.941124 16055 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:02.967645 16638 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.626s	user 0.008s	sys 0.002s
I20260925 16:46:02.973709 16675 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:02.978580 16617 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:02.959102 16614 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:03.011520  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.980455  9123 rpcz_store.cc:276] 0925 16:46:01.153308 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.153436 (+   128us) service_pool.cc:227] Handling call
0925 16:46:01.164083 (+ 10647us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:01.164421 (+   338us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:01.164450 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:01.164985 (+   535us) log.cc:842] Serialized 26 byte log entry
0925 16:46:01.190104 (+ 25119us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:01.197910 (+  7806us) log.cc:842] Serialized 14 byte log entry
0925 16:46:01.198092 (+   182us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:01.198155 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:02.067291 (+869136us) spinlock_profiling.cc:243] Waited 3.78 ms on lock 0x7b18002db020. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:02.881418 (+814127us) spinlock_profiling.cc:243] Waited 19.2 ms on lock 0x7b18002db020. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:02.895790 (+ 14372us) raft_consensus.cc:1671] finished
0925 16:46:02.895821 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:02.895974 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":12358,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":458704,"raft.run_cpu_time_us":222,"raft.run_wall_time_us":9460,"spinlock_wait_cycles":52803072,"thread_start_us":24791,"threads_started":1,"wal-append.queue_time_us":171334}
I20260925 16:46:02.970733  9048 rpcz_store.cc:276] 0925 16:46:01.482995 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.520590 (+ 37595us) service_pool.cc:227] Handling call
0925 16:46:01.520855 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.289910 (+769055us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:02.850622 (+560712us) spinlock_profiling.cc:243] Waited 703 ms on lock 0x7b54000bf9d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:02.850793 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1616786816}
I20260925 16:46:02.975600 16604 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:02.937619 16540 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:02.997131  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.985558  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.021421  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.003253  9046 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
W20260925 16:46:02.986683  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 91977.9us
I20260925 16:46:02.966252 16639 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260925 16:46:03.014294  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.025401  9048 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:03.026208  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:03.026404  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.026891  8975 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:02.991958 16516 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:03.024773  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3270) took 1163 ms. Trace:
I20260925 16:46:03.018846  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.029601  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:02.951128 16596 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.035107 16596 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.035934 16634 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Stepping down as leader of term 25
W20260925 16:46:03.036160 16679 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260925 16:46:03.036429 16634 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:03.037493 16634 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.039124  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.039886  9123 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
W20260925 16:46:03.040902 16607 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.564s	user 0.008s	sys 0.000s
I20260925 16:46:03.041261 16607 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:03.041282  9123 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260925 16:46:03.005916 16055 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:03.046548 16404 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.500s	user 0.007s	sys 0.002s
I20260925 16:46:03.047349  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2196) took 1284 ms. Trace:
I20260925 16:46:03.011292 16614 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:02.996565 15954 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.047716  9694 rpcz_store.cc:276] 0925 16:46:01.762514 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.782233 (+ 19719us) service_pool.cc:227] Handling call
0925 16:46:01.796275 (+ 14042us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.260602 (+464327us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.046677 (+786075us) spinlock_profiling.cc:243] Waited 24.1 ms on lock 0x7b54005107a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2db42 00007f719bf29f26 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:03.047138 (+   461us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.047302 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":962453248}
I20260925 16:46:03.048396 16614 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.049113  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.049384 15954 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.047010 16404 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.030218  9119 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:03.064075  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.050030  9124 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:03.005503 15775 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.005585 16573 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:03.017796 16633 consensus_meta.cc:287] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.676s	user 0.011s	sys 0.000s
I20260925 16:46:03.033293 16540 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.051556  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:02.979120 16602 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.053515  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:02.989245 16510 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.068120  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.072324  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.073107 15775 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.068651 16661 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.075269  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.076216  9122 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:03.078647  9119 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:03.081255  9046 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:46:03.028667  8970 rpcz_store.cc:276] 0925 16:46:01.861494 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.861631 (+   137us) service_pool.cc:227] Handling call
0925 16:46:01.876742 (+ 15111us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:01.887680 (+ 10938us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:01.887730 (+    50us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:01.909988 (+ 22258us) log.cc:842] Serialized 501 byte log entry
0925 16:46:02.192081 (+282093us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:02.192116 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:02.192202 (+    86us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:02.852580 (+660378us) spinlock_profiling.cc:243] Waited 2.32 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:03.020517 (+167937us) raft_consensus.cc:1671] finished
0925 16:46:03.020542 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.024705 (+  4163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5335424,"thread_start_us":200680,"threads_started":1,"wal-append.queue_time_us":399290}
I20260925 16:46:03.095654  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.094055  9119 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:03.083499  9696 raft_consensus.cc:2354] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19.
I20260925 16:46:03.093295  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.074749 15714 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:03.092835  9047 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
W20260925 16:46:03.097440  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 155783us
I20260925 16:46:03.093003  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.102644  9702 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:03.098891  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.086790  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.006727 16638 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.079833  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.093288  9048 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 20
I20260925 16:46:03.098716  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:03.099455  9047 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:03.100282  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.080953 16649 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.105209  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.101063  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.104022  9122 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:03.110010  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:03.103029 16689 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260925 16:46:03.112246 16689 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:03.112658 16689 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:03.113659 16689 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.115048 16689 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:03.115445  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:03.115768 16051 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:55034 (request call id 1263) took 8245 ms. Trace:
I20260925 16:46:03.116030  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.116988 16230 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.117560  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.118494  8970 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:03.118791  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:03.119055 16230 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.102909 15954 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260925 16:46:03.120234 16688 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260925 16:46:03.121860  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:03.123073  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.123755 16516 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.124325  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.125452  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.126514  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.128476 15775 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.127578  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:03.110620  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.126518 16589 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:46:03.130240 16404 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.130208 16693 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:03.131403 16602 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.103377 16109 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:03.132001 16543 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.132267  9701 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:03.132966 16108 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.133644  9047 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:46:03.134424 16510 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.139045  9048 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:03.116147 16051 rpcz_store.cc:276] 0925 16:45:54.863293 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:57.497117 (+2633824us) service_pool.cc:227] Handling call
0925 16:45:57.573480 (+ 76363us) log.cc:842] Serialized 501 byte log entry
0925 16:45:58.327432 (+753952us) spinlock_profiling.cc:243] Waited 5.39 ms on lock 0x7b180053a220. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:45:59.135300 (+807868us) spinlock_profiling.cc:243] Waited 4.74 ms on lock 0x7b180053a220. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:03.106368 (+3971068us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":305064,"raft.queue_time_us":24390,"raft.run_cpu_time_us":1308,"raft.run_wall_time_us":14383,"spinlock_wait_cycles":23301248,"thread_start_us":133833,"threads_started":1,"wal-append.queue_time_us":812047,"wal-append.run_cpu_time_us":2040,"wal-append.run_wall_time_us":1023247}
I20260925 16:46:03.094717 16661 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.140632 15714 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:03.143240  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.233913 16618 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:46:03.234622 16608 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
W20260925 16:46:03.234776  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 91619.2us
I20260925 16:46:03.235133 16608 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:03.103552  9119 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.129067 15775 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:03.237393 16404 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:03.238818  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.119238  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.239962  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:03.240234  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:03.109392 16610 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.213s	user 0.013s	sys 0.000s
I20260925 16:46:03.095424 16593 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:03.152284  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.077039 16573 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.174604 16385 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.098886 16675 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.145290 16512 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260925 16:46:03.158702 16686 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:46:03.159392 16638 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.149501 16230 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:03.146168 16589 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:03.148871 16649 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:03.084964 16631 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260925 16:46:03.082396 16633 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.183183  9122 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:03.250989  8970 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:03.250427  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.197410 16598 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.257695  9694 raft_consensus.cc:2379] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:03.351298  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2198) took 1060 ms. Trace:
I20260925 16:46:03.351649  9694 rpcz_store.cc:276] 0925 16:46:02.291179 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.107965 (+816786us) service_pool.cc:227] Handling call
0925 16:46:03.351226 (+243261us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:03.352334 16598 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:03.352841  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.155144 16109 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:03.353670 16109 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:03.313512 16608 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.355065 16608 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:03.257211 16604 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.358322 16604 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.359560  8975 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:03.153571  9046 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [20.15-22.16]
W20260925 16:46:03.360436  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3264) took 2352 ms (client timeout 1518 ms). Trace:
I20260925 16:46:03.349726 16573 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.361038  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.362673  9046 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:03.155637 16540 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:03.233923 16442 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.240640 16614 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:03.241356 16594 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Stepping down as leader of term 22
W20260925 16:46:03.260218  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83816.2us
I20260925 16:46:03.364223 16594 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:03.364310 16593 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:03.364995 16593 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.365294 16594 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.366436 16594 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:03.310953  9043 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260925 16:46:03.367264 16593 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.240638 16636 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:03.261108 16510 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:03.367795 16612 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:03.259511 16610 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:03.312222 16645 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.185762 15954 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.112s
I20260925 16:46:03.265058 16385 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.263510 16512 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:03.297557 15714 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:03.300237 16516 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.323490  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:03.333030  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82687.6us
I20260925 16:46:03.251776  9047 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: [24.17-24.17]
I20260925 16:46:03.333650  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:03.320247  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 13)
I20260925 16:46:03.331589 16230 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:03.310335 16358 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.322747 16649 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:03.341404 16661 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.345345 16633 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.346120  8973 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:03.346509 16617 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.264883 16630 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.058s
I20260925 16:46:03.323159 16589 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:03.349675 16690 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:46:03.323287 16663 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:46:03.353055  9123 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260925 16:46:03.264119  9048 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
W20260925 16:46:03.360848  8972 rpcz_store.cc:269] 0925 16:46:00.978343 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.979393 (+  1050us) service_pool.cc:227] Handling call
0925 16:46:03.330180 (+2350787us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b54003e7954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:03.330328 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1824793856}
I20260925 16:46:03.370033 16542 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:03.374866  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.376863  9016 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:03.379292  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45725.9us
I20260925 16:46:03.379949  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:03.381397  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 71027.1us
I20260925 16:46:03.410890  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.364070 16442 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.384037 15714 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.384258 16230 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.386169 16358 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:03.386464  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1867) took 3055 ms. Trace:
I20260925 16:46:03.381866 16618 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:03.389662 16516 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.378327 16512 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:03.393221  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3762) took 1064 ms. Trace:
I20260925 16:46:03.394806  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3646) took 1285 ms. Trace:
I20260925 16:46:03.439589  9044 rpcz_store.cc:276] 0925 16:46:02.329059 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.403545 (+ 74486us) service_pool.cc:227] Handling call
0925 16:46:02.464689 (+ 61144us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.782365 (+317676us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.392937 (+610572us) spinlock_profiling.cc:243] Waited 267 ms on lock 0x7b54000dfa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.393152 (+   215us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":614206208}
I20260925 16:46:03.440476  9124 rpcz_store.cc:276] 0925 16:46:02.109360 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.109475 (+   115us) service_pool.cc:227] Handling call
0925 16:46:02.124363 (+ 14888us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.072189 (+947826us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.394425 (+322236us) spinlock_profiling.cc:243] Waited 925 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.394624 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2128350464}
I20260925 16:46:03.374333 15954 consensus_queue.cc:1225] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 19.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:46:03.397022 16649 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:03.397735  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.430500 16607 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:03.364002 16540 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.380970  8966 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:03.426146 16690 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:03.403146  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3638) took 1627 ms. Trace:
I20260925 16:46:03.416508  8971 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:03.458693  9118 rpcz_store.cc:276] 0925 16:46:01.775744 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.775910 (+   166us) service_pool.cc:227] Handling call
0925 16:46:01.788576 (+ 12666us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:01.870630 (+ 82054us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:01.870665 (+    35us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:01.870714 (+    49us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:01.870745 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.402925 (+1532180us) spinlock_profiling.cc:243] Waited 81.8 ms on lock 0x7b54001c9154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.402970 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.403089 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":188236032}
I20260925 16:46:03.424437  8970 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:03.428387  9700 rpcz_store.cc:276] 0925 16:46:00.330867 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.331533 (+   666us) service_pool.cc:227] Handling call
0925 16:46:00.331798 (+   265us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:00.872588 (+540790us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.386230 (+2513642us) spinlock_profiling.cc:243] Waited 329 ms on lock 0x7b5400689cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.386392 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":757710080}
I20260925 16:46:03.415196 16661 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:03.432338  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.461707  9122 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:03.408635 16542 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:03.371142 16544 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.461289  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2183) took 3421 ms. Trace:
I20260925 16:46:03.466130  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:03.467296  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.420030 16645 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:03.451675  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:03.402753  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3747) took 2458 ms (client timeout 2370 ms). Trace:
I20260925 16:46:03.454125  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.454272  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.453539  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1874) took 1158 ms. Trace:
W20260925 16:46:03.468856  9045 rpcz_store.cc:269] 0925 16:46:00.944566 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.951509 (+  6943us) service_pool.cc:227] Handling call
0925 16:46:03.402545 (+2451036us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54002265d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:03.402685 (+   140us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2010739072}
I20260925 16:46:03.464395  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.469395  9121 rpcz_store.cc:276] 0925 16:46:02.294842 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.470021 (+175179us) service_pool.cc:227] Handling call
0925 16:46:02.487229 (+ 17208us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.665756 (+178527us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:02.665801 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:02.665856 (+    55us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:02.665899 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.453312 (+787413us) spinlock_profiling.cc:243] Waited 178 ms on lock 0x7b54001c8754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.453363 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.453479 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":409937280}
I20260925 16:46:03.466058  9699 rpcz_store.cc:276] 0925 16:46:00.039927 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.040128 (+   201us) service_pool.cc:227] Handling call
0925 16:46:00.040473 (+   345us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:00.215489 (+175016us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.215533 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:00.216202 (+   669us) log.cc:842] Serialized 26 byte log entry
0925 16:46:00.783229 (+567027us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:46:00.783266 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.452228 (+2668962us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b5400537fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.452285 (+    57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:03.452340 (+    55us) raft_consensus.cc:1671] finished
0925 16:46:03.452351 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.461214 (+  8863us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2314,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"spinlock_wait_cycles":395084160,"thread_start_us":566585,"threads_started":1,"wal-append.queue_time_us":722878,"wal-append.run_cpu_time_us":2170,"wal-append.run_wall_time_us":1235014}
I20260925 16:46:03.470932  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:03.457844  9701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1885) took 2050 ms (client timeout 1708 ms). Trace:
I20260925 16:46:03.460668  8975 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:03.427829 16691 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.463188  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:03.473647  9701 rpcz_store.cc:269] 0925 16:46:01.398665 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.401249 (+  2584us) service_pool.cc:227] Handling call
0925 16:46:03.449262 (+2048013us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54004731d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:03.449371 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3923985664}
I20260925 16:46:03.476465  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.464804 16358 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:03.462293 16695 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260925 16:46:03.475615  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.480229  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.446023 16618 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:03.480654  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:03.488449  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:03.488500  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.489866  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:03.490528  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.483656  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.487080  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.492200  9047 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:03.493727  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.493818  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:03.494788  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 1901) took 1198 ms. Trace:
I20260925 16:46:03.494904  8970 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:03.495352  9700 rpcz_store.cc:276] 0925 16:46:02.296557 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.488176 (+1191619us) service_pool.cc:227] Handling call
0925 16:46:03.494734 (+  6558us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:03.496516  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.501338  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.503134  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:03.449889 16572 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.039s
I20260925 16:46:03.505311  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.468446 16605 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:03.499419  9122 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:03.497172  9700 raft_consensus.cc:2362] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19. Re-sending same reply.
I20260925 16:46:03.506721  9090 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.507889  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.508074  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.506687  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.508670  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.509408  8941 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.511804  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.515300  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.516147  9122 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:03.517071  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.480937 16393 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:03.493654 16610 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:03.528076  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.537156  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.537226  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.519325  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.516903 16451 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:03.457657 16607 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.538281  9121 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:03.538638  9124 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:03.544941  9047 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:03.553259  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.554730  9700 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:03.554903  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:03.555428  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1607) took 1258 ms. Trace:
I20260925 16:46:03.555686  9047 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:03.472324 16633 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
I20260925 16:46:03.555944  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.502959 16573 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:03.494521 16630 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:03.552044  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.485272 16208 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260925 16:46:03.555958  9700 rpcz_store.cc:276] 0925 16:46:02.296869 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.536844 (+1239975us) service_pool.cc:227] Handling call
0925 16:46:03.555358 (+ 18514us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:03.554176  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:03.578795  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.487993 16691 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.561563  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:03.513942 16565 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:03.586894  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:03.479903 16544 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.529165 16106 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:03.586644  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.577771  9047 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:03.557174  8967 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260925 16:46:03.482901 16358 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.546481 16610 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:03.604338  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:03.578989  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.584637  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:03.595160  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.582017 16617 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.559741 16690 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:03.608390 16690 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:03.609701 16510 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:03.609371 16690 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.611171  9047 raft_consensus.cc:1226] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [18.12-19.13]
I20260925 16:46:03.605814  9699 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:46:03.577991  8970 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:03.573652 16451 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:03.583575 16573 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:03.517078 16542 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.606595  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:03.620265  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 110964us
I20260925 16:46:03.585474 16633 consensus_queue.cc:1225] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 16.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260925 16:46:03.586052 16630 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:03.607787  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.596850 16689 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:03.611577  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.612962  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.520007 16605 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:03.596501 16696 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.187s	user 0.000s	sys 0.001s
I20260925 16:46:03.610812 16690 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:03.615623 16451 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.616696  9122 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260925 16:46:03.622435 16594 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:03.617352  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.649748  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.554385 16635 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:03.619011  8970 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:03.617347 16442 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.606623  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.587603 16615 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:03.597564 16645 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:03.575076 16572 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:03.611545 16610 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:03.640945  9700 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:03.642407  9045 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:03.650686 16516 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.621039 15775 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:03.584100 15954 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:03.650439  9124 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:03.639465 16675 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:03.654167 16706 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:03.659933 16661 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:03.666092 16572 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:03.695902 16573 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.696893 16572 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:03.655534  9701 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:03.699877 16607 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.701633 16706 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.661602  8970 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:03.611743 16106 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.703917  8970 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:03.704696  8970 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.705263 16106 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.650832 16542 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:03.664094 16512 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.707459 16512 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.664819 16605 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.666561  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2530) took 1396 ms. Trace:
W20260925 16:46:03.644301  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 92399.5us
I20260925 16:46:03.664925 16645 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.668334  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3639) took 1884 ms. Trace:
I20260925 16:46:03.584812 16109 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.640326 16614 consensus_queue.cc:1046] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260925 16:46:03.658406 16208 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:03.601786 16618 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.675995  9124 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:03.676004  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:03.680673 16675 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:03.688519 16699 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260925 16:46:03.696365 16691 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.705677  8970 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:03.714128  8973 raft_consensus.cc:1203] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Deduplicated request from leader. Original: 14.10->[17.11-20.13]   Dedup: 17.11->[18.12-20.13]
I20260925 16:46:03.709952  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.709088  9694 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:03.712910  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2537) took 1830 ms. Trace:
I20260925 16:46:03.727231  9115 rpcz_store.cc:276] 0925 16:46:01.784229 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.789849 (+  5620us) service_pool.cc:227] Handling call
0925 16:46:01.794519 (+  4670us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:01.968780 (+174261us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:01.968826 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:01.968884 (+    58us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:01.968926 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.668142 (+1699216us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400166554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.668187 (+    45us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.668289 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":386966784}
I20260925 16:46:03.655499  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.708516  9050 rpcz_store.cc:276] 0925 16:46:02.269934 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.270962 (+  1028us) service_pool.cc:227] Handling call
0925 16:46:02.271450 (+   488us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:02.329379 (+ 57929us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:02.329409 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:03.016428 (+687019us) spinlock_profiling.cc:243] Waited 29.4 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:03.016888 (+   460us) log.cc:842] Serialized 26 byte log entry
0925 16:46:03.106561 (+ 89673us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:03.106603 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.106711 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:03.666265 (+559554us) raft_consensus.cc:1671] finished
0925 16:46:03.666312 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.666506 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":67636096,"thread_start_us":42884,"threads_started":1,"wal-append.queue_time_us":305705}
I20260925 16:46:03.745095  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57624 (request call id 0) took 1417 ms. Trace:
I20260925 16:46:03.727241  9701 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:03.789629  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2548) took 1489 ms. Trace:
I20260925 16:46:03.839578  9041 rpcz_store.cc:276] 0925 16:46:02.328057 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.361196 (+ 33139us) service_pool.cc:227] Handling call
0925 16:46:03.744837 (+1383641us) spinlock_profiling.cc:243] Waited 13.4 ms on lock 0x7b5400126954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:03.744974 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30740352}
I20260925 16:46:03.840314  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:03.839349  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 129508us
W20260925 16:46:03.841303  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 185890us
I20260925 16:46:03.725521  9045 pending_rounds.cc:76] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 14
I20260925 16:46:03.841569  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.842840  9045 pending_rounds.cc:97] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260925 16:46:03.844753  9045 raft_consensus.cc:2866] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:03.843309  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.839967  8967 rpcz_store.cc:276] 0925 16:46:02.300174 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.367791 (+ 67617us) service_pool.cc:227] Handling call
0925 16:46:03.330514 (+962723us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:03.603343 (+272829us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.788588 (+185245us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b54003e7954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.789406 (+   818us) spinlock_profiling.cc:243] Waited 912 ms on lock 0x7b54003e7950. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:03.789542 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2593732096}
W20260925 16:46:03.849258  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 173341us
I20260925 16:46:03.849754  8973 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: [17.11-20.13]
I20260925 16:46:03.793059  9122 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:03.729142  9700 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:03.838531  8969 rpcz_store.cc:276] 0925 16:46:01.882765 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.900987 (+ 18222us) service_pool.cc:227] Handling call
0925 16:46:01.901260 (+   273us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.792236 (+890976us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.712680 (+920444us) spinlock_profiling.cc:243] Waited 890 ms on lock 0x7b54003e8d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.712854 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2047264512}
I20260925 16:46:03.670230 16540 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.671818 16615 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:03.852556  9701 raft_consensus.cc:2379] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:46:03.866143  9090 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.566s (SENT)
I20260925 16:46:03.902518  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:03.904650  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.905378  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:03.906677  9124 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:03.680226 16661 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:03.794935 16558 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.411s	user 0.002s	sys 0.000s
I20260925 16:46:03.910362  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.804723 16634 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:03.744174 16106 raft_consensus.cc:3032] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:03.837817 16614 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260925 16:46:03.899976  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 297963us
I20260925 16:46:03.731066 16518 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:03.746865 16645 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:03.868608 15954 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:46:03.932642  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:03.933297  9115 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:03.909368  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3661) took 1161 ms. Trace:
I20260925 16:46:03.868877 16596 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:03.790886 16608 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:03.708567 16706 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:03.868093 16510 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:03.868045 16582 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:03.925684  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:03.805454 16613 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:03.801877 16649 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:03.916775 16632 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.006s	sys 0.005s
I20260925 16:46:03.928925  8967 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 4 to 14, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:03.911412 16605 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:03.794426 16589 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.933804  9121 rpcz_store.cc:276] 0925 16:46:02.748035 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.553946 (+805911us) service_pool.cc:227] Handling call
0925 16:46:03.577307 (+ 23361us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.577489 (+   182us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:46:03.595026 (+ 17537us) log.cc:842] Serialized 14 byte log entry
0925 16:46:03.908731 (+313705us) log.cc:842] Serialized 14 byte log entry
0925 16:46:03.908993 (+   262us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:03.909054 (+    61us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:03.909100 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.909177 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.909309 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":17916,"prepare.run_cpu_time_us":80,"prepare.run_wall_time_us":73,"raft.queue_time_us":30826,"thread_start_us":304617,"threads_started":1}
I20260925 16:46:03.745528 16358 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:03.923274 16106 raft_consensus.cc:729] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:03.912575 16661 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:03.921469 16442 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:03.981657  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 377372us
I20260925 16:46:03.758265 16109 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.913957  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2199) took 1582 ms. Trace:
I20260925 16:46:03.985000  9700 rpcz_store.cc:276] 0925 16:46:02.331093 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.910062 (+1578969us) service_pool.cc:227] Handling call
0925 16:46:03.913892 (+  3830us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:03.940596 16510 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:03.942713 16632 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.546s	user 0.006s	sys 0.006s
I20260925 16:46:03.986042  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:03.988435  9050 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260925 16:46:03.989822  8966 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:03.991437  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1511) took 1137 ms. Trace:
I20260925 16:46:03.951480 16613 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.991789  8966 rpcz_store.cc:276] 0925 16:46:02.853652 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.530009 (+676357us) service_pool.cc:227] Handling call
0925 16:46:03.530321 (+   312us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.990170 (+459849us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.991217 (+  1047us) spinlock_profiling.cc:243] Waited 459 ms on lock 0x7b54003575d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:03.991387 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1056346496}
I20260925 16:46:03.992408 16106 consensus_queue.cc:260] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 11, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:03.994071 16106 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:03.994508 16613 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:03.950996 16605 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:03.996517 16605 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.997712  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:03.999095  9046 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:03.999950  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3772) took 1065 ms. Trace:
I20260925 16:46:04.000859 16589 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:04.001569  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2195) took 2297 ms. Trace:
I20260925 16:46:04.001773  8972 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:04.001964  9693 rpcz_store.cc:276] 0925 16:46:01.704478 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.704682 (+   204us) service_pool.cc:227] Handling call
0925 16:46:01.705064 (+   382us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.366351 (+661287us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.001363 (+1635012us) spinlock_profiling.cc:243] Waited 620 ms on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.001514 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1425134848}
I20260925 16:46:04.003324  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1509) took 1150 ms. Trace:
I20260925 16:46:04.003829  8972 rpcz_store.cc:276] 0925 16:46:02.853011 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.418596 (+565585us) service_pool.cc:227] Handling call
0925 16:46:03.418985 (+   389us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.002419 (+583434us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.003082 (+   663us) spinlock_profiling.cc:243] Waited 582 ms on lock 0x7b54003c3cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.003266 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1339668352}
I20260925 16:46:04.005275 16308 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:04.006160 16585 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:04.006507 16585 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:04.007241 16585 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.944839 16608 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.000289  9042 rpcz_store.cc:276] 0925 16:46:02.934242 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.170846 (+236604us) service_pool.cc:227] Handling call
0925 16:46:03.171274 (+   428us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:03.174276 (+  3002us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:03.174321 (+    45us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:03.186327 (+ 12006us) log.cc:842] Serialized 52 byte log entry
0925 16:46:03.402205 (+215878us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:03.416881 (+ 14676us) log.cc:842] Serialized 14 byte log entry
0925 16:46:03.429042 (+ 12161us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.429150 (+   108us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:03.999763 (+570613us) raft_consensus.cc:1671] finished
0925 16:46:03.999782 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:03.999900 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":16369,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":6954,"raft.queue_time_us":13815,"raft.run_cpu_time_us":360,"raft.run_wall_time_us":63956,"thread_start_us":165580,"threads_started":1,"wal-append.queue_time_us":279706}
I20260925 16:46:04.008450 16585 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:04.009078 16510 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:04.009465 16608 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:04.003438  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.013335 16572 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.956809 16689 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:03.981007 16645 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:03.933099 16518 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.954494  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.020001  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:04.032620  9041 raft_consensus.cc:595] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.032999  9041 raft_consensus.cc:603] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:03.951398 16582 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:46:04.059131  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 426703us
I20260925 16:46:04.059360  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:04.064029  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.067435  9699 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:04.024273 16518 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:04.069113  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.070348  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.070191  9700 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:04.072916  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.074067  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.088714  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:04.092394  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.056386 16649 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:04.098133  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.056937 16630 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:04.100785  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:04.102263  9121 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:04.020318 16442 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.950546 16596 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.141s
I20260925 16:46:04.110174 16442 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.111501  9115 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:04.111909 16582 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.096688 16648 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.115686 16648 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.120784  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.122825  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:04.111054 16510 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.072507 16572 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.127239  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.128237 16442 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:04.134996 16442 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:04.135874 16442 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:03.948485 16675 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.019660 16610 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.021451 16645 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.153970  9121 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:04.159128  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.160014  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:04.161661  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.164193  9693 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:04.117462 15954 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260925 16:46:04.169389  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 157423us
I20260925 16:46:04.170667  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.171339  8967 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:03.956561 16615 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:04.173465  9090 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Timed out: RequestConsensusVote RPC to 127.7.158.196:37639 timed out after 1.764s (SENT)
I20260925 16:46:04.173842  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.174481  9121 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260925 16:46:04.173874  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.177937  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.180404  8970 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260925 16:46:04.193496  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.175323  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:04.162099 16558 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260925 16:46:04.201135  9042 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:04.202098  9042 raft_consensus.cc:595] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.201965  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.208091  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:04.211165  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.218302  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.173038 16636 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:04.212951 16607 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:46:04.231033 16055 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.231530 16703 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.213364 16512 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
I20260925 16:46:04.232161 16703 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.232931 16512 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:46:04.233444 16512 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:04.234632 16703 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.234383 16512 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.235052  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.236631  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2188) took 3418 ms. Trace:
W20260925 16:46:04.236935 16716 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260925 16:46:04.237118  9695 rpcz_store.cc:276] 0925 16:46:00.817799 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.817990 (+   191us) service_pool.cc:227] Handling call
0925 16:46:00.818344 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.131747 (+1313403us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.236343 (+2104596us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b5400534154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.236569 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2986328960}
I20260925 16:46:04.239084  9695 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:04.240078  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3730) took 4216 ms. Trace:
I20260925 16:46:04.240548  9049 rpcz_store.cc:276] 0925 16:46:00.023641 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.023848 (+   207us) service_pool.cc:227] Handling call
0925 16:46:00.044680 (+ 20832us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:00.057901 (+ 13221us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:00.057941 (+    40us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:00.075440 (+ 17499us) log.cc:842] Serialized 52 byte log entry
0925 16:46:00.500622 (+425182us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:00.651077 (+150455us) log.cc:842] Serialized 14 byte log entry
0925 16:46:00.651522 (+   445us) log.cc:842] Serialized 14 byte log entry
0925 16:46:02.414307 (+1762785us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b18002994a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:46:02.415255 (+   948us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:02.415329 (+    74us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:02.738085 (+322756us) spinlock_profiling.cc:243] Waited 2.02 ms on lock 0x7b18002994a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:03.320344 (+582259us) spinlock_profiling.cc:243] Waited 6.96 ms on lock 0x7b18002994a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:03.794296 (+473952us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:04.239834 (+445538us) raft_consensus.cc:1671] finished
0925 16:46:04.239863 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:04.240012 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":31715,"prepare.queue_time_us":236669,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":75,"raft.queue_time_us":106139,"raft.run_cpu_time_us":443,"raft.run_wall_time_us":66555,"spinlock_wait_cycles":56658432,"thread_start_us":480260,"threads_started":2,"wal-append.queue_time_us":633415}
I20260925 16:46:04.254509  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.255466  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.254541  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.256484  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2193) took 2635 ms. Trace:
I20260925 16:46:04.257462  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:04.257736 16717 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.129s	user 0.000s	sys 0.000s
I20260925 16:46:04.256839  9698 rpcz_store.cc:276] 0925 16:46:01.621632 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.621858 (+   226us) service_pool.cc:227] Handling call
0925 16:46:01.645185 (+ 23327us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:01.874822 (+229637us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:01.874865 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:01.875351 (+   486us) log.cc:842] Serialized 26 byte log entry
0925 16:46:02.206106 (+330755us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:02.206258 (+   152us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.256077 (+2049819us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b540053e8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.256140 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:04.256201 (+    61us) raft_consensus.cc:1671] finished
0925 16:46:04.256216 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:04.256434 (+   218us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14115,"raft.queue_time_us":113133,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":7410,"spinlock_wait_cycles":494712192,"thread_start_us":279970,"threads_started":1,"wal-append.queue_time_us":525425,"wal-append.run_cpu_time_us":2787,"wal-append.run_wall_time_us":1379356}
I20260925 16:46:04.254979  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:04.259152  9698 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:04.259627 16627 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:04.260958  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:04.261659 16627 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:04.262581 16610 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:04.212734 16592 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:04.264650  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3658) took 1808 ms. Trace:
I20260925 16:46:04.268081  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1873) took 1975 ms. Trace:
I20260925 16:46:04.268582  9117 rpcz_store.cc:276] 0925 16:46:02.292530 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.421308 (+128778us) service_pool.cc:227] Handling call
0925 16:46:02.421595 (+   287us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.477396 (+ 55801us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:02.477427 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:02.477465 (+    38us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:02.477491 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.267796 (+1790305us) spinlock_profiling.cc:243] Waited 55.6 ms on lock 0x7b5400163d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.267854 (+    58us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:04.268011 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":127911168}
I20260925 16:46:04.270149  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3257) took 3380 ms. Trace:
I20260925 16:46:04.270656  8974 rpcz_store.cc:276] 0925 16:46:00.889529 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:00.897365 (+  7836us) service_pool.cc:227] Handling call
0925 16:46:00.897677 (+   312us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.263588 (+1365911us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.269872 (+2006284us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b54001e3554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.270082 (+   210us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3139630976}
I20260925 16:46:04.273844  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1864) took 2824 ms. Trace:
I20260925 16:46:04.274200  9120 rpcz_store.cc:276] 0925 16:46:01.419130 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.419355 (+   225us) service_pool.cc:227] Handling call
0925 16:46:01.436418 (+ 17063us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:01.750746 (+314328us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.243474 (+2492728us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.243669 (+   195us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":681782528}
I20260925 16:46:04.282833 16714 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260925 16:46:04.294122 16718 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260925 16:46:04.283362  9123 rpcz_store.cc:276] 0925 16:46:02.455960 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.051258 (+595298us) service_pool.cc:227] Handling call
0925 16:46:03.081207 (+ 29949us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:03.408939 (+327732us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.264357 (+855418us) spinlock_profiling.cc:243] Waited 272 ms on lock 0x7b5400164754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.264582 (+   225us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":624635648}
I20260925 16:46:04.298302  9120 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:04.298485 16596 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:04.299674 16596 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:04.300108 16596 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:04.300350  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.301517  9117 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260925 16:46:04.301115 16596 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.302856 16596 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:04.307116  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1611) took 2009 ms. Trace:
I20260925 16:46:04.307255 16645 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.271257 16319 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260925 16:46:04.217337 16706 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.097s
I20260925 16:46:04.307664  9695 rpcz_store.cc:276] 0925 16:46:02.297950 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.238530 (+1940580us) service_pool.cc:227] Handling call
0925 16:46:04.238871 (+   341us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.239498 (+   627us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.239678 (+   180us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:04.312424  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:04.314885  9695 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:04.307734  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1614) took 1954 ms. Trace:
I20260925 16:46:04.316231  9698 rpcz_store.cc:276] 0925 16:46:02.305552 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.258586 (+1953034us) service_pool.cc:227] Handling call
0925 16:46:04.258863 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.259482 (+   619us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.259650 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:04.210081 16712 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.124s
I20260925 16:46:04.318179  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1902) took 1841 ms. Trace:
I20260925 16:46:04.318756 16712 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:04.319517 16712 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:04.309237 16319 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:04.321044 16319 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:04.320604 16712 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.322333 16712 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:04.322161 16319 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.168843 16358 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 12, Time since last communication: 0.056s
I20260925 16:46:04.309685 16512 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:04.324533 16358 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:04.325014 16358 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:04.325918 16358 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.209156 16635 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.119s
I20260925 16:46:04.331965 16319 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:04.335945 16636 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:04.337395 16636 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.315490  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1616) took 1998 ms. Trace:
I20260925 16:46:04.340015  9695 rpcz_store.cc:276] 0925 16:46:02.317194 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.314363 (+1997169us) service_pool.cc:227] Handling call
0925 16:46:04.314677 (+   314us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.315243 (+   566us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.315435 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:04.343922  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.344731  8967 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:04.226985  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:04.349197  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 122306us
I20260925 16:46:04.351467  9117 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:04.354022  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.224489 16630 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.358618  9124 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:04.318621  9698 rpcz_store.cc:276] 0925 16:46:02.476795 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.317277 (+1840482us) service_pool.cc:227] Handling call
0925 16:46:04.317618 (+   341us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.317826 (+   208us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:04.317865 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:04.317919 (+    54us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:04.317961 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.318024 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:04.318136 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:04.363099  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:04.363322  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:04.260983 16719 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260925 16:46:04.378641  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:04.327488 16358 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:04.385819  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:04.386709  9048 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:04.310676 16706 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:04.404321  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.418708  9048 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:04.413213  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:04.420109  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:04.377305 16542 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.000s
I20260925 16:46:04.356410 16714 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:04.425319  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.308586 16648 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:04.339872 16051 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.072s
I20260925 16:46:04.423979  9044 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:04.441790  9046 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:04.376279 16713 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:04.380872 16689 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:04.458941  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 250935us
I20260925 16:46:04.520881  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:04.521991  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:04.522374  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 65111.7us
I20260925 16:46:04.378185 16517 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:04.516130  9046 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:04.405064 16645 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:04.373803 16642 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.089s
I20260925 16:46:04.441877 16690 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:46:04.525578  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.526703  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.412132 16706 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:04.570809  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:04.571619  8974 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:04.543744  9046 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.576102  9046 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:04.468547 16714 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:04.420298 16109 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.126s
W20260925 16:46:04.520020 16661 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.531s	user 0.009s	sys 0.000s
I20260925 16:46:04.521920 16592 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.033s
I20260925 16:46:04.555598 16610 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:04.555969 16633 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.555879 16517 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.556773 16607 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:04.558616 16689 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:04.552471 16645 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.630383  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:04.550379  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 125152us
I20260925 16:46:04.408000 16581 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.166s
I20260925 16:46:04.677067  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:04.516505 16648 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:04.544214 16589 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.455945 16518 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.123s
I20260925 16:46:04.594107  9046 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260925 16:46:04.686115  9046 pending_rounds.cc:76] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 16
I20260925 16:46:04.686498  9046 pending_rounds.cc:97] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260925 16:46:04.686813  9046 raft_consensus.cc:2866] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260925 16:46:04.619253  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 445775us
W20260925 16:46:04.619678  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52277us
W20260925 16:46:04.656837 16634 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.728s	user 0.007s	sys 0.004s
I20260925 16:46:04.620219 16510 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.691733  8974 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:04.701164  9046 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:04.703475  8973 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:04.586884 16714 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:04.706188  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2560) took 1588 ms. Trace:
I20260925 16:46:04.706537  8971 rpcz_store.cc:276] 0925 16:46:03.117964 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.796667 (+678703us) service_pool.cc:227] Handling call
0925 16:46:03.797090 (+   423us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:03.797515 (+   425us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:03.797554 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:03.798080 (+   526us) log.cc:842] Serialized 26 byte log entry
0925 16:46:04.165564 (+367484us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:04.165614 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.165697 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:04.705980 (+540283us) raft_consensus.cc:1671] finished
0925 16:46:04.706016 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:04.706128 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":113,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":94,"thread_start_us":366829,"threads_started":1,"wal-append.queue_time_us":853403}
I20260925 16:46:04.690698 16589 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:04.694337 16672 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.302s	user 0.001s	sys 0.013s
W20260925 16:46:04.709209 16672 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.317s	user 0.001s	sys 0.013s
I20260925 16:46:04.709748 16589 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:04.686755 16721 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260925 16:46:04.715066  9117 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260925 16:46:04.724447  9124 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260925 16:46:04.624264 16661 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.630220 16633 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.741946 16633 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.744592 16517 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:04.747437  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1899) took 2627 ms. Trace:
I20260925 16:46:04.691468 16051 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:04.737411 16661 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:04.722817 16594 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:04.738276 16645 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:04.726509 16712 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:04.739626  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.739537 16578 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:04.692034 16627 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.766106  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:04.751034  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1444) took 1900 ms. Trace:
I20260925 16:46:04.766954  9043 rpcz_store.cc:276] 0925 16:46:02.850597 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.116389 (+265792us) service_pool.cc:227] Handling call
0925 16:46:03.116657 (+   268us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.367468 (+250811us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.750732 (+1383264us) spinlock_profiling.cc:243] Waited 185 ms on lock 0x7b54002a2e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:04.750973 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":424351488}
I20260925 16:46:04.757099  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:04.727041 16634 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:04.755501 16051 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.704668 16706 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.764160 16607 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:46:04.730494 16108 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260925 16:46:04.765074 16578 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.764847 16714 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.758949  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:04.748000  9701 rpcz_store.cc:276] 0925 16:46:02.119860 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.101790 (+1981930us) service_pool.cc:227] Handling call
0925 16:46:04.135100 (+ 33310us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:04.135343 (+   243us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:46:04.135371 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:04.135845 (+   474us) log.cc:842] Serialized 26 byte log entry
0925 16:46:04.355792 (+219947us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:04.355830 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.355895 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:04.747133 (+391238us) raft_consensus.cc:1671] finished
0925 16:46:04.747169 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:04.747363 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":219666,"threads_started":1,"wal-append.queue_time_us":609752}
I20260925 16:46:04.754944 16594 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:04.731201 16512 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260925 16:46:04.755805 15954 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.755300 16733 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:04.771615  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 219451us
I20260925 16:46:04.822481  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.774261  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.697387 16648 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.805660  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.827562  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.828013  8973 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:04.829363  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:04.829942  9701 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:04.833607  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.816617 16731 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.892515 16731 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.816571  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:46:04.807091 15714 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.020s	sys 0.016s
I20260925 16:46:04.820470  9050 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
W20260925 16:46:04.896118 15714 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.020s	sys 0.016s
W20260925 16:46:04.896169  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79686.5us
I20260925 16:46:04.800285 16510 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:04.839358  9120 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:04.814935  8971 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:04.817601 16578 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.844035 16634 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:04.839319 16581 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.006s
I20260925 16:46:04.847941  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:04.821660 16594 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:04.850270  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:04.824719 16706 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:04.857785 16654 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.306s	user 0.000s	sys 0.010s
I20260925 16:46:04.836846 16712 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:04.867792 16648 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:04.870611 16714 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:04.871516 16109 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260925 16:46:04.878974 16596 consensus_meta.cc:287] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.576s	user 0.011s	sys 0.002s
I20260925 16:46:04.768221 16689 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.830286 16733 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.827777 15954 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.768932 16627 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.901074 16510 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:04.932296  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.933661  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.946547  9041 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 12.
I20260925 16:46:04.938885  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.947315  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.951808  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.932534 16208 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:04.955504  9121 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:46:04.917802 16108 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.028s
I20260925 16:46:04.936596 16582 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.962965  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:04.945099  9701 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:04.967638  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:04.968431  8971 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:04.973863  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:04.974241  9041 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260925 16:46:04.976495  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.972693  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:04.934813 16712 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260925 16:46:04.980079  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:04.960193 16578 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:04.988226  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:04.984580 16731 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:04.990614 16589 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:46:04.990899 16731 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:04.991307 16642 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:46:04.997236  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:04.998651 16713 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:04.986968 16585 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:05.001370 16585 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:05.005515 16510 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:04.992659 16745 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:04.989548 16630 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:05.059113 16745 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.059378 16630 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.061784 16745 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.007403  9119 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:05.062693 16630 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.010949  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1903) took 2532 ms. Trace:
I20260925 16:46:05.012135 16051 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.004932 16585 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.063895  9695 rpcz_store.cc:276] 0925 16:46:02.478887 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.341309 (+1862422us) service_pool.cc:227] Handling call
0925 16:46:04.341712 (+   403us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:04.342111 (+   399us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:04.342150 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:04.342745 (+   595us) log.cc:842] Serialized 26 byte log entry
0925 16:46:04.911368 (+568623us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:04.911403 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.911466 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:05.010752 (+ 99286us) raft_consensus.cc:1671] finished
0925 16:46:05.010773 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.010896 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":482504,"threads_started":1,"wal-append.queue_time_us":635969}
I20260925 16:46:05.065960  9695 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:05.066498  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1905) took 2285 ms. Trace:
I20260925 16:46:05.066767  9695 rpcz_store.cc:276] 0925 16:46:02.781140 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.065486 (+2284346us) service_pool.cc:227] Handling call
0925 16:46:05.065785 (+   299us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.066294 (+   509us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.066452 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:46:05.036371  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 221705us
W20260925 16:46:05.053547  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56389.9us
I20260925 16:46:05.068395  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1906) took 2284 ms. Trace:
I20260925 16:46:05.068995  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:04.967280 16582 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:04.991434 16731 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.087893  8970 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260925 16:46:05.088303  8970 pending_rounds.cc:76] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 13
I20260925 16:46:05.088596  8970 pending_rounds.cc:97] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260925 16:46:05.088833  8970 raft_consensus.cc:2866] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:05.090765  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.091567  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:05.092592  9119 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:46:05.093202  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3659) took 2478 ms. Trace:
I20260925 16:46:05.095019  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.058362 16596 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:05.093487  9119 rpcz_store.cc:276] 0925 16:46:02.614644 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.064365 (+449721us) service_pool.cc:227] Handling call
0925 16:46:03.064623 (+   258us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.559754 (+1495131us) spinlock_profiling.cc:243] Waited 23.7 ms on lock 0x7b5800a910b0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:46:05.007030 (+447276us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b58008abfb0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bea5f63 00007f719bf09aba 00007f719bf213af 00007f719bf22b4e 00007f719bf2cc89 00007f719bf2d556 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684
0925 16:46:05.092945 (+ 85915us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.093156 (+   211us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1079547008}
I20260925 16:46:05.108810  9050 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260925 16:46:05.098410  8974 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:05.075067 16705 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:05.107933  9701 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:05.111469  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1618) took 2264 ms. Trace:
I20260925 16:46:05.111814  9701 rpcz_store.cc:276] 0925 16:46:02.847326 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.096238 (+2248912us) service_pool.cc:227] Handling call
0925 16:46:05.096505 (+   267us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.111237 (+ 14732us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.111421 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.096552 16746 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:05.108008 16389 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 20 current term: 20 is higher.
I20260925 16:46:05.097935 15954 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.088370 16642 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260925 16:46:05.123665  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.113571 16108 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:05.119005 16743 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.135428 16108 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.136245 16743 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.119593 16746 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.137647 16108 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.128257 16308 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.068804  9695 rpcz_store.cc:276] 0925 16:46:02.784164 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.067689 (+2283525us) service_pool.cc:227] Handling call
0925 16:46:05.067961 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.068127 (+   166us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.068149 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.068183 (+    34us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:05.068210 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.068263 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.068346 (+    83us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.125161  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.129281 15954 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.146827 15954 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.148448 16582 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.149528 15954 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.152676  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.153124  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.153283  9701 raft_consensus.cc:1799] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.153761  8974 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:05.153259  9115 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:05.154539  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:05.123073  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 161862us
I20260925 16:46:05.122756 16705 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.013s
I20260925 16:46:05.145910 16627 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.145589 16308 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.146256 16572 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:05.153895  9701 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:05.144690  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50726.8us
I20260925 16:46:05.158715  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.174340  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.176098  9115 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:05.179144 16582 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:05.145946 16746 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.157857 16733 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.182472 16585 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:05.169708 16578 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.022s
I20260925 16:46:05.192641  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1910) took 2021 ms. Trace:
I20260925 16:46:05.162998 16757 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:05.179733 16582 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.193018  9701 rpcz_store.cc:276] 0925 16:46:03.171023 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.175268 (+2004245us) service_pool.cc:227] Handling call
0925 16:46:05.192209 (+ 16941us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.192368 (+   159us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.192391 (+    23us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.192427 (+    36us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:05.192452 (+    25us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.192499 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.192593 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.202009  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:05.211643  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 088ac48c62d34a40b53987746a70b871, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:05.212230  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 088ac48c62d34a40b53987746a70b871, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.185279 16572 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.184197 16756 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.168836 16745 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260925 16:46:05.171840 16591 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.043s
W20260925 16:46:05.222576  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53958.5us
I20260925 16:46:05.220645  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1913) took 2048 ms. Trace:
I20260925 16:46:05.229380  9115 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:05.229640  9701 rpcz_store.cc:276] 0925 16:46:03.174202 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.209098 (+2034896us) service_pool.cc:227] Handling call
0925 16:46:05.220195 (+ 11097us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.220363 (+   168us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.220385 (+    22us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.220424 (+    39us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:46:05.220456 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.220504 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.220594 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.180804 15954 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:05.193173 16731 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.180058 16512 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
W20260925 16:46:05.231527  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53991.5us
I20260925 16:46:05.201161 16627 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260925 16:46:05.232635 16591 consensus_queue.cc:1225] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260925 16:46:05.187875 16740 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.040s
I20260925 16:46:05.209522 16585 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.243117  9701 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:05.234010 16639 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.243896  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.246848  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1914) took 1924 ms. Trace:
I20260925 16:46:05.247184  9701 rpcz_store.cc:276] 0925 16:46:03.322124 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.231366 (+1909242us) service_pool.cc:227] Handling call
0925 16:46:05.242373 (+ 11007us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.246636 (+  4263us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.246810 (+   174us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.253315 16594 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.255091 16757 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:05.232930 16756 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.262013  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57624 (request call id 2) took 1094 ms. Trace:
I20260925 16:46:05.283454 16308 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.283824  9042 rpcz_store.cc:276] 0925 16:46:04.167508 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.167671 (+   163us) service_pool.cc:227] Handling call
0925 16:46:05.261647 (+1093976us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400401b20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bebfdc0 00007f719bf249c2 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86
0925 16:46:05.261952 (+   305us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":246419712}
I20260925 16:46:05.285517 16756 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.286063 16756 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.286506 16756 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.243417 16753 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260925 16:46:05.264565  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3667) took 2322 ms. Trace:
I20260925 16:46:05.289734 16756 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.268412  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.289460  9122 rpcz_store.cc:276] 0925 16:46:02.941707 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.667257 (+725550us) service_pool.cc:227] Handling call
0925 16:46:03.678421 (+ 11164us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.900622 (+222201us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.264102 (+1363480us) spinlock_profiling.cc:243] Waited 114 ms on lock 0x7b540019cdd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:05.264497 (+   395us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":262535936}
I20260925 16:46:05.219682 16572 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.277004  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.291651  9122 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260925 16:46:05.293260 16572 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.294158 16596 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:05.294682 16596 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:05.295055 16596 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:05.295645  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.295533 16649 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:05.296315  9048 raft_consensus.cc:1799] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.296903  9048 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 19 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:46:05.297210 16591 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.297459  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.297683  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.294880  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.280319  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.300849  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1915) took 1970 ms. Trace:
I20260925 16:46:05.301283  9701 rpcz_store.cc:276] 0925 16:46:03.330719 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.299970 (+1969251us) service_pool.cc:227] Handling call
0925 16:46:05.300228 (+   258us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.300442 (+   214us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.300479 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.300535 (+    56us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:05.300580 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.300645 (+    65us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.300774 (+   129us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.304083  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.276626 16745 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:46:05.306358  9701 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:05.307869  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:05.309677  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.310779  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.311473  9115 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:05.312026  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.314183  9115 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 13. (term mismatch)
I20260925 16:46:05.314699  9115 pending_rounds.cc:76] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 12
I20260925 16:46:05.309885  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.315065  9115 pending_rounds.cc:97] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 19.13
I20260925 16:46:05.317139  9115 raft_consensus.cc:2866] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:05.318914  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.316628  8973 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:05.349745  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.324559  9115 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 13
I20260925 16:46:05.350680  9115 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260925 16:46:05.350942  9115 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:05.321660  9701 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:05.351534  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.349644  8966 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:05.323159  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.321230  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.322212  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.354148  9046 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:05.356508  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.353346  9048 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
W20260925 16:46:05.320386 16767 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.068s	user 0.005s	sys 0.001s
I20260925 16:46:05.280858 16757 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:05.369561  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.310145 16572 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.309788 16706 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:05.378149  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.267551 16639 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.357803 16746 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:05.361723 16753 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260925 16:46:05.386271  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:05.356374 16745 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.297711 16591 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.377130 15954 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:05.391640 16512 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.400303  9041 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:05.412019  9041 raft_consensus.cc:603] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:05.393704  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.399309  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.396730  8973 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:05.365533 16592 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260925 16:46:05.397277 16746 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:05.395619 16572 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.443439 16582 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.400609 16642 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
W20260925 16:46:05.473459  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 121977us
I20260925 16:46:05.472616  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:05.447273 16051 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.475661  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.477454  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.417659 16589 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.049s
I20260925 16:46:05.404295 16745 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.416451 16512 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.447598 16627 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260925 16:46:05.468217 16746 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:05.494000  9048 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:05.495085  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:05.546810  9041 raft_consensus.cc:595] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.547123  9041 raft_consensus.cc:603] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:05.496063 16639 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.497561  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2547) took 1918 ms. Trace:
I20260925 16:46:05.499876  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:05.479899 16706 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:05.500579 16585 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.500988 16594 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.501149  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:05.502377  9699 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1621) took 2203 ms (client timeout 2057 ms). Trace:
I20260925 16:46:05.506516 16596 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.508266  9700 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:05.546821  8971 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260925 16:46:05.480638 16051 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.511955 16753 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.513378  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1877) took 2894 ms. Trace:
I20260925 16:46:05.514556 16591 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.492161 16690 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:05.517740 16769 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.258s	user 0.001s	sys 0.000s
W20260925 16:46:05.520819 16766 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260925 16:46:05.524354  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1917) took 2058 ms. Trace:
I20260925 16:46:05.568341  9701 rpcz_store.cc:276] 0925 16:46:03.465503 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.308853 (+1843350us) service_pool.cc:227] Handling call
0925 16:46:05.318473 (+  9620us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.353100 (+ 34627us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.524148 (+171048us) spinlock_profiling.cc:243] Waited 3.01 ms on lock 0x7b540048b2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:05.524302 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6928256}
I20260925 16:46:05.569815  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.525409 16132 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:05.526129 15954 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:46:05.527544  9693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1623) took 1607 ms (client timeout 1919 ms). Trace:
W20260925 16:46:05.579998  9693 rpcz_store.cc:269] 0925 16:46:03.923739 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.003130 (+ 79391us) service_pool.cc:227] Handling call
0925 16:46:05.527322 (+1524192us) spinlock_profiling.cc:243] Waited 152 ms on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:05.527479 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":349240192}
W20260925 16:46:05.529572 16694 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 2.208s	user 0.001s	sys 0.001s
I20260925 16:46:05.483369 16776 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:05.483639 16733 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:05.536767 16772 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260925 16:46:05.538691  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:05.589414  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:05.509303 16740 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.551184  9122 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:05.592448  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.547755  9045 rpcz_store.cc:276] 0925 16:46:03.579537 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.724905 (+145368us) service_pool.cc:227] Handling call
0925 16:46:03.725302 (+   397us) raft_consensus.cc:1457] Updating replica for 3 ops
0925 16:46:03.873581 (+148279us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:03.873632 (+    51us) raft_consensus.cc:1525] Triggering prepare for 3 ops
0925 16:46:03.874490 (+   858us) log.cc:842] Serialized 78 byte log entry
0925 16:46:04.128643 (+254153us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:04.169629 (+ 40986us) log.cc:842] Serialized 14 byte log entry
0925 16:46:04.170080 (+   451us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:04.170149 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:05.084564 (+914415us) spinlock_profiling.cc:243] Waited 25.1 ms on lock 0x7b1800502f60. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:05.494866 (+410302us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b1800502f60. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:05.497347 (+  2481us) raft_consensus.cc:1671] finished
0925 16:46:05.497371 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.497504 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":43823,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":62,"raft.queue_time_us":25967,"raft.run_cpu_time_us":205,"raft.run_wall_time_us":10465,"spinlock_wait_cycles":218955904,"thread_start_us":205742,"threads_started":1,"wal-append.queue_time_us":312576}
W20260925 16:46:05.550364  9699 rpcz_store.cc:269] 0925 16:46:03.299181 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.612297 (+313116us) service_pool.cc:227] Handling call
0925 16:46:05.502154 (+1889857us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b54006eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:05.502293 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":840710528}
I20260925 16:46:05.593070  9693 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:46:05.556233  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:46:05.538345 16572 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.595522  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:05.593796  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.559471  9118 rpcz_store.cc:276] 0925 16:46:02.619420 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.527657 (+908237us) service_pool.cc:227] Handling call
0925 16:46:03.559102 (+ 31445us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:03.945296 (+386194us) raft_consensus.cc:1520] Early marking committed up to index 17
0925 16:46:04.020669 (+ 75373us) log.cc:842] Serialized 14 byte log entry
0925 16:46:04.631091 (+610422us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:04.684411 (+ 53320us) log.cc:842] Serialized 26 byte log entry
0925 16:46:04.684572 (+   161us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:04.684614 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.513022 (+828408us) spinlock_profiling.cc:243] Waited 73.2 ms on lock 0x7b54001c9654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:05.513064 (+    42us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:05.513109 (+    45us) raft_consensus.cc:1671] finished
0925 16:46:05.513197 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.513328 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20328,"prepare.queue_time_us":67109,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":155863,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":188,"spinlock_wait_cycles":168395008,"thread_start_us":901995,"threads_started":3,"wal-append.queue_time_us":290092}
I20260925 16:46:05.547755  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:05.565513  8970 raft_consensus.cc:2354] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:05.481077  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.590626  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.591475  9701 raft_consensus.cc:2362] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23. Re-sending same reply.
I20260925 16:46:05.578481 16132 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:05.560112  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
W20260925 16:46:05.602020  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 121023us
I20260925 16:46:05.603191  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.603480  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.570581 16632 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:05.609421  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.610226  9121 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:05.611279  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.607597  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:05.566099 16594 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260925 16:46:05.617350  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:05.617524  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.620359  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.621559  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.623020  9041 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260925 16:46:05.588646 16582 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.629722  9699 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260925 16:46:05.583369 16626 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260925 16:46:05.634718  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:05.627787  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.609907 15954 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:05.618791 16632 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.626329  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.637847  9121 raft_consensus.cc:2396] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260925 16:46:05.632964  9699 pending_rounds.cc:76] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 16
I20260925 16:46:05.564065 16753 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.609440 16572 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.609421 16308 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:46:05.567476 16690 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.628439  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.638273  9699 pending_rounds.cc:97] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260925 16:46:05.616410 16599 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:05.627344 16781 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:05.623656 16733 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:05.630096 16706 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:05.630002 16630 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:05.605859 16740 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.630146 16639 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:05.676736  9122 raft_consensus.cc:2396] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 17.
I20260925 16:46:05.592782 16776 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.671519  9699 raft_consensus.cc:2866] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:05.692839  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2213) took 1372 ms. Trace:
I20260925 16:46:05.677531 16599 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.640275 16308 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:05.682788  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.688046  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:05.679802  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51472.4us
I20260925 16:46:05.632582 16582 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.700976  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.709182  9119 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:05.710060  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.689329 16630 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:05.712708 16596 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.720667 16630 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.721518 16753 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.723902 16051 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.725735  9042 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:05.699684  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1508) took 2847 ms. Trace:
I20260925 16:46:05.727586  8975 rpcz_store.cc:276] 0925 16:46:02.852600 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.377491 (+524891us) service_pool.cc:227] Handling call
0925 16:46:03.460449 (+ 82958us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.473800 (+ 13351us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.699483 (+2225683us) spinlock_profiling.cc:243] Waited 82.7 ms on lock 0x7b54001e2650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:05.699617 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":190179712}
I20260925 16:46:05.693380  9699 rpcz_store.cc:276] 0925 16:46:04.320351 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.601525 (+1281174us) service_pool.cc:227] Handling call
0925 16:46:05.624266 (+ 22741us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.692608 (+ 68342us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.692790 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.678671 16706 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:05.632333 16714 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.055s
W20260925 16:46:05.732053  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1609) took 3428 ms (client timeout 1566 ms). Trace:
I20260925 16:46:05.692204 16370 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.672760 16572 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.698170  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:05.713292  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:05.745254  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47149.7us
I20260925 16:46:05.745606  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.646852  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.746857  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.713446  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:05.715234 16785 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260925 16:46:05.715723 16690 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.688030 16639 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:05.719338 16745 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.697223 16713 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:05.697516  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:05.752120  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:05.732496  9697 rpcz_store.cc:269] 0925 16:46:02.297403 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.299123 (+  1720us) service_pool.cc:227] Handling call
0925 16:46:05.725522 (+3426399us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54006eda54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:05.725630 (+   108us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":396096768}
I20260925 16:46:05.752975  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:05.752996  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55548.3us
I20260925 16:46:05.747638  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:05.698107 16308 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:05.754768  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.707803 16512 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.649178 16132 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.753849  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.636801 16627 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.773504 16627 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.777297  9115 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: [20.12-20.12]
I20260925 16:46:05.779799 16540 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:05.727128 16733 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.757412  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.783129  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.783295 16442 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:05.783875 16585 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:05.784229  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:05.784500 16585 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:05.785018 16585 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:05.785264  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:05.732475 16706 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:05.751825 15954 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260925 16:46:05.764513 16632 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.787379 16632 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:05.741062 16051 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260925 16:46:05.758812  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.792299  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1898) took 1200 ms. Trace:
I20260925 16:46:05.792794  9120 rpcz_store.cc:276] 0925 16:46:04.592270 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.592470 (+   200us) service_pool.cc:227] Handling call
0925 16:46:05.792086 (+1199616us) spinlock_profiling.cc:243] Waited 177 ms on lock 0x7b540007dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:05.792229 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":406071168}
I20260925 16:46:05.755883 16639 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:05.771092  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.772761 16132 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:05.780978 16733 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.785337 16585 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.762183 16661 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:05.771972  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.818882  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.783535 16599 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.832191  9122 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:05.770766 16745 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:05.753993 16370 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.845359  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:05.769407 16776 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.849789 16584 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.850363 16584 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.854489 16584 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.831408 16585 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:05.855432  9120 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260925 16:46:05.856694  9123 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:05.831964 16661 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:05.834905 16594 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.867969  9699 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260925 16:46:05.869720  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:05.868726  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1923) took 1301 ms. Trace:
I20260925 16:46:05.875102  9699 rpcz_store.cc:276] 0925 16:46:04.567003 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.848751 (+1281748us) service_pool.cc:227] Handling call
0925 16:46:05.867532 (+ 18781us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.868443 (+   911us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.868663 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:05.768771 16746 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.845238 16599 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:05.879117  9123 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:05.885406  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2208) took 2236 ms. Trace:
I20260925 16:46:05.902523  9120 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
W20260925 16:46:05.900424  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 138885us
I20260925 16:46:05.872929 16661 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:05.909914  9115 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:05.863279 16572 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.927930  9123 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260925 16:46:05.945364 16733 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:05.948308  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 163100us
I20260925 16:46:05.949050  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:05.857257 16745 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.950062  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:05.924412 16720 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260925 16:46:05.952040  9118 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25.
I20260925 16:46:05.935020 16661 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:05.877988 16594 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.957955  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:05.959725  9048 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:05.961148  9089 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:05.963063 16627 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:05.963721 16802 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:05.964404 16802 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:05.960209 16370 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.021080 16661 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.021903 16661 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:06.023975 16594 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:05.995638 16740 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.032874 16746 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.033560  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1872) took 3762 ms. Trace:
I20260925 16:46:06.033924  9116 rpcz_store.cc:276] 0925 16:46:02.271084 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.290074 (+ 18990us) service_pool.cc:227] Handling call
0925 16:46:02.290347 (+   273us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:02.728723 (+438376us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:02.728761 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:02.728799 (+    38us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:02.728826 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.033350 (+3304524us) spinlock_profiling.cc:243] Waited 438 ms on lock 0x7b540009f454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:06.033394 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.033509 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1007713024}
I20260925 16:46:05.961263 16599 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:06.003232 16713 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:05.990983 16582 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:05.983450 16622 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:06.005882 16706 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.007504 16745 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.009721 16308 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.035145  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:06.037931  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87935us
I20260925 16:46:06.046267  9116 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:06.046779  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:06.046926  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:06.048671  9014 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:06.047113  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.058868 16308 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:06.059352 16701 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.463s	user 0.002s	sys 0.003s
I20260925 16:46:06.059559 16308 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:46:06.060865 16308 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:06.061796 16308 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:06.042522 16622 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:06.063504 16713 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:06.064042 16582 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:06.070322 16622 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:06.082778  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.084112  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.084682  9122 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:06.086303  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2212) took 1801 ms. Trace:
I20260925 16:46:06.087038  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:06.092136 16208 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.092617 16208 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:06.086802  9701 rpcz_store.cc:276] 0925 16:46:04.284624 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.608295 (+1323671us) service_pool.cc:227] Handling call
0925 16:46:05.608613 (+   318us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.683580 (+ 74967us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:46:05.855115 (+171535us) log.cc:842] Serialized 14 byte log entry
0925 16:46:05.970559 (+115444us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.970630 (+    71us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:05.970688 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.086019 (+115331us) spinlock_profiling.cc:243] Waited 74.7 ms on lock 0x7b540053e8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:06.086083 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.086237 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":36859,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":12410,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":9431,"spinlock_wait_cycles":171788672,"thread_start_us":278150,"threads_started":2,"wal-append.queue_time_us":194067}
I20260925 16:46:06.094480  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:06.095790  9701 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:06.097972  9122 raft_consensus.cc:2354] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22.
I20260925 16:46:06.077232 16713 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.099246 16713 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:06.100073 16706 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:06.100386  9702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1615) took 3783 ms (client timeout 1621 ms). Trace:
W20260925 16:46:06.100831  9702 rpcz_store.cc:269] 0925 16:46:02.316807 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.830059 (+513252us) service_pool.cc:227] Handling call
0925 16:46:06.100224 (+3270165us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54004a0e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:06.100327 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":396398336}
I20260925 16:46:06.101329  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:06.101872  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.102439  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1909) took 2931 ms. Trace:
I20260925 16:46:06.103005  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3795) took 1167 ms. Trace:
I20260925 16:46:06.100881 16585 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.103581  9050 rpcz_store.cc:276] 0925 16:46:04.935603 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.935890 (+   287us) service_pool.cc:227] Handling call
0925 16:46:04.946300 (+ 10410us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.110530 (+164230us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.102802 (+992272us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b54001af754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:06.102958 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":346462592}
I20260925 16:46:06.105412 16585 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.105265 16639 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:06.107369  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 473745us
W20260925 16:46:06.108286  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1619) took 3260 ms (client timeout 1685 ms). Trace:
W20260925 16:46:06.108639  9694 rpcz_store.cc:269] 0925 16:46:02.848095 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.352550 (+504455us) service_pool.cc:227] Handling call
0925 16:46:06.108113 (+2755563us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:06.108230 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":817390976}
I20260925 16:46:06.109582  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.110155  9694 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:06.101913  9048 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:06.111121  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:06.111001  9698 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:06.102855  9695 rpcz_store.cc:276] 0925 16:46:03.170750 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.143821 (+1973071us) service_pool.cc:227] Handling call
0925 16:46:06.101162 (+957341us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.101371 (+   209us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.101400 (+    29us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:06.101444 (+    44us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:06.101478 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.101532 (+    54us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.102236 (+   704us) spinlock_profiling.cc:243] Waited 957 ms on lock 0x7b54004a0e50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:06.102373 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2200867200}
I20260925 16:46:06.113806  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:06.102473  9702 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:06.113394  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:06.115314  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.117197  9701 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:06.119184  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.119930  9702 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:06.116477  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:06.124495  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:06.077924 16582 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:06.126965  9701 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260925 16:46:06.127769  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1925) took 1218 ms. Trace:
I20260925 16:46:06.128159  9701 rpcz_store.cc:276] 0925 16:46:04.909482 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.119067 (+1209585us) service_pool.cc:227] Handling call
0925 16:46:06.119477 (+   410us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.127440 (+  7963us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.127679 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:06.107905 16639 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.134110  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:06.134903  9050 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:06.131358 16732 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260925 16:46:06.298745  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 189119us
I20260925 16:46:06.132830 16802 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.310086  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:06.301337  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:06.125730 16806 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:06.135794 16599 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:06.321653  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1458) took 2883 ms. Trace:
I20260925 16:46:06.316666  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:06.297235 16746 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:06.296572 16733 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.304311 16732 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:06.330757  9047 rpcz_store.cc:276] 0925 16:46:03.438726 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:03.638035 (+199309us) service_pool.cc:227] Handling call
0925 16:46:03.651186 (+ 13151us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:03.677899 (+ 26713us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:03.677931 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:03.677971 (+    40us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:03.677999 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.321436 (+2643437us) spinlock_profiling.cc:243] Waited 26.5 ms on lock 0x7b54000bf4d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:06.321483 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.321601 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":61020416}
W20260925 16:46:06.328302 16810 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.004s
I20260925 16:46:06.315330 16632 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:06.304592 16701 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.181s	user 0.000s	sys 0.010s
I20260925 16:46:06.329404  9048 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:06.336972  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:06.269536 16773 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.052s
I20260925 16:46:06.305946 16661 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:06.331004  9046 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:06.305374 16612 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.295328 16370 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.346637  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3694) took 1592 ms. Trace:
I20260925 16:46:06.353192 16786 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:06.331964 16599 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:06.374379  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:06.342211 16732 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:06.383056  9124 rpcz_store.cc:276] 0925 16:46:04.754681 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.754824 (+   143us) service_pool.cc:227] Handling call
0925 16:46:04.755131 (+   307us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.768098 (+ 12967us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:04.768142 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:04.768195 (+    53us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:04.768238 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.346388 (+1578150us) spinlock_profiling.cc:243] Waited 12.7 ms on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:06.346441 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.346577 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":29260032}
I20260925 16:46:06.343643 16816 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:06.316231 16709 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.055s
I20260925 16:46:06.342249 16733 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.356922 16632 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.329260 16582 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.407389 16816 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:06.392300 16599 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:06.403949  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3274) took 4057 ms. Trace:
I20260925 16:46:06.439397  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1926) took 1371 ms. Trace:
I20260925 16:46:06.396710 16777 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.043s
I20260925 16:46:06.387600 16612 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.393606 16661 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.394292 16370 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.443893  8968 rpcz_store.cc:276] 0925 16:46:02.346119 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.480213 (+134094us) service_pool.cc:227] Handling call
0925 16:46:02.508116 (+ 27903us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:02.534062 (+ 25946us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:02.534099 (+    37us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:03.388559 (+854460us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:03.389239 (+   680us) log.cc:842] Serialized 52 byte log entry
0925 16:46:03.556731 (+167492us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:03.582836 (+ 26105us) log.cc:842] Serialized 14 byte log entry
0925 16:46:03.583045 (+   209us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:03.583116 (+    71us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:06.058815 (+2475699us) spinlock_profiling.cc:243] Waited 3.11 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:06.403564 (+344749us) raft_consensus.cc:1671] finished
0925 16:46:06.403596 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.403857 (+   261us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":16583,"prepare.queue_time_us":26374,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":38,"raft.queue_time_us":46718,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":4506,"spinlock_wait_cycles":11695232,"thread_start_us":167048,"threads_started":1,"wal-append.queue_time_us":206159}
I20260925 16:46:06.426118 16802 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:06.373262  9014 leader_election.cc:398] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22.
I20260925 16:46:06.481779  9014 leader_election.cc:401] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
I20260925 16:46:06.460412  9702 rpcz_store.cc:276] 0925 16:46:05.067599 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.131042 (+1063443us) service_pool.cc:227] Handling call
0925 16:46:06.131525 (+   483us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.131805 (+   280us) raft_consensus.cc:1520] Early marking committed up to index 19
0925 16:46:06.292094 (+160289us) log.cc:842] Serialized 14 byte log entry
0925 16:46:06.437917 (+145823us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:06.437970 (+    53us) raft_consensus.cc:1631] Marking committed up to 19
0925 16:46:06.438020 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.438674 (+   654us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.439340 (+   666us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":636,"prepare.queue_time_us":160479,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":1739,"raft.queue_time_us":107,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":5914,"thread_start_us":145168,"threads_started":1}
W20260925 16:46:06.501868  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 145701us
I20260925 16:46:06.455634 16582 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:06.444411 16816 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:06.480464  9048 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:06.474938  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:46:06.479031 16746 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:06.505035 16788 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.479880 16820 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.501675 16786 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:06.509732 16815 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.155s	user 0.000s	sys 0.001s
I20260925 16:46:06.480288  9694 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:46:06.543773  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.544546  9694 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:06.510499  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55351.7us
I20260925 16:46:06.544395  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:06.545599  8940 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:06.511605  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1927) took 1212 ms. Trace:
I20260925 16:46:06.508697 16583 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:06.483860 16635 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:06.443490  9050 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:06.517354  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.523864  9089 leader_election.cc:398] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:06.553977  9089 leader_election.cc:401] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:06.509153 16812 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22.
I20260925 16:46:06.501019 16802 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.555356  9050 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:06.557125  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:06.558202  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:06.549047  9695 rpcz_store.cc:276] 0925 16:46:05.298750 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.132005 (+833255us) service_pool.cc:227] Handling call
0925 16:46:06.132386 (+   381us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:06.274907 (+142521us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.274954 (+    47us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:06.302324 (+ 27370us) log.cc:842] Serialized 26 byte log entry
0925 16:46:06.450034 (+147710us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:06.501549 (+ 51515us) log.cc:842] Serialized 14 byte log entry
0925 16:46:06.503404 (+  1855us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.503476 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:06.511360 (+  7884us) raft_consensus.cc:1671] finished
0925 16:46:06.511382 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.511502 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":13648,"prepare.queue_time_us":51317,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":2529,"raft.queue_time_us":122220,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":11307,"thread_start_us":111992,"threads_started":1,"wal-append.queue_time_us":194523}
I20260925 16:46:06.552132 16308 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:46:06.561195 16794 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:06.561859  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.561717 16794 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.563078  9702 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:06.543629 16132 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:06.548089 16557 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.567801  9702 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:06.573400  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:06.575160  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:06.598991  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:06.576498  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:06.564163  9694 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:06.575791  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:06.601228  9694 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1636) took 1188 ms. Trace:
I20260925 16:46:06.601580  9694 rpcz_store.cc:276] 0925 16:46:05.412399 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.545215 (+1132816us) service_pool.cc:227] Handling call
0925 16:46:06.564004 (+ 18789us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.601020 (+ 37016us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.601181 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:06.602648  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:06.547447 16544 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.608672  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:06.580225  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:06.636505  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:06.637950  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44714.6us
I20260925 16:46:06.571940 16591 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.651041  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:06.653064  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:06.654048  8971 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 23: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:46:06.640610  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60455.1us
I20260925 16:46:06.654685  8968 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 18. Ops: []
I20260925 16:46:06.553086 16822 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:06.571844 16800 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:06.552901 16635 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:06.656142  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3710) took 1116 ms. Trace:
I20260925 16:46:06.600144 16583 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:06.598677 16565 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 18
I20260925 16:46:06.706459 16583 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.660135  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.709489  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.709689 16812 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.710276 16812 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.712282 16812 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.714238 16610 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:06.714634 16610 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:46:06.716301  9696 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1608) took 4419 ms (client timeout 1764 ms). Trace:
I20260925 16:46:06.716523  9697 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260925 16:46:06.716697  9696 rpcz_store.cc:269] 0925 16:46:02.297147 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:02.314590 (+ 17443us) service_pool.cc:227] Handling call
0925 16:46:06.716076 (+4401486us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b540071e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:06.716219 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1640782080}
I20260925 16:46:06.717133  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1900) took 4595 ms. Trace:
I20260925 16:46:06.717494  9700 rpcz_store.cc:276] 0925 16:46:02.122030 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.146664 (+2024634us) service_pool.cc:227] Handling call
0925 16:46:05.508019 (+1361355us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.550661 (+ 42642us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.716962 (+1166301us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54006eebd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:06.717083 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3079341440}
I20260925 16:46:06.717904  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.719273  9696 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:06.717947  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.585427 16802 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.607177 16594 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.585943 16733 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:06.571219 16051 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:06.522748 16820 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.663115  9120 rpcz_store.cc:276] 0925 16:46:05.539594 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.949553 (+409959us) service_pool.cc:227] Handling call
0925 16:46:05.957433 (+  7880us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:05.975433 (+ 18000us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.975478 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:05.976009 (+   531us) log.cc:842] Serialized 26 byte log entry
0925 16:46:06.129225 (+153216us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:06.129282 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.129412 (+   130us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:06.655935 (+526523us) raft_consensus.cc:1671] finished
0925 16:46:06.655954 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.656077 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12815,"raft.queue_time_us":13211,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":7226,"thread_start_us":104021,"threads_started":1,"wal-append.queue_time_us":316436}
I20260925 16:46:06.650718 16544 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.014s
I20260925 16:46:06.519683 16788 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.546062 16786 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.666458  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3811) took 1058 ms. Trace:
I20260925 16:46:06.667246 16393 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:06.667817 16829 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:06.574048 16557 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.572501 16612 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.650780 16591 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.668604 16607 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:06.669863 16713 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.568s	user 0.004s	sys 0.003s
W20260925 16:46:06.671834 16814 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.140s	user 0.001s	sys 0.001s
I20260925 16:46:06.571811 16727 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.101s
W20260925 16:46:06.672163 16797 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.009s	sys 0.001s
I20260925 16:46:06.660097 16800 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.563663 16794 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.656415 16106 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
I20260925 16:46:06.778576 16607 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.788785 16607 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.673689  9048 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 16. (term mismatch)
I20260925 16:46:06.674078 16635 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.790438  9048 pending_rounds.cc:76] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 15
I20260925 16:46:06.790742  9048 pending_rounds.cc:97] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260925 16:46:06.790835 16635 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:06.768584 16308 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:06.792181 16308 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.784231 16795 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.680028  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:06.684361 16816 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.796278  8968 raft_consensus.cc:2379] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:06.683109  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:06.797269 16816 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.686125 16732 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.799111 16732 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.688154 16540 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:06.692050 16825 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:06.577821 16632 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:06.693324 16370 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.693517 16512 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.799901 16540 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.800688 16512 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.802139 16540 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.688107  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.802811 16512 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.803711 16512 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.803841  9694 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:46:06.697278 16599 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:06.702178 16622 consensus_meta.cc:287] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.605s	user 0.005s	sys 0.002s
I20260925 16:46:06.804805 16622 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.805683 16557 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.805773 16599 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.784394 16733 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:06.806820 16733 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.807150 16622 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.694736 16661 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.578284 16208 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.808652 16733 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.809679 16208 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:06.810618  9116 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:06.655344 16746 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.810861 16565 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:06.572052 16132 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.722493  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:06.723450  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:06.815339  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 91984.9us
I20260925 16:46:06.572171 16055 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:06.729857  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:06.827148  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 97407.9us
I20260925 16:46:06.737186  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:06.569461 16784 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:06.752431  9042 rpcz_store.cc:276] 0925 16:46:05.607610 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.607782 (+   172us) service_pool.cc:227] Handling call
0925 16:46:06.666282 (+1058500us) spinlock_profiling.cc:243] Waited 90.1 ms on lock 0x7b54002b6bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:06.666405 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":207186816}
I20260925 16:46:06.770581  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.715364 16610 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.778780 16612 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.791006  9048 raft_consensus.cc:2866] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:06.832741 16599 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:06.795112 16795 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.833258 16599 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:06.833000 16612 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.833726 16599 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:06.834930 16795 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:06.563833 16818 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260925 16:46:06.811930  8970 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:06.750737 16802 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
W20260925 16:46:06.720098 16790 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.005s	user 0.007s	sys 0.000s
I20260925 16:46:06.835788  9120 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:06.812033  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3713) took 1218 ms. Trace:
I20260925 16:46:06.836447  9122 rpcz_store.cc:276] 0925 16:46:05.593168 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.383449 (+790281us) service_pool.cc:227] Handling call
0925 16:46:06.386714 (+  3265us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.449671 (+ 62957us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.449702 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:06.449740 (+    38us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:06.449768 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.811792 (+362024us) spinlock_profiling.cc:243] Waited 62.8 ms on lock 0x7b54001ee1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:06.811852 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.811982 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":144362240}
I20260925 16:46:06.837905  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.838404  9696 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:06.756887 16393 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:06.839462  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3799) took 1883 ms. Trace:
I20260925 16:46:06.835050 16612 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:06.785627 16800 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:06.838088  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1628) took 1742 ms. Trace:
I20260925 16:46:06.750375 16051 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.778380 16812 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:06.850229 16812 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:06.850665 16820 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:06.851107 16812 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.839835  9049 rpcz_store.cc:276] 0925 16:46:04.955793 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.956025 (+   232us) service_pool.cc:227] Handling call
0925 16:46:04.968063 (+ 12038us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:04.978506 (+ 10443us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:04.978551 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:04.983066 (+  4515us) log.cc:842] Serialized 26 byte log entry
0925 16:46:05.531314 (+548248us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b180037bee0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:46:05.677537 (+146223us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:05.677574 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.677639 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:06.719400 (+1041761us) spinlock_profiling.cc:243] Waited 11.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:06.839236 (+119836us) raft_consensus.cc:1671] finished
0925 16:46:06.839265 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.839400 (+   135us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":9983,"raft.queue_time_us":14238,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":7785,"spinlock_wait_cycles":33840256,"thread_start_us":146051,"threads_started":1,"wal-append.queue_time_us":731183}
I20260925 16:46:06.751410 16709 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.061s
I20260925 16:46:06.854172 16795 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:46:06.785473 16829 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:06.749864 16594 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.848047  8974 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 15: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:06.846728  9701 rpcz_store.cc:276] 0925 16:46:05.095891 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.163013 (+1067122us) service_pool.cc:227] Handling call
0925 16:46:06.272644 (+109631us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:06.295921 (+ 23277us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.295955 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:06.302200 (+  6245us) log.cc:842] Serialized 26 byte log entry
0925 16:46:06.659062 (+356862us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:06.659103 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.659162 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:06.837899 (+178737us) raft_consensus.cc:1671] finished
0925 16:46:06.837917 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:06.838027 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":22779,"raft.queue_time_us":23375,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":6752,"thread_start_us":356596,"threads_started":1,"wal-append.queue_time_us":476604}
I20260925 16:46:06.860020  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.861304  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:06.861801  9701 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:06.838783 16622 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:06.847289  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:06.849840 16802 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:06.842839  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:06.839247 16661 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:06.862867  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.663452 16822 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.856539 16610 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:06.804324 16512 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:06.780076 16713 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:06.876034  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 309374us
I20260925 16:46:06.868945  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:06.843786 16784 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.845691 16055 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:06.867393 16802 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:06.939103  9701 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:06.878418  9124 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 14.
I20260925 16:46:07.043674  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:06.879637  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:06.950503 16776 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:06.983716 16565 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:07.046988 16776 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:07.047582  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.047305 16565 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.048251  9696 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:46:07.049263  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:06.984846 16607 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.050100 16607 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.053133  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:06.989487  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.600s (SENT) [suppressed 12 similar messages]
I20260925 16:46:07.056155  8941 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:07.057655 16557 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:07.058100 16557 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:07.058493 16557 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:07.047909 16776 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.065102 16776 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:07.053294 16607 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.032912 16132 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.087682 16565 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:07.088239  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 147588us
W20260925 16:46:07.088593 16702 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 3.494s	user 0.004s	sys 0.012s
I20260925 16:46:05.902678  9693 rpcz_store.cc:276] 0925 16:46:03.649155 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.596534 (+1947379us) service_pool.cc:227] Handling call
0925 16:46:05.621127 (+ 24593us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.621307 (+   180us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:46:05.688828 (+ 67521us) log.cc:842] Serialized 14 byte log entry
0925 16:46:05.885110 (+196282us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.885156 (+    46us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:05.885196 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.885253 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:05.885355 (+   102us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":98973,"prepare.run_cpu_time_us":24,"prepare.run_wall_time_us":24,"raft.queue_time_us":15500,"thread_start_us":250206,"threads_started":2}
I20260925 16:46:07.089664 16825 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:07.098647 16825 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:07.091125  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.114318 16055 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:07.137012 16451 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:07.137655 16451 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.159366 16055 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.186967 16055 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.190086  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:07.192309 16623 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:07.192893 16623 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:07.193931 16623 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.198040 16795 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:07.198701 16795 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.175905  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.183216  9693 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: [18.15-18.15]
I20260925 16:46:07.206622 16776 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:07.208150 16794 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:07.208865 16794 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.121307  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.228611  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.235954  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:07.237598  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 354738us
W20260925 16:46:06.876780  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 318668us
I20260925 16:46:07.245127  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.250339  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.249462  9047 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:06.868789 16622 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:07.230877 16384 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260925 16:46:06.879880 16834 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.262920  9043 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:07.267904  9693 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260925 16:46:07.239462  9122 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
W20260925 16:46:07.284929  9700 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.009s	sys 0.021s
I20260925 16:46:07.275044  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:07.285375  9700 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.566s	user 0.010s	sys 0.021s
W20260925 16:46:07.266516  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 213468us
I20260925 16:46:07.286226  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:07.295209  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.324435  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.325224  9043 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:07.329167  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.331486  9122 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:07.332906  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1910) took 1636 ms. Trace:
I20260925 16:46:07.333225  9122 rpcz_store.cc:276] 0925 16:46:05.696193 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.319837 (+1623644us) service_pool.cc:227] Handling call
0925 16:46:07.320157 (+   320us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:07.332678 (+ 12521us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.332859 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:07.240257 16540 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
I20260925 16:46:07.345291  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1911) took 1646 ms. Trace:
I20260925 16:46:07.345724  9122 rpcz_store.cc:276] 0925 16:46:05.698515 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.334043 (+1635528us) service_pool.cc:227] Handling call
0925 16:46:07.344681 (+ 10638us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:07.344903 (+   222us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:07.344939 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:07.344992 (+    53us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:07.345041 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.345104 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.345230 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:07.348090  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.350389  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.351238  9049 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:07.273486 16612 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.283917 16806 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260925 16:46:07.397202  9702 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.593s	user 0.030s	sys 0.066s
W20260925 16:46:07.404166  9702 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.600s	user 0.034s	sys 0.066s
I20260925 16:46:07.408434  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.410192  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.372202 16786 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:07.413192  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.000s	sys 0.021s
W20260925 16:46:07.420682  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.001s	sys 0.022s
W20260925 16:46:07.397668  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64597.6us
W20260925 16:46:07.378202  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.723s	user 0.007s	sys 0.045s
I20260925 16:46:07.331619 16661 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:07.369917 16813 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260925 16:46:07.376819 16385 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.347237 16589 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:07.331203 16835 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
W20260925 16:46:07.374037 16702 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260925 16:46:07.352392 16601 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:07.370725 16132 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:07.437362  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 447715us
W20260925 16:46:07.446733  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.008s	sys 0.045s
W20260925 16:46:07.494602  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 839811us
I20260925 16:46:07.434949  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:07.446534  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:07.378379 16451 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:07.516839 16594 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.517884 16055 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.265748 16829 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.522396 16622 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.525029 16713 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.526717 16784 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:07.440631 16557 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.480396 16840 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:07.381484 16788 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.321020 16834 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:07.448558 16830 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.600s	user 0.000s	sys 0.001s
I20260925 16:46:07.489166  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.489267  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:07.435279 16583 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.587s	user 0.022s	sys 0.043s
I20260925 16:46:07.492748  9693 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:07.496812  9049 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:07.424569 16794 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.400436 16612 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.497913 16835 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:07.497840 16385 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:07.499230 16822 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.500164 16393 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.504952 16512 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:07.505381 16601 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.505647 16757 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.459499 16703 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:07.507773 16051 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.508140 16132 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.489806 16589 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.581212  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3709) took 2045 ms. Trace:
W20260925 16:46:07.581808  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 247488us
I20260925 16:46:07.512178 16608 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.380393 16806 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.509770  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3706) took 2063 ms. Trace:
I20260925 16:46:07.586697  9115 rpcz_store.cc:276] 0925 16:46:05.446735 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.778863 (+332128us) service_pool.cc:227] Handling call
0925 16:46:05.779082 (+   219us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.910384 (+131302us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.509556 (+1599172us) spinlock_profiling.cc:243] Waited 131 ms on lock 0x7b5400165654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.509716 (+   160us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":300418944}
I20260925 16:46:07.581737  9123 rpcz_store.cc:276] 0925 16:46:05.535879 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.930095 (+394216us) service_pool.cc:227] Handling call
0925 16:46:05.930548 (+   453us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:05.948810 (+ 18262us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:46:05.957201 (+  8391us) log.cc:842] Serialized 14 byte log entry
0925 16:46:06.074712 (+117511us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:07.237660 (+1162948us) spinlock_profiling.cc:243] Waited 1.16 ms on lock 0x7b2c000d80e8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:07.238040 (+   380us) log.cc:842] Serialized 26 byte log entry
0925 16:46:07.238198 (+   158us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:07.238233 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.238312 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.576330 (+338018us) raft_consensus.cc:1671] finished
0925 16:46:07.581007 (+  4677us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.581144 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":9763,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":2158,"raft.queue_time_us":192,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":2253,"spinlock_wait_cycles":2662144,"thread_start_us":113950,"threads_started":1,"wal-append.queue_time_us":175735}
I20260925 16:46:07.588229  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:07.588585  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:07.397334 16591 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.531365 16557 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.344131 16802 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.560763  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.561025  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.594563  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:07.479732 16661 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:07.557830 16583 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.711s	user 0.022s	sys 0.044s
W20260925 16:46:07.552194 16308 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.024s	sys 0.042s
I20260925 16:46:07.577880  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:07.509773 16841 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:07.580140  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:07.510589 16774 log.cc:924] Time spent T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.068s	user 0.012s	sys 0.003s
I20260925 16:46:07.614763  9693 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:07.614665  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:07.588975  9115 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:07.615837  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:07.592305  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:07.578619 16822 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:07.604441 16308 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.751s	user 0.024s	sys 0.042s
I20260925 16:46:07.608608  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:07.604555 16565 consensus_queue.cc:1159] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 17 status { last_received { term: 15 index: 13 } last_committed_idx: 13 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: [16.14-16.14]" } } last_received_current_leader { term: 0 index: 0 } }
W20260925 16:46:07.609712 16765 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.369s	user 0.000s	sys 0.018s
I20260925 16:46:07.609972 16583 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:07.609937  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:07.613960 16610 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.740s	user 0.005s	sys 0.002s
I20260925 16:46:07.611194 16132 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:07.558019 16845 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:07.585860 16703 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.600744 16757 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:07.627333  9115 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:46:07.627652  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.645174  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.645373  9696 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:07.646013  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:07.646747  9115 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:07.590420 16806 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:07.603399 16393 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:07.604794 16795 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.553498 16840 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.632259  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3685) took 3069 ms. Trace:
I20260925 16:46:07.648336  9117 rpcz_store.cc:276] 0925 16:46:04.562980 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.563887 (+   907us) service_pool.cc:227] Handling call
0925 16:46:04.564413 (+   526us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:04.715430 (+151017us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.632004 (+2916574us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400142b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.632171 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":345777920}
I20260925 16:46:07.609712 16834 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.609881 16589 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.594053 16608 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.633288 16583 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.635308 16794 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:07.663270  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.666647  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.666365  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.674556 16743 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.635000 16835 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:07.679015 16837 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
I20260925 16:46:07.633945 16822 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.663429 16583 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:07.662796 16794 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:07.668166 16858 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:07.644762 16845 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:07.722554 16822 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.718483 16794 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:07.719682 16825 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.619s	user 0.011s	sys 0.000s
I20260925 16:46:07.740041 16825 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:07.756830 16851 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
W20260925 16:46:07.765054 16854 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.095s	user 0.000s	sys 0.001s
I20260925 16:46:07.765113 16840 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:07.765882 16844 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.272s	user 0.000s	sys 0.008s
W20260925 16:46:07.766013 16850 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
W20260925 16:46:07.761108 16849 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260925 16:46:07.767087 16845 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.511526  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:07.509320  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62879.9us
I20260925 16:46:07.804704  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1542) took 2721 ms. Trace:
I20260925 16:46:07.805317  8967 rpcz_store.cc:276] 0925 16:46:05.083075 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.085070 (+  1995us) service_pool.cc:227] Handling call
0925 16:46:05.085390 (+   320us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:05.085582 (+   192us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.085608 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:05.086010 (+   402us) log.cc:842] Serialized 26 byte log entry
0925 16:46:05.154861 (+ 68851us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:05.154907 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:05.154986 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.609167 (+2454181us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:07.803526 (+194359us) raft_consensus.cc:1671] finished
0925 16:46:07.803619 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.804374 (+   755us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2761600,"thread_start_us":68491,"threads_started":1,"wal-append.queue_time_us":114918}
I20260925 16:46:07.813158  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1480) took 1212 ms. Trace:
I20260925 16:46:07.814913  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3316) took 1237 ms. Trace:
I20260925 16:46:07.813694  9045 rpcz_store.cc:276] 0925 16:46:06.600245 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.600510 (+   265us) service_pool.cc:227] Handling call
0925 16:46:06.600877 (+   367us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:06.601221 (+   344us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.601260 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:06.601758 (+   498us) log.cc:842] Serialized 26 byte log entry
0925 16:46:06.879664 (+277906us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:06.879734 (+    70us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.879803 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.765317 (+885514us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:07.812265 (+ 46948us) raft_consensus.cc:1671] finished
0925 16:46:07.812315 (+    50us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.812819 (+   504us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":86665,"raft.run_cpu_time_us":59,"raft.run_wall_time_us":58,"spinlock_wait_cycles":68063104,"thread_start_us":228738,"threads_started":1,"wal-append.queue_time_us":739041}
I20260925 16:46:07.818586  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3317) took 1241 ms. Trace:
W20260925 16:46:07.824669  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 364110us
I20260925 16:46:07.825104  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3312) took 1250 ms. Trace:
I20260925 16:46:07.825621  8973 rpcz_store.cc:276] 0925 16:46:06.574310 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.579250 (+  4940us) service_pool.cc:227] Handling call
0925 16:46:06.579514 (+   264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.782354 (+202840us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.782399 (+    45us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:06.782453 (+    54us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:06.782496 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.824586 (+1042090us) spinlock_profiling.cc:243] Waited 203 ms on lock 0x7b540020e754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.824664 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.824936 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":465952128}
I20260925 16:46:07.815479  8972 rpcz_store.cc:276] 0925 16:46:06.576874 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.582105 (+  5231us) service_pool.cc:227] Handling call
0925 16:46:06.582389 (+   284us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.811958 (+229569us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.811994 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:06.812035 (+    41us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:06.812066 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.814199 (+1002133us) spinlock_profiling.cc:243] Waited 229 ms on lock 0x7b54003570d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.814309 (+   110us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.814636 (+   327us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":527487232}
I20260925 16:46:07.819113  8969 rpcz_store.cc:276] 0925 16:46:06.577325 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.577435 (+   110us) service_pool.cc:227] Handling call
0925 16:46:06.577705 (+   270us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.938358 (+360653us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.938388 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:06.938427 (+    39us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:06.938455 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.817934 (+879479us) spinlock_profiling.cc:243] Waited 360 ms on lock 0x7b54001c4b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.818038 (+   104us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.818371 (+   333us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":829016960}
I20260925 16:46:07.829728  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:07.834683  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3821) took 1257 ms. Trace:
I20260925 16:46:07.835108  9050 rpcz_store.cc:276] 0925 16:46:06.576691 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.592341 (+ 15650us) service_pool.cc:227] Handling call
0925 16:46:06.640149 (+ 47808us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:06.878510 (+238361us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.878543 (+    33us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:06.899310 (+ 20767us) log.cc:842] Serialized 52 byte log entry
0925 16:46:07.426244 (+526934us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:07.833419 (+407175us) log.cc:842] Serialized 14 byte log entry
0925 16:46:07.833910 (+   491us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.834056 (+   146us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.834151 (+    95us) raft_consensus.cc:1671] finished
0925 16:46:07.834173 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.834489 (+   316us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":101934,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":29,"raft.queue_time_us":47578,"raft.run_cpu_time_us":48,"raft.run_wall_time_us":47,"thread_start_us":1076538,"threads_started":3,"wal-append.queue_time_us":640646}
I20260925 16:46:06.508899  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:07.840718  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1482) took 1206 ms. Trace:
I20260925 16:46:07.841331  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:07.841188  9048 rpcz_store.cc:276] 0925 16:46:06.634608 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.634735 (+   127us) service_pool.cc:227] Handling call
0925 16:46:06.660048 (+ 25313us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.833279 (+173231us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.840140 (+1006861us) spinlock_profiling.cc:243] Waited 13.2 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.840521 (+   381us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30425344}
I20260925 16:46:07.843078  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:07.798900  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 287234us
W20260925 16:46:07.852913  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 49658us
I20260925 16:46:07.881162  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:07.881538  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:07.858861  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1920) took 1872 ms. Trace:
I20260925 16:46:07.884017  9116 rpcz_store.cc:276] 0925 16:46:05.986388 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.046912 (+ 60524us) service_pool.cc:227] Handling call
0925 16:46:07.858265 (+1811353us) spinlock_profiling.cc:243] Waited 759 ms on lock 0x7b540019c3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:07.858636 (+   371us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1745506560}
I20260925 16:46:07.886348  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:07.860297  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3986) took 1137 ms. Trace:
I20260925 16:46:07.888010  9120 rpcz_store.cc:276] 0925 16:46:06.723029 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.751170 (+ 28141us) service_pool.cc:227] Handling call
0925 16:46:07.859926 (+1108756us) spinlock_profiling.cc:243] Waited 3.8 ms on lock 0x7b54001c9154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:07.860134 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8736640}
I20260925 16:46:07.888451  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:07.861392  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1908) took 2165 ms. Trace:
I20260925 16:46:07.889379  9124 rpcz_store.cc:276] 0925 16:46:05.695535 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.044861 (+1349326us) service_pool.cc:227] Handling call
0925 16:46:07.045237 (+   376us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:07.045655 (+   418us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:07.045689 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:07.046211 (+   522us) log.cc:842] Serialized 26 byte log entry
0925 16:46:07.438685 (+392474us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:07.438740 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.438830 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.860851 (+422021us) raft_consensus.cc:1671] finished
0925 16:46:07.860906 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.861194 (+   288us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5141,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":96,"thread_start_us":392086,"threads_started":1,"wal-append.queue_time_us":532941}
I20260925 16:46:07.890921  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:07.862130  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.820631  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.656426  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:07.893782  9117 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:07.894838  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:07.865409  9118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 3960) took 2338 ms (client timeout 2061 ms). Trace:
W20260925 16:46:07.896320  9118 rpcz_store.cc:269] 0925 16:46:05.527072 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.623136 (+ 96064us) service_pool.cc:227] Handling call
0925 16:46:07.864933 (+2241797us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b5400144454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:07.865155 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":727572224}
I20260925 16:46:07.866600  9122 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:07.898527  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:07.899358  9116 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:07.867985  9119 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:07.900943  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:07.901671  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3970) took 2356 ms. Trace:
I20260925 16:46:07.910331  9694 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:07.902058  9119 rpcz_store.cc:276] 0925 16:46:05.545688 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.090831 (+545143us) service_pool.cc:227] Handling call
0925 16:46:07.867442 (+1776611us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:07.900140 (+ 32698us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.901376 (+  1236us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400144450. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:07.901555 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4084793216}
I20260925 16:46:07.915205  9694 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:46:07.922286  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:07.922725  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:07.924438 16833 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:07.924607 16822 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:07.925040 16833 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.925699 16833 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:07.918748  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1914) took 2134 ms. Trace:
I20260925 16:46:07.927343 16610 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:07.925577 16822 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.930719 16610 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.931770 16608 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.932534 16834 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:07.933045 16834 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.933092 16822 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.933576 16834 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:07.700476 16612 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:07.937078 16703 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:07.938326 16604 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:07.938786 16604 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.939218 16604 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:07.939971  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:07.934084  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2218) took 2115 ms. Trace:
I20260925 16:46:07.941002  8974 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:07.941468  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1477) took 1389 ms. Trace:
I20260925 16:46:07.942539 16132 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:07.943452 16132 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:07.945034 16132 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:07.942554 16308 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260925 16:46:07.946074  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46432us
I20260925 16:46:07.946364 16308 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:07.946861 16308 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:07.923640  9702 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:07.929388  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:07.926491  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:07.928638  9122 rpcz_store.cc:276] 0925 16:46:05.784654 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.372271 (+1587617us) service_pool.cc:227] Handling call
0925 16:46:07.374005 (+  1734us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:07.898430 (+524425us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.899661 (+  1231us) spinlock_profiling.cc:243] Waited 492 ms on lock 0x7b54001a04d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:07.918666 (+ 19005us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1131493632}
I20260925 16:46:07.942103  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1930) took 1490 ms. Trace:
I20260925 16:46:07.925045  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:07.964536  8967 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:46:07.965720  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:07.967944 16862 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:07.968150 16840 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:07.968297 16846 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260925 16:46:07.968844  9701 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.711s	user 0.034s	sys 0.045s
I20260925 16:46:07.967243  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:07.968701 16840 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:07.960654  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:07.971069  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1921) took 1868 ms. Trace:
I20260925 16:46:07.970641  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1916) took 2157 ms. Trace:
I20260925 16:46:07.979355  9696 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:07.972671  9116 rpcz_store.cc:276] 0925 16:46:06.093691 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.900233 (+1806542us) service_pool.cc:227] Handling call
0925 16:46:07.900730 (+   497us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:07.901160 (+   430us) raft_consensus.cc:1520] Early marking committed up to index 15
0925 16:46:07.901538 (+   378us) log.cc:842] Serialized 14 byte log entry
0925 16:46:07.961274 (+ 59736us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:07.961337 (+    63us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:07.961504 (+   167us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.961594 (+    90us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.961741 (+   147us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":34163,"prepare.queue_time_us":7982,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":54,"raft.queue_time_us":41641,"thread_start_us":17788,"threads_started":1}
I20260925 16:46:07.975919  9117 rpcz_store.cc:276] 0925 16:46:05.803515 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.895402 (+2091887us) service_pool.cc:227] Handling call
0925 16:46:07.903066 (+  7664us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:07.953454 (+ 50388us) raft_consensus.cc:1520] Early marking committed up to index 16
0925 16:46:07.953485 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:07.960686 (+  7201us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:07.960741 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.960819 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.960955 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:07.903201 16601 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:07.985724 16771 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:07.956938  9700 rpcz_store.cc:276] 0925 16:46:06.451188 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.718381 (+267193us) service_pool.cc:227] Handling call
0925 16:46:06.718681 (+   300us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:07.285713 (+567032us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:07.285742 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:07.299276 (+ 13534us) log.cc:842] Serialized 26 byte log entry
0925 16:46:07.649906 (+350630us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:07.649944 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.650007 (+    63us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.928659 (+278652us) raft_consensus.cc:1671] finished
0925 16:46:07.941671 (+ 13012us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.941927 (+   256us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":83879,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"thread_start_us":784667,"threads_started":2,"wal-append.queue_time_us":391020}
I20260925 16:46:08.000586  9117 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 18. Ops: []
I20260925 16:46:08.001367  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3983) took 1498 ms. Trace:
I20260925 16:46:08.001724  9117 rpcz_store.cc:276] 0925 16:46:06.502910 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.999752 (+1496842us) service_pool.cc:227] Handling call
0925 16:46:08.000227 (+   475us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.001096 (+   869us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.001296 (+   200us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8064}
I20260925 16:46:07.972987 16846 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.003975 16846 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:07.974565 16840 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:07.995915  9701 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.791s	user 0.034s	sys 0.046s
I20260925 16:46:08.009603  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:07.941982  9046 rpcz_store.cc:276] 0925 16:46:06.551830 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.553475 (+  1645us) service_pool.cc:227] Handling call
0925 16:46:06.553818 (+   343us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:06.758478 (+204660us) raft_consensus.cc:1520] Early marking committed up to index 15
0925 16:46:07.323494 (+565016us) log.cc:842] Serialized 14 byte log entry
0925 16:46:07.817243 (+493749us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:07.818645 (+  1402us) log.cc:842] Serialized 52 byte log entry
0925 16:46:07.818917 (+   272us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:07.819437 (+   520us) log.cc:842] Serialized 14 byte log entry
0925 16:46:07.819656 (+   219us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:07.819863 (+   207us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.941088 (+121225us) raft_consensus.cc:1671] finished
0925 16:46:07.941112 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.941303 (+   191us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":19718,"prepare.queue_time_us":823540,"prepare.run_cpu_time_us":88,"prepare.run_wall_time_us":90,"raft.queue_time_us":243840,"raft.run_cpu_time_us":574,"raft.run_wall_time_us":46722,"spinlock_wait_cycles":1009408,"thread_start_us":1031122,"threads_started":3,"wal-append.queue_time_us":366025}
W20260925 16:46:08.010991  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43972.2us
I20260925 16:46:08.009922  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3984) took 1503 ms. Trace:
I20260925 16:46:08.014063  9117 rpcz_store.cc:276] 0925 16:46:06.503374 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.002677 (+1499303us) service_pool.cc:227] Handling call
0925 16:46:08.003103 (+   426us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.003499 (+   396us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.003536 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.003598 (+    62us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:08.003633 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.006514 (+  2881us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.006595 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:07.940748  9695 rpcz_store.cc:276] 0925 16:46:05.818272 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:06.559814 (+741542us) service_pool.cc:227] Handling call
0925 16:46:06.560215 (+   401us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:06.578466 (+ 18251us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:06.578497 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:06.578921 (+   424us) log.cc:842] Serialized 26 byte log entry
0925 16:46:06.859968 (+281047us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:06.860008 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:06.860069 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:07.678380 (+818311us) spinlock_profiling.cc:243] Waited 53.4 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:07.933416 (+255036us) raft_consensus.cc:1671] finished
0925 16:46:07.933460 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:07.933855 (+   395us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":17827,"raft.queue_time_us":18769,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":74,"spinlock_wait_cycles":122923904,"thread_start_us":280778,"threads_started":1,"wal-append.queue_time_us":770528}
I20260925 16:46:08.016635  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:08.018167 16851 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260925 16:46:08.020462  8974 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:08.025463 16610 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.027447 16661 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.028554 16771 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.035912  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:08.036428 16771 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:08.037496  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:08.039803  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117040us
I20260925 16:46:08.040473  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2200) took 5553 ms. Trace:
I20260925 16:46:08.041078 16825 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.041998  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1922) took 3475 ms. Trace:
I20260925 16:46:08.042418  9697 rpcz_store.cc:276] 0925 16:46:04.566685 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.753368 (+1186683us) service_pool.cc:227] Handling call
0925 16:46:06.716198 (+962830us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.716934 (+   736us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.041557 (+1324623us) spinlock_profiling.cc:243] Waited 939 ms on lock 0x7b540071e650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:08.041788 (+   231us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2159701888}
I20260925 16:46:08.049669  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.024170 16051 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.020s
I20260925 16:46:08.061151  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1922) took 1676 ms. Trace:
I20260925 16:46:08.064299  9116 rpcz_store.cc:276] 0925 16:46:06.385130 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.997729 (+1612599us) service_pool.cc:227] Handling call
0925 16:46:08.060093 (+ 62364us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.060585 (+   492us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.060633 (+    48us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.060708 (+    75us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:08.060742 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.060822 (+    80us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.061069 (+   247us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.062561  9696 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:46:08.040866  9698 rpcz_store.cc:276] 0925 16:46:02.486604 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:04.360372 (+1873768us) service_pool.cc:227] Handling call
0925 16:46:06.110848 (+1750476us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:06.124288 (+ 13440us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.040112 (+1915824us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b5400192650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:08.040282 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3936743168}
I20260925 16:46:08.076061  9697 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
W20260925 16:46:08.059624 16599 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.225s	user 0.011s	sys 0.004s
I20260925 16:46:08.087929  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.090430  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1924) took 3135 ms. Trace:
I20260925 16:46:08.090864  9699 rpcz_store.cc:276] 0925 16:46:04.909127 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.876034 (+966907us) service_pool.cc:227] Handling call
0925 16:46:05.925131 (+ 49097us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:05.995764 (+ 70633us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:05.995805 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:05.995859 (+    54us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:05.995900 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.044118 (+2048218us) spinlock_profiling.cc:243] Waited 70.4 ms on lock 0x7b540062f2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:08.044189 (+    71us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.044430 (+   241us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":161852160}
I20260925 16:46:08.102732  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1653) took 1242 ms. Trace:
I20260925 16:46:08.077520 16862 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.117580 16540 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.117888 16582 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.118155 16540 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.118584 16582 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.119875  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:08.120863 16610 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:08.121572 16610 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.124076  9116 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
W20260925 16:46:08.126175  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 283379us
I20260925 16:46:08.129559  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:08.129801 16838 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.130338 16838 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.096807 16661 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.132021  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.132465 16838 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.132200 16661 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.132994 16838 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.133565 16838 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.134310 16661 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.135289  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.103157  9701 rpcz_store.cc:276] 0925 16:46:06.860272 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.203134 (+342862us) service_pool.cc:227] Handling call
0925 16:46:07.203526 (+   392us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:07.204000 (+   474us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:07.204041 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:07.204538 (+   497us) log.cc:842] Serialized 26 byte log entry
0925 16:46:08.102241 (+897703us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:08.102352 (+   111us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.102434 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:08.102495 (+    61us) raft_consensus.cc:1671] finished
0925 16:46:08.102506 (+    11us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.102663 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":280195,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":8776,"thread_start_us":803111,"threads_started":1,"wal-append.queue_time_us":553195}
I20260925 16:46:08.155200  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:08.157105  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 60431.6us
I20260925 16:46:08.147450  9115 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:08.108295 16051 consensus_queue.cc:1225] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 25.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
W20260925 16:46:08.168987  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45641.9us
I20260925 16:46:08.156199  8967 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:08.176707 16838 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.176801 16540 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:08.179131 16871 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260925 16:46:08.178753 16583 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.179862 16585 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.180572 16585 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.182724 16585 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.184094  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.184937  8973 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:08.187490 16634 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:08.187978 16634 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.188264  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3715) took 1667 ms. Trace:
I20260925 16:46:08.188360 16634 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:08.189916 16800 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.332s	user 0.012s	sys 0.003s
I20260925 16:46:08.190901 16610 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.195771 16615 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:08.182715  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:08.188711  9116 rpcz_store.cc:276] 0925 16:46:06.521313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.124918 (+1603605us) service_pool.cc:227] Handling call
0925 16:46:08.141273 (+ 16355us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.187944 (+ 46671us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.187972 (+    28us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.188028 (+    56us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:46:08.188054 (+    26us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.188107 (+    53us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.188216 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.190389 16800 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.208755  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.212548  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.213402 16800 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.213037 16794 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.213860 16835 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:08.214846  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.215360 16794 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.110858 16599 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:08.215746  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47504.3us
I20260925 16:46:08.221052  9699 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:08.227319  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.228192  9046 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:08.255049  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3714) took 1731 ms. Trace:
I20260925 16:46:08.261574  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.257970  9117 rpcz_store.cc:276] 0925 16:46:06.520952 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.054341 (+1533389us) service_pool.cc:227] Handling call
0925 16:46:08.126159 (+ 71818us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.233678 (+107519us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.233720 (+    42us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.233781 (+    61us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:08.250364 (+ 16583us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.250452 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.250595 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.259352  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.210824 16840 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.230686 16604 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.281440 16783 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:08.281909 16783 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:08.282096  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.283088 16604 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.282908 16783 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.283614  9047 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:08.284062  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.284788 16783 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:08.233306 16615 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.285588 16645 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:08.285959  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.286339 16645 consensus_queue.cc:1225] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 21.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
I20260925 16:46:08.287087 16615 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.288951 16840 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.298719  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.299674  8974 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
W20260925 16:46:08.299916 16806 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.619s	user 0.009s	sys 0.009s
I20260925 16:46:08.300419 16806 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.304476  9115 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:08.204483 16862 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.291008 16846 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.309743  9043 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:08.312736  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3718) took 1770 ms. Trace:
I20260925 16:46:08.314677  9698 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
W20260925 16:46:08.316145  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 94068.4us
I20260925 16:46:08.313227  9115 rpcz_store.cc:276] 0925 16:46:06.544655 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.244924 (+1700269us) service_pool.cc:227] Handling call
0925 16:46:08.273800 (+ 28876us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.309318 (+ 35518us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.312681 (+  3363us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.315148  9698 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:08.270656 16585 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:08.310464  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:08.323328  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.327271  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3717) took 1805 ms. Trace:
I20260925 16:46:08.330229  9116 rpcz_store.cc:276] 0925 16:46:06.521847 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.229918 (+1708071us) service_pool.cc:227] Handling call
0925 16:46:08.280364 (+ 50446us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.320107 (+ 39743us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.320146 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.326967 (+  6821us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:08.327019 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.327093 (+    74us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.327214 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.336395 16846 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.340783  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.341289 16794 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:08.341650 16757 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.690s	user 0.015s	sys 0.000s
I20260925 16:46:08.341866 16794 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.342485  9121 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:08.342489  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.349177 16802 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:08.351946 16839 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.352231 16836 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.352512 16839 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.352913 16836 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.356163 16836 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.357062 16812 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:08.362850 16806 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.367878  9123 raft_consensus.cc:2396] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 18 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260925 16:46:08.372756  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:08.376940  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46860us
I20260925 16:46:08.391258  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.392077  9041 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:08.389340  9698 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.401171  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.402150  9041 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:08.402640  8974 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260925 16:46:08.404673  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.378799 16582 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.387779 16840 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:08.386369 16583 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.414893  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3720) took 1830 ms. Trace:
I20260925 16:46:08.413511  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3719) took 1829 ms. Trace:
I20260925 16:46:08.417987  9115 rpcz_store.cc:276] 0925 16:46:06.584592 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.329771 (+1745179us) service_pool.cc:227] Handling call
0925 16:46:08.387091 (+ 57320us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.408909 (+ 21818us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.408945 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.414589 (+  5644us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:08.414639 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.414709 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.414827 (+   118us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.418365  9117 rpcz_store.cc:276] 0925 16:46:06.584273 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.275544 (+1691271us) service_pool.cc:227] Handling call
0925 16:46:08.331534 (+ 55990us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.407587 (+ 76053us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.407624 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.413215 (+  5591us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:08.413266 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.413336 (+    70us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.413451 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:46:08.425819  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 150624us
I20260925 16:46:08.434381  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.440544  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.442895 16862 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.444015  9046 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:08.417160 16599 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.446560 16794 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:08.447099  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:08.447664  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.448336  8970 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:08.448921  8970 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:46:08.441645  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.414247 16840 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.451766  9117 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:08.452019 16840 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:08.451424  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.452800  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.453109  8966 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:08.453609  9117 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:08.451179  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.454144  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.454975  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.427160 16834 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.450855  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.456635  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.455946  8970 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 27: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:08.455377 16599 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:08.395753 16585 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.473312  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.474237 16834 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.392666 16833 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.474267  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:08.474273 16776 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:08.475237  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.481704  9050 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:08.475458  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.475791  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.476601  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.448932  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:08.479995  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.481626 16599 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.490710  9117 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:08.491195 16599 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:08.491636 16308 consensus_meta.cc:287] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.544s	user 0.013s	sys 0.000s
I20260925 16:46:08.491899  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.492033 16308 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.492511  9048 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:46:08.493333  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:08.493728 16585 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.494678  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.495813  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.496177  9049 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:08.496984  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.497560  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.498099  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.498698  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.499294  8974 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:08.499624  9045 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
W20260925 16:46:08.482635  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47030.4us
I20260925 16:46:08.500008  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.501250  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.502947 16794 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:08.503306 16746 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.503870 16746 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.504534 16802 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:08.504905 16802 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:08.505935 16746 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:08.505820 16802 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.503891  9698 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:08.507624  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.508263  9117 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:08.511170  8974 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:08.456265 16675 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:08.512324  8974 raft_consensus.cc:1226] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:08.512670  9044 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:08.512872  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.478765  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:08.514029  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 43589.3us
I20260925 16:46:08.514150  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:08.514954  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.490835  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.493848  9048 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:08.512148 16833 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.514391  8970 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:46:08.528976  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.529551 16840 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.530334  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.530931  9115 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:08.532305  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.532923  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.534479 16523 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:08.534860 16523 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:08.535189 16523 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:08.536964  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:08.455471  9666 connection.cc:232] RPC call timeout handler was delayed by -1.5621421739999732s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1816s for a response
I20260925 16:46:08.521744  9049 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:08.522164  8969 raft_consensus.cc:2396] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:46:08.524534  8968 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:08.525251  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:08.526618  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 77741.7us
I20260925 16:46:08.526804 16783 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:46:08.538239  9666 connection.cc:232] RPC call timeout handler was delayed by -1.252822432999892s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1543s for a response
I20260925 16:46:08.539947 16834 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:08.542156 16834 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:08.541374  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0728024349998577s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22160000000000002s for a response
I20260925 16:46:08.507114 16802 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:08.542439  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:08.516687 16308 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.546545 16833 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:08.546689  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:08.544694  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0054925799997818s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18730000000000002s for a response
I20260925 16:46:08.547875  8973 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:46:08.549028  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.551357  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.565515  9698 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:08.547441 16834 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:08.573612  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.560771  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:08.566004  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:08.558610  9115 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:08.580329  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3982) took 2273 ms. Trace:
I20260925 16:46:08.580708  9122 rpcz_store.cc:276] 0925 16:46:06.306512 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.973307 (+1666795us) service_pool.cc:227] Handling call
0925 16:46:08.012071 (+ 38764us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:08.043290 (+ 31219us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.043327 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:08.043862 (+   535us) log.cc:842] Serialized 26 byte log entry
0925 16:46:08.306695 (+262833us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:08.332104 (+ 25409us) log.cc:842] Serialized 14 byte log entry
0925 16:46:08.359963 (+ 27859us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.360043 (+    80us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:08.580135 (+220092us) raft_consensus.cc:1671] finished
0925 16:46:08.580154 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.580268 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":62218,"prepare.queue_time_us":25414,"prepare.run_cpu_time_us":55,"prepare.run_wall_time_us":55,"raft.queue_time_us":34159,"raft.run_cpu_time_us":353,"raft.run_wall_time_us":24939,"thread_start_us":262380,"threads_started":1,"wal-append.queue_time_us":529403}
I20260925 16:46:08.582685 16583 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.582708  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.583300 16583 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.583838  9122 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:08.585711 16583 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:08.585819  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.586519  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.587064  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:08.588116  9046 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:08.588393 16799 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 21 current term: 21 is higher.
I20260925 16:46:08.588716 16638 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:08.587224  9694 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 12.
I20260925 16:46:08.589241 16638 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.531594 16840 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.550585 16833 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:08.596876  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.573177  9047 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
W20260925 16:46:08.594777  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 52272.6us
I20260925 16:46:08.595978  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:08.599179  9041 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 17. (term mismatch)
I20260925 16:46:08.626049  9041 pending_rounds.cc:76] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 16
I20260925 16:46:08.626951  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.632691  9117 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:08.594980 16839 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.640249  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:08.643004  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.641069  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.643841  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.600071 16833 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:08.641845  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.599809 16783 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260925 16:46:08.666491  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 70848.7us
I20260925 16:46:08.651880  8941 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:08.653103 16638 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.655185 16384 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:08.654975 16634 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:08.646696  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47208.7us
I20260925 16:46:08.692893  8940 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.687275  9046 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:08.693369 16634 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.656831  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.694748 16384 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:08.694936  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.695264 16384 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:08.695851  9050 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:08.696194 16384 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.662084  9042 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:08.663815  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:08.700139  9696 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:08.637468  9041 pending_rounds.cc:97] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260925 16:46:08.701162  9041 raft_consensus.cc:2866] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:08.702280 16389 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.703624  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:08.704596 16881 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.705564  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:08.705276 16881 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.699841  9050 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260925 16:46:08.670029  9122 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:08.703151 16389 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.688019 16800 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election won for term 16
W20260925 16:46:08.724000  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 80277.5us
I20260925 16:46:08.734602  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.738348  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.738905 16389 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:08.739126  9116 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
W20260925 16:46:08.744103  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 75841.2us
I20260925 16:46:08.742699  9048 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:08.754247  8940 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.685003 16783 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:08.757812  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.735764 16812 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:08.768646  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3992) took 1197 ms. Trace:
I20260925 16:46:08.769119  9122 rpcz_store.cc:276] 0925 16:46:07.571665 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.735270 (+1163605us) service_pool.cc:227] Handling call
0925 16:46:08.762047 (+ 26777us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.768234 (+  6187us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.768285 (+    51us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.768337 (+    52us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:08.768380 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.768458 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.768585 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:08.762321 16783 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:08.768592 16840 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:08.765184 16585 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:08.822957  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1924) took 1683 ms. Trace:
I20260925 16:46:08.830897  9115 rpcz_store.cc:276] 0925 16:46:07.139509 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.637121 (+1497612us) service_pool.cc:227] Handling call
0925 16:46:08.736530 (+ 99409us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.784881 (+ 48351us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.784920 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:08.822587 (+ 37667us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:08.822646 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.822734 (+    88us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.822890 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {}
W20260925 16:46:08.795501  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.020s	sys 0.009s
I20260925 16:46:08.831899  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:08.834610  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3980) took 2528 ms. Trace:
W20260925 16:46:08.840068  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.020s	sys 0.009s
W20260925 16:46:08.841069  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 558360us
I20260925 16:46:08.827636  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:08.785095 16862 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.780962 16812 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:08.859371  9116 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260925 16:46:08.768309 16308 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.065s
W20260925 16:46:08.872900  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75209.7us
I20260925 16:46:08.833783 16776 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:08.840510  9119 rpcz_store.cc:276] 0925 16:46:06.305975 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.926352 (+1620377us) service_pool.cc:227] Handling call
0925 16:46:07.994242 (+ 67890us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:08.028522 (+ 34280us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.028560 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:08.029137 (+   577us) log.cc:842] Serialized 26 byte log entry
0925 16:46:08.378375 (+349238us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:08.785762 (+407387us) log.cc:842] Serialized 14 byte log entry
0925 16:46:08.827662 (+ 41900us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:08.833480 (+  5818us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:08.833957 (+   477us) raft_consensus.cc:1671] finished
0925 16:46:08.834218 (+   261us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:08.834548 (+   330us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":40321,"prepare.queue_time_us":23086,"prepare.run_cpu_time_us":73,"prepare.run_wall_time_us":73,"raft.queue_time_us":42022,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":18743,"thread_start_us":732192,"threads_started":2,"wal-append.queue_time_us":599859}
I20260925 16:46:08.829909 16840 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.892783  8975 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:08.852473 16604 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:08.928206 16604 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:08.899995 16705 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.851723 16585 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:46:08.941355  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79590.9us
I20260925 16:46:08.941000 16585 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.914923 16862 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.944921  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:08.945128 16523 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.909202  9115 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260925 16:46:08.918481  9016 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:08.947619 16389 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.948011  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:08.948324  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:08.949321  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.949859 16583 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:08.949976 16829 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:08.950377  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.950541 16829 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:08.950636 16308 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:46:08.951119 16308 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:08.928761 16557 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:08.929457 16879 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260925 16:46:08.930106 16591 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:08.929765 16604 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:08.929800 16819 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.669s	user 0.017s	sys 0.011s
I20260925 16:46:08.936174 16812 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.928303 16799 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:08.945495  9048 raft_consensus.cc:1799] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:08.947028 16523 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:08.833130 16634 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260925 16:46:08.948156 16389 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.977797  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:08.927320  9042 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:46:08.953627  9697 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:08.957494  9119 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:08.914825 16840 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:08.951469 16308 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:08.970741 16834 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.972038 16862 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:08.972324 16819 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.886s	user 0.018s	sys 0.011s
I20260925 16:46:08.978163  9048 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:46:08.950384 16583 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:08.998188  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.002413  9119 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:08.983408 16799 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:09.012843 16835 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:09.013456 16835 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:09.017076  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 241693us
I20260925 16:46:08.951452 16829 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:08.960850 16557 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.001368 16862 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
W20260925 16:46:09.043358  8972 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.005s	sys 0.011s
W20260925 16:46:09.065124  8972 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.537s	user 0.005s	sys 0.012s
W20260925 16:46:09.021050 16599 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.529s	user 0.007s	sys 0.003s
W20260925 16:46:09.065534 16623 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.626s	user 0.013s	sys 0.028s
W20260925 16:46:09.078876 16885 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.332s	user 0.002s	sys 0.002s
W20260925 16:46:09.094880  9123 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1925) took 1508 ms (client timeout 1980 ms). Trace:
W20260925 16:46:09.095315  9123 rpcz_store.cc:269] 0925 16:46:07.586313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.588284 (+  1971us) service_pool.cc:227] Handling call
0925 16:46:09.094669 (+1506385us) spinlock_profiling.cc:243] Waited 778 ms on lock 0x7b54003bfbd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:09.094828 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1789352192}
W20260925 16:46:09.096356 16802 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.535s	user 0.011s	sys 0.000s
W20260925 16:46:09.097011  9121 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 1912) took 3367 ms (client timeout 1873 ms). Trace:
W20260925 16:46:09.097384  9121 rpcz_store.cc:269] 0925 16:46:05.729032 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:05.746650 (+ 17618us) service_pool.cc:227] Handling call
0925 16:46:09.096805 (+3350155us) spinlock_profiling.cc:243] Waited 2.59 s on lock 0x7b5400165154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:09.096920 (+   115us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5967631616}
I20260925 16:46:09.098529  9118 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260925 16:46:09.098871  9118 pending_rounds.cc:76] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 13
I20260925 16:46:09.099083  9118 pending_rounds.cc:97] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260925 16:46:09.099299  9118 raft_consensus.cc:2866] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:08.998793 16705 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.101109  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 3976) took 3046 ms. Trace:
I20260925 16:46:09.101408 16705 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.101461  9118 rpcz_store.cc:276] 0925 16:46:06.055118 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.897572 (+1842454us) service_pool.cc:227] Handling call
0925 16:46:08.362153 (+464581us) spinlock_profiling.cc:243] Waited 5.47 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:46:09.098168 (+736015us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:09.099688 (+  1520us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:09.100933 (+  1245us) spinlock_profiling.cc:243] Waited 736 ms on lock 0x7b54003bfbd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:09.101052 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1704780544}
I20260925 16:46:09.075120 16599 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.103879 16599 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.107168 16881 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.107877 16833 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.109227  9049 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:09.109907 16833 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:09.110567 16594 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.719s	user 0.003s	sys 0.043s
W20260925 16:46:09.111387 16594 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.827s	user 0.004s	sys 0.044s
I20260925 16:46:09.121090  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.122006  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3721) took 2526 ms. Trace:
I20260925 16:46:09.122668  9116 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:09.122500  9117 rpcz_store.cc:276] 0925 16:46:06.584879 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.514938 (+1930059us) service_pool.cc:227] Handling call
0925 16:46:08.626155 (+111217us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.642436 (+ 16281us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:09.111520 (+469084us) spinlock_profiling.cc:243] Waited 71.7 ms on lock 0x7b54001c9150. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:09.111663 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":164851456}
I20260925 16:46:09.126855  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:09.145313  9119 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:09.133242  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 379037us
W20260925 16:46:09.079967 16623 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.882s	user 0.013s	sys 0.029s
I20260925 16:46:09.003624 16591 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.152459  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:09.166899  9042 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:09.164759  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.177783  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.008605 16799 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.169144  9123 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:09.164467  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.187760  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.193230 16840 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:09.196616 16626 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.650s	user 0.022s	sys 0.022s
W20260925 16:46:09.197057 16626 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.022s	sys 0.022s
I20260925 16:46:09.197480 16799 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.199115  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:09.200304 16581 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:09.200452 16710 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:09.201097 16523 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:09.201474 16523 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:09.201792 16523 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:09.201836 16581 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:09.202325 16581 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.203102 16581 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.204360 16581 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:09.204525  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.204988  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.205359  8973 raft_consensus.cc:2354] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24.
I20260925 16:46:09.206211  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.207265  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.209962 16523 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.212384 16523 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.216785  9048 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:09.219072  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:09.219671  9046 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:09.189564  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.231946  9049 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:09.187073  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:09.235090  9044 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:09.239387  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:09.234045 16806 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.013s	sys 0.009s
I20260925 16:46:09.245924  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.247005  8973 raft_consensus.cc:2354] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21.
I20260925 16:46:09.211403 16783 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:09.249464 16806 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.013s	sys 0.009s
I20260925 16:46:09.254575  9123 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:09.233386 16840 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.129246 16835 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.262614  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.269850  8968 raft_consensus.cc:2354] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18.
I20260925 16:46:09.266393  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.361174  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.383960 16308 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.386088 16308 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.386889  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.389886 16626 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:09.390511 16591 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.394452  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.395231  8973 raft_consensus.cc:2354] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24.
I20260925 16:46:09.396056  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.359748 16834 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:09.268028 16800 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.502s	user 0.006s	sys 0.019s
I20260925 16:46:09.404150  9119 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:09.406785 16800 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.428563 16800 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:09.432423  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.013s	sys 0.025s
I20260925 16:46:09.432758 16835 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.434641 16783 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.436499 16583 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:09.253226 16581 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.187s
I20260925 16:46:09.408613  9044 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:46:09.422350  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.445505  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.427201  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.422807  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2589) took 1427 ms. Trace:
I20260925 16:46:09.407635  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:09.450718  8967 rpcz_store.cc:276] 0925 16:46:07.995249 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.005685 (+ 10436us) service_pool.cc:227] Handling call
0925 16:46:08.043951 (+ 38266us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.172101 (+128150us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:09.422564 (+1250463us) spinlock_profiling.cc:243] Waited 83.7 ms on lock 0x7b5400137254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:09.422751 (+   187us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":192410496}
I20260925 16:46:09.451679  9041 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:09.446101  8975 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
W20260925 16:46:09.459342  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 70081.2us
W20260925 16:46:09.409195 16894 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
W20260925 16:46:09.409688 16888 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.162s	user 0.000s	sys 0.000s
W20260925 16:46:09.410271 16890 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.168s	user 0.000s	sys 0.000s
I20260925 16:46:09.463008  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:09.432842  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.013s	sys 0.026s
I20260925 16:46:09.461786  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.466651  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.400911 16389 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.406217  8974 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:09.473296  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.473318  9044 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:09.477231  8967 raft_consensus.cc:2354] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22.
I20260925 16:46:09.477100  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.479204  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:09.480553  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.479233  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.485391  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:09.479756  9693 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.574s	user 0.016s	sys 0.015s
W20260925 16:46:09.496120  9693 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.592s	user 0.016s	sys 0.015s
I20260925 16:46:09.472716 16132 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:09.472846 16836 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:09.501792  9046 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:09.506287  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:09.506978  8967 raft_consensus.cc:2354] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18.
I20260925 16:46:09.506470  9041 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:09.467809 16675 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260925 16:46:09.497001 16581 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.020s
I20260925 16:46:09.507673  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.509112 16591 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:09.509470 16591 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.510306 16591 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.512844 16589 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 21.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260925 16:46:09.513835 16703 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:09.514190 16703 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.514985 16703 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.519647 16703 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:09.497579 16132 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.525799 16132 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.526937 16132 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:09.527827 16821 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:09.528249 16821 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:09.528600 16821 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:09.532684 16890 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:46:09.534127  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1555) took 1060 ms. Trace:
I20260925 16:46:09.534502  8972 rpcz_store.cc:276] 0925 16:46:08.474150 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.487974 (+ 13824us) service_pool.cc:227] Handling call
0925 16:46:08.525792 (+ 37818us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:08.527500 (+  1708us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.527528 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:08.527964 (+   436us) log.cc:842] Serialized 26 byte log entry
0925 16:46:09.065924 (+537960us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:09.065999 (+    75us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:09.066122 (+   123us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:09.533905 (+467783us) raft_consensus.cc:1671] finished
0925 16:46:09.533930 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:09.534072 (+   142us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":487,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":100,"thread_start_us":537487,"threads_started":1,"wal-append.queue_time_us":687843}
I20260925 16:46:09.501271 16836 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:09.536758 16836 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.537904 16836 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:09.511500 16591 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:09.544759  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.545635  8974 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:09.561017  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:09.562464  9044 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:09.566898  8975 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:09.487972 16557 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.574201  8970 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:09.567778  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:09.576982  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:09.582017  9122 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.024s	sys 0.048s
I20260925 16:46:09.564656 16615 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:09.584070  9122 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.024s	sys 0.049s
I20260925 16:46:09.566947 16881 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:09.572883 16634 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:09.588213  9120 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.013s	sys 0.033s
W20260925 16:46:09.600204  9015 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.013s	sys 0.013s
W20260925 16:46:09.610605  9015 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.013s	sys 0.014s
W20260925 16:46:09.610931  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 913659us
I20260925 16:46:09.609145  8940 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:09.583618 16812 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.005s	sys 0.011s
I20260925 16:46:09.583199 16705 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:09.618435  9044 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260925 16:46:09.618029  9120 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.752s	user 0.013s	sys 0.037s
I20260925 16:46:09.634001  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:09.612881  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.014s	sys 0.025s
W20260925 16:46:09.634775  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.692s	user 0.017s	sys 0.070s
W20260925 16:46:09.641183  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.018s	sys 0.070s
W20260925 16:46:09.641973  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 699797us
W20260925 16:46:09.643586  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.665s	user 0.014s	sys 0.025s
W20260925 16:46:09.644043  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 726181us
I20260925 16:46:09.642010  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1915) took 3853 ms. Trace:
W20260925 16:46:09.617949 16604 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.027s	sys 0.017s
W20260925 16:46:09.612735 16812 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.006s	sys 0.011s
I20260925 16:46:09.647351  9120 rpcz_store.cc:276] 0925 16:46:05.788987 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.896529 (+2107542us) service_pool.cc:227] Handling call
0925 16:46:08.304553 (+408024us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:46:08.304739 (+   186us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:08.318099 (+ 13360us) raft_consensus.cc:1520] Early marking committed up to index 18
0925 16:46:08.765302 (+447203us) log.cc:842] Serialized 14 byte log entry
0925 16:46:09.641707 (+876405us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:09.641764 (+    57us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:09.641802 (+    38us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:09.641859 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:09.641964 (+   105us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":47107,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":68,"raft.queue_time_us":22931,"spinlock_wait_cycles":11852672,"thread_start_us":1161766,"threads_started":2}
I20260925 16:46:09.679569  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.677366 16389 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.007s
W20260925 16:46:09.681866  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73125.4us
I20260925 16:46:09.682567  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:09.683533 16384 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:09.679766  9090 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:09.589735 16615 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:09.670619 16604 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.028s	sys 0.018s
I20260925 16:46:09.641491 16819 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:09.689893  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:09.586535 16881 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.674420 16705 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.683863 16675 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:46:09.707016  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.673303 16840 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:09.635165 16634 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.711608  9123 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:09.715583 16615 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.675583 16710 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260925 16:46:09.716118  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:09.683890 16835 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260925 16:46:09.726262  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:09.716918 16840 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.718314 16384 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:09.718987  8939 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:09.719102 16901 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:09.730696  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:09.731452  9118 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:09.707151 16812 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:09.720880 16745 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:09.721233 16705 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:09.722283  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:09.710085 16819 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.726902  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:09.729925  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:09.719900 16389 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:09.704298 16834 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.023s
I20260925 16:46:09.723271  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:09.750368  9050 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:09.764693  9120 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:09.760632  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:09.735114 15954 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.031s	sys 0.041s
I20260925 16:46:09.773996 16902 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:09.734226 16833 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:09.772193 15954 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.830s	user 0.031s	sys 0.042s
W20260925 16:46:09.795981  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77128.6us
I20260925 16:46:09.796891  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:09.799476 16840 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.800066 16845 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:09.814492 16881 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.816494 16690 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:09.826920  9120 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
W20260925 16:46:09.827934  9115 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.020s	sys 0.060s
W20260925 16:46:09.830721  9115 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.021s	sys 0.060s
W20260925 16:46:09.792317  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.013s	sys 0.009s
I20260925 16:46:09.782177 16384 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:09.828271 16845 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.841986 16845 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:09.842844  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:09.780200 16812 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.847301  9697 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:09.851329  8969 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.010s	sys 0.006s
W20260925 16:46:09.851809  8969 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.010s	sys 0.006s
W20260925 16:46:09.836597  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.013s	sys 0.009s
W20260925 16:46:09.852774  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 834260us
W20260925 16:46:09.827391  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.009s	sys 0.012s
W20260925 16:46:09.857092  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.009s	sys 0.012s
W20260925 16:46:09.857565  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 907821us
I20260925 16:46:09.796363 16833 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.835395 16604 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:09.876297 16604 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:09.876812 16604 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:46:09.859323  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 62538.4us
I20260925 16:46:09.860643  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:09.824409 16821 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.838821 16384 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.844719 16905 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:09.872027 16833 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.827593 16690 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.894325  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:09.897540  9118 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:09.835660 16840 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 26.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.031s
I20260925 16:46:09.913237 16522 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:46:09.913739 16522 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:09.921183  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:09.933506  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.600s (SENT)
W20260925 16:46:09.921809 16585 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.949s	user 0.017s	sys 0.029s
I20260925 16:46:09.914752 16522 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.859809 16819 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:09.918428 16634 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:09.905123 16905 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:10.030280  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.071s	sys 0.142s
I20260925 16:46:10.006358  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:10.050278  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.108s	user 0.072s	sys 0.147s
I20260925 16:46:09.957604  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1928) took 1826 ms. Trace:
W20260925 16:46:09.944370 16585 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.018s	sys 0.029s
I20260925 16:46:09.939579  9015 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:10.017027  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:10.059011  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 122231us
I20260925 16:46:10.066506  9041 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:10.066742  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:09.950976 16522 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:46:10.061926  8966 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.044s	sys 0.068s
W20260925 16:46:10.070518  8966 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.836s	user 0.045s	sys 0.068s
I20260925 16:46:10.073796  9045 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:09.943442 16840 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260925 16:46:10.046109 16812 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:10.057087 16829 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.068s	sys 0.128s
I20260925 16:46:10.080900  9043 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:10.059218  9122 rpcz_store.cc:276] 0925 16:46:08.131724 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.830687 (+698963us) service_pool.cc:227] Handling call
0925 16:46:08.867911 (+ 37224us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:08.940436 (+ 72525us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:08.940474 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:08.940944 (+   470us) log.cc:842] Serialized 26 byte log entry
0925 16:46:09.586354 (+645410us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:09.586391 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:09.586476 (+    85us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:09.957354 (+370878us) raft_consensus.cc:1671] finished
0925 16:46:09.957382 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:09.957537 (+   155us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48562,"raft.queue_time_us":79171,"raft.run_cpu_time_us":99,"raft.run_wall_time_us":99,"thread_start_us":645081,"threads_started":1,"wal-append.queue_time_us":949055}
I20260925 16:46:10.067577 16710 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:10.078166  9696 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:46:09.967001 16821 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:10.079635  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 73386.9us
I20260925 16:46:09.952282 16690 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:10.080556  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 147079us
I20260925 16:46:10.088395  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:10.089378  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.657s (SENT)
I20260925 16:46:10.022073 16384 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.090334 16384 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:10.100840 16905 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:10.105083  9698 raft_consensus.cc:3032] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:10.105427  9698 raft_consensus.cc:729] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:10.105719  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.106379  9701 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:10.005950 16132 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
W20260925 16:46:10.109216  9089 connection.cc:232] RPC call timeout handler was delayed by -1.1190242859997852s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18910000000000002s for a response
W20260925 16:46:10.109695  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0587242859999151s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1958s for a response
W20260925 16:46:10.110129  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0201393169998028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260925 16:46:10.111043  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:10.081192 16829 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.557s	user 0.068s	sys 0.128s
I20260925 16:46:10.114075  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.116822  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.117404  9702 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:10.118638  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:10.119819 16208 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:10.123121 16845 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:10.107945 16840 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:10.126678  9698 consensus_queue.cc:260] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.129830  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:10.132522  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:10.132845 16132 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:10.133244  9045 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:10.133196 16132 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:10.136101  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.136401  9124 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:10.134441  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:10.087949 16585 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:10.138060  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.138741  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.143316  9696 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
W20260925 16:46:10.140908  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56209.8us
I20260925 16:46:10.139773  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:10.144412  9015 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.681s (SENT)
I20260925 16:46:10.147483  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.147552  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:10.149689 16626 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:10.154824  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.155470  9698 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:10.159723  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.160867  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.164121 16862 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:10.166358  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.166888  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.166747 16523 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:10.167163  9696 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:10.167896 16905 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:10.168602  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.168704  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.168861 16523 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:10.169737  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.170156 16523 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:10.170794  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.177049  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.180025 16308 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:10.181354 16308 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:10.182179 16308 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:10.183290 16308 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:10.184204 16836 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:10.184945 16836 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.191256  9696 raft_consensus.cc:2396] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:46:10.195667  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.192468  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1918) took 4242 ms. Trace:
I20260925 16:46:10.196281  9124 rpcz_store.cc:276] 0925 16:46:05.949874 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:07.897940 (+1948066us) service_pool.cc:227] Handling call
0925 16:46:09.103334 (+1205394us) spinlock_profiling.cc:243] Waited 5.17 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:46:09.103536 (+   202us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:10.137649 (+1034113us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.192171 (+ 54522us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54003bf6d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:10.192375 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2386768000}
I20260925 16:46:10.139437 16710 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260925 16:46:10.197635 16710 consensus_queue.cc:1225] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 8dc3391062084f45a6ba62d28d340722 log is divergent from this leader: its last log entry 17.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260925 16:46:10.198138 16710 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:10.198455 16710 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:10.199290 16710 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:10.200961 16710 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:46:10.203351 16591 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.664s	user 0.010s	sys 0.000s
I20260925 16:46:10.203202  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.205132 16604 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.205837  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.205933  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.206465  8975 raft_consensus.cc:2362] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22. Re-sending same reply.
I20260925 16:46:10.207108 16604 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:10.207190  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.207996  8970 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:10.207870  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.206595  8973 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 11.
I20260925 16:46:10.208631  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.207443  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.209486  8974 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:10.210816  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.192111 16836 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:10.217130 16626 consensus_queue.cc:1159] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 17 status { last_received { term: 16 index: 11 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:10.217862  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.220052  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.154690  8865 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 15, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 15 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:46:10.173885 16911 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260925 16:46:10.208067  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.229770  9701 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:10.221388  9696 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:10.230765  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.231534  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.244824  9695 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:10.246894  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:10.225688  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54893.8us
I20260925 16:46:10.235114  9699 raft_consensus.cc:1799] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:10.153491 16585 raft_consensus.cc:2741] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
W20260925 16:46:10.236471  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 347689us
I20260925 16:46:10.238857  9702 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
W20260925 16:46:10.243142  9042 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.781s	user 0.018s	sys 0.012s
I20260925 16:46:10.253789  8968 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:46:10.255097  9042 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.019s	sys 0.012s
I20260925 16:46:10.254794  9699 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 20 because replica has last-logged OpId of term: 18 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:46:10.256371  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.232388 16840 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:10.286482  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:10.242908 16800 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.014s	sys 0.021s
W20260925 16:46:10.288826  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 144441us
I20260925 16:46:10.290874  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.294750  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.296419 16533 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:10.297052  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:10.265064 16308 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:10.298204 16308 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:10.298655 16308 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:10.302820  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.689s (SENT)
I20260925 16:46:10.308089  9698 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:10.308455  9698 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:10.309170  9698 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.310186  9698 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:10.315959 16594 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:10.319082  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.160023 16132 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.325244  9116 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260925 16:46:10.326386  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:10.293581 16800 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.861s	user 0.014s	sys 0.022s
I20260925 16:46:10.329118  9119 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:10.330252  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.331030  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.320257 16912 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:10.338526 16912 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:10.338660  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:10.339039 16912 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:10.340744  9666 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.332420 16690 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:10.333175  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.333822  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.348888  9117 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:10.335005  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.241523 16905 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260925 16:46:10.342788  9120 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260925 16:46:10.335049  8865 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 22. New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:10.352720  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.353331  8968 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:10.348320  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:10.362715  8971 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:10.355268  9014 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:10.369535  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50555.7us
I20260925 16:46:10.280035 16840 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.370406  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:10.348294 16690 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:10.373548  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:10.381896  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:10.382165  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.382726  9116 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 21
I20260925 16:46:10.357580 16594 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:46:10.395848  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:10.406895  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117290us
W20260925 16:46:10.407657  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.714s (SENT)
I20260925 16:46:10.408133  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:10.371670 16585 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:10.414650  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3328) took 1215 ms. Trace:
I20260925 16:46:10.416003  9122 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260925 16:46:10.421761  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:10.375211 16812 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:10.425110  9121 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260925 16:46:10.415966  8969 rpcz_store.cc:276] 0925 16:46:09.198877 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:09.203713 (+  4836us) service_pool.cc:227] Handling call
0925 16:46:09.204045 (+   332us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:09.204276 (+   231us) raft_consensus.cc:1520] Early marking committed up to index 17
0925 16:46:09.858316 (+654040us) log.cc:842] Serialized 14 byte log entry
0925 16:46:10.409912 (+551596us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:10.409964 (+    52us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:10.414422 (+  4458us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.414499 (+    77us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:10.414602 (+   103us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":2043,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":35076,"thread_start_us":1081135,"threads_started":2}
I20260925 16:46:10.395119 16907 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:10.432226  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.438146  9123 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:10.405803 16594 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:10.394311 16690 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:10.444988  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.447054  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.447872  9041 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:10.422875 16582 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:10.451116 16840 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:10.451866  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:10.454447  9123 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 12. Current term is 13. Ops: []
I20260925 16:46:10.454829 16913 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:10.492476 16913 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:46:10.493072 16913 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:10.412724 16881 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260925 16:46:10.494107 16913 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.438941 16908 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:10.476645  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3330) took 1277 ms. Trace:
I20260925 16:46:10.479939  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.482967  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:10.430205 16915 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:10.441160 16594 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:10.497037  8971 rpcz_store.cc:276] 0925 16:46:09.199580 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:09.199810 (+   230us) service_pool.cc:227] Handling call
0925 16:46:09.200100 (+   290us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:10.375820 (+1175720us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.476359 (+100539us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54003c3cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:10.476581 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2658568448}
I20260925 16:46:10.448231 16905 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:10.446378 16862 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:10.440610 16907 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:10.515772 16910 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260925 16:46:10.500141 16908 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:10.448691 16812 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:10.524760  8974 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:10.526646  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.487521 16582 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:10.539444  9041 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260925 16:46:10.553705  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.440653 16585 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.072s
W20260925 16:46:10.556066  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 436419us
I20260925 16:46:10.570638  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.571679  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.572785  8967 raft_consensus.cc:2396] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 22 because replica has last-logged OpId of term: 20 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:46:10.573348  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.575888  8968 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:10.577667  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:10.577906  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.571513  8971 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:10.510921 16705 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:10.588738  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:10.513041 16881 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:10.596973 16836 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:10.597376 16836 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:10.598228 16836 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:10.601400  8865 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 18, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 18 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:10.604312  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 75136.5us
I20260925 16:46:10.605275  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.537678 16604 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:10.584064  9121 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:10.603122  8865 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 14, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 14 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:10.553843 16908 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:10.558192 16582 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:10.623173  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:10.638484  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 78929.6us
I20260925 16:46:10.639714 16132 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:10.670905 16920 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260925 16:46:10.671185  9041 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:10.587497 16821 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:10.652578  8865 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 16 to 19. New cstate: current_term: 19 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:10.623947  8970 raft_consensus.cc:2362] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22. Re-sending same reply.
I20260925 16:46:10.681844  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3868) took 1463 ms. Trace:
I20260925 16:46:10.684315  9044 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:10.652623 16905 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:10.646180 16800 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:10.646236 16915 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:10.606560 16881 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:10.637461 16819 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:10.682217  9042 rpcz_store.cc:276] 0925 16:46:09.218353 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:09.235519 (+ 17166us) service_pool.cc:227] Handling call
0925 16:46:09.251378 (+ 15859us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:09.259148 (+  7770us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:09.259213 (+    65us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:09.286314 (+ 27101us) log.cc:842] Serialized 26 byte log entry
0925 16:46:09.440289 (+153975us) spinlock_profiling.cc:243] Waited 1.62 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:46:10.255536 (+815247us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:10.255588 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.255672 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:10.675277 (+419605us) raft_consensus.cc:1671] finished
0925 16:46:10.675298 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:10.681783 (+  6485us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":134,"raft.run_cpu_time_us":11884,"raft.run_wall_time_us":186853,"spinlock_wait_cycles":3720960,"thread_start_us":793182,"threads_started":1,"wal-append.queue_time_us":985649}
W20260925 16:46:10.714654  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 308144us
I20260925 16:46:10.651086 16705 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:10.620790 16591 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260925 16:46:10.715473  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:10.706579  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:10.637411 16783 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.067s
I20260925 16:46:10.652390 16912 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.691406 16905 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:10.621145 16604 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.706497 16915 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:10.726543  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 385829us
I20260925 16:46:10.742741 16862 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:10.681491 16208 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260925 16:46:10.757680  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 387340us
I20260925 16:46:10.705596 16710 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
I20260925 16:46:10.696249 16821 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.765702  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.767076  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:10.707209 16800 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.781246  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.782361  9120 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:10.786893  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.790213  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.790990  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:10.707722 16812 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:10.734433 16690 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.796722  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:10.797595  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 389936us
W20260925 16:46:10.813138  9015 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.920s (SENT)
I20260925 16:46:10.809235  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:10.775241 16522 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260925 16:46:10.825726  9698 raft_consensus.cc:2354] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:10.803141 16384 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Stepping down as leader of term 12
I20260925 16:46:10.802238 16845 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:10.820983 16907 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:10.823064 16862 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:10.888761  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 206646us
I20260925 16:46:10.893940  9116 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:10.897173  9123 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260925 16:46:10.898197  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 95657.1us
I20260925 16:46:10.866819 16384 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:10.906796  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 118630us
I20260925 16:46:10.908322  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:10.797883 16905 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.901144 16907 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260925 16:46:10.803786 16705 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.17, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:10.941346  9116 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260925 16:46:10.950006  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:10.939268 16931 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.243s	user 0.001s	sys 0.000s
I20260925 16:46:10.973678  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:10.974551  9116 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:10.924062 16951 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:10.942687 16881 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:10.979401 16936 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.260s	user 0.001s	sys 0.001s
W20260925 16:46:11.005599  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 307561us
I20260925 16:46:11.045892  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:11.046303  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:11.046748  9043 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:11.047190  9041 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
W20260925 16:46:11.006654  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 94521.2us
I20260925 16:46:10.952288 16912 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:10.979094 16604 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.087255  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:10.984602 16591 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260925 16:46:10.999341 16940 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
W20260925 16:46:11.091303  9015 connection.cc:232] RPC call timeout handler was delayed by -1.1001818290001211s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2034s for a response
I20260925 16:46:11.105530  9116 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:11.100107  9700 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
W20260925 16:46:11.111022  8972 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.002s
I20260925 16:46:11.003633 16905 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:11.118510  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:11.120301  9015 connection.cc:232] RPC call timeout handler was delayed by -1.0039806330000829s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2174s for a response
I20260925 16:46:11.116907  8972 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 13.
W20260925 16:46:11.131553  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 165341us
I20260925 16:46:11.002411 16821 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:11.138623  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.031s (SENT)
I20260925 16:46:11.142841  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:11.143188 16928 log.cc:924] Time spent T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.001s
I20260925 16:46:11.144109 16821 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:11.144671 16821 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.146855 16821 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.150588  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:11.151979  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:11.156164  8969 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.582s	user 0.010s	sys 0.001s
W20260925 16:46:11.156230  8973 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.562s	user 0.004s	sys 0.008s
I20260925 16:46:11.158787  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.159914  8973 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
W20260925 16:46:11.135878 16938 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.359s	user 0.001s	sys 0.000s
W20260925 16:46:11.152943 16937 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.358s	user 0.000s	sys 0.001s
I20260925 16:46:11.139550 16941 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:11.195138  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:11.176278  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 93717.4us
I20260925 16:46:11.152613  9693 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19. Re-sending same reply.
I20260925 16:46:10.979797 16384 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.113677 16591 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:11.153982 16800 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.200237  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:11.201267  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:11.176407 16944 log.cc:924] Time spent T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.277s	user 0.001s	sys 0.000s
I20260925 16:46:11.176651 16690 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:10.988279 16951 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.216142  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2617) took 1142 ms. Trace:
I20260925 16:46:11.217281  9048 rpcz_store.cc:276] 0925 16:46:10.073676 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.073888 (+   212us) service_pool.cc:227] Handling call
0925 16:46:10.084790 (+ 10902us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:10.086371 (+  1581us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:10.086412 (+    41us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:10.129586 (+ 43174us) log.cc:842] Serialized 26 byte log entry
0925 16:46:10.446527 (+316941us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:10.446573 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.446639 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:11.215947 (+769308us) raft_consensus.cc:1671] finished
0925 16:46:11.215970 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:11.216092 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1137,"raft.queue_time_us":6910,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":97,"thread_start_us":309060,"threads_started":1,"wal-append.queue_time_us":525075}
I20260925 16:46:11.161171  8969 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:11.181898 16833 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:11.238727  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:11.238974 16966 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:11.239142  8941 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.240844  8969 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:11.239596 16966 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:11.190266 16604 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:11.242076  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:11.246834  8969 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:11.247581  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:11.206784 16591 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:11.253885  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:11.254878  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 480749us
I20260925 16:46:11.262358  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:11.219688 16941 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:11.267791  9666 connection.cc:232] RPC call timeout handler was delayed by -1.0180882930001189s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1527s for a response
I20260925 16:46:11.269305  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:11.269605  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:11.274857  8971 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:11.275050  8969 raft_consensus.cc:2362] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16. Re-sending same reply.
I20260925 16:46:11.271627  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:11.260493  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.512s	user 0.003s	sys 0.006s
W20260925 16:46:11.276484  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.528s	user 0.003s	sys 0.007s
I20260925 16:46:11.278585  9124 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260925 16:46:11.276391  8970 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:11.281597  8968 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260925 16:46:11.290138  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 167239us
I20260925 16:46:11.257169 16604 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:11.339054  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 97855.1us
W20260925 16:46:11.320148 16915 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.577s	user 0.007s	sys 0.006s
I20260925 16:46:11.260190 16384 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
W20260925 16:46:11.338186  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 76003us
W20260925 16:46:11.346974  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.055s (SENT)
W20260925 16:46:11.349768 16954 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
W20260925 16:46:11.350656 16949 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260925 16:46:11.351018 16907 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:11.331944 16821 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:11.351209 16626 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:11.365875  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1677) took 1071 ms. Trace:
I20260925 16:46:11.366358  9695 rpcz_store.cc:276] 0925 16:46:10.294971 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.322394 (+ 27423us) service_pool.cc:227] Handling call
0925 16:46:10.347423 (+ 25029us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:10.347624 (+   201us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:10.347650 (+    26us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:10.369385 (+ 21735us) log.cc:842] Serialized 26 byte log entry
0925 16:46:10.801325 (+431940us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:10.801369 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.801434 (+    65us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:11.365605 (+564171us) raft_consensus.cc:1671] finished
0925 16:46:11.365636 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:11.365809 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"thread_start_us":385994,"threads_started":1,"wal-append.queue_time_us":548077}
W20260925 16:46:11.354738 16308 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.032s	user 0.008s	sys 0.004s
I20260925 16:46:11.362249 16951 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.362562 16604 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:11.363164 16955 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.168s	user 0.000s	sys 0.001s
I20260925 16:46:11.352635 16984 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:11.380472  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:11.372723  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.369025  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1678) took 1073 ms. Trace:
W20260925 16:46:11.357604 16594 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.819s	user 0.006s	sys 0.006s
I20260925 16:46:11.388010  9699 rpcz_store.cc:276] 0925 16:46:10.295396 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.321418 (+ 26022us) service_pool.cc:227] Handling call
0925 16:46:10.321734 (+   316us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:10.335114 (+ 13380us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:10.335146 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:10.375851 (+ 40705us) log.cc:842] Serialized 26 byte log entry
0925 16:46:10.807089 (+431238us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:10.807147 (+    58us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:10.807244 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:11.368823 (+561579us) raft_consensus.cc:1671] finished
0925 16:46:11.368847 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:11.368973 (+   126us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":10113,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":101,"thread_start_us":375504,"threads_started":1,"wal-append.queue_time_us":592077}
I20260925 16:46:11.388748 16594 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.356581 16980 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:11.393988  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:11.365895 16626 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:11.358985 16907 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:11.373478 16840 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:11.402458  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 727220us
I20260925 16:46:11.357746 16915 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.415405  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1676) took 1135 ms. Trace:
I20260925 16:46:11.415840  9046 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:10.896824  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:11.432096  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.415457 16915 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:11.420042 16582 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.766s	user 0.002s	sys 0.010s
I20260925 16:46:11.427193  9702 rpcz_store.cc:276] 0925 16:46:10.280107 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.291673 (+ 11566us) service_pool.cc:227] Handling call
0925 16:46:10.345393 (+ 53720us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:10.675765 (+330372us) raft_consensus.cc:1520] Early marking committed up to index 16
0925 16:46:10.716249 (+ 40484us) log.cc:842] Serialized 14 byte log entry
0925 16:46:11.032320 (+316071us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:11.037159 (+  4839us) log.cc:842] Serialized 26 byte log entry
0925 16:46:11.038516 (+  1357us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:11.038883 (+   367us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:11.039392 (+   509us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:11.415208 (+375816us) raft_consensus.cc:1671] finished
0925 16:46:11.415233 (+    25us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:11.415346 (+   113us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10347,"prepare.queue_time_us":26468,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":3091,"raft.queue_time_us":330094,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":22723,"thread_start_us":590517,"threads_started":3,"wal-append.queue_time_us":651090}
I20260925 16:46:11.417773  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4022) took 1096 ms. Trace:
I20260925 16:46:11.433987  8865 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 19. New cstate: current_term: 19 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:11.433633 16690 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:11.435961  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:11.434608  9115 rpcz_store.cc:276] 0925 16:46:10.321334 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.321491 (+   157us) service_pool.cc:227] Handling call
0925 16:46:10.333286 (+ 11795us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:10.333688 (+   402us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:10.333731 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:10.334235 (+   504us) log.cc:842] Serialized 26 byte log entry
0925 16:46:10.698446 (+364211us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:10.938710 (+240264us) log.cc:842] Serialized 14 byte log entry
0925 16:46:11.417323 (+478613us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b5400234220. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bebdfb3 00007f719bf2af0f 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c
0925 16:46:11.417368 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:11.417443 (+    75us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:11.417494 (+    51us) raft_consensus.cc:1671] finished
0925 16:46:11.417587 (+    93us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:11.417719 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2998,"prepare.queue_time_us":207273,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":42,"raft.queue_time_us":294840,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":8986,"spinlock_wait_cycles":68488832,"thread_start_us":877404,"threads_started":3,"wal-append.queue_time_us":558094}
I20260925 16:46:11.436853  9695 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:11.436496 16690 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:11.437433  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48703.5us
I20260925 16:46:11.378856 16308 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.438653 16690 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:11.435109 16582 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.439414 16308 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.440644 16945 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:11.424541 16594 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:11.441944 16907 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:11.444044  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50017.5us
I20260925 16:46:11.413432  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.435364  8865 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:11.449940  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 76107.8us
I20260925 16:46:11.375391 16523 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260925 16:46:11.432504 16626 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:11.458189  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 90594.2us
I20260925 16:46:11.468868  8865 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:11.445230 16208 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:11.462481  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.412621 16956 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:11.481484  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:11.484757 16966 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:11.391140 16941 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.493106  8865 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 16, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:11.496766  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:11.498272  8940 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:11.499455  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 152656us
I20260925 16:46:11.428013 16840 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:11.417958 16591 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:11.505379  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.139s (SENT)
I20260925 16:46:11.505939  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:11.492457 16132 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.817s	user 0.011s	sys 0.000s
I20260925 16:46:11.482129 16208 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:11.481159 16582 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.505975  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.491441 16862 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:11.411345 16980 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.567986 16978 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:11.583515 16978 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:11.583878 16978 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:11.563974  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 65755.5us
I20260925 16:46:11.584767 16980 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:11.568116  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 154757us
I20260925 16:46:11.585068  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:11.571997  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71857us
W20260925 16:46:11.574981  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 118882us
I20260925 16:46:11.568449 16819 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:11.584438 16582 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:11.584954 16908 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.924s	user 0.011s	sys 0.000s
I20260925 16:46:11.579344  8966 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:11.587235  8865 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 15. New cstate: current_term: 15 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:11.507236 16626 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:11.562283  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 97721.6us
I20260925 16:46:11.604198  9043 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:11.604247  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:11.606649  8941 leader_election.cc:398] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:11.609154  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.610037  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.606246  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:11.613023 16208 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.613435  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.613876  9050 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:11.603983 16582 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.614231  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.614909  9043 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 25. Current term is 26. Ops: []
W20260925 16:46:11.572045  8866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 343) took 54963 ms (client timeout 15000 ms). Trace:
I20260925 16:46:11.615063  9700 raft_consensus.cc:1226] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:11.616986 16990 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:11.618913  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:11.621860  9049 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:11.632915  9044 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 26: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:11.613436  9045 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:11.623888  9048 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260925 16:46:11.620046  9694 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:11.625989  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2610) took 1448 ms. Trace:
W20260925 16:46:11.637603  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 145579us
I20260925 16:46:11.638429  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:11.635986  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.636484  8966 rpcz_store.cc:276] 0925 16:46:10.177942 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.202921 (+ 24979us) service_pool.cc:227] Handling call
0925 16:46:11.625816 (+1422895us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400355cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:11.625904 (+    88us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3127950720}
I20260925 16:46:11.600744 16862 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:11.599570 16912 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:11.600939 16984 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:11.634057  8865 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 19 to 23, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 23 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:11.627599  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
W20260925 16:46:11.629555 16977 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.280s	user 0.000s	sys 0.002s
W20260925 16:46:11.657542  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50471.1us
I20260925 16:46:11.656277  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:11.658692  9041 raft_consensus.cc:595] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.662323  9041 raft_consensus.cc:603] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:11.615676 16208 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:11.623855 16836 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:11.656812  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:11.649482  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.667099  9046 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:11.621107 16582 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.644773 16819 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:11.674152  9691 tablet_service.cc:1514] Processing DeleteTablet for tablet 12359c2bff0b46de91daa934c219103c with delete_type TABLET_DATA_TOMBSTONED (TS e3a3bc92ca0a4efa913eca1800a1550d not found in new config with opid_index -1) from {username='slave'} at 127.0.0.1:50780
I20260925 16:46:11.647867 16946 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:11.667613 16901 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.009s
I20260925 16:46:11.661947 16604 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.016s
I20260925 16:46:11.637204 16966 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:11.682955  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:11.687042  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.686302  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:11.673131  8865 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 17, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 17 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:11.705289  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 197973us
I20260925 16:46:11.705439  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:11.705693  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.673209  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.658484 16984 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:11.696985  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:11.631872 16783 consensus_queue.cc:1159] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 24 status { last_received { term: 22 index: 17 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.18-23.18]" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:11.699301  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.702983  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:11.605100 16908 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.710017  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.712641  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:11.660902 16862 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.706219 16915 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:11.728847  9015 leader_election.cc:398] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18.
I20260925 16:46:11.707578 16984 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:11.712376 16881 raft_consensus.cc:2741] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260925 16:46:11.771718  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.723878 16960 raft_consensus.cc:3032] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:11.728751 16946 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:11.784124  9047 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260925 16:46:11.785586  9047 pending_rounds.cc:76] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 13
I20260925 16:46:11.785868  9047 pending_rounds.cc:97] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260925 16:46:11.786134  9047 raft_consensus.cc:2866] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:11.785686  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.786813 16881 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:11.788107  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.788800 16881 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:11.789101  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.789897 16881 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:11.790424 16881 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:11.790616  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.792845 16582 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:11.794831  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.712514 16996 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.064s
I20260925 16:46:11.817335  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:11.818334  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:11.799378  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 118194us
I20260925 16:46:11.820286  8865 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 16, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:46:11.813133  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 130774us
I20260925 16:46:11.735172 16956 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:11.755270 16958 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:11.712842 16966 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:11.831059 16985 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.477s	user 0.001s	sys 0.002s
I20260925 16:46:11.832644 16966 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:11.823769 16582 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:46:11.834342 16582 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:11.795749 16591 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:11.835500 16582 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.823845 16967 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:46:11.825006 17001 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
W20260925 16:46:11.825701 16999 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
W20260925 16:46:11.842000 17000 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.185s	user 0.001s	sys 0.000s
W20260925 16:46:11.843217 16964 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.492s	user 0.000s	sys 0.003s
I20260925 16:46:11.844255 16908 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:11.845999  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:11.846575  9041 raft_consensus.cc:595] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.846895  9041 raft_consensus.cc:603] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:11.846716  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.823115  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:11.854212  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.699824 16819 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:11.855615  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:11.865180  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4031) took 1110 ms. Trace:
I20260925 16:46:11.865729  8865 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 17, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 17 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:11.865553  9122 rpcz_store.cc:276] 0925 16:46:10.755018 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:10.755157 (+   139us) service_pool.cc:227] Handling call
0925 16:46:10.766153 (+ 10996us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:11.083539 (+317386us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:11.083647 (+   108us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:11.084692 (+  1045us) log.cc:842] Serialized 26 byte log entry
0925 16:46:11.235239 (+150547us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:11.235290 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:11.236962 (+  1672us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:11.820091 (+583129us) spinlock_profiling.cc:243] Waited 6.36 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:11.850629 (+ 30538us) raft_consensus.cc:1671] finished
0925 16:46:11.850651 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:11.865111 (+ 14460us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1590,"raft.queue_time_us":184431,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":12582,"spinlock_wait_cycles":14618368,"thread_start_us":455006,"threads_started":2,"wal-append.queue_time_us":268564}
I20260925 16:46:11.791114 16881 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:11.796279 16965 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260925 16:46:11.781976 16960 raft_consensus.cc:729] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:11.873874  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:11.879806  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56802.1us
I20260925 16:46:11.784934 16840 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:11.770750 16994 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:46:11.885483  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 161118us
I20260925 16:46:11.890331  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:11.784312 16991 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:11.893911 16991 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:11.894312 16912 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:11.894743 16991 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:11.894915 16912 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:11.895637 16912 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:11.897657  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.864776 16908 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:11.864228 16956 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:46:11.871234 16946 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:11.872303 16996 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:11.877754 16905 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.747s	user 0.011s	sys 0.008s
I20260925 16:46:11.902376  8865 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:11.905740  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:11.909310  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 49027.3us
I20260925 16:46:11.907030  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:11.906351  9122 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260925 16:46:11.965274  9117 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:11.974946  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:11.931825 17005 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:11.942660  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45113.6us
W20260925 16:46:11.940589  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 215248us
I20260925 16:46:11.937428  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:11.963783  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 238435us
W20260925 16:46:11.624044  8866 rpcz_store.cc:269] 0925 16:45:16.608558 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:16.610986 (+  2428us) service_pool.cc:227] Handling call
0925 16:46:11.571791 (+54960805us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:00.843451 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:01.188119 (+344668us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:01.194907 (+  6788us) write_op.cc:435] Acquired schema lock
0925 16:46:01.199298 (+  4391us) tablet.cc:660] Decoding operations
0925 16:46:01.377429 (+178131us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:01.377522 (+    93us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:01.377570 (+    48us) tablet.cc:683] Acquiring locks for 12 operations
0925 16:46:01.500606 (+123036us) tablet.cc:699] Row locks acquired
0925 16:46:01.500641 (+    35us) write_op.cc:260] PREPARE: finished
0925 16:46:01.500841 (+   200us) write_op.cc:270] Start()
0925 16:46:01.500984 (+   143us) write_op.cc:276] Timestamp: P: 1790354761500776 usec, L: 0
0925 16:46:01.501028 (+    44us) op_driver.cc:331] REPLICATION: starting
0925 16:46:01.501800 (+   772us) log.cc:842] Serialized 4765 byte log entry
0925 16:46:02.580911 (+1079111us) op_driver.cc:444] REPLICATION: finished
0925 16:46:03.042152 (+461241us) write_op.cc:301] APPLY: starting
0925 16:46:03.042249 (+    97us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:03.112888 (+ 70639us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:03.113000 (+   112us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:03.132378 (+ 19378us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:03.133088 (+   710us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=24,key_file_lookups=24,delta_file_lookups=24,mrs_lookups=0
0925 16:46:03.133288 (+   200us) write_op.cc:312] APPLY: finished
0925 16:46:03.134063 (+   775us) log.cc:842] Serialized 113 byte log entry
0925 16:46:03.135754 (+  1691us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:03.136430 (+   676us) write_op.cc:454] Released schema lock
0925 16:46:03.136844 (+   414us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:03.138757 (+  1913us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:03.138912 (+   155us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":10589722,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":365944,"apply.run_cpu_time_us":20247,"apply.run_wall_time_us":99317,"cfile_cache_hit":50,"cfile_cache_hit_bytes":54215,"num_ops":12,"prepare.queue_time_us":434930,"prepare.run_cpu_time_us":14837,"prepare.run_wall_time_us":734643,"raft.queue_time_us":460343,"raft.run_cpu_time_us":97570,"raft.run_wall_time_us":460993,"replication_time_us":1068655,"thread_start_us":764776,"threads_started":4,"wal-append.queue_time_us":72855,"wal-append.run_cpu_time_us":14080,"wal-append.run_wall_time_us":2579616}]]}
I20260925 16:46:11.942505  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c6030f186a664452b127609fadec766b"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57624
W20260925 16:46:11.928053  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 106457us
I20260925 16:46:11.909219 16908 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:11.928610 16986 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:11.929271  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:11.945457  8865 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 23, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 23 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:11.942010  9699 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:11.980861  9041 raft_consensus.cc:595] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.980113  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:11.970750 16945 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260925 16:46:11.989893  9115 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
W20260925 16:46:11.987391  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50088us
I20260925 16:46:11.997354  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:11.936075 16996 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:11.991351  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:11.971065 16956 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:11.999671  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:11.998229  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.000581  9120 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:12.006538  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:12.007086  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:12.006588  8865 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 22 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 25 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:12.016422  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:12.021943  8865 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 18, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:12.000003 16845 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:12.025276 16845 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:12.025664 16845 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:12.027817  9121 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23.
I20260925 16:46:11.999543 17012 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:11.992388 16951 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:12.033753  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.046667  9049 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260925 16:46:12.047614  8865 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 16, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:12.016199 16945 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:12.056025  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:12.021088 16591 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:12.059911  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:12.031088 16533 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:46:12.045535 17007 log.cc:924] Time spent T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260925 16:46:12.034873 17012 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:12.036123 16833 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:12.067595  8865 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:12.065654  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:12.132421  9046 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:12.122004  9050 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:12.045259 16862 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:12.051874 16821 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:12.039075 16951 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:12.046936 17005 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:12.134328  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 127308us
I20260925 16:46:11.969142 16960 consensus_queue.cc:260] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:12.138862  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 115154us
W20260925 16:46:12.148692  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 151432us
W20260925 16:46:12.148350  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 157041us
I20260925 16:46:12.054456 16800 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:46:12.158409 16988 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.543s	user 0.003s	sys 0.000s
W20260925 16:46:12.159020 16978 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.575s	user 0.010s	sys 0.000s
I20260925 16:46:12.159502 16978 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.161469 16978 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:12.161207 16881 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.131868 16591 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:12.162164 16591 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.163129 16881 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:12.164064 16591 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:12.164300 16862 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:12.164458 17026 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:46:12.164589 16591 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:12.166363  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 171982us
I20260925 16:46:12.128312 16953 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:12.156351  8865 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 18, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:12.171079  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:12.158962 16948 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.183s
I20260925 16:46:12.172266 17014 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:12.172431 16821 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:12.172653  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:12.173347 16821 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.173797 16981 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.113s
I20260925 16:46:12.174187  8865 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 22. New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:12.175582  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:12.172293  9048 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:12.175899  8865 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 17 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:12.177538  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:12.178176  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.179580  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.132346 17012 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:12.132071 16833 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:12.189993  8865 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:12.185606  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 126606us
I20260925 16:46:12.175949  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:12.193982  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:12.194588  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:12.195832  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:12.196589  9046 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:12.196924  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:12.197531  8973 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:12.197546  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:12.155251 16951 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:12.200764  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:12.200382  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:12.203233  9047 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:12.208235  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:12.209522  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.210842  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:12.211995  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:12.214006  8975 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260925 16:46:12.207801  8966 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:12.216308  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:12.221361  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:12.228457  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:12.228658  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:12.232607  8975 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 21. Current term is 22. Ops: []
W20260925 16:46:12.207993 17009 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.147s	user 0.001s	sys 0.000s
I20260925 16:46:12.235478  8972 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:12.176556 16966 consensus_queue.cc:1046] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.051s
I20260925 16:46:12.195832 16833 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:12.234560  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 235004us
I20260925 16:46:12.227680  8973 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:12.233139  8974 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 13: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:12.236789  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:12.218088  8865 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index -1 to 10, term changed from 13 to 21, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:12.238229 17018 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260925 16:46:12.247857  8966 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:12.235996 16690 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.004s
W20260925 16:46:12.219445 16626 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.612s	user 0.010s	sys 0.000s
I20260925 16:46:12.243269  9048 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260925 16:46:12.219561 16836 consensus_meta.cc:287] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.541s	user 0.009s	sys 0.000s
I20260925 16:46:12.185101 16591 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.148289 16908 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.251091  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.281438  9121 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:12.251991  8865 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 16, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 16 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:12.283300  8865 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 15, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 15 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:12.256119 17035 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:12.260023  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:12.260143  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.291932  9042 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 15. (term mismatch)
I20260925 16:46:12.292333  9042 pending_rounds.cc:76] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 14
I20260925 16:46:12.292554  9042 pending_rounds.cc:97] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 23.15
I20260925 16:46:12.292784  9042 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:12.286052 16819 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:12.295089  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.294760  8865 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 5 to 8, term changed from 10 to 15, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 15 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:12.296643  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50257.2us
I20260925 16:46:12.298635  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:12.297253  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68150.2us
I20260925 16:46:12.302966  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:12.289455 17035 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.190924 16956 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.337096  9699 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:12.340296  9699 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:12.287137 16996 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:12.345671  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46071.6us
I20260925 16:46:12.296490 16881 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:12.350091  9699 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.352480  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:12.353216  9697 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:12.353515 16845 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.352702  9699 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:12.352619  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:12.360530  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.361790  9695 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:12.356115  9700 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:12.366345 17028 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:12.366890 17028 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:12.367252 17028 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:12.367811 17037 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:12.369450 17023 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:12.371024 17023 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:12.371546 17008 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.402s	user 0.002s	sys 0.000s
W20260925 16:46:12.372273 17021 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260925 16:46:12.372195  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:12.372766  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85885.8us
I20260925 16:46:12.372031 17024 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.022s
I20260925 16:46:12.340305 16626 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:12.391956  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:12.359254 16953 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:12.399132  9115 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260925 16:46:12.355676 16845 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:12.371611 17023 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
W20260925 16:46:12.405201  8860 catalog_manager.cc:4815] TS e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): delete failed for tablet 12359c2bff0b46de91daa934c219103c because of a CAS failure. No further retry: Illegal state: Request specified cas_config_opid_index_less_or_equal of 7 but the committed config has opid_index of 10
I20260925 16:46:12.405608 17030 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:12.406101 17030 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:12.406461 17030 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:12.406682 17029 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260925 16:46:12.392889 16941 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260925 16:46:12.409934 17028 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:12.410509 17006 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.474s	user 0.003s	sys 0.018s
I20260925 16:46:12.402251  9697 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
W20260925 16:46:12.412179 17019 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.220s	user 0.000s	sys 0.001s
I20260925 16:46:12.412236 17036 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:46:12.371556 17025 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:12.420334  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3898) took 1378 ms. Trace:
I20260925 16:46:12.420684  9042 rpcz_store.cc:276] 0925 16:46:11.041926 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:11.042073 (+   147us) service_pool.cc:227] Handling call
0925 16:46:11.042370 (+   297us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:12.293306 (+1250936us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:12.420130 (+126824us) spinlock_profiling.cc:243] Waited 1.25 s on lock 0x7b54002b6bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:12.420286 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2872589568}
I20260925 16:46:12.423369  9702 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260925 16:46:12.422264  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 82391.2us
I20260925 16:46:12.424777  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:12.435467  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 97452.7us
I20260925 16:46:12.436542  9015 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:12.422753  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 233702us
I20260925 16:46:12.447542  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:12.365549 16881 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.419775 17035 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:12.456919  9115 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:12.390414 16905 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.044s
I20260925 16:46:12.467545  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:12.446652 16984 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.679s	user 0.010s	sys 0.000s
I20260925 16:46:12.444128 17025 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:12.446364 17023 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:12.419836 16626 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.435568 16953 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.040s
I20260925 16:46:12.466076 16308 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:12.469297 17035 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:12.420257 16987 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.053s
I20260925 16:46:12.450523 17005 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260925 16:46:12.487809 16948 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:12.484299 16845 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:12.501673  9699 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
W20260925 16:46:12.509461  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 127541us
I20260925 16:46:12.509840  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:12.529191  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:12.531374 16996 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:12.531999 16996 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:12.532991 16800 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:12.532855 16996 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.534482 16995 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260925 16:46:12.508370 16991 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.545s	user 0.009s	sys 0.001s
W20260925 16:46:12.557590  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81751.3us
I20260925 16:46:12.526818 16591 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:12.563923  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 96514.2us
I20260925 16:46:12.615097  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:12.620384  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:12.622987  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 161853us
W20260925 16:46:12.622960  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 249768us
I20260925 16:46:12.625660  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:12.523957 16987 consensus_queue.cc:1225] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:46:12.523645 16913 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.141s
I20260925 16:46:12.473699 16984 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:12.568445 17033 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.251s	user 0.001s	sys 0.000s
I20260925 16:46:12.717398  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:12.718242  8967 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:12.507685 17035 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.723377  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.724157  9122 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:12.675689 16591 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:12.623171 16991 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.703055 16986 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:12.721956 16915 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:12.736384 17029 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260925 16:46:12.753233 17041 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.245s	user 0.001s	sys 0.000s
I20260925 16:46:12.753502 17047 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:12.755388 16991 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:12.756091 16915 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.757714 17046 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Stepping down as leader of term 23
W20260925 16:46:12.777473  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 157243us
I20260925 16:46:12.758111 17045 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:12.750834 16986 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:12.762064  9044 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:12.761873 16966 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:12.739394 17027 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:12.738248 16308 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:12.778235  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:12.761101 17035 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:12.764792  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 149678us
I20260925 16:46:12.775802 17038 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:12.809351  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:12.807757  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 180905us
W20260925 16:46:12.783015 16912 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.887s	user 0.005s	sys 0.006s
I20260925 16:46:12.813269  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:12.777048 16626 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:12.777812 17046 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:12.777616 17028 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:12.820920  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:12.819290  9014 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23.
I20260925 16:46:12.825498  9014 leader_election.cc:401] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260925 16:46:12.785423 16986 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:12.805480 17027 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:12.736663 17023 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 22, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.831420 16984 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:12.832471 16951 consensus_meta.cc:287] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.618s	user 0.010s	sys 0.000s
I20260925 16:46:12.832894 16951 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:12.834870 16951 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:12.812569 17038 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:12.836144 17038 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.808861 16966 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.839919 17038 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:12.841562 16966 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:12.842163  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 40a71744ceba4efe949720cb0f274853 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:12.845211 17004 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.909s	user 0.007s	sys 0.004s
I20260925 16:46:12.849042  8967 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
W20260925 16:46:12.857530  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 225945us
I20260925 16:46:12.824132 17005 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:12.826435 16833 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.536s	user 0.002s	sys 0.007s
W20260925 16:46:12.858283  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 187655us
I20260925 16:46:12.876291  9118 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:12.880798  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:12.829589 17045 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:12.777393 17030 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.889998  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:12.894956  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 116801us
I20260925 16:46:12.897950  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.818801 16912 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.904734  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:12.909132  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:12.950865  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.951612  9120 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:12.888741 16967 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:12.956935  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:12.972905  9047 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:12.976538  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:12.883137 16833 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:12.907400 17005 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:12.981489  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:12.987296  9041 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:12.955852 17037 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.000s
I20260925 16:46:12.977276  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:12.955530 17068 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:12.996477  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 177299us
I20260925 16:46:13.014067  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:12.957551 17012 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.750s	user 0.011s	sys 0.000s
I20260925 16:46:12.970722 17028 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:13.099112  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:12.960731 16626 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:12.897709 16308 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.102015  9045 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:13.109572  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 133602us
W20260925 16:46:13.109792  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 95807.5us
I20260925 16:46:13.110443  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:13.013758 16821 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:13.043256  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f15ade9737ac41438bda476a00b4ad97, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.126437  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.126637  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.126875  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:13.034221 17037 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:13.127496  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:13.140843  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:13.127786  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f15ade9737ac41438bda476a00b4ad97, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.145067  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.106769 16626 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:13.139832 16821 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.147253 16626 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:13.147380 17077 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.147818 17043 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.288s
I20260925 16:46:13.147931 17077 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.148869 16987 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:13.149125 17028 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:13.149288 16987 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:13.151260  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:13.152051  8967 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:13.102759 17005 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:13.173753  9702 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:13.181519  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.126497 16783 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:13.190848  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:13.113054 16915 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.101011 17067 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:13.132295 17035 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23.
I20260925 16:46:13.191987  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.182329  9115 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:46:13.194473  8972 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:13.149775 16987 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:13.200793  9693 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:13.200995 17059 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:13.201169 17055 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.237s
W20260925 16:46:13.128100  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 113408us
I20260925 16:46:13.213325  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:13.214293  9701 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:13.217819  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:13.041283 17012 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.148867 16821 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.179922 17077 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:13.216661 16975 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.064s
I20260925 16:46:13.271376 16833 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.041009 17068 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.272668 17030 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.207528 17067 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:13.271435 16912 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:13.197551 16783 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:13.197973 16604 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.245364 17035 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:13.282156  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:13.438897  9115 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:13.289750  9045 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
W20260925 16:46:13.290436  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 394189us
W20260925 16:46:13.291445  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 409131us
I20260925 16:46:13.187510  9041 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:12.953527 17046 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.371071  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:13.370111  8967 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:13.401099  9701 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:12.951917 17027 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.425753  8971 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 28: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:46:13.456403  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.009s	sys 0.020s
W20260925 16:46:13.456794  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.635s	user 0.009s	sys 0.020s
I20260925 16:46:13.422608  8972 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
W20260925 16:46:13.450685  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79687.1us
W20260925 16:46:13.460594  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 265281us
I20260925 16:46:13.363078 17053 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:13.372970 16821 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:13.417243 16995 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.469775  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:13.468552  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:13.485673  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:13.484472  9699 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.006s	sys 0.023s
W20260925 16:46:13.488140  9699 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.510s	user 0.007s	sys 0.023s
I20260925 16:46:13.438953 16783 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:13.466079  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:13.466296  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:13.464088 16948 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.894s	user 0.006s	sys 0.017s
W20260925 16:46:13.480291 17048 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.003s	sys 0.020s
I20260925 16:46:13.418114 17067 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:13.505314  9015 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:13.506419 16915 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260925 16:46:13.511747 17042 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.789s	user 0.004s	sys 0.015s
W20260925 16:46:13.497309 17008 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260925 16:46:13.484529 16821 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:13.516239 16821 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:13.518373  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.516260  9041 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:13.519767  9041 raft_consensus.cc:595] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:13.479792  9115 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:13.374225 16966 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.112s
I20260925 16:46:13.497742  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:13.523689  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 282564us
I20260925 16:46:13.530211  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:13.501564 16948 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.943s	user 0.006s	sys 0.017s
I20260925 16:46:13.535789  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:13.539202  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:13.549350  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:13.501677 17025 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.551158  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:13.552119  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:13.522619 17048 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.003s	sys 0.021s
I20260925 16:46:13.451705 16604 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:13.558398  9122 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.020s	sys 0.061s
I20260925 16:46:13.549412  8967 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:13.563575  9695 raft_consensus.cc:2354] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20.
I20260925 16:46:13.453390 17035 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.533903 17005 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:46:13.574472  9122 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.604s	user 0.020s	sys 0.061s
I20260925 16:46:13.557804 17037 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
W20260925 16:46:13.571872  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 334397us
I20260925 16:46:13.559602 17059 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:13.491132 17053 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.498169 16995 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.576898 16975 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260925 16:46:13.628170  9696 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:13.584674 17037 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:13.600665 17056 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.458s	user 0.000s	sys 0.001s
W20260925 16:46:13.630688 16967 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.658s	user 0.005s	sys 0.004s
W20260925 16:46:13.636620  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.017s	sys 0.028s
W20260925 16:46:13.642206  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.650s	user 0.017s	sys 0.029s
W20260925 16:46:13.644869  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 159145us
I20260925 16:46:13.679814  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:13.621342 17092 raft_consensus.cc:2781] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:13.572690 17025 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.637782 17059 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:13.635764 16975 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:13.637260 17037 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:46:13.691183  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 160541us
I20260925 16:46:13.678750 17005 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:13.677803 16967 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:13.681449 17012 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:13.696317  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:13.698400  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 193171us
I20260925 16:46:13.702711  9115 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:13.693663 16975 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 11 FOLLOWER]: Advancing to term 12
W20260925 16:46:13.712216 17096 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260925 16:46:13.712466 16941 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:13.728470 17043 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:13.729811  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3919) took 1535 ms (client timeout 1704 ms). Trace:
W20260925 16:46:13.730338  9045 rpcz_store.cc:269] 0925 16:46:12.193982 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.195289 (+  1307us) service_pool.cc:227] Handling call
0925 16:46:13.729581 (+1534292us) spinlock_profiling.cc:243] Waited 880 ms on lock 0x7b5400261bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:13.729719 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2023572864}
I20260925 16:46:13.731791  9016 leader_election.cc:398] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20.
I20260925 16:46:13.732117  9016 leader_election.cc:401] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:46:13.733110  9047 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:13.716077 17074 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260925 16:46:13.716602 17072 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.396s	user 0.001s	sys 0.000s
I20260925 16:46:13.717106 16604 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:13.702282 17061 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:13.709830 16986 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.849s	user 0.009s	sys 0.001s
I20260925 16:46:13.702843 17059 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:13.718725 17084 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260925 16:46:13.721123 16987 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.521s	user 0.007s	sys 0.002s
W20260925 16:46:13.722899 17058 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.057s	user 0.008s	sys 0.006s
W20260925 16:46:13.725315 16626 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.577s	user 0.003s	sys 0.005s
I20260925 16:46:13.728142 16941 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.715752 17070 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:13.738073  9115 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 28.
I20260925 16:46:13.739989  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.703599 17005 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.817190  9117 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:13.689311 17092 raft_consensus.cc:686] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:13.743785  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.818313  9119 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:13.819988  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:13.744489  9116 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:13.820890 17071 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 19. Current term is 20.
I20260925 16:46:13.748682  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:13.823670 16995 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:13.825327 17092 consensus_queue.cc:237] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.828644 17070 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:13.829667 17070 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.833583  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.766819  9045 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260925 16:46:13.836319 17093 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.151s	user 0.000s	sys 0.000s
I20260925 16:46:13.837424 16991 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.842075 16941 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:13.744509  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63566.4us
I20260925 16:46:13.794627  8974 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:13.702214 17088 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:13.797873  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.705875 17068 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.742421 16966 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.846616  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:13.860215  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 305396us
W20260925 16:46:13.863758  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 158478us
I20260925 16:46:13.868134  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:13.845757 17097 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.885932  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 1998) took 1339 ms. Trace:
I20260925 16:46:13.885373  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:13.889426  9697 rpcz_store.cc:276] 0925 16:46:12.546133 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.546312 (+   179us) service_pool.cc:227] Handling call
0925 16:46:12.546719 (+   407us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:12.744196 (+197477us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:12.744238 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:12.744695 (+   457us) log.cc:842] Serialized 26 byte log entry
0925 16:46:12.861309 (+116614us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:12.861378 (+    69us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:12.861474 (+    96us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:13.885716 (+1024242us) raft_consensus.cc:1671] finished
0925 16:46:13.885736 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:13.885864 (+   128us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":70791,"raft.queue_time_us":262981,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":2728,"thread_start_us":247065,"threads_started":2,"wal-append.queue_time_us":436131}
I20260925 16:46:13.838057 16991 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.899866  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:13.904628 17098 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260925 16:46:13.892684 17104 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:13.905750 17100 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.906454 16990 raft_consensus.cc:2741] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260925 16:46:13.906354 17100 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.908234 16941 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:13.863004 17035 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.909075 17100 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.909699 17025 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.818593 16626 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.911317 16951 raft_consensus.cc:979] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:13.911935 16951 raft_consensus.cc:1067] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:13.912626 16626 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:13.913280  8975 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:13.805130 17061 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.915386 17061 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:13.816397 16987 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:13.917441  9044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3920) took 1723 ms (client timeout 1948 ms). Trace:
I20260925 16:46:13.917613 16987 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:13.917954  9044 rpcz_store.cc:269] 0925 16:46:12.194314 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.194419 (+   105us) service_pool.cc:227] Handling call
0925 16:46:13.917209 (+1722790us) spinlock_profiling.cc:243] Waited 549 ms on lock 0x7b54002c0454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:13.917379 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1262881152}
I20260925 16:46:13.920902  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1694) took 1619 ms. Trace:
I20260925 16:46:13.921363  9700 rpcz_store.cc:276] 0925 16:46:12.301594 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.301752 (+   158us) service_pool.cc:227] Handling call
0925 16:46:12.340614 (+ 38862us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:12.376425 (+ 35811us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:13.920631 (+1544206us) spinlock_profiling.cc:243] Waited 15.3 ms on lock 0x7b54006eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:13.920835 (+   204us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":35238144}
I20260925 16:46:13.887190  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:13.805471 16986 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.890849  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:13.930961  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:13.927043  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3927) took 1031 ms. Trace:
I20260925 16:46:13.933609  9048 rpcz_store.cc:276] 0925 16:46:12.895410 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.904085 (+  8675us) service_pool.cc:227] Handling call
0925 16:46:12.904365 (+   280us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:12.904564 (+   199us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:46:13.022605 (+118041us) log.cc:842] Serialized 14 byte log entry
0925 16:46:13.926540 (+903935us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:13.926660 (+   120us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:13.926715 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:13.926794 (+    79us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:13.926962 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":12322,"prepare.queue_time_us":729386,"prepare.run_cpu_time_us":9980,"prepare.run_wall_time_us":36278,"raft.queue_time_us":90888,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":4875,"thread_start_us":737980,"threads_started":3,"wal-append.queue_time_us":342948}
W20260925 16:46:13.895047 16710 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.544s	user 0.025s	sys 0.042s
I20260925 16:46:13.936681  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:13.889312 17043 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:13.896858 17068 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.945699  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:13.952909  9120 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:13.901336 17091 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:13.955650  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.952150  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:13.959800  9700 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:46:13.959961  9696 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:13.862424 16966 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:13.964592  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 73845.2us
I20260925 16:46:13.930959 17036 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:13.940434 16710 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.592s	user 0.026s	sys 0.042s
I20260925 16:46:13.932595 16626 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:13.961127  9121 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260925 16:46:13.927146 16582 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:13.942010 17043 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:13.941855 17074 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:13.922685 16783 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.924520 16308 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.061s
I20260925 16:46:13.856784 17088 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:13.971261 17113 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:13.980883 16958 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:13.981299 17051 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:13.981947 16582 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:13.995465  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 194091us
W20260925 16:46:13.996270  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:14.003029  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:13.997025  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:14.001129  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:13.969300 17053 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.008648  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.955478 16604 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.035s
I20260925 16:46:14.009292  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:13.982736 17043 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:13.900295 17059 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.019098  9117 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:14.019124  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.956477 17068 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:13.995244 16956 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.238s	user 0.019s	sys 0.030s
I20260925 16:46:14.023917  9121 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:14.030324  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.033124  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.033461  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:13.896819 17097 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.043448  9696 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:14.012743 16981 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:14.011070 17113 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:13.965723 17091 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:14.032457 16956 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.275s	user 0.020s	sys 0.030s
I20260925 16:46:13.995208 16987 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
W20260925 16:46:14.066721  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 72139.3us
I20260925 16:46:14.078184 16881 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.078737 17010 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.079245 17010 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.080637 16966 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.081240 17010 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.081645 16986 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:14.082334 17117 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260925 16:46:14.083822 17016 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 2.148s	user 0.019s	sys 0.008s
W20260925 16:46:14.085034  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 61975.9us
I20260925 16:46:14.043349 16990 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.033442 16690 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:13.976800 17036 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.089430  9117 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:14.043488 17045 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:14.072256  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.834s (SENT) [suppressed 36 similar messages]
I20260925 16:46:14.091943  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:13.994700 16975 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.096902  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.096941  9116 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
W20260925 16:46:14.086901 17038 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.247s	user 0.008s	sys 0.004s
I20260925 16:46:14.005192 16958 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:14.021456 16908 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.289s	user 0.008s	sys 0.022s
W20260925 16:46:14.122123  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58563.2us
I20260925 16:46:14.123060  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.129678  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:14.129930  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:14.130226  9048 raft_consensus.cc:595] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:14.130638  9048 raft_consensus.cc:603] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:14.128549  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4052) took 1029 ms. Trace:
I20260925 16:46:14.095538 16986 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:14.024688 17037 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.144150  9016 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:14.145438  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73209.8us
I20260925 16:46:14.136588  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.093426 17005 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:14.139392  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 292847us
I20260925 16:46:14.149492  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.146651  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:14.137787 17113 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.154276 16956 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:14.154392 17116 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
I20260925 16:46:14.156901 16960 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:14.129601 16908 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.397s	user 0.009s	sys 0.023s
I20260925 16:46:14.020632 17051 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:14.164018  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 157979us
I20260925 16:46:14.132612  9123 rpcz_store.cc:276] 0925 16:46:13.099212 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.100426 (+  1214us) service_pool.cc:227] Handling call
0925 16:46:13.127879 (+ 27453us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:13.128118 (+   239us) raft_consensus.cc:1520] Early marking committed up to index 18
0925 16:46:13.450106 (+321988us) log.cc:842] Serialized 14 byte log entry
0925 16:46:14.116062 (+665956us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:14.116133 (+    71us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:14.116188 (+    55us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:14.116256 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:14.128375 (+ 12119us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":381604,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":12732,"raft.run_cpu_time_us":64,"raft.run_wall_time_us":64,"thread_start_us":968634,"threads_started":3,"wal-append.queue_time_us":538545}
I20260925 16:46:14.151319  9121 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c6030f186a664452b127609fadec766b"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45954
W20260925 16:46:14.166473  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 200550us
I20260925 16:46:14.175381  9121 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:46:14.175822  9121 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:14.175791  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.178344  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.179453  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.180078  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.183200  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3911) took 2514 ms. Trace:
I20260925 16:46:14.181327  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:14.185235  9123 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:14.186336  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:14.140476 16986 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:14.191131 17119 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:46:14.191529 16986 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.192137 17005 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:14.192832 17005 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:14.192910 16986 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:14.187978  8941 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.182577 17024 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:14.122315 17045 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.194509 17024 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.195315 17031 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:14.195883 17031 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:14.196705 17045 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:14.189908  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:14.197649  9041 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:14.103645 16690 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.190006  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:14.185117  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:46:14.192179  9695 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:14.199270  9694 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:46:14.200850  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.143785 16991 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.150398 17094 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:14.200775  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.095399 16990 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.183578  9043 rpcz_store.cc:276] 0925 16:46:11.659648 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:11.659826 (+   178us) service_pool.cc:227] Handling call
0925 16:46:11.660232 (+   406us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:11.684403 (+ 24171us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:11.684432 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:11.701174 (+ 16742us) log.cc:842] Serialized 26 byte log entry
0925 16:46:11.889939 (+188765us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:11.890052 (+   113us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:11.890198 (+   146us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:13.974471 (+2084273us) spinlock_profiling.cc:243] Waited 6.01 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:14.163512 (+189041us) raft_consensus.cc:1671] finished
0925 16:46:14.163532 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:14.173686 (+ 10154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14525,"raft.queue_time_us":13334,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":12353,"spinlock_wait_cycles":13822848,"thread_start_us":169834,"threads_started":1,"wal-append.queue_time_us":195882}
I20260925 16:46:14.180450 17100 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:14.217682  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.204589  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:46:14.192317 17077 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:46:14.183573 16881 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260925 16:46:14.223728  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43714.9us
I20260925 16:46:14.220052  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.225590  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:14.226040 17088 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.216763 16783 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.227118 16990 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.227064 16958 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.224336  9699 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:14.257742  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.228559 17077 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:14.196702 17024 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.262557  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:14.263495  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84103.3us
I20260925 16:46:14.266408 17129 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:14.266602 17110 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.267735 17037 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:14.270432 17051 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.250135 17074 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260925 16:46:14.272293  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:46:14.273306 17123 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.075s	user 0.001s	sys 0.000s
W20260925 16:46:14.277560 16821 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.761s	user 0.009s	sys 0.002s
W20260925 16:46:14.324281  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 57776.4us
I20260925 16:46:14.278874  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1702) took 1320 ms. Trace:
I20260925 16:46:14.328236  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.328346  9702 rpcz_store.cc:276] 0925 16:46:12.958232 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.958422 (+   190us) service_pool.cc:227] Handling call
0925 16:46:12.958751 (+   329us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:13.179643 (+220892us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:14.278668 (+1099025us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400670554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:14.278825 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":450257280}
I20260925 16:46:14.216971 17094 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:14.196806 17031 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.12, Last appended by leader: 12, Current term: 23, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.279786 17068 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.279961  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.283772 17097 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.284828 17091 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.230173 16881 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:14.252565 17023 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:14.289736 16582 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:14.290747 17067 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.754s	user 0.010s	sys 0.000s
I20260925 16:46:14.291414  8973 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:14.265506  9116 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:14.297588  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.310820  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:14.265571  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 84264.4us
W20260925 16:46:14.306463  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 102578us
I20260925 16:46:14.311292  9123 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:14.349285  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.313853  9121 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:14.323144  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 92578.6us
I20260925 16:46:14.282394 17043 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.327059  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.278026  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.314608 17077 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:46:14.297238 16690 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.315932 16987 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.354681  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:14.355039  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.338788  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.343842  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:14.345425  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:14.357133  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.315080  9696 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:14.351521  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.331331 17094 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:14.353494  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:14.346097  9043 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:14.358831  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.359527  9123 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:14.338637 17129 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.365514  9698 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:14.360440  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.360937  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:14.361748  9121 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:14.361671  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.364108  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:14.343139 16881 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:14.368992  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.368297  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.369613  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.374856  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.319482 16991 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260925 16:46:14.369755  9665 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.363991  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:14.377377  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.377543  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.331192 16821 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:14.384738  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.356454 16986 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:14.383015  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.320164 17110 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.383356  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.384102 16959 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:14.387321  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.388773  8973 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260925 16:46:14.407850  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:14.369047 16984 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:14.409616  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.413105  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.413828  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.414937  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.416800  9696 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:14.416465  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.417999  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.378811 16967 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:14.420568  8967 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
W20260925 16:46:14.420342  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71113.8us
I20260925 16:46:14.387260 16995 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:14.415482  9123 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:14.373608 17139 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:14.356300 17067 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:14.425348  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.441815  9699 raft_consensus.cc:2396] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 25 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 17.
I20260925 16:46:14.411818 17038 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:14.417133 16948 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:14.448299 17121 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.108s
I20260925 16:46:14.449273 17005 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:14.419808 17060 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:14.384573 17035 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.055s
I20260925 16:46:14.464958  9042 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 28: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:14.369395 16987 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.424135 16582 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.460273 17105 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:14.460661 16995 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:14.460899 17135 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:14.462946 17143 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260925 16:46:14.423822 17053 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:14.440060 17139 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:14.478885  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69167.7us
I20260925 16:46:14.424902 16959 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:14.485359 17067 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.473826 16990 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:14.455961 16948 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:14.489296 17141 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
I20260925 16:46:14.373045 17129 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:14.566926  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 153895us
I20260925 16:46:14.471657 16945 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Stepping down as leader of term 25
W20260925 16:46:14.491629 17099 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.705s	user 0.002s	sys 0.001s
I20260925 16:46:14.574679 17035 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:14.575063  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 76017.9us
W20260925 16:46:14.580372  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 155112us
I20260925 16:46:14.581355  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.583093  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.593086  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:14.494387 17059 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.094s
I20260925 16:46:14.480775 16582 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.588732  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.576115 17139 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:14.578718 16990 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:14.597676 16995 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.586901 16948 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:14.600734  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3921) took 2406 ms. Trace:
I20260925 16:46:14.622390 16959 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.624656 16821 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.590677 17043 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.626956  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:14.598975  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.614184  8973 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:46:14.602614 16845 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:46:14.605688 16951 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:14.620051 16987 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.610955 17067 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.010s
I20260925 16:46:14.620481  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:14.639760  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.657433  9698 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.589761 16945 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:14.649474 16966 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:14.628245  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3928) took 1728 ms. Trace:
I20260925 16:46:14.659338  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:14.650843  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.654289  9702 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:14.651798  8970 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:14.598409 17053 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:14.658110  9698 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:14.611409 17143 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:14.668520  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.657326  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:14.659953  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 247948us
I20260925 16:46:14.660074  9046 rpcz_store.cc:276] 0925 16:46:12.900320 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.124205 (+1223885us) service_pool.cc:227] Handling call
0925 16:46:14.137770 (+ 13565us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:14.149315 (+ 11545us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.149347 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:14.149739 (+   392us) log.cc:842] Serialized 26 byte log entry
0925 16:46:14.316416 (+166677us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:14.316455 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:14.316527 (+    72us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:14.628066 (+311539us) raft_consensus.cc:1671] finished
0925 16:46:14.628084 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:14.628190 (+   106us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":137322,"raft.queue_time_us":29488,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":9429,"thread_start_us":161207,"threads_started":1,"wal-append.queue_time_us":166867}
I20260925 16:46:14.621852  9049 rpcz_store.cc:276] 0925 16:46:12.194719 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.832878 (+1638159us) service_pool.cc:227] Handling call
0925 16:46:13.833189 (+   311us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:13.923431 (+ 90242us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:13.923472 (+    41us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:13.923515 (+    43us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:13.923549 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:14.600492 (+676943us) spinlock_profiling.cc:243] Waited 90 ms on lock 0x7b54000bf4d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:14.600543 (+    51us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:14.600680 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":207093120}
I20260925 16:46:14.664994  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.672326  9695 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260925 16:46:14.620512 17129 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.673008  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.650517 16845 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:14.659322 17067 consensus_queue.cc:1225] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 225d3432101a4758bb9a6b0efeae09c5 log is divergent from this leader: its last log entry 19.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260925 16:46:14.654067 16951 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:14.598227 17035 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.662662 16994 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.658754 17028 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:14.679510  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:14.680204  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 98937.5us
I20260925 16:46:14.664703 16533 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:14.662988 17097 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:14.695776 17153 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.150s	user 0.000s	sys 0.001s
I20260925 16:46:14.695376 16945 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.692718 17028 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:14.692759  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 100561us
I20260925 16:46:14.705690  9041 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 21. Ops: []
I20260925 16:46:14.706806  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.705875  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:14.692345 16990 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.712538 16990 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:14.716228  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.717243 17035 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.717931 17094 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:14.692140 16533 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:14.719406 17121 consensus_queue.cc:1159] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 26 status { last_received { term: 25 index: 17 } last_committed_idx: 17 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:14.707144 17097 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:14.719502 16533 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.705420 16958 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:46:14.722081 17097 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:14.722909  8973 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:14.723145 17070 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:14.723572 17070 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:14.723726 17028 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:14.724416 17104 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:14.724545 17070 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.724676 16945 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:14.725853 17070 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:46:14.701874  8971 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3379) took 2514 ms (client timeout 1954 ms). Trace:
I20260925 16:46:14.718488 16984 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:46:14.730433  8971 rpcz_store.cc:269] 0925 16:46:12.178584 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.178700 (+   116us) service_pool.cc:227] Handling call
0925 16:46:14.692979 (+2514279us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54001c4654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:14.693104 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2796522240}
I20260925 16:46:14.723084  8968 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:14.737280  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.742115  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:14.743026  9124 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 21
I20260925 16:46:14.686702  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.744004  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:14.748867  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62297.7us
I20260925 16:46:14.750384  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.750964  9120 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:14.751497  9120 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:14.676411 17071 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.059s
I20260925 16:46:14.753842  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.754199  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.757406  9045 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:14.697713 16994 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.704591 17157 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:46:14.738518 16953 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.760422  9120 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:14.762311 17091 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:14.781231  9120 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:14.747929 17053 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:14.753540 16959 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260925 16:46:14.743570 17151 raft_consensus.cc:2741] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260925 16:46:14.758342 16991 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:14.807852  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.746919 16690 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.040s
I20260925 16:46:14.820822 17094 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:14.821578 17036 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.755048 17105 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260925 16:46:14.818934 16948 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.788703 17077 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.813181  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.806661 17053 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:14.832846  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79103.1us
I20260925 16:46:14.839226  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.844884  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.845183  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:14.827256  9120 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260925 16:46:14.840839  9124 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:14.848151  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:14.849639  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:14.850059  9124 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 22
I20260925 16:46:14.851845  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:14.852942  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:14.876307  8971 raft_consensus.cc:1203] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 14.10->[17.11-23.15]   Dedup: 17.11->[18.12-23.15]
I20260925 16:46:14.856765  9120 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:14.825124 16987 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:14.879681  8971 pending_rounds.cc:76] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 11
I20260925 16:46:14.880048  8971 pending_rounds.cc:97] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260925 16:46:14.880440  8971 raft_consensus.cc:2866] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:14.880815  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:14.763005 16845 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.892143 17048 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:14.804164 16953 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.893111 17139 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.844640 16986 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:14.851284 17053 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:14.894706  9123 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:14.849920 17005 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:14.853596 16582 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:14.878887 17143 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:14.762290 16951 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:14.923360  9124 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:14.902935 16968 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:14.930037  9016 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.930912  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:14.932004  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 195913us
I20260925 16:46:14.918366 16901 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:15.319418  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:15.315536  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3922) took 3117 ms. Trace:
W20260925 16:46:15.326570  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 396578us
W20260925 16:46:15.332749  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 451981us
I20260925 16:46:15.322471  9050 rpcz_store.cc:276] 0925 16:46:12.198001 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.602797 (+2404796us) service_pool.cc:227] Handling call
0925 16:46:14.603162 (+   365us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:14.651831 (+ 48669us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.651866 (+    35us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:14.656610 (+  4744us) log.cc:842] Serialized 26 byte log entry
0925 16:46:14.842899 (+186289us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:14.842934 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.314908 (+471974us) spinlock_profiling.cc:243] Waited 48.3 ms on lock 0x7b5400260cd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.314967 (+    59us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:15.315028 (+    61us) raft_consensus.cc:1671] finished
0925 16:46:15.315047 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.315464 (+   417us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2034,"raft.queue_time_us":587,"raft.run_cpu_time_us":108,"raft.run_wall_time_us":4927,"spinlock_wait_cycles":111024384,"thread_start_us":162755,"threads_started":1,"wal-append.queue_time_us":229319}
W20260925 16:46:15.348166  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 427959us
I20260925 16:46:15.349463  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:14.915329 17104 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.405s
W20260925 16:46:15.317821 16990 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.605s	user 0.006s	sys 0.003s
I20260925 16:46:14.902503 16881 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:15.369514  9121 raft_consensus.cc:2396] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 27 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
W20260925 16:46:15.374812  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 443912us
W20260925 16:46:15.376732  9049 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.018s	sys 0.026s
W20260925 16:46:15.377089  9049 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.018s	sys 0.026s
I20260925 16:46:15.357580 17105 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260925 16:46:15.453672  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77843.8us
I20260925 16:46:15.454651  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:14.933781 16986 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.435s
I20260925 16:46:14.928742 17148 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.440s
I20260925 16:46:14.929111 17143 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:15.474233 17143 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:15.480517 17166 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:15.463452  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3393) took 1958 ms. Trace:
I20260925 16:46:15.482513  8972 rpcz_store.cc:276] 0925 16:46:13.505113 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.505295 (+   182us) service_pool.cc:227] Handling call
0925 16:46:13.548437 (+ 43142us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:14.898992 (+1350555us) spinlock_profiling.cc:243] Waited 46.5 ms on lock 0x7b18000c8860. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf22f6b 00007f719bf2d78b
0925 16:46:14.899180 (+   188us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.899218 (+    38us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:14.899272 (+    54us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:14.899309 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.463173 (+563864us) spinlock_profiling.cc:243] Waited 29.6 ms on lock 0x7b54002cb5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.463241 (+    68us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.463384 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2085,"raft.queue_time_us":156633,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":4812,"spinlock_wait_cycles":174937600,"thread_start_us":171405,"threads_started":1}
I20260925 16:46:15.379168 17048 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:15.526881  9115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3789) took 1848 ms (client timeout 2303 ms). Trace:
W20260925 16:46:15.534284  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79732.4us
W20260925 16:46:15.544572  9115 rpcz_store.cc:269] 0925 16:46:13.679025 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.679499 (+   474us) service_pool.cc:227] Handling call
0925 16:46:15.526691 (+1847192us) spinlock_profiling.cc:243] Waited 22.2 ms on lock 0x7b54001eebd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.526818 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":50996608}
I20260925 16:46:15.564687 16948 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:15.568749 17050 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 2.377s	user 0.006s	sys 0.010s
I20260925 16:46:15.572222 16901 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:15.572688 16901 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:15.574944 17164 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.672s	user 0.001s	sys 0.000s
I20260925 16:46:15.576457  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1968) took 1001 ms. Trace:
I20260925 16:46:15.576890  9119 rpcz_store.cc:276] 0925 16:46:14.574525 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.574653 (+   128us) service_pool.cc:227] Handling call
0925 16:46:14.575050 (+   397us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:14.580734 (+  5684us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.580773 (+    39us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:14.589302 (+  8529us) log.cc:842] Serialized 26 byte log entry
0925 16:46:14.807220 (+217918us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:14.807255 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:14.807324 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:15.576204 (+768880us) raft_consensus.cc:1671] finished
0925 16:46:15.576232 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.576390 (+   158us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":83,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":7595,"thread_start_us":152457,"threads_started":1,"wal-append.queue_time_us":198588}
I20260925 16:46:15.579044 17048 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:15.579669 17048 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:15.580026  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3394) took 1793 ms. Trace:
I20260925 16:46:15.580708 17048 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:15.582391 17171 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:15.584481  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3397) took 1740 ms. Trace:
I20260925 16:46:15.580406  8967 rpcz_store.cc:276] 0925 16:46:13.786354 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.786501 (+   147us) service_pool.cc:227] Handling call
0925 16:46:13.807173 (+ 20672us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:14.435566 (+628393us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.579814 (+1144248us) spinlock_profiling.cc:243] Waited 613 ms on lock 0x7b54001b3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.579973 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1410230016}
I20260925 16:46:15.604527  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3382) took 3345 ms. Trace:
I20260925 16:46:15.604907  8969 rpcz_store.cc:276] 0925 16:46:12.258961 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.259118 (+   157us) service_pool.cc:227] Handling call
0925 16:46:12.295398 (+ 36280us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:12.337638 (+ 42240us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:12.337668 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:12.340641 (+  2973us) log.cc:842] Serialized 26 byte log entry
0925 16:46:12.509224 (+168583us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:12.509263 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:12.509324 (+    61us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:15.568018 (+3058694us) spinlock_profiling.cc:243] Waited 3.99 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:15.584340 (+ 16322us) raft_consensus.cc:1671] finished
0925 16:46:15.584372 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.604466 (+ 20094us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":71128,"raft.queue_time_us":44917,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":14416,"spinlock_wait_cycles":9182080,"thread_start_us":118082,"threads_started":1,"wal-append.queue_time_us":667391}
I20260925 16:46:15.564600 16953 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:15.617033 16881 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:15.620450 17139 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:15.622135 17077 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:15.626994  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1712) took 1330 ms. Trace:
I20260925 16:46:15.629390  9699 rpcz_store.cc:276] 0925 16:46:14.296688 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.297361 (+   673us) service_pool.cc:227] Handling call
0925 16:46:15.626782 (+1329421us) spinlock_profiling.cc:243] Waited 89.7 ms on lock 0x7b5400436054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.626921 (+   139us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":206279936}
I20260925 16:46:15.631325 16975 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:15.632433  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1703) took 2669 ms (client timeout 1957 ms). Trace:
W20260925 16:46:15.632947  9694 rpcz_store.cc:269] 0925 16:46:12.962533 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.962668 (+   135us) service_pool.cc:227] Handling call
0925 16:46:15.632217 (+2669549us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540073c8d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.632338 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2639025024}
I20260925 16:46:15.584939  8975 rpcz_store.cc:276] 0925 16:46:13.844463 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.845109 (+   646us) service_pool.cc:227] Handling call
0925 16:46:13.845473 (+   364us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:13.913665 (+ 68192us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.584226 (+1670561us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54003566d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.584418 (+   192us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":155483008}
I20260925 16:46:15.653512  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3952) took 1040 ms. Trace:
I20260925 16:46:15.653997  9042 rpcz_store.cc:276] 0925 16:46:14.612740 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.612858 (+   118us) service_pool.cc:227] Handling call
0925 16:46:14.649881 (+ 37023us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:14.666741 (+ 16860us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.666773 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:14.666824 (+    51us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:14.666869 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.653266 (+986397us) spinlock_profiling.cc:243] Waited 16.6 ms on lock 0x7b54001707d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.653321 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.653444 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":38181248}
I20260925 16:46:15.663008 17183 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:15.663640 17183 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:15.668890 16946 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:15.669399 16946 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:15.670364 16946 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:15.674007 17144 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 1.352s	user 0.000s	sys 0.019s
I20260925 16:46:15.675851  9047 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 3939) took 2128 ms. Trace:
I20260925 16:46:15.676348  9047 rpcz_store.cc:276] 0925 16:46:13.547400 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.573137 (+ 25737us) service_pool.cc:227] Handling call
0925 16:46:13.732775 (+159638us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:13.733528 (+   753us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.675612 (+1942084us) spinlock_profiling.cc:243] Waited 159 ms on lock 0x7b5400261bd0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.675783 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":366418688}
I20260925 16:46:15.688825  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 3799) took 1548 ms. Trace:
I20260925 16:46:15.689235  9116 rpcz_store.cc:276] 0925 16:46:14.140480 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.166013 (+ 25533us) service_pool.cc:227] Handling call
0925 16:46:15.688681 (+1522668us) spinlock_profiling.cc:243] Waited 31.8 ms on lock 0x7b5400142b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.688770 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":73165056}
I20260925 16:46:15.689239  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1960) took 2094 ms. Trace:
I20260925 16:46:15.690443  9118 rpcz_store.cc:276] 0925 16:46:13.594421 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.595257 (+   836us) service_pool.cc:227] Handling call
0925 16:46:13.595528 (+   271us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:13.633389 (+ 37861us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:13.633432 (+    43us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:13.633497 (+    65us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:13.633542 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.689038 (+2055496us) spinlock_profiling.cc:243] Waited 33.9 ms on lock 0x7b54001c8754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.689078 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.689188 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":77887232}
I20260925 16:46:15.699093 17046 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:15.703718  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3402) took 1359 ms. Trace:
I20260925 16:46:15.703990 16994 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:15.704363 17110 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:15.704164  8968 rpcz_store.cc:276] 0925 16:46:14.344424 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.384256 (+ 39832us) service_pool.cc:227] Handling call
0925 16:46:15.703463 (+1319207us) spinlock_profiling.cc:243] Waited 316 ms on lock 0x7b54003e7e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.703645 (+   182us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":726791552}
W20260925 16:46:15.788740 17028 consensus_meta.cc:287] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.064s	user 0.009s	sys 0.004s
I20260925 16:46:15.789434  9700 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
W20260925 16:46:15.789701 17091 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.985s	user 0.009s	sys 0.000s
I20260925 16:46:15.789947 17024 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:15.790809 17183 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:15.790561 17024 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:15.789197 17028 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:15.797088 17109 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 1.764s	user 0.018s	sys 0.003s
I20260925 16:46:15.799536  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3780) took 2924 ms. Trace:
I20260925 16:46:15.800156  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1591) took 1632 ms. Trace:
I20260925 16:46:15.800592  8966 rpcz_store.cc:276] 0925 16:46:14.167810 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.167991 (+   181us) service_pool.cc:227] Handling call
0925 16:46:14.168317 (+   326us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:14.200392 (+ 32075us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.200425 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:14.200467 (+    42us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:14.200496 (+    29us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.799934 (+1599438us) spinlock_profiling.cc:243] Waited 31.9 ms on lock 0x7b54002fe754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.799982 (+    48us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.800107 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":73306368}
W20260925 16:46:15.804037 17145 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.481s	user 0.010s	sys 0.005s
I20260925 16:46:15.783270 17027 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:15.799907  9122 rpcz_store.cc:276] 0925 16:46:12.874722 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.874905 (+   183us) service_pool.cc:227] Handling call
0925 16:46:12.897356 (+ 22451us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:12.900321 (+  2965us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:46:13.577595 (+677274us) log.cc:842] Serialized 14 byte log entry
0925 16:46:14.101478 (+523883us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:14.113043 (+ 11565us) log.cc:842] Serialized 26 byte log entry
0925 16:46:14.113191 (+   148us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:14.116569 (+  3378us) log.cc:842] Serialized 14 byte log entry
0925 16:46:14.116730 (+   161us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:14.116803 (+    73us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:14.293004 (+176201us) spinlock_profiling.cc:243] Waited 4.73 ms on lock 0x7b18003dd380. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:15.796254 (+1503250us) spinlock_profiling.cc:243] Waited 3.08 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:15.799323 (+  3069us) raft_consensus.cc:1671] finished
0925 16:46:15.799345 (+    22us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.799479 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":32676,"prepare.queue_time_us":600081,"prepare.run_cpu_time_us":99,"prepare.run_wall_time_us":101,"raft.queue_time_us":82609,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":48382,"spinlock_wait_cycles":17972480,"thread_start_us":1081790,"threads_started":3,"wal-append.queue_time_us":383539}
I20260925 16:46:15.806073  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2009) took 1622 ms. Trace:
I20260925 16:46:15.808816  9697 rpcz_store.cc:276] 0925 16:46:14.183179 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.183301 (+   122us) service_pool.cc:227] Handling call
0925 16:46:14.183576 (+   275us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:14.197076 (+ 13500us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:14.197109 (+    33us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:14.197150 (+    41us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:14.197182 (+    32us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:15.805721 (+1608539us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b540064aad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:15.805770 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:15.806009 (+   239us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":30586240}
I20260925 16:46:15.811808 17091 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:15.813423 17114 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:15.813967 17114 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:15.814783 17114 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:15.817360 16945 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 1.091s	user 0.011s	sys 0.002s
I20260925 16:46:15.817904  9693 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:15.848872  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2292) took 1119 ms. Trace:
I20260925 16:46:15.849428  9693 rpcz_store.cc:276] 0925 16:46:14.729101 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.729233 (+   132us) service_pool.cc:227] Handling call
0925 16:46:15.848649 (+1119416us) spinlock_profiling.cc:243] Waited 1.06 s on lock 0x7b540053fa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:15.848795 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2436148608}
I20260925 16:46:15.818789 16946 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:15.859179 17024 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:15.868105  9117 raft_consensus.cc:3032] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:15.868495  9117 raft_consensus.cc:729] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:15.703481 16901 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:15.883183 16533 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:15.873251  9117 consensus_queue.cc:260] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:15.887224  9117 raft_consensus.cc:3037] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:15.894178  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.023s	sys 0.043s
W20260925 16:46:15.894516  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.738s	user 0.023s	sys 0.043s
I20260925 16:46:15.895851  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:15.866763 17071 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:15.875211 16905 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:16.022619  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3377) took 3844 ms (client timeout 1834 ms). Trace:
W20260925 16:46:16.023310  8970 rpcz_store.cc:269] 0925 16:46:12.178048 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.178750 (+   702us) service_pool.cc:227] Handling call
0925 16:46:16.022392 (+3843642us) spinlock_profiling.cc:243] Waited 2.29 s on lock 0x7b54003c4bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:16.022516 (+   124us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5272306432}
I20260925 16:46:16.026765  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:16.027516  9694 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:16.015477  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2284) took 2007 ms. Trace:
I20260925 16:46:16.029065  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:16.029793  9702 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:46:16.030536  9700 rpcz_store.cc:276] 0925 16:46:14.008047 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.009317 (+  1270us) service_pool.cc:227] Handling call
0925 16:46:16.015234 (+2005917us) spinlock_profiling.cc:243] Waited 1.76 s on lock 0x7b54004c40d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:16.015413 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4037561728}
I20260925 16:46:16.037235 17046 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.012141 16967 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.010316 16951 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:16.009192 17060 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.014401 17071 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:16.043499 17046 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.054136 17046 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:16.054639  9667 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.840s	user 0.088s	sys 0.131s
W20260925 16:46:16.054934  9667 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.088s	sys 0.131s
I20260925 16:46:16.057557 17060 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.059495 17060 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:16.060617 16901 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:16.064235 17053 consensus_meta.cc:287] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.137s	user 0.012s	sys 0.002s
I20260925 16:46:16.069003  9694 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:16.070938  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:16.079150  9664 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.001s	sys 0.034s
W20260925 16:46:16.079550  9664 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.027s	user 0.001s	sys 0.034s
I20260925 16:46:16.090965  9694 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
I20260925 16:46:16.106460  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:16.112344  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.762s	user 0.023s	sys 0.097s
W20260925 16:46:16.112725  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.023s	sys 0.097s
W20260925 16:46:16.113337  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 763920us
I20260925 16:46:16.117951  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:16.107167  9700 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:16.138200  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.145826  9702 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:46:16.147418  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.148537 16604 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:16.140496 16945 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:16.149374 16945 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.105036 17074 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.151355 16945 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.150907 17074 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.024770 16905 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:16.181896  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64068.3us
I20260925 16:46:16.152241 17040 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:16.152839 17054 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:16.084376 17070 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.358s	user 0.010s	sys 0.008s
I20260925 16:46:16.152992  9117 raft_consensus.cc:1261] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260925 16:46:16.156158 17088 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:16.093223 17037 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.746s	user 0.008s	sys 0.015s
I20260925 16:46:16.064690 17053 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.081506 17060 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.189026  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4076) took 1447 ms. Trace:
I20260925 16:46:16.207139  9117 rpcz_store.cc:276] 0925 16:46:14.741503 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.749370 (+  7867us) service_pool.cc:227] Handling call
0925 16:46:14.749724 (+   354us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:15.868017 (+1118293us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b5400161fa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:46:16.188713 (+320696us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:16.188965 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":113638784}
I20260925 16:46:16.195022 17054 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.194840 17088 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.105774 17046 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:16.196432 17037 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.009s	sys 0.015s
W20260925 16:46:16.163826 17026 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.004s	user 0.031s	sys 0.077s
I20260925 16:46:16.182623  9089 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:16.228525  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45994.6us
I20260925 16:46:16.178238 16208 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:16.180980 16604 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:46:16.065953 16967 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.236351 16604 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:16.237524 16967 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.237174 16604 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.178469 17038 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:16.238171 17038 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.104529 16984 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:16.240031 17038 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.240331 16984 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:16.240684 17053 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.241154 16984 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.218019 17028 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.231460 17071 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.216096 17127 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.243885 17127 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.244428 16905 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:16.219424  8940 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.034s	sys 0.078s
W20260925 16:46:16.245520  8940 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.918s	user 0.034s	sys 0.078s
I20260925 16:46:16.245882 17127 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:16.246434 16968 consensus_meta.cc:287] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.928s	user 0.008s	sys 0.007s
I20260925 16:46:16.246817 16968 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:16.229204 16845 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:46:16.219712  8971 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.012s	sys 0.020s
W20260925 16:46:16.249455  8971 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.922s	user 0.012s	sys 0.020s
I20260925 16:46:16.220304  9045 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:16.215773  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.878s	user 0.034s	sys 0.059s
I20260925 16:46:16.198086 17189 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:16.227598 17046 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.215426 17060 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.192957 17040 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.235836 16208 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:16.313508 16533 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.315505 16533 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.318169 17074 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:16.319844 17046 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.321113 16533 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:16.321859 17005 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.322320 17005 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:16.260263  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.930s	user 0.035s	sys 0.060s
I20260925 16:46:16.215602 17024 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:16.261682  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.926s	user 0.015s	sys 0.094s
W20260925 16:46:16.282629  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 3955) took 1451 ms (client timeout 1881 ms). Trace:
W20260925 16:46:16.326843  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.009s	user 0.016s	sys 0.094s
W20260925 16:46:16.327034  9045 rpcz_store.cc:269] 0925 16:46:14.831431 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.831580 (+   149us) service_pool.cc:227] Handling call
0925 16:46:16.282436 (+1450856us) spinlock_profiling.cc:243] Waited 1.34 s on lock 0x7b54002517d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:16.282573 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3083043584}
W20260925 16:46:16.230206 17026 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.255s	user 0.034s	sys 0.078s
I20260925 16:46:16.247573 17151 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:16.304282  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3415) took 1478 ms. Trace:
I20260925 16:46:16.305485 17060 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:16.305721 17085 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.307237 17028 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:16.310599  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.848s	user 0.014s	sys 0.021s
I20260925 16:46:16.330286  8971 rpcz_store.cc:276] 0925 16:46:14.825645 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.825803 (+   158us) service_pool.cc:227] Handling call
0925 16:46:14.848635 (+ 22832us) raft_consensus.cc:1457] Updating replica for 5 ops
0925 16:46:14.887920 (+ 39285us) raft_consensus.cc:1520] Early marking committed up to index 11
0925 16:46:15.282953 (+395033us) log.cc:842] Serialized 14 byte log entry
0925 16:46:15.325795 (+ 42842us) raft_consensus.cc:1525] Triggering prepare for 4 ops
0925 16:46:15.326702 (+   907us) log.cc:842] Serialized 104 byte log entry
0925 16:46:15.326861 (+   159us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:15.327146 (+   285us) log.cc:842] Serialized 14 byte log entry
0925 16:46:15.812780 (+485634us) spinlock_profiling.cc:243] Waited 27.3 ms on lock 0x7b1800036ca0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f719fdd2bcf 00007f71990027b6 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d
0925 16:46:16.250164 (+437384us) log.cc:842] Serialized 14 byte log entry
0925 16:46:16.293242 (+ 43078us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:16.303964 (+ 10722us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:16.304044 (+    80us) raft_consensus.cc:1671] finished
0925 16:46:16.304061 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:16.304231 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":408870,"prepare.queue_time_us":632589,"prepare.run_cpu_time_us":126,"prepare.run_wall_time_us":4562,"raft.queue_time_us":611397,"raft.run_cpu_time_us":351,"raft.run_wall_time_us":9250,"spinlock_wait_cycles":62769408,"thread_start_us":1307619,"threads_started":3,"wal-append.queue_time_us":323869}
I20260925 16:46:16.324996 17005 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.334601 17088 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.335011 17085 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.336329  9699 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
W20260925 16:46:16.353848  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.984s	user 0.014s	sys 0.021s
W20260925 16:46:16.326397  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.00699e+06us
I20260925 16:46:16.337116 17040 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.321136 17054 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:16.345237 17027 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.539s	user 0.009s	sys 0.000s
I20260925 16:46:16.345716 17091 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:16.346575 17184 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:16.347481 17071 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:16.314608 16208 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:16.362732  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.307s	user 0.008s	sys 0.022s
W20260925 16:46:16.367153 16995 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.463s	user 0.000s	sys 0.031s
W20260925 16:46:16.382025  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.009s	sys 0.023s
W20260925 16:46:16.367417  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.010s	sys 0.022s
W20260925 16:46:16.383893  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.010s	sys 0.022s
I20260925 16:46:16.372308  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:16.384560  9122 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:16.374632  9701 raft_consensus.cc:2396] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 15.
I20260925 16:46:16.369169  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:16.385560  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 847715us
I20260925 16:46:16.352111 16710 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:16.361550 17005 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:16.403476  8974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.021s	sys 0.016s
W20260925 16:46:16.418432  8974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.022s	sys 0.016s
I20260925 16:46:16.330569 17024 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.426029  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.442242  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:16.442575  9118 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
W20260925 16:46:16.389153 16995 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.487s	user 0.001s	sys 0.031s
I20260925 16:46:16.380746 17184 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.463092 17184 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.352109 17028 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.461385 17110 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.465227 17028 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.465505 17110 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.465816 16705 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:16.466609  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:16.467007 16705 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:16.469085  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:16.469560 16901 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.467428 17110 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.471129 16995 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.471640 16995 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.473141 17024 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.474012 17010 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.474514 17010 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.475255  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:16.476502 17010 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.476570  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.477289  9695 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:16.473738 16995 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.475492  9700 raft_consensus.cc:2362] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18. Re-sending same reply.
I20260925 16:46:16.480006  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.481400 16384 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.481526  9694 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:16.481775  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.481917 16384 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.482429  8971 raft_consensus.cc:2362] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19. Re-sending same reply.
I20260925 16:46:16.483016 16783 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.483502 16783 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.484369 16591 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:16.484592  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.485591 16783 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.479594 16995 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.488312 16995 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.470167 16901 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.489265  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.490150 16995 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.492030  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.493263  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.493842  9696 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:16.490170 16901 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.482391 17055 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.494987  8971 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:16.495611 16913 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:16.496261  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77613us
I20260925 16:46:16.504482  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:16.504873  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:16.505545  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:16.507987  9701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2278) took 2988 ms (client timeout 1707 ms). Trace:
I20260925 16:46:16.512420  8966 raft_consensus.cc:1203] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Deduplicated request from leader. Original: 14.10->[17.11-22.14]   Dedup: 22.14->[]
I20260925 16:46:16.513370  8966 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 22. Current term is 23. Ops: [17.11-22.14]
I20260925 16:46:16.499185  9122 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:16.467408 16705 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:16.496282  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.508562  8971 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:16.493778 17110 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.506811 17199 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260925 16:46:16.376219 17091 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.518551  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.519562  9694 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:16.441301 16912 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.521294  9119 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:16.507306 16812 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:16.495191 17055 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.524464  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.524921  9116 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 21. Ops: []
I20260925 16:46:16.535292  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:16.512288  9701 rpcz_store.cc:269] 0925 16:46:13.518009 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:13.518134 (+   125us) service_pool.cc:227] Handling call
0925 16:46:16.505967 (+2987833us) spinlock_profiling.cc:243] Waited 2.86 s on lock 0x7b5400192654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:16.506083 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6566520704}
I20260925 16:46:16.535851  8975 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:16.525759  9122 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:16.535997  8972 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:16.507465 17127 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.533114  8970 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:46:16.510361 16384 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.539283  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.540284 17127 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.542164 17127 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:16.542634 17043 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.542900  8972 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:16.526175 16912 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.538287  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:16.543155 17043 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.549464  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.550714  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:16.551378  8969 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:16.518968 17137 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:16.447553 16710 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.548271  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:16.452796 17005 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.548403  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:16.548492  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.558617  8975 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:16.549364  8968 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:16.518318 16908 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.508562 17125 consensus_queue.cc:1035] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.027s
I20260925 16:46:16.555737  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.555965  9123 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 25: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:16.557175  8970 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:46:16.557607  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:16.534031  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.024s	sys 0.041s
I20260925 16:46:16.563436  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.560328  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.591598  9122 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:16.588268  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.544518 17053 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:16.588958  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.198s	user 0.028s	sys 0.045s
I20260925 16:46:16.547302 17167 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.593132  8966 raft_consensus.cc:1203] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Deduplicated request from leader. Original: 22.16->[23.17-23.17]   Dedup: 23.17->[]
I20260925 16:46:16.604884  8966 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260925 16:46:16.509896 16913 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.597275  9115 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:16.567654  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.598904  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:16.534722  9049 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.034s	sys 0.041s
I20260925 16:46:16.560179 17127 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.594650  8967 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:16.523098 17110 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:16.589874  9016 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.013s	sys 0.026s
I20260925 16:46:16.557770 17028 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.534860 16967 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.623510  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.623514  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.614405  8970 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 12.
I20260925 16:46:16.625370  9120 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
W20260925 16:46:16.614912  9049 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.036s	sys 0.042s
I20260925 16:46:16.620522  8967 raft_consensus.cc:2396] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 16 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260925 16:46:16.626837  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1515) took 1933 ms. Trace:
W20260925 16:46:16.622089  9016 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.013s	sys 0.026s
I20260925 16:46:16.623780  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:16.629557  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.12787e+06us
I20260925 16:46:16.556476 17137 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.604065  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.615733  9116 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:16.633113  9694 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:46:16.633759  9115 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260925 16:46:16.634886  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.645613  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.591657 17126 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.627291  9049 rpcz_store.cc:276] 0925 16:46:14.693256 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:14.693449 (+   193us) service_pool.cc:227] Handling call
0925 16:46:14.693770 (+   321us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:14.693988 (+   218us) raft_consensus.cc:1520] Early marking committed up to index 18
0925 16:46:15.377455 (+683467us) log.cc:842] Serialized 14 byte log entry
0925 16:46:16.626426 (+1248971us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:16.626493 (+    67us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:16.626555 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:16.626646 (+    91us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:16.626779 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":112544,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"thread_start_us":1927610,"threads_started":2}
I20260925 16:46:16.646443  9120 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:16.595392 17024 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.603595 17150 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.667841  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:16.667841  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.603430 17199 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.672539  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.602990 17187 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:16.668455  9701 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:16.665061  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:16.653621 17114 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.835s	user 0.004s	sys 0.024s
I20260925 16:46:16.632273 16951 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:16.682682 17048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.004s	sys 0.027s
I20260925 16:46:16.665084  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:16.588692 16908 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.692657  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.632264 16812 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.632380 17137 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:16.695724  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.699996  9119 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:16.667514 17060 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:16.706012  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:16.707468  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.621541 17053 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.677826 17085 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.712430  9122 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:16.712468  9115 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
W20260925 16:46:16.692631 17048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.004s	sys 0.027s
I20260925 16:46:16.710353  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.733618  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.675276 17171 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.650266 16967 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.622308 17167 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.686055 17199 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.726168  8975 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
W20260925 16:46:16.689764 17114 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.871s	user 0.004s	sys 0.024s
I20260925 16:46:16.729952  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.650058 17028 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.712881  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.661123 17127 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.737232  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.738091 17040 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.672873 17024 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.738610 16308 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:16.739874 16845 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:16.742352 16913 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.748898 17064 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.752255 17035 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.754099 16912 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:16.822832  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.760726  9119 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:16.761886  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:16.762575 17100 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 23.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:16.560469 16705 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.771131  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.772241 17085 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.830632  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:16.831655  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69855.3us
I20260925 16:46:16.724931  8969 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:16.712280 17060 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:16.668223 17126 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.725382  9701 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
W20260925 16:46:16.788532 16996 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.923s	user 0.018s	sys 0.030s
I20260925 16:46:16.713568 17125 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:16.837594 17060 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:16.794358  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:16.693163 17104 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.076s
I20260925 16:46:16.705076 16812 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:16.686976 17150 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:16.771729 17188 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.275s	user 0.001s	sys 0.000s
I20260925 16:46:16.697661 16951 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.808110 17040 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:16.820832  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.308s	user 0.015s	sys 0.019s
I20260925 16:46:16.821419  9115 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:16.757164 16908 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.824004  9119 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:16.790870 17106 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.000s	sys 0.028s
W20260925 16:46:16.788700 17113 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.891s	user 0.007s	sys 0.044s
I20260925 16:46:16.823601  8966 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:46:16.835994  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.788650 17043 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.779354  9122 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:16.839165  8969 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:16.821733 16308 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:16.837363 16690 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:16.821334 16845 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:16.846994  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:16.826387 17046 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:16.851557  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:16.855666  9120 raft_consensus.cc:2379] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:16.808880 17091 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.738543 16710 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.079300  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:16.827672 17064 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.772810 17171 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.841421 17187 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:16.825798 17035 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:17.078238  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.565s	user 0.018s	sys 0.026s
I20260925 16:46:17.079641  9014 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:17.096156  9693 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.865s	user 0.015s	sys 0.028s
W20260925 16:46:17.109938  9693 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.879s	user 0.016s	sys 0.028s
I20260925 16:46:16.892514  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:17.110828  8967 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:16.844372 16384 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:16.887404 17052 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.778s	user 0.009s	sys 0.015s
I20260925 16:46:16.848006 17055 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:16.848157 17005 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:17.076085 17113 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.192s	user 0.010s	sys 0.050s
I20260925 16:46:17.077010  9119 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.099505 17046 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.114571 17185 raft_consensus.cc:2741] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election decision vote started in defunct term 24: won
I20260925 16:46:17.115140 17171 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.115352  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:16.852840 16996 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.987s	user 0.018s	sys 0.030s
I20260925 16:46:17.191069  9700 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:17.077646 17106 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.210s	user 0.008s	sys 0.029s
I20260925 16:46:16.836359 17085 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:16.932503 16705 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:17.126338  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:17.128602  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 277105us
I20260925 16:46:17.082346 16968 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:17.076025 16690 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:17.126999 16908 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:17.099731 17195 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:17.115625 17187 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:17.117671 17103 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.801s	user 0.008s	sys 0.020s
W20260925 16:46:17.116493 17052 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.248s	user 0.013s	sys 0.019s
I20260925 16:46:17.083375 16845 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:17.186717  9119 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:17.125623 16384 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.189841 17194 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader election won for term 28
W20260925 16:46:17.135926 16984 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.892s	user 0.014s	sys 0.064s
I20260925 16:46:16.937693 16967 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.203608  9116 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:17.137251 17110 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.184304 17070 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:17.264282  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59820.2us
I20260925 16:46:16.925028 17125 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.183874 17048 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:17.186482 17197 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:17.237650 16690 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:17.207042 17171 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:17.269958 17103 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.407s	user 0.008s	sys 0.020s
W20260925 16:46:17.268605 16604 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.965s	user 0.039s	sys 0.132s
I20260925 16:46:17.257813 17100 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:17.419322  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:17.470840  9119 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:46:17.481227  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:17.269456 17053 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:17.345364 16984 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.102s	user 0.015s	sys 0.077s
I20260925 16:46:17.237310 16968 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:17.536778  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49077.3us
I20260925 16:46:17.372140 17052 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:17.487206 16967 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:17.206288 16308 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.591398  8968 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:17.480639 17199 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.595582  9119 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:17.270534 17195 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.488021 17005 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:17.481681 17028 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.481145 17167 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.480100 17194 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:17.589502 16604 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.237s	user 0.039s	sys 0.143s
I20260925 16:46:17.276042 16908 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.488834 17127 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:17.608817  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 127659us
I20260925 16:46:17.622813 17052 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:17.622893 16308 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:17.647848 17198 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.446s	user 0.000s	sys 0.001s
I20260925 16:46:17.648586 16968 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.648166 17194 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.625702 17103 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:17.649551 17103 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:17.650394 17103 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.651428 17103 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:17.654878 17200 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.764s	user 0.000s	sys 0.001s
I20260925 16:46:17.666347 17035 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.534492 17197 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.600436 17126 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.678989 17046 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.527501 17070 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.534897 17048 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.592069 17171 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.596467 17100 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.639300 17028 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:17.623274 16967 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.667637 17052 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.633795 17005 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.699347  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3417) took 2540 ms. Trace:
I20260925 16:46:17.671689 17104 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:17.668872 17127 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:17.676628 17150 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.679842 16812 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.690565  8971 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:17.643519 16951 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.539744 17024 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.760866 17187 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:17.773641 17205 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.303s	user 0.001s	sys 0.000s
I20260925 16:46:17.726573 17040 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.717887 16908 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.720430 17064 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.731204 17028 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:17.732477 16384 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.776948 17125 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:17.793471 17189 consensus_meta.cc:287] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 1.480s	user 0.011s	sys 0.002s
I20260925 16:46:17.779759 17127 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:17.794059 17204 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.287s	user 0.001s	sys 0.001s
I20260925 16:46:17.778740 17104 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:17.813664 17197 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.823825 17104 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:17.827319 16208 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.411s	user 0.010s	sys 0.002s
I20260925 16:46:17.822556 17189 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:17.824738 17195 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.843340  9124 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:17.849838  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:17.850656  9700 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:17.771878  8974 rpcz_store.cc:276] 0925 16:46:15.158644 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:15.158829 (+   185us) service_pool.cc:227] Handling call
0925 16:46:15.318757 (+159928us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:15.497950 (+179193us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:15.497996 (+    46us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:15.521970 (+ 23974us) log.cc:842] Serialized 26 byte log entry
0925 16:46:16.419962 (+897992us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:16.420014 (+    52us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:16.420098 (+    84us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:17.654234 (+1234136us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:17.690081 (+ 35847us) raft_consensus.cc:1671] finished
0925 16:46:17.690108 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:17.699262 (+  9154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":10837,"raft.queue_time_us":494055,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":295596800,"thread_start_us":1003766,"threads_started":2,"wal-append.queue_time_us":1236992}
I20260925 16:46:17.835686 17070 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.854466  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:17.858743  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4086) took 1220 ms. Trace:
I20260925 16:46:17.859246  9115 rpcz_store.cc:276] 0925 16:46:16.638382 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.730423 (+ 92041us) service_pool.cc:227] Handling call
0925 16:46:16.730682 (+   259us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:17.101948 (+371266us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:17.858466 (+756518us) spinlock_profiling.cc:243] Waited 90.5 ms on lock 0x7b540009ef54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:17.858679 (+   213us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":208249216}
I20260925 16:46:17.860738  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:17.861986 16913 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:17.862522 16913 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:17.863489 17208 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.599s	user 0.003s	sys 0.007s
I20260925 16:46:17.862011  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:17.866523  9115 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:17.867874  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:17.867874  9115 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:17.842172 16208 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.870231  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4095) took 1111 ms. Trace:
I20260925 16:46:17.872164  9115 rpcz_store.cc:276] 0925 16:46:16.758361 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.867427 (+1109066us) service_pool.cc:227] Handling call
0925 16:46:17.867691 (+   264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:17.869942 (+  2251us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:17.870163 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:17.843611 17085 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.864482 17187 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:17.881016  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1980) took 1345 ms. Trace:
I20260925 16:46:17.894598  9124 rpcz_store.cc:276] 0925 16:46:16.535401 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.535642 (+   241us) service_pool.cc:227] Handling call
0925 16:46:16.535919 (+   277us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:17.845503 (+1309584us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:17.880711 (+ 35208us) spinlock_profiling.cc:243] Waited 1.31 s on lock 0x7b540009f454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:17.880949 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3006346624}
I20260925 16:46:17.889708  8970 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:17.896062  9124 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:17.865267 17100 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.875200 17040 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:17.901835  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2632) took 1386 ms. Trace:
I20260925 16:46:17.902307  8971 rpcz_store.cc:276] 0925 16:46:16.515636 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.515754 (+   118us) service_pool.cc:227] Handling call
0925 16:46:17.690324 (+1174570us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:17.788490 (+ 98166us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:17.894302 (+105812us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b540020e250. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:17.901779 (+  7477us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2689376640}
I20260925 16:46:17.875524 17048 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:17.888238 17171 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.887090 17187 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:17.906412 17040 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:17.863585 16913 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:17.915198 17187 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:17.931612  9115 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 12. Ops: []
I20260925 16:46:17.923514 17040 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:17.914086 17005 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:17.934387 17127 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:17.935860 17060 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.805s	user 0.006s	sys 0.004s
W20260925 16:46:17.926710 17024 consensus_queue.cc:1159] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 18 status { last_received { term: 17 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:17.913971 17028 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:17.955011  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1604) took 1283 ms. Trace:
I20260925 16:46:17.977602  8970 rpcz_store.cc:276] 0925 16:46:16.672069 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.672231 (+   162us) service_pool.cc:227] Handling call
0925 16:46:17.954845 (+1282614us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b54003c4bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:17.954967 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2797020928}
I20260925 16:46:17.980860  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:17.981801  9700 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:18.000905  9117 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.505s	user 0.021s	sys 0.069s
W20260925 16:46:18.001528  9117 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.505s	user 0.021s	sys 0.069s
W20260925 16:46:18.005473  9697 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.724s	user 0.045s	sys 0.071s
W20260925 16:46:18.006021  9697 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.755s	user 0.046s	sys 0.072s
I20260925 16:46:17.980228 16208 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:18.005339 17207 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.516s	user 0.000s	sys 0.002s
I20260925 16:46:17.961580 17060 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:18.018921  9118 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.462s	user 0.014s	sys 0.053s
W20260925 16:46:18.023007  9118 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.467s	user 0.014s	sys 0.053s
W20260925 16:46:17.957890 17163 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.480s	user 0.048s	sys 0.117s
I20260925 16:46:17.983640 17046 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
W20260925 16:46:18.044230  9702 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.555s	user 0.028s	sys 0.064s
W20260925 16:46:18.044787  9702 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.556s	user 0.028s	sys 0.064s
W20260925 16:46:18.032510 17163 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.557s	user 0.048s	sys 0.117s
I20260925 16:46:18.018596 16967 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:18.022153 17071 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.642s	user 0.014s	sys 0.000s
W20260925 16:46:18.025128  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.363s	user 0.009s	sys 0.056s
W20260925 16:46:18.061985  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.400s	user 0.010s	sys 0.056s
W20260925 16:46:18.021492  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.458s	user 0.038s	sys 0.105s
W20260925 16:46:18.064946  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.501s	user 0.039s	sys 0.105s
W20260925 16:46:18.065281  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.50181e+06us
W20260925 16:46:18.069380  9123 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.379s	user 0.017s	sys 0.041s
W20260925 16:46:18.069832  9123 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.380s	user 0.017s	sys 0.041s
I20260925 16:46:18.024947 17151 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:18.067337 17103 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:18.079507 17151 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:18.095316 17137 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.360s	user 0.010s	sys 0.001s
W20260925 16:46:18.092658 16845 consensus_meta.cc:287] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.738s	user 0.006s	sys 0.006s
I20260925 16:46:18.087858 17103 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.115116 17137 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.121950 17185 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Stepping down as leader of term 11
I20260925 16:46:18.122351 17185 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:18.117364 16705 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.908s	user 0.012s	sys 0.000s
I20260925 16:46:18.175124  8973 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 26: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
W20260925 16:46:18.181322  9121 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.475s	user 0.034s	sys 0.050s
W20260925 16:46:18.181344  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 114902us
I20260925 16:46:18.186414  9045 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 13. (term mismatch)
I20260925 16:46:18.188886  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:18.189445  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2037) took 2028 ms. Trace:
I20260925 16:46:18.135936 17060 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:18.310693  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.129181 17103 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:18.312287  9121 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.606s	user 0.034s	sys 0.051s
I20260925 16:46:18.138019 17104 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.126127 17137 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.123183 17185 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.317576 16913 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:18.318943 17185 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 11 FOLLOWER]: Advancing to term 12
I20260925 16:46:18.134862 17187 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.320827 17035 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:18.322137 17035 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.323158 17187 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.130364 17040 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.275334 17071 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:18.335848 17005 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:18.278806  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:18.294255  9693 rpcz_store.cc:276] 0925 16:46:16.161266 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.164436 (+  3170us) service_pool.cc:227] Handling call
0925 16:46:16.196960 (+ 32524us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:16.197344 (+   384us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:16.197384 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:16.205285 (+  7901us) log.cc:842] Serialized 26 byte log entry
0925 16:46:17.110358 (+905073us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:17.110409 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:17.110490 (+    81us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:18.188813 (+1078323us) raft_consensus.cc:1671] finished
0925 16:46:18.188857 (+    44us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.189197 (+   340us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":587,"raft.run_cpu_time_us":127,"raft.run_wall_time_us":11061,"thread_start_us":879446,"threads_started":1,"wal-append.queue_time_us":1808007}
I20260925 16:46:18.336584 17005 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:18.337145 17005 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:18.293620  9045 pending_rounds.cc:76] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 12
I20260925 16:46:18.337474 17040 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:18.337764  9045 pending_rounds.cc:97] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 22.13
I20260925 16:46:18.338274  9045 raft_consensus.cc:2866] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:18.336553 17071 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.342885 17071 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:18.349954  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:18.350768  9693 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:18.351346  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1606) took 1663 ms (client timeout 2150 ms). Trace:
W20260925 16:46:18.351859  8973 rpcz_store.cc:269] 0925 16:46:16.687568 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.688170 (+   602us) service_pool.cc:227] Handling call
0925 16:46:18.350954 (+1662784us) spinlock_profiling.cc:243] Waited 1.4 s on lock 0x7b54001e2654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:18.351206 (+   252us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3223295232}
I20260925 16:46:18.354525 17192 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:18.356292 16690 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.787s	user 0.012s	sys 0.000s
I20260925 16:46:18.357055 16690 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.364540  9693 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
W20260925 16:46:18.367136 17213 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.275s	user 0.001s	sys 0.003s
I20260925 16:46:18.115284 16845 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.371645  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2047) took 1884 ms. Trace:
I20260925 16:46:18.359427 16690 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:18.443883  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 109549us
I20260925 16:46:18.355638 17192 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.403052  9702 rpcz_store.cc:276] 0925 16:46:16.486602 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.487529 (+   927us) service_pool.cc:227] Handling call
0925 16:46:16.487855 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:16.488210 (+   355us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:16.488235 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:16.488606 (+   371us) log.cc:842] Serialized 26 byte log entry
0925 16:46:18.045432 (+1556826us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:18.045488 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.045581 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:18.370836 (+325255us) raft_consensus.cc:1671] finished
0925 16:46:18.370883 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.371473 (+   590us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1288,"raft.queue_time_us":9638,"raft.run_cpu_time_us":136,"raft.run_wall_time_us":5206,"thread_start_us":1556507,"threads_started":1,"wal-append.queue_time_us":1879308}
W20260925 16:46:18.457738  8975 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.576s	user 0.018s	sys 0.032s
I20260925 16:46:18.449119 17104 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:18.464483  9116 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.010s	sys 0.014s
W20260925 16:46:18.466168  8975 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.623s	user 0.018s	sys 0.032s
I20260925 16:46:18.462817  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:18.468294  9116 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.875s	user 0.010s	sys 0.014s
I20260925 16:46:18.459483 17114 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:18.460391 16996 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.141s	user 0.013s	sys 0.021s
W20260925 16:46:18.471916  9701 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.236s	user 0.008s	sys 0.037s
I20260925 16:46:18.476868 17151 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:18.478331  9701 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.290s	user 0.008s	sys 0.038s
I20260925 16:46:18.491595  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1974) took 2064 ms. Trace:
I20260925 16:46:18.492214  9121 rpcz_store.cc:276] 0925 16:46:16.433430 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.443824 (+ 10394us) service_pool.cc:227] Handling call
0925 16:46:16.508927 (+ 65103us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:16.548891 (+ 39964us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:16.548935 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:16.555233 (+  6298us) log.cc:842] Serialized 26 byte log entry
0925 16:46:16.705614 (+150381us) spinlock_profiling.cc:243] Waited 25.8 ms on lock 0x7b18003c6ee0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:46:18.313172 (+1607558us) raft_consensus.cc:1631] Marking committed up to 9
0925 16:46:18.313293 (+   121us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.313428 (+   135us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:18.491062 (+177634us) raft_consensus.cc:1671] finished
0925 16:46:18.491093 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.491486 (+   393us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":39491,"raft.queue_time_us":46662,"raft.run_cpu_time_us":76,"raft.run_wall_time_us":2379,"spinlock_wait_cycles":59382144,"thread_start_us":1606986,"threads_started":1,"wal-append.queue_time_us":1803164}
W20260925 16:46:18.480670  9015 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.028s	sys 0.030s
W20260925 16:46:18.480542  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.745s	user 0.014s	sys 0.025s
I20260925 16:46:18.494534  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1975) took 2052 ms. Trace:
W20260925 16:46:18.500962  9015 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.378s	user 0.028s	sys 0.031s
W20260925 16:46:18.498955  9122 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.309s	user 0.012s	sys 0.032s
I20260925 16:46:18.473706  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:18.481590 16996 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.216s	user 0.013s	sys 0.022s
W20260925 16:46:18.504587  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.834s	user 0.015s	sys 0.025s
W20260925 16:46:18.505137  9122 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.012s	sys 0.032s
I20260925 16:46:18.495957  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.477841 17192 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:18.503141  9666 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 1.490s	user 0.019s	sys 0.022s
W20260925 16:46:18.503852  9699 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.244s	user 0.016s	sys 0.029s
W20260925 16:46:18.498742  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.299s	user 0.009s	sys 0.046s
I20260925 16:46:18.469851 17127 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:18.506951  9042 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
W20260925 16:46:18.513662  9699 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.321s	user 0.016s	sys 0.030s
W20260925 16:46:18.514904  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.391s	user 0.010s	sys 0.046s
W20260925 16:46:18.511073  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.628s	user 0.015s	sys 0.006s
W20260925 16:46:18.512185  9666 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.579s	user 0.019s	sys 0.023s
W20260925 16:46:18.509389  9120 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.626s	user 0.008s	sys 0.036s
W20260925 16:46:18.519232  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56853.2us
W20260925 16:46:18.519857  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 474095us
W20260925 16:46:18.508158 17106 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.170s	user 0.011s	sys 0.024s
I20260925 16:46:18.528518  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:18.523597  8939 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.817s	user 0.004s	sys 0.035s
W20260925 16:46:18.526016  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.968s	user 0.003s	sys 0.019s
W20260925 16:46:18.530794  9120 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.709s	user 0.009s	sys 0.036s
W20260925 16:46:18.530645  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.016s	sys 0.006s
W20260925 16:46:18.527355  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.59458e+06us
W20260925 16:46:18.533171  8939 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.895s	user 0.004s	sys 0.035s
W20260925 16:46:18.534907  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.046s	user 0.003s	sys 0.019s
I20260925 16:46:18.500073  9118 rpcz_store.cc:276] 0925 16:46:16.443591 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.470488 (+ 26897us) service_pool.cc:227] Handling call
0925 16:46:16.470817 (+   329us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:16.547559 (+ 76742us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:16.547588 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:16.556141 (+  8553us) log.cc:842] Serialized 26 byte log entry
0925 16:46:18.023642 (+1467501us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:18.023715 (+    73us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.023847 (+   132us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:18.494115 (+470268us) raft_consensus.cc:1671] finished
0925 16:46:18.494151 (+    36us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.494379 (+   228us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":79405,"raft.queue_time_us":79070,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":4135,"thread_start_us":1467159,"threads_started":1,"wal-append.queue_time_us":1912798}
W20260925 16:46:18.533017 17106 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.264s	user 0.012s	sys 0.024s
I20260925 16:46:18.535028 17035 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.540971 17114 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:18.550359  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 907356us
I20260925 16:46:18.552928  9124 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 22
W20260925 16:46:18.555809  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.47612e+06us
I20260925 16:46:18.570241  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:18.569931  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:18.573520  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.574347  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:18.546252 17189 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:18.578083  9701 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2058) took 1390 ms. Trace:
I20260925 16:46:18.571237 17035 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:18.585027 16984 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.842s	user 0.022s	sys 0.058s
I20260925 16:46:18.592832  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "225d3432101a4758bb9a6b0efeae09c5"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:18.593364  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:18.578830 17194 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.785s	user 0.018s	sys 0.023s
I20260925 16:46:18.540755 17127 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.593835  9048 raft_consensus.cc:595] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Received request to transfer leadership to TS 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:18.592904  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 1990) took 1920 ms. Trace:
I20260925 16:46:18.594882  9121 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:18.592700 16984 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.951s	user 0.022s	sys 0.059s
I20260925 16:46:18.603880  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3822) took 2192 ms. Trace:
I20260925 16:46:18.581593  9701 rpcz_store.cc:276] 0925 16:46:17.187425 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.187568 (+   143us) service_pool.cc:227] Handling call
0925 16:46:17.187970 (+   402us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:18.557210 (+1369240us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:18.564278 (+  7068us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.564349 (+    71us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:18.564396 (+    47us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.568799 (+  4403us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.578024 (+  9225us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":309,"raft.queue_time_us":50077,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":10505,"thread_start_us":1294067,"threads_started":1}
I20260925 16:46:18.606897  9042 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260925 16:46:18.600642 17218 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
W20260925 16:46:18.602732 17194 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.883s	user 0.018s	sys 0.024s
I20260925 16:46:18.628499 17218 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:18.628988 17127 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:18.604295  9123 rpcz_store.cc:276] 0925 16:46:16.634367 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.634526 (+   159us) service_pool.cc:227] Handling call
0925 16:46:16.668974 (+ 34448us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:16.669181 (+   207us) raft_consensus.cc:1520] Early marking committed up to index 18
0925 16:46:18.070232 (+1401051us) log.cc:842] Serialized 14 byte log entry
0925 16:46:18.525078 (+454846us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.534388 (+  9310us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:18.539039 (+  4651us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.543926 (+  4887us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.554436 (+ 10510us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1705916,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":46,"raft.queue_time_us":4179,"raft.run_cpu_time_us":281,"raft.run_wall_time_us":12601,"thread_start_us":1782744,"threads_started":2,"wal-append.queue_time_us":446816}
I20260925 16:46:18.632493  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2057) took 1494 ms. Trace:
I20260925 16:46:18.606541  9117 rpcz_store.cc:276] 0925 16:46:16.370652 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.370790 (+   138us) service_pool.cc:227] Handling call
0925 16:46:16.371131 (+   341us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:16.388632 (+ 17501us) raft_consensus.cc:1520] Early marking committed up to index 15
0925 16:46:18.002124 (+1613492us) log.cc:842] Serialized 14 byte log entry
0925 16:46:18.506981 (+504857us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.514539 (+  7558us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:18.532869 (+ 18330us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.541364 (+  8495us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.563240 (+ 21876us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":104213,"prepare.queue_time_us":1985956,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":57,"raft.queue_time_us":29352,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":11820,"spinlock_wait_cycles":14983936,"thread_start_us":1909977,"threads_started":2,"wal-append.queue_time_us":557720}
I20260925 16:46:18.634199  9699 rpcz_store.cc:276] 0925 16:46:17.137851 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.189111 (+ 51260us) service_pool.cc:227] Handling call
0925 16:46:17.192362 (+  3251us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:18.582333 (+1389971us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:18.586367 (+  4034us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.590145 (+  3778us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:18.594234 (+  4089us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.605465 (+ 11231us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.632420 (+ 26955us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":84254,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":96112,"thread_start_us":1323113,"threads_started":1}
I20260925 16:46:18.646477 17035 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.675886  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:18.688385  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4088) took 2049 ms. Trace:
I20260925 16:46:18.676360 16845 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:18.639997 17189 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.696823  9702 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:18.629968 17218 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.699256 17226 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:46:18.700366 17232 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:18.701285  9666 connection.cc:232] RPC call timeout handler was delayed by -1.1974183370000446s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1627s for a response
I20260925 16:46:18.702169 17229 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:18.709830  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4089) took 2070 ms. Trace:
W20260925 16:46:18.715947  9700 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.701s	user 0.010s	sys 0.013s
I20260925 16:46:18.716502  9700 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:18.705878 16913 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:18.719915 17227 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260925 16:46:18.722148 17114 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.708791 17052 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:18.724050 17052 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:18.724450 17052 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:18.727885 17229 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.730434 17229 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:18.732970  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.733865  9117 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:18.734974  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.736179  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.736977  9117 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:18.737705  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.738319  9117 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:18.739084  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.740826  9123 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 23 index: 13. (index mismatch)
W20260925 16:46:18.741892  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c756d218cfc0470183a9fe1cc08a22ab, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:18.742240  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c756d218cfc0470183a9fe1cc08a22ab, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.743028 17035 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.744617 17232 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.745641  9120 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4094) took 2038 ms. Trace:
W20260925 16:46:18.752429  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53865.1us
I20260925 16:46:18.752646 17071 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:46:18.753203 17071 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:18.754280 17071 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:18.756896 17238 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.136s	user 0.001s	sys 0.000s
I20260925 16:46:18.757527  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.759418  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.760449  9693 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:18.761759  9117 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:18.762276 17189 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.762768  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.762861  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.763274  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4092) took 2111 ms. Trace:
I20260925 16:46:18.764271  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.764410  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.765051  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.765285  9046 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:18.765867  9044 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:18.766546  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.763454  9117 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:18.767571  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.768110  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.768311  9123 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:18.768839  9117 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:46:18.769012  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.769209  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.769714  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.770131  9123 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:18.772047  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.772840  9123 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:46:18.774349  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.774749  9696 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:18.771080  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.772251  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.776423  9050 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:18.786820  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:18.763675  9119 rpcz_store.cc:276] 0925 16:46:16.651553 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.628049 (+976496us) service_pool.cc:227] Handling call
0925 16:46:17.628464 (+   415us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:17.786414 (+157950us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:46:17.786457 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:17.786965 (+   508us) log.cc:842] Serialized 26 byte log entry
0925 16:46:18.595871 (+808906us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:18.607495 (+ 11624us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.755416 (+147921us) spinlock_profiling.cc:243] Waited 157 ms on lock 0x7b5400164254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:18.755473 (+    57us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:18.756103 (+   630us) spinlock_profiling.cc:243] Waited 3.68 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:18.763023 (+  6920us) raft_consensus.cc:1671] finished
0925 16:46:18.763044 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.763219 (+   175us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":787,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110,"spinlock_wait_cycles":370665600,"thread_start_us":710839,"threads_started":1,"wal-append.queue_time_us":758343}
I20260925 16:46:18.746140  9120 rpcz_store.cc:276] 0925 16:46:16.707598 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.639018 (+931420us) service_pool.cc:227] Handling call
0925 16:46:17.681169 (+ 42151us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:17.812074 (+130905us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:17.812105 (+    31us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:17.812507 (+   402us) log.cc:842] Serialized 26 byte log entry
0925 16:46:18.601025 (+788518us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:18.611034 (+ 10009us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.745075 (+134041us) spinlock_profiling.cc:243] Waited 128 ms on lock 0x7b54003bf1d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:18.745143 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:18.745238 (+    95us) raft_consensus.cc:1671] finished
0925 16:46:18.745256 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.745569 (+   313us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":9543,"spinlock_wait_cycles":294191360,"thread_start_us":713776,"threads_started":1,"wal-append.queue_time_us":820050}
I20260925 16:46:18.773666  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.719336 16913 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.789081  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.789127  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.780827  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.790393  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.790522  9696 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:18.791266  9694 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:18.791556  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.788152  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.792308  9696 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:46:18.792790  9048 raft_consensus.cc:2396] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 21 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:46:18.793239  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.793360  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.793658  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:18.793951  9696 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:46:18.794227  9048 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:18.794595  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.794936  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.783097  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.785367  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.796268  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:18.788113 17227 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:18.796764 17227 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:18.796875  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.798071 17227 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.782739  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.799659  9695 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:18.800203  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.770411  9117 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:18.801594 17227 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:18.799877  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.776711  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.770342  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.804656 17005 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.805327 16913 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:18.792582  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:18.805938  9115 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:18.806142  9702 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:18.807132 17226 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:18.787314  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.807565 17226 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:18.808080 17226 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:18.808261  9045 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:18.818825  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.820152 17106 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:18.820761 17106 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:18.820268 17226 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.821911 17106 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.823079 17226 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.817574  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.828250  9050 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:18.828559  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.830739  9123 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:18.829077  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.832182  9119 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:18.802026  9698 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 21 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 14.
I20260925 16:46:18.829397  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.832782  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.779500  9124 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:18.829681  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:18.834198 17035 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:18.834904 17035 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:18.834692 17227 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:18.835389 17035 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:18.835939 17227 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:18.836452 17227 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:18.839113  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.834232  9115 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:18.840353 17220 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:18.840902 17220 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:18.841470 17220 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:18.842402  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.843233  9117 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:18.747319 17232 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:18.841029  8972 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.532s	user 0.005s	sys 0.006s
I20260925 16:46:18.865458  8972 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:18.801544 17071 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:46:18.866920  8972 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1603) took 2202 ms (client timeout 1540 ms). Trace:
I20260925 16:46:18.847566 17219 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:18.868244 17219 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.870836 17219 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.848956 17171 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260925 16:46:18.851120 17247 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
W20260925 16:46:18.867352  8972 rpcz_store.cc:269] 0925 16:46:16.664553 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.664792 (+   239us) service_pool.cc:227] Handling call
0925 16:46:18.866633 (+2201841us) spinlock_profiling.cc:243] Waited 1.63 s on lock 0x7b54002cd3d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:18.866792 (+   159us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3744198400}
I20260925 16:46:18.858883 17220 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.881713 17220 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.878983 17227 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.888754 17171 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:46:18.890132 17171 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:18.890537 17171 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:18.891656  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.891664 17227 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.892625  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 28.
I20260925 16:46:18.893641  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:18.894456 17227 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:18.894574  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:18.852788  9121 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:18.895493 17219 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:18.895992 17219 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:18.853099  8941 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.896330 17219 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:18.897137 17091 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:18.897670 17091 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:18.897778  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.853160  9016 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:18.855100  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:18.857357  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:18.899605  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46539.4us
W20260925 16:46:18.900015  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47078.6us
I20260925 16:46:18.900322  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.900951  9044 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:18.901782  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.902727  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.903362  9044 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:18.858672  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:18.711295  9116 rpcz_store.cc:276] 0925 16:46:16.639107 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.491717 (+852610us) service_pool.cc:227] Handling call
0925 16:46:17.592649 (+100932us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:17.592897 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:46:18.505362 (+912465us) log.cc:842] Serialized 14 byte log entry
0925 16:46:18.681338 (+175976us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.683952 (+  2614us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:18.691490 (+  7538us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.694451 (+  2961us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.709780 (+ 15329us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":782919,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":49,"raft.queue_time_us":7505,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":18785,"thread_start_us":1009026,"threads_started":2,"wal-append.queue_time_us":164964}
I20260925 16:46:18.905078  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.905756  9121 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:46:18.905959 17219 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.900338  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:18.860677  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.861614  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:18.908754  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.909080  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.909844  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.910449  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.910885  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.911249  9045 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:18.859992 17005 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.891412 17171 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:18.898697 17091 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:18.785529  9700 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:18.862973  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.890280  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:18.689352  9122 rpcz_store.cc:276] 0925 16:46:16.638896 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:17.112987 (+474091us) service_pool.cc:227] Handling call
0925 16:46:17.113311 (+   324us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:17.113494 (+   183us) raft_consensus.cc:1520] Early marking committed up to index 10
0925 16:46:18.512447 (+1398953us) log.cc:842] Serialized 14 byte log entry
0925 16:46:18.687387 (+174940us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.687543 (+   156us) raft_consensus.cc:1631] Marking committed up to 10
0925 16:46:18.687744 (+   201us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.687959 (+   215us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.688293 (+   334us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1261976,"prepare.run_cpu_time_us":70,"prepare.run_wall_time_us":65,"raft.queue_time_us":1992,"raft.run_cpu_time_us":146,"raft.run_wall_time_us":147,"thread_start_us":1523820,"threads_started":2}
I20260925 16:46:18.911522  9041 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:18.912433  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.852068 17226 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:18.883374  9048 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:18.915989  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.916587  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.912381  9697 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2034) took 2870 ms. Trace:
I20260925 16:46:18.895689  9014 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:18.945178  9044 raft_consensus.cc:2379] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:18.912230 17110 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:18.979915  9115 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:18.995278  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.930852  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.895409  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1617) took 2052 ms. Trace:
I20260925 16:46:18.895156 17227 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:18.920042  9119 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:18.919744  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.992870  9047 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 21. Ops: []
I20260925 16:46:18.996372  8975 rpcz_store.cc:276] 0925 16:46:16.842578 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.842776 (+   198us) service_pool.cc:227] Handling call
0925 16:46:16.843118 (+   342us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:16.843350 (+   232us) raft_consensus.cc:1520] Early marking committed up to index 18
0925 16:46:18.508110 (+1664760us) log.cc:842] Serialized 14 byte log entry
0925 16:46:18.689827 (+181717us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.695938 (+  6111us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:18.712266 (+ 16328us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.895195 (+182929us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.895317 (+   122us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":1682112,"prepare.run_cpu_time_us":100,"prepare.run_wall_time_us":5813,"raft.queue_time_us":7254,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":9067,"thread_start_us":1753772,"threads_started":2,"wal-append.queue_time_us":154677}
I20260925 16:46:18.999567  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.001006  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.001982  9047 raft_consensus.cc:2396] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:46:19.002831  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:18.995613 17035 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.006409 17035 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:18.978101 17220 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:18.917441  9697 rpcz_store.cc:276] 0925 16:46:16.041383 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:16.042362 (+   979us) service_pool.cc:227] Handling call
0925 16:46:16.042608 (+   246us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:16.042773 (+   165us) raft_consensus.cc:1520] Early marking committed up to index 16
0925 16:46:16.105470 (+ 62697us) log.cc:842] Serialized 14 byte log entry
0925 16:46:16.250449 (+144979us) spinlock_profiling.cc:243] Waited 30.6 ms on lock 0x7b18004bc700. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb157b 00007f719bf3488a
0925 16:46:18.485971 (+2235522us) spinlock_profiling.cc:243] Waited 3.41 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:18.564333 (+ 78362us) spinlock_profiling.cc:243] Waited 14.7 ms on lock 0x7b18004bc700. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:46:18.685207 (+120874us) log.cc:842] Serialized 14 byte log entry
0925 16:46:18.696117 (+ 10910us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:18.710178 (+ 14061us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:18.911883 (+201705us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:18.911982 (+    99us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:18.912115 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":61524,"prepare.run_cpu_time_us":46,"prepare.run_wall_time_us":48,"raft.queue_time_us":12345,"raft.run_cpu_time_us":295,"raft.run_wall_time_us":4013,"spinlock_wait_cycles":111956992,"thread_start_us":1874846,"threads_started":2,"wal-append.queue_time_us":2365376}
I20260925 16:46:19.011025  9050 raft_consensus.cc:2379] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 16: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:19.007875  9043 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:18.922614 17171 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:18.987594 17219 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:19.012616  9041 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:18.998454 17227 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:19.024384  9047 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:19.025130  9047 raft_consensus.cc:595] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:19.025550  9047 raft_consensus.cc:603] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:19.029680  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:19.010154 17220 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:18.875178 17052 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.029661  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:19.038275  9043 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:19.040719  9045 raft_consensus.cc:2396] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 24 because replica has last-logged OpId of term: 23 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 17.
I20260925 16:46:19.044130  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:19.052810  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95527us
I20260925 16:46:19.054865  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.055840  9697 raft_consensus.cc:2354] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:19.027143 17110 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.038378 17035 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:19.089265  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47536.6us
I20260925 16:46:19.038754 17220 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:19.051765  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:19.100934  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.101878  9697 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:19.111443  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.107007  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:19.100289  9666 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.194:45245 timed out after 2.150s (SENT) [suppressed 33 similar messages]
I20260925 16:46:19.115245  9700 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:19.096824 17232 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:19.118024  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.116608  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.119793  9694 raft_consensus.cc:1799] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:19.120388  9694 raft_consensus.cc:2354] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:19.121104  9044 raft_consensus.cc:1799] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:19.121707  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.124876  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:19.126685  9044 raft_consensus.cc:2354] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17.
I20260925 16:46:19.134351  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:19.137079  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 236799us
I20260925 16:46:19.139616  9697 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:46:19.134719 17226 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:19.141988 17226 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:19.142419 17226 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:19.144707 17103 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:19.146821  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.147578  9118 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:19.145243 17103 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.151288 17103 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.153424  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.154188  9698 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:19.164376  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.168251  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.169591  9047 raft_consensus.cc:2379] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 27: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:19.172869  9041 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:19.179461  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.180768  9694 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 27: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:19.185810  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.186561  9698 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:19.187712  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.188441  9697 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:19.193321  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.193477  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.198575  9699 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:19.207314  9047 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:19.168921 17232 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:19.214020  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:19.216380  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.218084  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.205296 17103 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:19.214600  9702 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:46:19.205016 17052 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:19.222702  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.220793  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.223824  9700 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:19.212245 17260 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260925 16:46:19.235687 17260 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:19.236063 17260 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.236918 17260 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.238070 17260 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:19.239218  9049 raft_consensus.cc:1226] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:19.240881  9042 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:19.246479 17226 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:19.248214  9046 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 14 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260925 16:46:19.248760 17227 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:19.250020  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.250661 17227 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:19.255168  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.255829  9042 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:19.256668  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.257833  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.258483  9042 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:19.258920  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.260458  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.261605  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.262616  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.235682 17110 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:19.267308  9090 leader_election.cc:398] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:19.267642  9090 leader_election.cc:401] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:19.268196 17218 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:19.270466  9697 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:19.251369  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.273746  9044 raft_consensus.cc:2354] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
I20260925 16:46:19.274971  9046 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:19.259361  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.279589  9047 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:19.280161  9700 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:19.278975  9698 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:46:19.282402  9043 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:19.284862  9697 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:19.284894  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.289736  9044 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:19.290272  9044 raft_consensus.cc:595] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.290697  9044 raft_consensus.cc:603] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260925 16:46:19.285054  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 247170us
I20260925 16:46:19.292235  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.293166  9115 raft_consensus.cc:2396] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 18 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:46:19.295166  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.296371  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.298882  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.300904  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.301734  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.308161  9016 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:19.311414  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 415867us
I20260925 16:46:19.308888  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.318717  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.319553  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:19.319921  9115 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:19.325451 17261 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:19.325991 17261 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.329329  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.325471  9016 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.297389 16913 raft_consensus.cc:2741] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 26: won
I20260925 16:46:19.328348  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.302248 17071 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:19.333343  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.335609  9044 raft_consensus.cc:1799] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Handling vote request from an unknown peer 40a71744ceba4efe949720cb0f274853
I20260925 16:46:19.338192  9044 raft_consensus.cc:2354] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
W20260925 16:46:19.337129  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46494.9us
I20260925 16:46:19.345183  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.327234 17185 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:19.352084  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.333115 17040 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:19.355038  9698 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:19.343631 17005 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:19.358503  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:19.361663  9046 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:19.362255  9046 raft_consensus.cc:595] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.362596  9046 raft_consensus.cc:603] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:19.362764  9044 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 27: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:19.350394 17071 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.356108 17052 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader election won for term 16
I20260925 16:46:19.355997 17106 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260925 16:46:19.372917  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.377233  9042 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:19.326943 17261 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.374747  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.357151 17226 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:19.373523  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.374946  9090 leader_election.cc:398] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:19.356561 17258 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:19.364719 17040 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:19.370276 17185 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:19.380385  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.363619 17005 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:19.383198 17052 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.377068 17106 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:19.385231 17263 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.083s
I20260925 16:46:19.464867 17227 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:19.465433 17227 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.466499 17227 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.468171 17227 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:19.386947 17228 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:19.472563 17228 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:19.473595 17228 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.388715 17040 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.385306  9090 leader_election.cc:401] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:19.392257  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.391835  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.481010  9044 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:19.409482  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.417857  9116 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260925 16:46:19.419245  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.397868  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.434357  8972 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 13. Current term is 14. Ops: []
I20260925 16:46:19.390522  9699 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:19.436110  8973 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:19.437523  8971 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:19.438328  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.443202  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.399765 17232 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:19.390961 17185 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.534581 17232 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 21
I20260925 16:46:19.536487  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.536764  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.537904  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.537935  9697 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:19.533823  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.484808  9118 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:19.438051  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.533120  9047 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:46:19.461803  8865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 346) took 18301 ms (client timeout 15000 ms). Trace:
I20260925 16:46:19.460464  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:19.431219  8975 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
W20260925 16:46:19.407925 17255 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.193s	user 0.000s	sys 0.001s
I20260925 16:46:19.387847 17258 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:19.590698 17258 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:19.591773 17265 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
I20260925 16:46:19.594336  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.595044  9041 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:19.595737  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.596791  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.597808  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.598806  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:19.601186  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.707s (SENT)
I20260925 16:46:19.585043  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:19.485301  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 110532us
W20260925 16:46:19.580273  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 215645us
I20260925 16:46:19.446321  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.420926  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:19.603303  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 123797us
I20260925 16:46:19.586195  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.538992  9042 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:19.390178  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.587744  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.587893  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.588136  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.588327  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.397071 17052 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.589730  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.397670  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:19.608570  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 148327us
I20260925 16:46:19.605206  9044 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:19.442991  8967 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:19.524111  9050 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:19.608135  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.400597 17220 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:19.612517  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 223554us
I20260925 16:46:19.614904  8969 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 15.
I20260925 16:46:19.612361  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.404806 17106 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:19.609216  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.615180  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.615238  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.392025 17005 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:19.442889 17035 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:19.619093  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:19.630854  9048 raft_consensus.cc:595] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.631457  9048 raft_consensus.cc:603] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:19.619390  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:19.621753  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:19.633212  9049 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:19.623172  9697 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260925 16:46:19.633857  9041 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 24 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260925 16:46:19.625382  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.400173 17114 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.216s
I20260925 16:46:19.643422  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.638720  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.621524 17261 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:19.650740  9120 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 12.
I20260925 16:46:19.642596  9696 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260925 16:46:19.628005 17263 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:19.625289 17218 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:19.660108  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.655339  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.658272  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.391024 17071 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.669030  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.676967  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.677194  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.679767  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:19.680503  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71308.3us
I20260925 16:46:19.657492 17261 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:19.692464  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:46:19.662079 17218 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:19.699904  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.650470 17103 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.045s
I20260925 16:46:19.700455  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.698302  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.699769  8973 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 24: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:19.695154  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.693451  8968 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
W20260925 16:46:19.750870  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69468us
I20260925 16:46:19.700594 17218 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:19.752056  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:19.753921  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:19.751019  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.677672 17263 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:19.758494  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.698573 17261 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:19.768106  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 138916us
I20260925 16:46:19.699688 17228 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:19.772461  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.773597  8974 raft_consensus.cc:2396] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 20 because replica has last-logged OpId of term: 19 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 13.
I20260925 16:46:19.782963  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.784345  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.785420  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.787842  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:19.775130  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 145213us
I20260925 16:46:19.791545  8975 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:19.788589  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.792888  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.759845 17260 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:19.789228  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.792547  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.796574  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.799428  9124 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:19.802002  8971 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:19.804167  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.788172  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:19.805722  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.808350  8969 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 24 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 14.
I20260925 16:46:19.787053 17257 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:19.787617 17273 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:19.810215  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.829031  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:19.831430  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 63597.3us
I20260925 16:46:19.834074  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.835032  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.835647  8968 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:19.836532  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.837965  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:19.801515 17260 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:19.841005  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.762s (SENT)
I20260925 16:46:19.841418  8974 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
W20260925 16:46:19.583076  8865 rpcz_store.cc:269] 0925 16:46:01.160478 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:01.190776 (+ 30298us) service_pool.cc:227] Handling call
0925 16:46:19.461528 (+18270752us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:13.111151 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:13.205567 (+ 94416us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:13.205629 (+    62us) write_op.cc:435] Acquired schema lock
0925 16:46:13.205644 (+    15us) tablet.cc:660] Decoding operations
0925 16:46:13.567616 (+361972us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:13.567757 (+   141us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:13.567815 (+    58us) tablet.cc:683] Acquiring locks for 28 operations
0925 16:46:13.570962 (+  3147us) tablet.cc:699] Row locks acquired
0925 16:46:13.571011 (+    49us) write_op.cc:260] PREPARE: finished
0925 16:46:13.571194 (+   183us) write_op.cc:270] Start()
0925 16:46:13.571387 (+   193us) write_op.cc:276] Timestamp: P: 1790354773571120 usec, L: 0
0925 16:46:13.571433 (+    46us) op_driver.cc:331] REPLICATION: starting
0925 16:46:13.743048 (+171615us) log.cc:842] Serialized 10988 byte log entry
0925 16:46:14.695998 (+952950us) op_driver.cc:444] REPLICATION: finished
0925 16:46:14.814710 (+118712us) write_op.cc:301] APPLY: starting
0925 16:46:14.814801 (+    91us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:15.641491 (+826690us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:15.641661 (+   170us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:16.473911 (+832250us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:16.474304 (+   393us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=56,key_file_lookups=56,delta_file_lookups=56,mrs_lookups=0
0925 16:46:16.474360 (+    56us) write_op.cc:312] APPLY: finished
0925 16:46:16.474878 (+   518us) log.cc:842] Serialized 244 byte log entry
0925 16:46:18.056777 (+1581899us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:18.062725 (+  5948us) write_op.cc:454] Released schema lock
0925 16:46:18.071001 (+  8276us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:18.095357 (+ 24356us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:18.096445 (+  1088us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1699712,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":115793,"apply.run_cpu_time_us":205240,"apply.run_wall_time_us":3282430,"cfile_cache_hit":114,"cfile_cache_hit_bytes":120999,"num_ops":28,"prepare.queue_time_us":466101,"prepare.run_cpu_time_us":28229,"prepare.run_wall_time_us":1096252,"raft.queue_time_us":225174,"raft.run_cpu_time_us":45544,"raft.run_wall_time_us":128918,"replication_time_us":1124450,"spinlock_wait_cycles":1261440,"thread_start_us":2251950,"threads_started":5,"wal-append.queue_time_us":2268419,"wal-append.run_cpu_time_us":39187,"wal-append.run_wall_time_us":2417321}]]}
I20260925 16:46:19.846719 16845 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:19.786278 17228 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:19.850364  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:19.864298  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:19.864482  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:19.859870  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 74627.6us
I20260925 16:46:19.859333  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.837581 17273 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:19.845781 17260 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:19.869372  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.866189  9124 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:46:19.839408 17257 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:19.879442  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.882647  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.881911  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.885360  8972 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:19.844528 17220 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:19.887156  9121 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260925 16:46:19.889567  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79810.7us
I20260925 16:46:19.879204 17273 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:19.897131  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 66547.1us
I20260925 16:46:19.900273 17258 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:19.903719 17277 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260925 16:46:19.905196 17220 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:19.883173 17103 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:19.901331 17263 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:19.888937  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 78496us
I20260925 16:46:19.863961 16845 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:19.907938  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:19.886971 17257 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:19.912147  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:19.909816  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.930222  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.933645  8972 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:19.937356  9696 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:19.883132 17279 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.048s
I20260925 16:46:19.927759 16845 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:19.948342  8970 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260925 16:46:19.936605 17103 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:19.953845  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:19.959167  8972 raft_consensus.cc:2362] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17. Re-sending same reply.
I20260925 16:46:19.953395  9694 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260925 16:46:19.983160  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46053.6us
I20260925 16:46:19.954447  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:20.000715  9121 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260925 16:46:19.956070 17278 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260925 16:46:20.006958  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.951759 16913 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:19.939327 17271 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:19.957024 17280 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:20.027647  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:20.019197 17185 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.010s
W20260925 16:46:20.016901 17282 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260925 16:46:20.032733 17228 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.033744 17288 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260925 16:46:20.027662  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 121224us
I20260925 16:46:20.039886  8974 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:20.019058  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:19.983421 17220 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:19.954589 17287 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:19.951951 17171 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.065s
W20260925 16:46:20.056329  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 44548.5us
I20260925 16:46:20.057828  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.058740  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:19.951686 17260 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:20.017380 16913 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:20.042670 17280 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.070245  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.069422  9121 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:20.074950  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:20.079533  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.068585 16913 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:20.099588  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 79430.8us
I20260925 16:46:20.064440 17220 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.159791 17274 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.108s
I20260925 16:46:20.161677 17218 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.154032 17295 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
W20260925 16:46:20.163581  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 77593.5us
W20260925 16:46:20.163579  9045 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.525s	user 0.006s	sys 0.000s
I20260925 16:46:20.165061  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.061059 17273 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:20.180220  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.065191 17226 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.099s
I20260925 16:46:20.176909  9045 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
W20260925 16:46:20.180543  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 81915.2us
W20260925 16:46:20.184388  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 124297us
I20260925 16:46:20.180934  8975 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:46:20.162509 17261 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:20.161691 16845 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.569902  9120 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:46:20.569909  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:20.172747 17040 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:20.586714  9118 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:20.570567  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.210726  9121 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260925 16:46:20.570230  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 379832us
W20260925 16:46:20.247457  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57388.6us
I20260925 16:46:20.350423  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:20.579972  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 368998us
I20260925 16:46:20.210398  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:20.592408  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:20.226413  9116 raft_consensus.cc:1226] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22. Ops: []
W20260925 16:46:20.593947  8974 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.530s	user 0.009s	sys 0.001s
I20260925 16:46:20.597769  9666 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:20.598358  8974 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
W20260925 16:46:20.188318 17232 consensus_meta.cc:287] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.653s	user 0.010s	sys 0.000s
I20260925 16:46:20.181259 17258 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.606199  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:20.176604 17295 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:20.225968 17227 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.757s	user 0.005s	sys 0.006s
W20260925 16:46:20.531715 17106 consensus_meta.cc:287] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.882s	user 0.007s	sys 0.003s
W20260925 16:46:20.492523 17305 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260925 16:46:20.486299 17257 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260925 16:46:20.668708  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:20.543288 17005 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.873s	user 0.006s	sys 0.002s
W20260925 16:46:20.408525 17291 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.404s	user 0.000s	sys 0.001s
I20260925 16:46:20.587602 17218 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:20.659888  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49508.5us
I20260925 16:46:20.660589  9696 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: [18.16-18.16]
W20260925 16:46:20.661366  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55242.3us
I20260925 16:46:20.663189  9043 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260925 16:46:20.674398  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:20.667774  8975 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:20.472395 17273 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.449119 17260 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.496403 17220 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:20.190555 17103 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:20.662904  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50162.6us
I20260925 16:46:20.672049 17185 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:20.662554  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:46:20.660756 17232 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
W20260925 16:46:20.678802  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 73288.2us
I20260925 16:46:20.594720 17040 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:20.692024 17040 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:20.696318 17312 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:46:20.679255  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:20.683342 17309 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:20.675370 17257 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.699012 17309 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:20.701869  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:20.703505  8967 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:46:20.702124 17257 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:20.702039 17309 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:20.687347  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:46:20.705900  9045 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1539) took 1668 ms (client timeout 1841 ms). Trace:
W20260925 16:46:20.706316  9045 rpcz_store.cc:269] 0925 16:46:19.035744 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:19.051450 (+ 15706us) service_pool.cc:227] Handling call
0925 16:46:20.702368 (+1650918us) spinlock_profiling.cc:243] Waited 544 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:20.702464 (+    96us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1252104576}
I20260925 16:46:20.709432  9118 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 29.
I20260925 16:46:20.710897  8967 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:20.712371 17261 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.713558  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:20.718142 16845 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.718760 16845 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:20.676038 17005 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.725662  9123 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:20.726017 17005 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:20.708055 17260 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260925 16:46:20.662988 17106 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.729211 17106 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:20.683483 17103 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.731913  8969 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 11. Current term is 13. Ops: []
I20260925 16:46:20.723289  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3448) took 1121 ms. Trace:
I20260925 16:46:20.733497 17103 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:20.733861 17280 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:20.708531 17295 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.735229 17295 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:20.742728 17274 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:20.735086  8967 rpcz_store.cc:276] 0925 16:46:19.589977 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:20.701591 (+1111614us) service_pool.cc:227] Handling call
0925 16:46:20.711430 (+  9839us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:20.747800  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:20.743765  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46702us
I20260925 16:46:20.737881  9123 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:20.743052 17312 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:20.743590 17280 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260925 16:46:20.741922  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.757910  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:20.759025  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:20.760200 17312 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:20.754769 17257 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election won for term 29
I20260925 16:46:20.754906  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.809219  9089 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.816931 17324 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:20.816725 17185 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:20.817574 17324 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:20.818392  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 145202us
I20260925 16:46:20.818064 17185 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.821640 17325 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:20.822000 17325 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:20.824091  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 110631us
W20260925 16:46:20.826634  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65247.7us
I20260925 16:46:20.811546 17040 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.829649 17040 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.829838 17312 ts_tablet_manager.cc:1905] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:46:20.831193 17257 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:20.832368 17257 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:20.833340 17295 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:20.834259  9666 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:20.835551  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:20.836439 17040 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:20.812498 16913 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.646s	user 0.010s	sys 0.000s
I20260925 16:46:20.837073  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:20.837270 16913 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.839740  9697 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:20.818064 17324 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.842527 17324 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:20.843015 17324 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:20.844233  9089 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:20.844934  9089 raft_consensus.cc:2670] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: unable to run election callback: Service unavailable: Thread pool token was shut down
I20260925 16:46:20.846976  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:20.823604 17325 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:20.836452 17309 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:20.851807 17103 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:20.839435 16913 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.825304 17274 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:20.855194 17274 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:20.855410  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4002) took 1472 ms. Trace:
I20260925 16:46:20.855805  9043 rpcz_store.cc:276] 0925 16:46:19.382842 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:19.609278 (+226436us) service_pool.cc:227] Handling call
0925 16:46:19.626259 (+ 16981us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:20.674722 (+1048463us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:20.855170 (+180448us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b54002a2454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:20.855333 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2383858048}
I20260925 16:46:20.856205  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4111) took 1074 ms. Trace:
I20260925 16:46:20.857367  9116 rpcz_store.cc:276] 0925 16:46:19.782213 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:19.783543 (+  1330us) service_pool.cc:227] Handling call
0925 16:46:19.800347 (+ 16804us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:20.604669 (+804322us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:20.855983 (+251314us) spinlock_profiling.cc:243] Waited 412 ms on lock 0x7b5400010254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:20.856145 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":946863360}
W20260925 16:46:20.853262  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 111434us
I20260925 16:46:20.811275 17310 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:46:20.862416  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 196658us
I20260925 16:46:20.862754  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.843581 17324 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:20.868548  9694 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
W20260925 16:46:20.868604  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 113753us
I20260925 16:46:20.853307 17309 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:20.870795 17219 consensus_queue.cc:1046] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.006s
I20260925 16:46:20.874516 17274 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:20.875978  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:20.876539  9696 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:20.872357 17071 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.005s
I20260925 16:46:20.866466 17106 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.011s
I20260925 16:46:20.868343 17295 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:20.879136 17295 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:20.879477 17295 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:20.882026 17219 raft_consensus.cc:3032] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:20.882424 17219 raft_consensus.cc:729] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:20.885793  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:20.886297 17275 log.cc:924] Time spent T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 1.089s	user 0.014s	sys 0.004s
I20260925 16:46:20.887955 17103 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:20.891999  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1622) took 1004 ms. Trace:
I20260925 16:46:20.892372  8969 rpcz_store.cc:276] 0925 16:46:19.887488 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:19.887607 (+   119us) service_pool.cc:227] Handling call
0925 16:46:19.889414 (+  1807us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:20.732427 (+843013us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:20.891777 (+159350us) spinlock_profiling.cc:243] Waited 842 ms on lock 0x7b54002fe754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:20.891927 (+   150us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1937058560}
I20260925 16:46:20.892858  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.896421  9700 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:20.847430 17040 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:20.895905  9696 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
W20260925 16:46:20.902927  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43643.7us
I20260925 16:46:20.870296 17324 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:20.908401  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:20.909260  9696 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:20.917207  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.917915 17322 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:20.919867 17322 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:20.920248 17322 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:20.918397 17106 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:20.926251 16996 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:46:20.926625 16996 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:20.926993 16996 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:46:20.932988  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.933830 17005 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:20.934897  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:20.953251  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:20.985497  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 145870us
I20260925 16:46:20.883220 17219 consensus_queue.cc:260] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:20.986104  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 92286.5us
I20260925 16:46:21.002861  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:20.987207  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 82481.8us
I20260925 16:46:21.009780  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:20.907070 17324 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:21.014251  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.018566  9694 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:20.939632 17071 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:21.025061  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.020001  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.026142  9694 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:46:21.024901  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:21.024310  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.027957  9120 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:21.011137 17232 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:21.030669  9043 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:21.036259  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.037541  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.038009  9697 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260925 16:46:21.026239  9700 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:21.033210  9121 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 12.
I20260925 16:46:21.040936  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:21.042026  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.043043  9045 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 27: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:21.046146  9050 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:21.021664 17103 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:21.034015 17232 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:21.060403 17308 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:21.061039 17308 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:21.061471 17308 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:21.063043 17091 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:21.034917 17071 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.059975 17313 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:21.060515 17232 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:21.066414  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63676.4us
I20260925 16:46:21.068380  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.074047  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:21.082129  9694 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260925 16:46:21.074834  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.079607  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.081310  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.084964  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.081344  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.080515  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.083381  9049 raft_consensus.cc:2362] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23. Re-sending same reply.
I20260925 16:46:21.053750 17219 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:21.078296  9046 raft_consensus.cc:2362] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17. Re-sending same reply.
I20260925 16:46:21.089080  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.089182  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.089778  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.085429  9043 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:21.052783 17280 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:21.091594  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.092403  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.049414 17185 raft_consensus.cc:2741] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260925 16:46:21.095906  9050 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:21.091454 17218 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:21.127297  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 48538.6us
W20260925 16:46:21.139992  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 120395us
I20260925 16:46:21.141029  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:21.127954 17327 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:21.136158 17110 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:21.088454 17005 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:21.130759 17322 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.131376 17290 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.107s
I20260925 16:46:21.144557 17110 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.094148  9047 raft_consensus.cc:2362] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19. Re-sending same reply.
I20260925 16:46:21.136917  9699 raft_consensus.cc:1226] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:21.145306 17308 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.146767 17110 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.147347 17308 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:21.033588 17194 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.057s
I20260925 16:46:21.105072  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.077493 17310 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:21.156879  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.087819  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:21.139514  9044 raft_consensus.cc:2354] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
W20260925 16:46:21.141294  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 44731.1us
W20260925 16:46:21.097083  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 161048us
W20260925 16:46:21.097635  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 79635us
I20260925 16:46:21.147512 17322 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.077260 17313 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:21.097204  9045 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:21.081471 17311 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:21.136111 17035 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:21.171753  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.171777 17313 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:21.173210 17270 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.264s	user 0.007s	sys 0.037s
I20260925 16:46:21.173295 17261 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260925 16:46:21.176188 17316 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:21.177085  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:21.170816 17005 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.166253 17171 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:21.186888  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.188077  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:21.188383  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 100759us
I20260925 16:46:21.167412 17310 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:21.184252 17270 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.417s	user 0.007s	sys 0.038s
I20260925 16:46:21.195189  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:21.170146 17260 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260925 16:46:21.196267 17005 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:21.194008  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:21.166211 17263 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260925 16:46:21.203756 17114 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:21.206584  9042 raft_consensus.cc:2396] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 22 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:46:21.170478 17218 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.208513 17218 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.208277 17310 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.186520 17035 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.209553 17310 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:21.210750 17035 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.189113 17273 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:21.201594 17110 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:21.187908 17258 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.021s
I20260925 16:46:21.214326  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.182058 17311 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.215821 17185 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:21.217437 17311 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.217964  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.218717 17295 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.219187  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.219894 17114 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:21.220434 17114 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:21.219800 17232 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.220727 17295 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:21.221873 17071 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.222594 17232 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.227106  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.227254  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.228116  9700 raft_consensus.cc:2396] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260925 16:46:21.193988 17322 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Leader election won for term 13
I20260925 16:46:21.231457  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.196419 17194 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:21.232080  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:21.233331  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:21.233817  9122 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
W20260925 16:46:21.236214  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59202us
I20260925 16:46:21.237347  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:21.239256  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:21.234941 17194 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:21.240170 17219 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:21.240569 17194 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.241864 17194 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:21.242959 16996 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.240563 17219 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:21.244377 17219 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:21.244900 16996 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.245559  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.220798 17114 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:21.264266  9120 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:21.200613 17227 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:21.230854 17106 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:21.275743  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:21.232519 17274 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:21.286103  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.248015 17261 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260925 16:46:21.284066  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:21.282312 17263 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:46:21.308431  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89322.6us
I20260925 16:46:21.309087  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.299834 17227 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:21.318542  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 94171.2us
I20260925 16:46:21.319298  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.329527 17312 ts_tablet_manager.cc:1918] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 10.7
I20260925 16:46:21.331171 17333 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:21.311072 17261 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:21.339318 17322 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:21.340121 17110 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:21.340752 17219 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.341284 17322 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.342962 17219 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.345494  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.346072  9124 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:21.291834 17336 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.102s
I20260925 16:46:21.360952  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:21.370833  9124 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:21.337302 17333 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:21.395329  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:21.398521  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45476.5us
I20260925 16:46:21.388686 17312 log.cc:1196] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/c694676902c54ad8bfe8e7fd5a725e33
W20260925 16:46:21.406091  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 97026.2us
I20260925 16:46:21.408932 17103 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:21.405824 17337 consensus_queue.cc:1046] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.176s
I20260925 16:46:21.410717 17337 raft_consensus.cc:3032] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:21.411029 17337 raft_consensus.cc:729] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:21.411784 17337 consensus_queue.cc:260] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.412957 17337 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:21.416221  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 4117) took 1612 ms. Trace:
I20260925 16:46:21.416710  9123 rpcz_store.cc:276] 0925 16:46:19.803708 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:19.803937 (+   229us) service_pool.cc:227] Handling call
0925 16:46:21.415982 (+1612045us) spinlock_profiling.cc:243] Waited 921 ms on lock 0x7b54001c9654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:21.416118 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2117531008}
I20260925 16:46:21.418485  9115 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260925 16:46:21.404477 17309 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:21.421981 17309 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:21.422865 17309 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.434564  9123 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260925 16:46:21.438459 17005 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:21.438840 17005 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:21.440004 17232 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:21.440506 17232 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.442520 17232 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.428398 17103 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:21.443733 17103 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.401798 17345 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:21.353269 17261 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.399364 17333 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:21.452097  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.454142 17171 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.020s
W20260925 16:46:21.481191  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 120323us
W20260925 16:46:21.572888  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 98910.1us
I20260925 16:46:21.587561  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.588981  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.439582 17005 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.454092 17110 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.020s
I20260925 16:46:21.425544 17227 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:21.573369 17324 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.550s	user 0.009s	sys 0.010s
I20260925 16:46:21.600593 17329 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:21.606598 17312 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43368 (request call id 7) took 1658 ms. Trace:
I20260925 16:46:21.607002 17312 rpcz_store.cc:276] 0925 16:46:19.999815 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:20.027326 (+ 27511us) service_pool.cc:227] Handling call
0925 16:46:20.680658 (+653332us) ts_tablet_manager.cc:1145] Deleting tablet c694676902c54ad8bfe8e7fd5a725e33
0925 16:46:20.695812 (+ 15154us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0925 16:46:21.203751 (+507939us) tablet_metadata.cc:641] Metadata flushed
0925 16:46:21.329269 (+125518us) tablet_metadata.cc:641] Metadata flushed
0925 16:46:21.591769 (+262500us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":949,"tablet-delete.queue_time_us":627039,"thread_start_us":138511,"threads_started":1}
I20260925 16:46:21.607851  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.599393 17313 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.608918 17329 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:21.610069  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.610493 17313 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.611063 17329 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:21.612118  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:21.575086  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 176955us
I20260925 16:46:21.567832 17190 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:21.572556  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.581672  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.614565 17261 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.600419 17324 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.617452 17005 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:21.636721 17333 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.638062  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.638651 17333 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.620016  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.639361 17333 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:21.632643 17219 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:21.634343  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70159.4us
W20260925 16:46:21.572911  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 171490us
I20260925 16:46:21.635321 17226 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:21.635772  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45376.7us
I20260925 16:46:21.636407 17324 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.638659  9049 raft_consensus.cc:2362] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27. Re-sending same reply.
I20260925 16:46:21.639465  9699 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:21.639930  9696 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:21.640187  9045 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:21.625545  9116 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:21.654332  9666 connection.cc:232] RPC call timeout handler was delayed by -1.6776566579999326s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1585s for a response
I20260925 16:46:21.640259  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:21.654901  9666 connection.cc:232] RPC call timeout handler was delayed by -1.4472566580000148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1841s for a response
I20260925 16:46:21.655413  9044 raft_consensus.cc:2362] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22. Re-sending same reply.
I20260925 16:46:21.641367  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.642481  9041 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260925 16:46:21.642484  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.630384 17190 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:21.646368  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:21.629920 17325 raft_consensus.cc:2741] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:46:21.650640  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.666469  9046 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:46:21.661653  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:21.661514  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.689069  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.689584  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.690251  9050 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:21.675010  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.691089  9048 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:21.601181 17227 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.695369  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.696113  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.697167  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:21.700734  9044 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:21.674794 17273 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:21.707568  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46175.2us
W20260925 16:46:21.708940  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48211us
W20260925 16:46:21.709246  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62948.5us
I20260925 16:46:21.662878 17226 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.695264 17327 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:21.692643 17185 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:21.723271  9046 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:21.723655  9043 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:21.653285 17114 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.725013  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.701107 17071 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:21.653165 17219 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:21.738088  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:21.739202  9050 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:21.705304 17346 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:21.741003  9041 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:21.917487  9041 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260925 16:46:21.744879  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:21.723678 17190 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.834425  9117 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.13-23.13]
I20260925 16:46:21.906488  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 23.
I20260925 16:46:21.769529  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.766544  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.928030  9050 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: [20.14-22.15]
I20260925 16:46:21.803973  8966 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22. Ops: [21.15-21.15]
I20260925 16:46:21.813812  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:21.935009  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.935765  8969 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:21.795634  9044 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:21.935225  9119 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:21.765097  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.812178  9121 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: []
I20260925 16:46:21.765125 17227 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.747363 17071 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:21.768852  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:21.775688 17310 consensus_meta.cc:287] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.012s
I20260925 16:46:21.770507  8971 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260925 16:46:21.729382 17327 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:21.765576 17348 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.040s
I20260925 16:46:21.721961 17273 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:21.838120 17331 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.748s	user 0.005s	sys 0.003s
I20260925 16:46:21.842067  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:21.843802 17114 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:21.850683  9015 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.186s (SENT)
I20260925 16:46:21.957110  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:21.869967  9042 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: [28.17-28.17]
I20260925 16:46:21.880299  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:21.958067  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.958431  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 16.
I20260925 16:46:21.959972  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.960340  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.807389  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.961758  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.963004  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.827965  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.965147  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.966135  8968 raft_consensus.cc:2396] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 23 because replica has last-logged OpId of term: 22 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260925 16:46:21.966939  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.766450  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.968837  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.969878  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.970440  8972 raft_consensus.cc:2362] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23. Re-sending same reply.
I20260925 16:46:21.971146  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.773923 17226 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:21.967540  8968 raft_consensus.cc:2362] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18. Re-sending same reply.
I20260925 16:46:21.972777  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.816090  9046 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:21.768275 17281 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.045s
I20260925 16:46:21.978502  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:21.767215  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57643.7us
I20260925 16:46:21.979727  9666 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:21.902834  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 199837us
I20260925 16:46:21.822584  9116 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:21.981429  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:21.982136  9696 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:21.982057  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:21.983503  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:21.995378  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:21.996145  8971 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:22.000295  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 149639us
I20260925 16:46:21.973954 17327 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:22.012358  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.928624  9048 pending_rounds.cc:76] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 10
I20260925 16:46:21.933197  9041 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:21.935742  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.014237  9048 pending_rounds.cc:97] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260925 16:46:21.762458  9047 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:21.940032  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:22.014515  9048 raft_consensus.cc:2866] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:21.941826  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.942684  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.015219  8975 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:21.955519 17273 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:21.960572  9124 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:46:21.903586 17337 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.070s
I20260925 16:46:21.893424  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:21.959619  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:22.016618  9120 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 12 FOLLOWER]: Advancing to term 13
I20260925 16:46:22.016741  9121 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:21.723440 17313 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:21.976145  8972 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:22.016383  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.018121  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.977298  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:21.763751  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet c694676902c54ad8bfe8e7fd5a725e33 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:22.019598  8858 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 394776us
I20260925 16:46:21.765653  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.002486  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:21.996819 17190 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:22.005242  9116 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:22.000465 17171 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:21.940953  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:22.010407 17232 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:21.997022 17330 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:21.990398 17309 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:22.021008  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.003624  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:22.021780  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 926054us
I20260925 16:46:22.026124  8969 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:22.029248  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:22.020712  8967 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
W20260925 16:46:22.034127  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56934.2us
I20260925 16:46:22.036006  9119 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 25: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:21.915244  9043 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:22.083659  9117 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:22.083096  8968 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Stepping down as leader of term 28
W20260925 16:46:22.046530  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 66898.7us
I20260925 16:46:22.110628  9700 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:22.110915  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.109905  8969 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:22.111238  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.084168  8970 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:22.043617  9124 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 14.
I20260925 16:46:22.089586  9120 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 13.
I20260925 16:46:22.111495  8972 raft_consensus.cc:2362] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17. Re-sending same reply.
I20260925 16:46:22.113160  8967 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:22.114073  9121 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 29 index: 17. (index mismatch)
I20260925 16:46:22.109628  8968 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.018572 17287 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.116750  8966 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 24: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:22.063649  9696 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:22.122270  9089 leader_election.cc:398] T c694676902c54ad8bfe8e7fd5a725e33 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 16. Current term is 17.
I20260925 16:46:22.135267  8972 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:22.136428  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.137511  8974 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:46:22.137743  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:22.141548  9121 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:22.137209  8969 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:22.142282  9666 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.112836 17219 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:22.170221  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:22.064131 17273 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:22.192586  9049 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
W20260925 16:46:22.188455  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46280.3us
I20260925 16:46:22.138907  8968 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 15, Last appended: 28.17, Last appended by leader: 17, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.194275  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:22.194772  9041 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:22.195116  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:22.186257  9116 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:22.187141  8970 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:22.186764  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.191613 17228 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:22.197969  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:22.198913  8968 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:22.182380  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 46508.4us
I20260925 16:46:22.140590 17330 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:22.096405 17232 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.225350  9047 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:22.227967  9050 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:22.201411  8871 catalog_manager.cc:5042] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: aborting the task: latest config opid_index 8; task opid_index 5
I20260925 16:46:22.192194 17309 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:46:22.179675 17367 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.231226  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.235100  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:22.238029 17359 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.125s	user 0.000s	sys 0.001s
I20260925 16:46:22.238608 17280 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
W20260925 16:46:22.238866 17362 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260925 16:46:22.239081 17280 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:22.190971 17273 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:22.239835 17273 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:22.239934 17280 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.241044 17280 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:22.242590  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2018) took 1218 ms. Trace:
I20260925 16:46:22.242935  9118 rpcz_store.cc:276] 0925 16:46:21.024323 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:21.024439 (+   116us) service_pool.cc:227] Handling call
0925 16:46:21.619049 (+594610us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b5800294998. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:46:21.619249 (+   200us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:21.619577 (+   328us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:21.619605 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:21.620016 (+   411us) log.cc:842] Serialized 26 byte log entry
0925 16:46:21.902228 (+282212us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:21.902282 (+    54us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:21.902372 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:22.242323 (+339951us) raft_consensus.cc:1671] finished
0925 16:46:22.242343 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:22.242537 (+   194us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":1040,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":19046,"spinlock_wait_cycles":2336512,"thread_start_us":281829,"threads_started":1,"wal-append.queue_time_us":426241}
I20260925 16:46:22.244119 17330 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.244685 17185 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:22.247298 17273 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.249171 17273 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:22.249437 17232 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:22.235550 17071 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.225916 17329 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:22.254971  8968 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 28 index: 17. Preceding OpId from leader: term: 29 index: 17. (term mismatch)
I20260925 16:46:22.255226  8968 pending_rounds.cc:76] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 16
I20260925 16:46:22.255344  8968 pending_rounds.cc:97] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 28.17
I20260925 16:46:22.255471  8968 raft_consensus.cc:2866] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:22.258234  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.259088 17071 raft_consensus.cc:2741] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260925 16:46:22.262145 17309 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:22.262476 17309 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:22.230765 17283 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.062s
I20260925 16:46:22.268057 17329 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:22.269160 17329 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 23.13, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.269731 17309 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.271574 17324 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:22.272022 17324 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:22.271781 17309 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:22.272967 17324 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.274310 17324 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:22.274802  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.275543  8968 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:22.275949  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.279152  8970 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:22.283046  8975 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
W20260925 16:46:22.284459  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53326.6us
I20260925 16:46:22.283733  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.285432  9696 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260925 16:46:22.287889  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50837.7us
I20260925 16:46:22.294238  9123 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260925 16:46:22.190272 17325 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.094s
I20260925 16:46:22.132792 17287 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.229564 17228 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election won for term 23
W20260925 16:46:22.307122  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 192691us
I20260925 16:46:22.303861 17284 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.017s
I20260925 16:46:22.286583 17367 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.308735  9696 raft_consensus.cc:2932] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Committing config change with OpId 18.14: config changed from index 4 to 14, VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:22.310214 17367 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.304477 17319 consensus_queue.cc:1046] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 21.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260925 16:46:22.313622 17319 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:22.313923 17319 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:22.315285 17313 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:46:22.292685 17110 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:22.319635  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:22.324224  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:22.320338 17052 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
I20260925 16:46:22.323832  8971 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:22.330336  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.330634  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:22.334264  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:22.331014  8971 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
W20260925 16:46:22.345851  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54937us
I20260925 16:46:22.346911  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.299659 17273 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.030s
I20260925 16:46:22.347628  8969 raft_consensus.cc:2362] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17. Re-sending same reply.
W20260925 16:46:22.347093  8871 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 340) took 71266 ms (client timeout 15000 ms). Trace:
W20260925 16:46:22.360226  8871 rpcz_store.cc:269] 0925 16:45:11.071044 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:11.071289 (+   245us) service_pool.cc:227] Handling call
0925 16:46:22.328507 (+71257218us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1547978,"reported_tablets":47}
I20260925 16:46:22.371411  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:22.372565  9123 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 18
I20260925 16:46:22.333150 17071 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:22.381255  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.385360  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.386389  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.400943  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:22.387588  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 40a71744ceba4efe949720cb0f274853 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:22.409010  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.383633 17274 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:22.382103 17071 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:22.412566  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:22.408447 17337 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.420838 17337 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.422859 17337 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.424965  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.414683 17071 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:22.427755  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:22.426095  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.428381  9700 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
W20260925 16:46:22.432830  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47588.9us
I20260925 16:46:22.436273 17287 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.436684 17232 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:22.436914 17313 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:22.437304 17232 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:22.437551 17313 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:46:22.438606 17313 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:22.439913 17194 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:22.440340 17194 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.441126 17194 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.442876 17322 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:22.400216 17363 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:22.314641 17319 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.449725 17319 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:22.414120 17293 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:22.414001 17284 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:22.413239 17274 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:22.443652 17322 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.453424 17274 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:22.454095 17322 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:22.462581  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet f15ade9737ac41438bda476a00b4ad97, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:22.462989  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet f15ade9737ac41438bda476a00b4ad97, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.463121  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:22.443089 17194 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:22.466356  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:22.455669 17322 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:22.466804  9123 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:22.456405 17114 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:46:22.470336 17228 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:22.471181  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55866.7us
W20260925 16:46:22.516774  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50877.1us
I20260925 16:46:22.513100  9699 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:22.467097 17110 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:22.522027  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 230960us
W20260925 16:46:22.522728  9666 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.080s (SENT)
W20260925 16:46:22.523300  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51317us
I20260925 16:46:22.525331  9089 leader_election.cc:398] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
W20260925 16:46:22.529358  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c71d03191b9f4a22a2ae4170c54fd018, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:22.529781  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c71d03191b9f4a22a2ae4170c54fd018, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.530915  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.467981 17337 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:22.532042 17337 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:22.470906 17005 raft_consensus.cc:2741] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:46:22.529284 17190 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.011s
I20260925 16:46:22.535219 17114 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.538125 17110 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.535552  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:22.538504 17114 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.540691 17313 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:22.541134  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 088ac48c62d34a40b53987746a70b871, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:22.541463  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 088ac48c62d34a40b53987746a70b871, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.524452 17273 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.518579 17310 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.023s
I20260925 16:46:22.532593 17337 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:22.545815 17327 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.526s	user 0.004s	sys 0.006s
I20260925 16:46:22.545998 17228 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.546262 17327 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.547462  9042 raft_consensus.cc:2354] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18.
I20260925 16:46:22.548043 17273 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.545373 17261 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:22.526031 17330 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:22.556286 16996 consensus_queue.cc:1046] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:46:22.559792 17261 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:22.568050 17270 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:22.569543 16996 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:46:22.569937 16996 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.570734 16996 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.543675 17333 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:22.590853 17190 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:22.591310 17190 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.592082 17190 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.593443 17190 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:22.588343 17309 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:22.598074  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:22.599042  9699 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:22.597673 17327 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.609925  8973 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:22.613504  9043 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
W20260925 16:46:22.614130  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 91446.9us
I20260925 16:46:22.618280 17344 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:22.618800 17344 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.619714 17344 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.581054 17333 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.589169 16996 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
W20260925 16:46:22.615477  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 2.150s (SENT)
I20260925 16:46:22.611642  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.627380  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.621369 17344 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:46:22.630635  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:22.631003  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.646133  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.647835  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.653475  9699 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:22.657573  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:22.579960 17330 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.661093 17232 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:22.668815 17363 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:22.669454 17363 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:22.670434 17363 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.661088 17370 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.012s
I20260925 16:46:22.644557 17005 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:22.654036 17280 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:22.688817  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73350.8us
I20260925 16:46:22.653306 17261 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.690052 17333 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.692009 17336 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:22.692508 17336 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:22.693442 17336 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.694597 17336 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:22.679298 17273 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.690100 17381 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:22.698352  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:22.698596  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:22.692569 17333 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:22.698952  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:22.701910  9702 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:22.702560  9118 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260925 16:46:22.703009  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 85494.8us
W20260925 16:46:22.704159  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 56543.1us
I20260925 16:46:22.705874  9089 leader_election.cc:398] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:22.706272  9045 raft_consensus.cc:1261] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 27 index: 18. (index mismatch)
I20260925 16:46:22.709148  9015 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.710319  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.641003 17071 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:22.714102  9121 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:22.715119  9115 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 13. Current term is 14. Ops: []
I20260925 16:46:22.718004  9118 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:22.712138  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.730729  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.733160  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:22.739715  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 90865.2us
I20260925 16:46:22.733783 17226 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:22.743906 17382 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260925 16:46:22.745182 17382 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:46:22.745621 17382 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:22.745759 17287 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:22.747025  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.746600 17382 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.747807 17287 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:22.758605  9121 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:22.748636  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.741463  8940 leader_election.cc:398] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18.
I20260925 16:46:22.749138 17329 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260925 16:46:22.759662  8940 leader_election.cc:401] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260925 16:46:22.754451  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.751896 17005 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:22.760862  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.763741 17171 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:22.764561  9041 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:22.764830  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.765564 17171 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:22.767506 17171 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.767962 17171 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:22.731750 17309 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:22.771201  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:22.772974  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.771234  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:22.777940  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 120733us
I20260925 16:46:22.739851 17381 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:22.786556  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:22.788175  9121 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
W20260925 16:46:22.845432  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 64333.6us
W20260925 16:46:22.859803  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 81138.8us
I20260925 16:46:22.774323 17345 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:22.761672 17232 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:22.736375 17110 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.053s
I20260925 16:46:22.770537 17226 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:22.782083 17284 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.907065  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:22.911029  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.845486 17280 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:22.922351  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20260925 16:46:22.896458 17359 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260925 16:46:22.926177  9124 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:22.928610  8975 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:22.783205 17287 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.125s
I20260925 16:46:22.870162 17387 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:22.957317  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 95442.4us
I20260925 16:46:22.846042 17309 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.079s
I20260925 16:46:22.953276  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.901618 17273 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.909512 17171 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:22.915230 17382 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:46:22.947320  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.789594 17383 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.163s
W20260925 16:46:22.965327  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48406.2us
I20260925 16:46:22.973462  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:22.961766  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.917749 17052 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260925 16:46:22.790869 17324 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.160s
W20260925 16:46:22.972163  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 201048us
I20260925 16:46:22.965037  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:22.967257  8972 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:22.982802  8975 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260925 16:46:22.996743 17376 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.072s	user 0.000s	sys 0.000s
W20260925 16:46:22.997773 17391 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
W20260925 16:46:22.999155 17392 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
W20260925 16:46:22.999815 17386 log.cc:924] Time spent T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260925 16:46:23.003448 17394 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.229s	user 0.001s	sys 0.000s
I20260925 16:46:22.954309 17227 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260925 16:46:23.020591 17052 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:22.991477  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:22.954253 17365 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:22.983325 17273 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.010833 17283 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.011824 17310 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:22.974282 17387 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.038s
I20260925 16:46:23.012178 17258 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:22.991004 17171 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:22.989778 17330 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:22.983074  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.024420  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.034626  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:22.918350 17284 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.078018  8968 raft_consensus.cc:2362] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19. Re-sending same reply.
W20260925 16:46:23.061888  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53074.1us
W20260925 16:46:23.063170  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 147075us
I20260925 16:46:23.060633 17227 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:23.070997 17232 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:23.058027 17005 raft_consensus.cc:2741] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election decision vote started in defunct term 23: won
W20260925 16:46:23.073172 17274 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.619s	user 0.010s	sys 0.000s
I20260925 16:46:23.092989 17284 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.093511 17273 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:23.076905 17194 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.592s	user 0.011s	sys 0.000s
I20260925 16:46:23.087193 17274 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.061147 17260 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:23.097530 17274 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.099138 17412 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.099716 17412 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.101841 17412 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.074811 17071 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.034085 17327 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:23.084007  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59727.5us
I20260925 16:46:23.084095 17227 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:23.083047 17171 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.074618 17283 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.078416 17258 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.104771 17424 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.105919  8974 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:23.106941 17345 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 17. Current term is 18.
I20260925 16:46:23.127159  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.129346  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:23.153080  9122 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:23.130475 17219 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.131367  9048 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:46:23.061451 17365 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.159060 17365 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.156152 17219 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.165910 17219 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.166539 17408 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:23.166936 17408 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:23.169200 17310 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.169651 17310 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:23.169935 17185 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:23.170389 17185 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:23.173384  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46332.3us
I20260925 16:46:23.180729  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:23.184765  8972 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:23.134491  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:23.135490  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.188344  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.136864  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.189734  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:23.190492  9045 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:23.138170  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.140033  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.200132  9121 raft_consensus.cc:2379] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:23.140704  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.201467  8966 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:23.140033  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.201903  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.144570  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.184918  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.077579  8971 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:23.188272  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.202730  9702 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:23.108489 17327 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.138427  9116 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260925 16:46:23.204624 17415 raft_consensus.cc:2741] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260925 16:46:23.205068 17327 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.206262  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.207202  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.207760  9089 leader_election.cc:398] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:23.208395 17309 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:23.207840  9043 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:23.152778 17258 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:23.209863  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.214671  9121 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:23.217150  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.171391 17185 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.233165  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:23.233510  8975 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:23.234493  8966 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:23.235011  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.220566  9041 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:23.230412  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 85352.3us
I20260925 16:46:23.235594  9696 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:23.219686  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.231496  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:23.217080 16996 consensus_meta.cc:287] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.580s	user 0.009s	sys 0.000s
W20260925 16:46:23.241371  9089 connection.cc:232] RPC call timeout handler was delayed by -1.521081587000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 1.5s for a response
I20260925 16:46:23.237121  9124 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:23.241386  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:23.243273  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.241586  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.238016  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.238109  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.238137  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.232328  8971 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260925 16:46:23.244938  9121 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:23.239898  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.245278  8972 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
I20260925 16:46:23.245355  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:23.245730  8972 pending_rounds.cc:76] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 14
I20260925 16:46:23.246086  8972 pending_rounds.cc:97] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260925 16:46:23.246363  8972 raft_consensus.cc:2866] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:23.242545  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.236104  8970 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
W20260925 16:46:23.241844  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48562.5us
I20260925 16:46:23.247897  9041 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:23.210805 17110 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:23.245774  9696 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:23.251228  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.252153  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.246749  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:23.253888  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.255470  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.250893  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.257764  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.258302  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.258857  8975 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:23.253516  9048 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:23.260572  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.261332  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.261698  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.262374  8970 raft_consensus.cc:2379] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:23.262427  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.263150  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.255753  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.264088  8966 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:23.264330  9049 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 24: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:23.265080  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.266115  8970 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:23.257299  9122 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:23.268321  9121 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260925 16:46:23.268918  8939 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.280826  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:23.210175 17412 consensus_queue.cc:1035] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 15, Time since last communication: 0.042s
I20260925 16:46:23.281817  8972 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:23.172037 17227 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.284704  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.293577  8971 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 25: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:23.251811 17330 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:23.229091 17329 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260925 16:46:23.306764  8975 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
W20260925 16:46:23.323982  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66286.3us
I20260925 16:46:23.269295 17415 raft_consensus.cc:2741] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election decision vote started in defunct term 19: won
I20260925 16:46:23.331665  9043 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:23.285229 17228 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:23.284802 17005 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:23.154767 17424 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:23.358098  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 115596us
I20260925 16:46:23.329427  8973 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
I20260925 16:46:23.296418 17114 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:23.250685 17293 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260925 16:46:23.336687 17185 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:23.349027  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 94784.9us
I20260925 16:46:23.359627  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:23.172873 17408 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.294950 17409 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:23.250784 17309 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.081s
I20260925 16:46:23.363551 17228 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:23.369267 17337 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.823s	user 0.008s	sys 0.004s
I20260925 16:46:23.296543 17324 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.067s
I20260925 16:46:23.285069 17381 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.063s
I20260925 16:46:23.331415 17327 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:23.346884 17273 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:23.428120  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.433224  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
W20260925 16:46:23.434456  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 139807us
I20260925 16:46:23.361840 17406 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260925 16:46:23.456038  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 96495.8us
I20260925 16:46:23.497051  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:23.337181 17375 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.053s
I20260925 16:46:23.348090 17382 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.087s
W20260925 16:46:23.349200 17219 consensus_queue.cc:1159] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 17 status { last_received { term: 17 index: 12 } last_committed_idx: 12 last_received_current_leader { term: 17 index: 12 } }
I20260925 16:46:23.466365 17330 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.004s
I20260925 16:46:23.466722 17273 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.493846 17424 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.510576 17273 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:23.512050 17397 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:23.512966 17411 consensus_queue.cc:1159] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 23 status { last_received { term: 23 index: 17 } last_committed_idx: 17 last_received_current_leader { term: 23 index: 17 } }
I20260925 16:46:23.467283 17414 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:23.514444  9115 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:23.515875 17408 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:23.516986 17425 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
W20260925 16:46:23.519006 17428 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260925 16:46:23.466898 17071 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:23.467021  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:23.447858 17413 raft_consensus.cc:2741] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election decision vote started in defunct term 18: won
I20260925 16:46:23.470245  9016 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:23.520629  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 44978.1us
W20260925 16:46:23.520897 17423 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.180s	user 0.000s	sys 0.000s
I20260925 16:46:23.494812  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.521987  9124 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:23.522374 17397 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:23.469779  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 207390us
I20260925 16:46:23.523362 17397 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.524634  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.446646 17409 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.525749 17409 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:23.464159 17337 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.479909 17283 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.464488 17333 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:23.531945 17337 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.470477 17327 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:23.532801 17327 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.533138 17327 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:23.533186  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.534040 17406 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:23.446938 17407 raft_consensus.cc:2741] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election decision vote started in defunct term 17: won
I20260925 16:46:23.541465 17407 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:23.494966 17228 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.505468 17171 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:23.605187  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52817.9us
I20260925 16:46:23.605764  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:23.557931  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:23.607957  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110962us
I20260925 16:46:23.502447 17110 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:23.611727  9014 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.620527  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:23.624094  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 153926us
W20260925 16:46:23.635622  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 77780us
I20260925 16:46:23.614955 17226 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:23.638816  9089 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.640811  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.625136 17337 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:46:23.685987  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49672.3us
W20260925 16:46:23.688323  8974 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.505s	user 0.002s	sys 0.010s
I20260925 16:46:23.638140 17171 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
W20260925 16:46:23.689139  9118 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.004s	sys 0.008s
W20260925 16:46:23.691506  9118 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.638s	user 0.004s	sys 0.008s
I20260925 16:46:23.666761  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:23.689742  8974 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.506s	user 0.002s	sys 0.010s
W20260925 16:46:23.688759  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 402402us
I20260925 16:46:23.643509 17279 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:23.623174 17365 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:23.637301 17310 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.725461  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.690486 17226 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:23.690407 17415 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:23.645016 17287 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:23.742686  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 416992us
W20260925 16:46:23.729842  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63197.3us
I20260925 16:46:23.693017 17424 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:23.693903 17171 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.716038 17279 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.664778 17319 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.753521  8968 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260925 16:46:23.731045 17280 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260925 16:46:23.762061  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.741833 17309 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:46:23.747085 17424 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.751457 17287 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.786175  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:23.786381 17287 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.773030  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.786752 17407 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:23.787393 17407 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:23.762467 17319 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.756563 17279 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:23.791618 17319 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.791823 17274 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:23.778060 17406 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:23.792316 17274 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.778370 17431 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:23.793156 17431 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:23.793521 17431 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:23.794219 17274 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.778716 17418 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.745373 17365 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.782080 17227 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:23.753582 17171 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:23.804860  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:23.782459 17424 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:23.773720 17441 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:23.788802  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.789111  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.797652 17418 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.876435 17418 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.877238  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:23.878005 17280 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:46:23.800230  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.781941 17409 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:23.856669  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58202.5us
W20260925 16:46:23.856761  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 211414us
I20260925 16:46:23.881256  9702 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
W20260925 16:46:23.873590  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 84868us
I20260925 16:46:23.882846  9089 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.884629  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:23.885017 17279 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.885402  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:23.885531 17409 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.886189  8967 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260925 16:46:23.886332  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.745729 17110 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:23.859375  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 157285us
I20260925 16:46:23.892769  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.893604 17407 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:23.893711 17406 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:23.894224 17406 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:23.894313 17407 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:23.894598 17406 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:23.887104 17375 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.008s
I20260925 16:46:23.896063 17375 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:23.896458 17375 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:23.819883 17309 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:23.897455 17375 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.897727 17309 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.898980 17375 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:23.900359 17413 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:23.900791 17413 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:23.901137 17413 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
W20260925 16:46:23.904662 17442 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:46:23.907258  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.907585  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.908267  9117 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:23.909449  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:23.909970  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:23.910068  9120 raft_consensus.cc:3037] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:23.912256  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:23.913013 17227 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:23.913380 17227 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:23.913682 17227 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:23.916540 17310 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.917176  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.920531 17227 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.799646 17365 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.920581 17327 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:23.922461 17258 consensus_meta.cc:287] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
I20260925 16:46:23.924547 17258 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.851259 17226 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.927256 17258 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.925689  9045 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:23.873541 17273 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:23.930881 17227 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.932740 17327 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.933019 17273 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:23.933702 17411 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:23.934288 17411 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:23.935113 17411 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.941452  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.944104  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:23.944434 17293 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:23.944486 17407 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:23.945091 17293 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.946233  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.946941 17407 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:23.947320 17407 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:23.809808  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.950757  8975 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:23.948520  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:23.953408  9702 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:23.953716  9120 raft_consensus.cc:2454] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:23.954411  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:23.931113  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:23.947865  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:23.957602  9696 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:23.958619  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:23.959167  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:23.947454 17293 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:23.970288  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:23.970196  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:23.984970  9115 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:23.947800 17407 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:23.980631  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.004815  9116 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:24.005084  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:24.008338  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 116755us
I20260925 16:46:24.005950  9042 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
W20260925 16:46:24.009362  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 399903us
I20260925 16:46:23.967226  8975 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:23.947978 17370 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.013581 17370 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:23.987494  9121 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:23.988159  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:23.979240  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.017139  9124 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:24.015558 17370 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.019337  8968 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:23.969655 17433 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:23.930068 17406 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.033133  9665 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:24.026842  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:24.042861  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:24.044915  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:24.051718  8973 raft_consensus.cc:595] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:23.970860 17324 consensus_queue.cc:1046] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.061s
I20260925 16:46:24.052103  8973 raft_consensus.cc:603] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:24.051966  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:24.058342  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:24.053079  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 94024.5us
I20260925 16:46:24.058410  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:24.025545 17415 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:24.065937  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.066574  8966 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:24.061905  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:24.064167  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.067732  8971 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:24.070266  8970 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:24.075213  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.076069  8971 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:24.042972 17443 raft_consensus.cc:2781] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:24.089026  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.089555  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.090247  8966 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:46:24.091005  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52514.4us
I20260925 16:46:24.091946 17363 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:24.094187  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.094843  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:24.111567  9117 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 25 because replica has last-logged OpId of term: 23 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 15.
I20260925 16:46:24.069646 17258 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:24.088320  9116 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:24.061015 17325 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:24.055780 17106 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:24.090057 17280 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:24.161933 17280 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:24.162923 17280 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.118896  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.042132 17344 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260925 16:46:24.090585 17346 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.167326 17346 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.150421 17325 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:24.169302 17325 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:24.122908  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:24.123349 17443 raft_consensus.cc:686] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:24.151525  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:24.172407 17443 consensus_queue.cc:237] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.177470  8975 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:24.124128 17337 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:24.128157 17279 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.098672 17415 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:24.136183  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.139075  9043 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:24.188154  9048 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:24.144364  9041 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260925 16:46:24.085320 17322 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:24.146384  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:24.090447 17345 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:24.195549 17345 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:24.195964 17345 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:24.177047 17171 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.198007 17424 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.198470 17171 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:24.192245  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70986.2us
I20260925 16:46:24.200124  9042 raft_consensus.cc:2379] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:24.191973  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:24.202525  9122 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:46:24.087586  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.142736  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.204912  8971 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:24.205319  9049 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:24.151523  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.206140  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:24.206521  9044 raft_consensus.cc:2379] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:24.206884  8973 raft_consensus.cc:595] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:24.156147  9050 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260925 16:46:24.156209 17363 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:24.159422  9693 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:24.159981  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.160276 17438 raft_consensus.cc:3032] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:24.161341  8972 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:46:24.169361 17346 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.122498 17110 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.221088 17110 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.134302 17406 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:24.192477  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46148.2us
I20260925 16:46:24.055859 17413 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.215847  9702 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:24.228289  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:24.228231  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.238678  9043 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:24.230670  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:24.232547  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:24.204193 17451 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:24.240612  9116 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:24.236544  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:24.248457  8971 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:24.251570 17406 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:24.252271 17406 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.254735 17406 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.257145  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.266978 17319 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:24.268421 17309 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:24.275954  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.278599  9117 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:24.217391 17171 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:24.217900 17438 raft_consensus.cc:729] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:24.315299  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 87084.8us
I20260925 16:46:24.282943  9123 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 17.
I20260925 16:46:24.373400  9122 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:46:24.373602 17406 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:24.374492 17406 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.375120 17411 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.375631 17411 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.376518 17383 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:24.377058 17406 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.377691 17411 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.378526 17106 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:24.379103 17367 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.379542 17367 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.381362  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:24.381398 17367 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.374004  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.263908 17451 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:24.392727 17171 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:24.395040 17171 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:24.396523 17461 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260925 16:46:24.398545 17459 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.157s	user 0.000s	sys 0.000s
I20260925 16:46:24.403843 17421 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.087s
I20260925 16:46:24.405678  9124 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:24.265213 17387 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.127s
I20260925 16:46:24.411043  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.416798  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.418469  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:24.416533  9117 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:24.235733 17226 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.155s
I20260925 16:46:24.417447  9048 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:24.423400  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.427491  8967 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:24.236961 17431 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.436151  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:24.406814 17451 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:24.441370  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.441727  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:24.442359  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.443085  8973 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:24.434674  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 118318us
I20260925 16:46:24.443431  8967 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:24.433807 17283 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:24.451717  9115 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:24.452075  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:24.454594  8973 raft_consensus.cc:595] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:24.452031  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.453251  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:24.437780 17411 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.456728 17436 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.069s
I20260925 16:46:24.454023 17337 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.453866 17283 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:24.460624 17283 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:24.440968 17280 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260925 16:46:24.414139 17327 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260925 16:46:24.447773 17406 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:24.452986 17441 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:24.451198 17424 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.512821  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.459398 17337 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:24.496353 17458 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260925 16:46:24.445765 17319 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260925 16:46:24.518759  9116 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:24.469501 17414 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:24.548349  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 79045.7us
I20260925 16:46:24.497128 17406 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:24.562585 17467 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260925 16:46:24.564440  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:24.414726 17363 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.574922 17367 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.410264 17415 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.589370  8971 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:24.464495 17345 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.595674  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.596477  9041 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:46:24.528891 17110 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.467010 17411 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.592414  8969 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:24.601697  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.575510 17413 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.601367 17408 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:24.604703  9043 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:24.589176 17406 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:24.607228  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:24.607772 17337 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.610173  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:24.612757  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.613502  8969 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 18.
I20260925 16:46:24.613485  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.575474 17367 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:24.606516 17375 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.707s	user 0.011s	sys 0.001s
I20260925 16:46:24.616866  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.631394  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.577342 17325 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.640461  9699 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260925 16:46:24.627194 17413 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:24.641408 17413 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:24.641957 17345 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.642576 17413 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.643464  8974 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260925 16:46:24.627399 17408 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:24.652583 17408 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.643963 17325 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.644251  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.646098  9700 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:24.647243  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.657724  9117 raft_consensus.cc:2354] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23.
I20260925 16:46:24.658846  9665 leader_election.cc:398] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23.
I20260925 16:46:24.659111  9665 leader_election.cc:401] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260925 16:46:24.647432 17434 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:24.648355  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.660634  9123 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:24.627418 17440 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:24.668021  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:24.616286 17337 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260925 16:46:24.680083  8969 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:46:24.660774 17478 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:24.682472  9123 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
W20260925 16:46:24.683079  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75922.7us
I20260925 16:46:24.685803  8939 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.682720  9700 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:24.666512 17414 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:24.683921  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 147218us
I20260925 16:46:24.684564  9117 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:24.669507 17440 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:24.687896  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.690789  9048 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:24.691927  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.684072 17431 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.694394 17436 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:24.688525 17325 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23.
I20260925 16:46:24.696655 17440 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:24.697630 17443 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:24.698112 17443 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.699828  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:24.700945 17431 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:24.679765 17110 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:24.700007 17443 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.685053 17478 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:24.690557 17274 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:24.709311  9120 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:46:24.710532  9048 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:24.715140 17367 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.711586 17478 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:24.720613  9702 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:24.720956  9702 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:24.718510 17110 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260925 16:46:24.721974  9702 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.722879  9702 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:24.687453 17477 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260925 16:46:24.725062 17480 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:24.725564 17480 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.732399  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:24.733008  9696 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:24.732961 17114 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260925 16:46:24.734848  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.729362 17274 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:24.737926 17274 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:24.720903 17475 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.081s	user 0.000s	sys 0.001s
W20260925 16:46:24.743091 17407 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.719s	user 0.008s	sys 0.000s
I20260925 16:46:24.743577 17407 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.744378  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:24.744977  9118 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:24.745275  9123 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:24.748340  9702 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260925 16:46:24.749410 17438 consensus_queue.cc:260] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.729621 17110 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:24.751523 17110 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.751910 17477 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:24.752149 17411 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.755505  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:24.752655 17477 consensus_queue.cc:1225] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 19.16 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 15
I20260925 16:46:24.773263  9702 pending_rounds.cc:76] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting all ops after (but not including) 15
I20260925 16:46:24.773576  9702 pending_rounds.cc:97] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: Aborting uncommitted NO_OP operation due to leader change: 19.16
I20260925 16:46:24.773811  9702 raft_consensus.cc:2866] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:24.774065 17443 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:24.774665 17443 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.776517  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.780350 17443 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.784364 17440 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.667373 17434 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.790940  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.757414 17110 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.729862 17283 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.796348  9693 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:24.799965  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:24.806923 17480 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.807010 17434 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.809448 17440 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.809809  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:24.810308 17279 raft_consensus.cc:979] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:24.810079 17478 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:24.810424  9123 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:24.810875 17279 raft_consensus.cc:1067] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:24.808130 17406 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.814440 17478 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:24.801301 17283 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:24.817059  9665 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:24.818475 17185 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:24.818800 17185 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:24.819128 17185 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:24.825344  9119 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:46:24.825966  9119 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:46:24.826323  9119 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:24.799572 17190 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:24.828248 17190 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:24.828591 17190 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:24.832685  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.833343  9123 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:24.836104  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.836885  9120 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:24.839111 17406 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.841645  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:24.843861  9014 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:24.844556  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 20 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:24.848299 17387 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:24.849063  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:24.849994  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 433190us
I20260925 16:46:24.854089  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.855131  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:24.855381  9045 raft_consensus.cc:1261] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:24.856256  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:24.857445  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:24.858125  9118 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:24.860221  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:24.861114  9048 raft_consensus.cc:2354] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23.
I20260925 16:46:24.863737  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.865187  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.866199  9048 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:24.872272  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:24.873203  8970 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:24.875128  9123 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:24.878289  9120 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:24.869364  9119 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.896924  9119 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.899158  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:24.900043  9697 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:24.905733  8970 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:24.899075  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.909003  8939 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:24.910463  8969 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260925 16:46:24.910463  9048 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:46:24.911933  8968 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: [16.10-18.11]
I20260925 16:46:24.898087  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:24.844159 17407 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.917016  9120 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260925 16:46:24.921022  9118 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:24.859944 17387 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:24.924595  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:24.926375 17387 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:24.926932  9045 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:24.898778 17171 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:24.937053 17483 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:24.938242 17480 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:24.980213  9697 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:24.916167 17418 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.017s
I20260925 16:46:24.900156 17309 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
I20260925 16:46:24.982373  9045 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260925 16:46:24.977269  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 52777.9us
W20260925 16:46:24.993250 17489 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
W20260925 16:46:24.994472  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52846.8us
W20260925 16:46:24.997071  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79147.6us
I20260925 16:46:25.001365  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:25.004099  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:25.003517  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:25.004817  9048 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
W20260925 16:46:25.009187  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 119242us
I20260925 16:46:25.012552  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:24.977197 17397 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260925 16:46:25.000941 17451 consensus_meta.cc:287] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.548s	user 0.011s	sys 0.003s
I20260925 16:46:25.024065  8966 raft_consensus.cc:595] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:25.029651  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:25.030189  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:25.000809 17287 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:24.996754 17483 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:25.040464  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:25.045470  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 157422us
I20260925 16:46:25.046247  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:25.046521  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:25.023494 17408 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:25.024138 17477 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:25.054608  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:25.062297  9048 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:25.021961 17480 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:25.065555 17488 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
W20260925 16:46:25.100755  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54597.8us
W20260925 16:46:25.066529 17496 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.069s	user 0.001s	sys 0.000s
I20260925 16:46:25.067095 17310 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:25.073067 17483 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.037357 17406 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:25.101538  9015 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:25.104966  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:25.117491  9043 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:25.046056 17171 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:25.122725 17171 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.128628 17185 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.130689 17185 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.043620 17287 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.060109 17477 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:25.032821 17451 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.151315  9048 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:25.114500 17219 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:25.119433 17408 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:25.152271  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 154766us
I20260925 16:46:25.159174  9666 leader_election.cc:398] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23.
I20260925 16:46:25.160367  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:25.143229 17477 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:25.196430  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:25.233107  9048 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:25.173588  9043 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:25.164834  9050 raft_consensus.cc:2354] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:25.238309  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:25.238968  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:25.244366  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:25.248621  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:25.249387  9044 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:25.251569  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:25.252691  9048 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260925 16:46:25.234700 17322 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:25.255941  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.232820 17424 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:25.243979 17409 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:25.265529  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:25.268144  8973 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:25.268435  8973 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:25.236294 17219 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:25.271133 17219 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:25.275810 17470 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260925 16:46:25.277186 17497 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260925 16:46:25.276808  8973 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.253746 17185 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:25.280671  9041 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260925 16:46:25.277997  8973 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:25.297327  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 4059) took 1231 ms. Trace:
I20260925 16:46:25.259342 17345 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260925 16:46:25.297695  9042 rpcz_store.cc:276] 0925 16:46:24.066319 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:24.066431 (+   112us) service_pool.cc:227] Handling call
0925 16:46:25.297141 (+1230710us) spinlock_profiling.cc:243] Waited 89.8 ms on lock 0x7b54000d43d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:25.297277 (+   136us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":206487296}
I20260925 16:46:25.299230 17287 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.299798 17418 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:46:25.300127  8966 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:25.300846  8966 raft_consensus.cc:595] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:25.301208  8966 raft_consensus.cc:603] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:25.301339 17228 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:25.301867 17228 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.296765  8973 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:25.240582 17498 raft_consensus.cc:2741] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260925 16:46:25.306835  9044 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
W20260925 16:46:25.304755  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 50034.4us
I20260925 16:46:25.259236 17443 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:25.322508  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53147.7us
I20260925 16:46:25.326560  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:25.267377 17413 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:25.305495 17228 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:25.334525  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89709.7us
I20260925 16:46:25.336092 17418 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:25.336936 17413 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:25.361573  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:25.337091 17227 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:25.337224  9044 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eb346a4d887940099443a0219edadef0"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57624
W20260925 16:46:25.338155 17190 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.002s
I20260925 16:46:25.338680 17171 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:25.263058 17322 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.254155 17480 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.260878 17436 consensus_queue.cc:1035] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.066s
I20260925 16:46:25.340843 17408 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.343329 17495 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:25.344442 17440 raft_consensus.cc:979] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:25.263549 17375 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.070s
I20260925 16:46:25.392365  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:25.392745  8970 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260925 16:46:25.394960  9123 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:25.346447 17451 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.378152 17227 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.310021 17309 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:25.396780 17427 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:25.397296 17427 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:25.396844 17309 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.266803 17424 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.366176 17411 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:25.370256 17414 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:46:25.380860  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 68135.3us
I20260925 16:46:25.397571 17227 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:25.391382  8940 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:25.398856  9121 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260925 16:46:25.358853  9700 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260925 16:46:25.360303 17418 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:25.360466 17478 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:25.415810  9115 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:25.420461  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:25.423889  9044 raft_consensus.cc:595] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:25.426719  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.429440  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:25.430209  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.437934  9043 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [22.17-22.17]
W20260925 16:46:25.464676  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63721.6us
W20260925 16:46:25.454721  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 48370.3us
I20260925 16:46:25.379220 17190 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.384255 17228 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
W20260925 16:46:25.510489  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53330.1us
W20260925 16:46:25.512025  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52813.5us
W20260925 16:46:25.512955  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 121658us
I20260925 16:46:25.437654 17344 raft_consensus.cc:1067] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:25.525990  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:25.463761 17322 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.511374 17329 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:25.683710  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2056) took 1545 ms. Trace:
I20260925 16:46:25.684439  9124 rpcz_store.cc:276] 0925 16:46:24.138225 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:24.143801 (+  5576us) service_pool.cc:227] Handling call
0925 16:46:24.189683 (+ 45882us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:24.409749 (+220066us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:25.683400 (+1273651us) spinlock_profiling.cc:243] Waited 216 ms on lock 0x7b540007dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:25.683622 (+   222us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":496172928}
W20260925 16:46:25.685516  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 113360us
I20260925 16:46:25.515977 17345 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:25.398085 17427 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:25.564813 17454 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260925 16:46:25.508785 17219 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.170s
W20260925 16:46:25.696813  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 278389us
I20260925 16:46:25.465137 17434 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.111s
I20260925 16:46:25.708910  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:25.709477  8974 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:25.430516 17413 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.687019 17479 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:25.702811  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.431314 17478 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.704828  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.735040  8971 raft_consensus.cc:1226] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 23. Current term is 24. Ops: [23.15-23.15]
I20260925 16:46:25.735371  8969 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:25.687242 17411 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:25.714557  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.677038  9048 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:25.726048  9124 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260925 16:46:25.698894  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 337368us
I20260925 16:46:25.730094  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.740729  9120 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:25.732846  9116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:46:25.741509  9116 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:46:25.741837  9116 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:25.742950  9115 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
W20260925 16:46:25.743954  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 176640us
I20260925 16:46:25.743049  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.758261  8966 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260925 16:46:25.760120  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.760738  8973 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:25.761893  8971 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:25.706441 17477 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.566045 17418 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.693250 17329 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.772336 17500 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.065s
I20260925 16:46:25.777705 17424 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.734220 17382 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.032s
I20260925 16:46:25.791972  9122 raft_consensus.cc:2354] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25.
I20260925 16:46:25.794720  9116 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.798650  8974 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:25.782438 17309 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:25.756829 17412 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.035s
I20260925 16:46:25.760812  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:25.718472 17433 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.046s
I20260925 16:46:25.781981 17478 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:25.764834  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:25.810181  9116 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:25.815526  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 54796.4us
I20260925 16:46:25.817670  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:25.823566  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 58910.8us
W20260925 16:46:25.824774 17512 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
W20260925 16:46:25.825261 17511 log.cc:924] Time spent T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
W20260925 16:46:25.826228 17507 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.268s	user 0.000s	sys 0.001s
W20260925 16:46:25.826459 17486 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.175s	user 0.010s	sys 0.004s
I20260925 16:46:25.830071 17329 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.820432 17495 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:25.820765 17190 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:25.741945 17479 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.834786 17421 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:25.835173 17421 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:25.836336 17479 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:25.835980 17421 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.837205 17421 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:25.837450  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2682) took 1239 ms. Trace:
I20260925 16:46:25.815023 17345 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:25.838233 17345 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.840103  9045 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:25.840181 17345 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.837877  9050 rpcz_store.cc:276] 0925 16:46:24.601060 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:24.601326 (+   266us) service_pool.cc:227] Handling call
0925 16:46:25.837252 (+1235926us) spinlock_profiling.cc:243] Waited 550 ms on lock 0x7b54000a73d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:25.837395 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1264596864}
I20260925 16:46:25.843724 17501 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:25.844133 17501 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:25.844306 17477 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:25.845100 17477 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:25.844974 17346 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:25.844520 17501 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:25.845696 17477 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.892225  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:25.893078  9694 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:25.854308 17477 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:25.900871  9118 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260925 16:46:25.903434  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:25.904170 17451 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:25.904830 17451 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.906337  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.907058 17451 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:25.899927  9696 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:25.911499  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:25.911810  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:25.903451  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 78982.7us
I20260925 16:46:25.908139  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:25.914530  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:25.915217  9696 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:25.916359  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:25.907055  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 220566us
I20260925 16:46:25.923048  9119 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:25.927275  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1580) took 1074 ms. Trace:
I20260925 16:46:25.929968  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:25.930724  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.934507  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:25.935945  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:25.936514  9123 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:25.940121  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:25.943549  9696 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
W20260925 16:46:25.946768  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:25.947121  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 8ee8e183d4e44c21804c9d95ed71dd2e, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.927639  9046 rpcz_store.cc:276] 0925 16:46:24.852549 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:24.861646 (+  9097us) service_pool.cc:227] Handling call
0925 16:46:24.861966 (+   320us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:25.081525 (+219559us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:25.081572 (+    47us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:25.304127 (+222555us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:25.304594 (+   467us) log.cc:842] Serialized 52 byte log entry
0925 16:46:25.679782 (+375188us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:25.909483 (+229701us) log.cc:842] Serialized 14 byte log entry
0925 16:46:25.923806 (+ 14323us) log.cc:842] Serialized 14 byte log entry
0925 16:46:25.926896 (+  3090us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:25.926975 (+    79us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:25.927087 (+   112us) raft_consensus.cc:1671] finished
0925 16:46:25.927100 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:25.927217 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":265898,"prepare.queue_time_us":62674,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":252083,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":4386,"spinlock_wait_cycles":2619264,"thread_start_us":549787,"threads_started":2,"wal-append.queue_time_us":432939}
I20260925 16:46:25.952426  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:25.954130  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 46063.4us
I20260925 16:46:25.908221 17411 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:25.931982 17309 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:25.947062 17500 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:25.962850 17443 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:25.974627  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.975934  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.976123  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:25.978816  9123 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:25.979019  8971 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:25.979060  9700 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:25.973495 17336 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:25.981379 17336 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:25.983337 17336 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:25.970261 17309 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.987951 17411 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:25.988479 17309 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:26.000830 17506 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.069s
I20260925 16:46:26.004223 17531 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:26.004863 17531 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:26.005223 17531 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:26.009014 17274 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:26.010439 17274 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:26.010859 17274 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:26.012524  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.013358  8969 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:26.016193  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:25.965600 17518 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:26.025424  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:26.281762  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:26.323010 17514 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.345s	user 0.000s	sys 0.000s
I20260925 16:46:26.328563 17518 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.333545 17524 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:26.334251 17274 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:26.338080 17421 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.500s	user 0.008s	sys 0.000s
I20260925 16:46:26.340116  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:26.340204  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.340989  9116 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:26.368861  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:26.357285  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1594) took 1005 ms. Trace:
I20260925 16:46:26.369818  9042 rpcz_store.cc:276] 0925 16:46:25.352320 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.358114 (+  5794us) service_pool.cc:227] Handling call
0925 16:46:25.379923 (+ 21809us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:25.380181 (+   258us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:46:25.580765 (+200584us) log.cc:842] Serialized 14 byte log entry
0925 16:46:25.924011 (+343246us) log.cc:842] Serialized 14 byte log entry
0925 16:46:26.356916 (+432905us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:26.356975 (+    59us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:26.357036 (+    61us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:26.357111 (+    75us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:26.357230 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":169010,"prepare.queue_time_us":125431,"prepare.run_cpu_time_us":87,"prepare.run_wall_time_us":659,"raft.queue_time_us":139045,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":4923,"spinlock_wait_cycles":9097088,"thread_start_us":784912,"threads_started":3}
W20260925 16:46:26.381294  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet c6030f186a664452b127609fadec766b, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:26.382308  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet c6030f186a664452b127609fadec766b, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:26.420123  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.042s	sys 0.017s
W20260925 16:46:26.420573  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.042s	sys 0.017s
W20260925 16:46:26.420938  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 678973us
W20260925 16:46:26.425786  9694 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.531s	user 0.006s	sys 0.003s
I20260925 16:46:26.426241  9694 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:26.430202  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:26.430971  9041 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:26.363967 17409 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:26.349855 17518 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:26.444694  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:26.448586 17523 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:26.327418  8867 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 8 to 10, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 10 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:26.474074 17526 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:46:26.525053  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.477108  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:26.376389 17329 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:26.518432  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:26.520969  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.531090  8971 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:26.536365  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.537187  8974 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
W20260925 16:46:26.528291 17411 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.005s	sys 0.006s
W20260925 16:46:26.531525 17537 log.cc:924] Time spent T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260925 16:46:26.551723  9041 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:26.543375 17329 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:26.552124 17411 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.007s
I20260925 16:46:26.515686 17409 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:26.574442  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 209480us
I20260925 16:46:26.560510 17549 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:26.601033  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:26.572503 17329 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:26.626214  9693 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1777) took 1869 ms (client timeout 2220 ms). Trace:
W20260925 16:46:26.626778  9693 rpcz_store.cc:269] 0925 16:46:24.754986 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:24.755216 (+   230us) service_pool.cc:227] Handling call
0925 16:46:26.624257 (+1869041us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b540079e5d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:26.624394 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":82069760}
W20260925 16:46:26.615075 17501 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.769s	user 0.011s	sys 0.001s
I20260925 16:46:26.630052 17523 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:26.629878 17501 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:26.631523  8873 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 219) took 121859 ms (client timeout 15000 ms). Trace:
W20260925 16:46:26.631986  8873 rpcz_store.cc:269] 0925 16:44:24.672663 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:44:24.672853 (+   190us) service_pool.cc:227] Handling call
0925 16:46:26.524108 (+121851255us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":48711,"reported_tablets":38}
I20260925 16:46:26.600672 17548 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.627837 17412 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:26.628679 17550 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.661403 17558 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:26.661811 17552 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:26.662020 17558 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.662350 17552 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.664711 17552 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.668537  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.649402 17412 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:26.669970  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:26.665982 17536 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:26.675294  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:26.672657 17531 consensus_meta.cc:287] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.665s	user 0.011s	sys 0.000s
I20260925 16:46:26.679348  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:26.671944 17412 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:26.687412  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:26.648440 17548 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.689131 17558 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:26.631362 17523 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.690142 17547 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:26.690325 17548 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.690714 17547 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.656600 17550 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.693034 17547 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.693483 17550 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:26.689306 17565 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:26.683230 17564 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:26.704144  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:26.707433  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.635874 17549 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.718216  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:26.719900  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.737895  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3917) took 1492 ms. Trace:
I20260925 16:46:26.738340  9119 rpcz_store.cc:276] 0925 16:46:25.245886 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.246032 (+   146us) service_pool.cc:227] Handling call
0925 16:46:25.246237 (+   205us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:25.923422 (+677185us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:26.737655 (+814233us) spinlock_profiling.cc:243] Waited 677 ms on lock 0x7b540010c054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:26.737838 (+   183us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1556121472}
I20260925 16:46:26.740274  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 2074) took 1335 ms. Trace:
I20260925 16:46:26.740712  9122 rpcz_store.cc:276] 0925 16:46:25.405116 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.406605 (+  1489us) service_pool.cc:227] Handling call
0925 16:46:26.740095 (+1333490us) spinlock_profiling.cc:243] Waited 359 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:26.740220 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":824698752}
I20260925 16:46:26.741073  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.741746  8974 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:26.700048 17501 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.703297 17409 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:26.705600 17547 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:26.761228  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 79052.7us
I20260925 16:46:26.767123  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:26.680980 17531 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:26.801832  8968 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:26.765479 17524 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:26.809347 17524 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:26.813169 17549 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.816668 17424 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.816761 17564 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.817376 17424 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:26.817461 17564 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.818073 17531 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.818638 17531 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.819053 17531 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:26.819731 17506 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:26.820377 17565 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:26.820194 17506 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.820626 17545 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.819506 17564 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:26.821223 17545 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.820895 17565 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:26.823135 17545 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:26.823423 17565 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.823808 17450 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.824342 17450 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:26.826272 17450 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:26.826993  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.827186  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.828111 17566 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:26.828209  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.828238  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.829061  8966 raft_consensus.cc:2379] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 24: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:26.830013  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.828657 17566 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:26.831517  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 1.02484e+06us
I20260925 16:46:26.831590  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:26.833115  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:26.764837 17329 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.819417 17424 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.844822  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.061657  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:27.067557  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:27.044088  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.067878  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.028141  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4213) took 1674 ms. Trace:
I20260925 16:46:27.069999  9118 rpcz_store.cc:276] 0925 16:46:25.353762 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.354469 (+   707us) service_pool.cc:227] Handling call
0925 16:46:25.354868 (+   399us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:25.901308 (+546440us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.027848 (+1126540us) spinlock_profiling.cc:243] Waited 546 ms on lock 0x7b540019d2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:27.028075 (+   227us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1255074560}
I20260925 16:46:26.898993  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:26.894074  8973 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:26.872476  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:26.911074  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.025442  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4086) took 1506 ms. Trace:
I20260925 16:46:27.074681  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.075065  8974 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:27.026693  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1597) took 1128 ms. Trace:
I20260925 16:46:26.872790  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.072943  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:26.810284 17438 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:27.022571  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1671) took 1315 ms. Trace:
I20260925 16:46:27.076115  9050 rpcz_store.cc:276] 0925 16:46:25.898368 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.898499 (+   131us) service_pool.cc:227] Handling call
0925 16:46:25.911142 (+ 12643us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:25.919146 (+  8004us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:25.919189 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:25.919811 (+   622us) log.cc:842] Serialized 26 byte log entry
0925 16:46:25.965064 (+ 45253us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:26.980666 (+1015602us) log.cc:842] Serialized 14 byte log entry
0925 16:46:27.026341 (+ 45675us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.026435 (+    94us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:27.026487 (+    52us) raft_consensus.cc:1671] finished
0925 16:46:27.026503 (+    16us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:27.026634 (+   131us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1076207,"prepare.queue_time_us":1015704,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":34,"raft.queue_time_us":60998,"raft.run_cpu_time_us":320,"raft.run_wall_time_us":6941,"thread_start_us":44927,"threads_started":1,"wal-append.queue_time_us":70271}
I20260925 16:46:27.078761  9046 raft_consensus.cc:2396] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260925 16:46:27.077275  8975 rpcz_store.cc:276] 0925 16:46:25.707041 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.707659 (+   618us) service_pool.cc:227] Handling call
0925 16:46:27.021717 (+1314058us) spinlock_profiling.cc:243] Waited 3.09 ms on lock 0x7b5800001898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:46:27.021945 (+   228us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:27.022157 (+   212us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:27.022193 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:27.022246 (+    53us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:27.022288 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.022373 (+    85us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:27.022500 (+   127us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":7110400}
I20260925 16:46:27.079559  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:27.080260  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:26.823640 17545 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:26.822185 17506 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.075366  9043 rpcz_store.cc:276] 0925 16:46:25.519080 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.519943 (+   863us) service_pool.cc:227] Handling call
0925 16:46:25.569361 (+ 49418us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:25.680968 (+111607us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:25.680997 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:25.698982 (+ 17985us) log.cc:842] Serialized 26 byte log entry
0925 16:46:25.827397 (+128415us) spinlock_profiling.cc:243] Waited 2.86 ms on lock 0x7b48002001d8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a0dd17f1 00007f71a0dc88e7 00007f71a0dc877a 00007f71a0ebc95f 00007f71a0ebc627 00007f71a0ed0b2c 00007f71a0ed0ad8 00007f71a0ed0a58 00007f71a0ed0a13 00007f71a0ecfcbc 00007f719fe51be6
0925 16:46:25.897391 (+ 69994us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:25.920169 (+ 22778us) log.cc:842] Serialized 14 byte log entry
0925 16:46:26.742121 (+821952us) spinlock_profiling.cc:243] Waited 4.56 ms on lock 0x7b1800203aa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:26.980363 (+238242us) spinlock_profiling.cc:243] Waited 2.98 ms on lock 0x7b1800203aa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f719fdd2bcf 00007f71990027b6 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d
0925 16:46:26.982057 (+  1694us) spinlock_profiling.cc:243] Waited 5.97 ms on lock 0x7b1800203aa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002638 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:27.024928 (+ 42871us) spinlock_profiling.cc:243] Waited 2.55 ms on lock 0x7b1800203aa0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f719bbb982c 00007f7198fe49dc 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7
0925 16:46:27.025078 (+   150us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.025165 (+    87us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:27.025215 (+    50us) raft_consensus.cc:1671] finished
0925 16:46:27.025228 (+    13us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:27.025377 (+   149us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":130803,"prepare.queue_time_us":25153,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":155789,"raft.run_cpu_time_us":916,"raft.run_wall_time_us":137984,"spinlock_wait_cycles":43502592,"thread_start_us":171604,"threads_started":2,"wal-append.queue_time_us":239990}
I20260925 16:46:27.083107  9046 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:27.087811 17409 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:27.088270 17409 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:27.061579 17383 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.088681 17409 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:27.061400 17479 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.088904 17383 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.089458 17479 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.091130 17383 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.096372 17427 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:26.976105 17556 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.097062 17556 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.098012 17409 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.099721 17545 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.103807 17418 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:27.105129 17531 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:26.974821 17568 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:26.976064 17566 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.105821  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2073) took 1701 ms. Trace:
I20260925 16:46:27.105841 17568 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.108167 17571 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:27.109499 17568 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.091420 17479 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.109953 17413 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
W20260925 16:46:26.855064 17559 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260925 16:46:27.106207  9117 rpcz_store.cc:276] 0925 16:46:25.404832 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.406525 (+  1693us) service_pool.cc:227] Handling call
0925 16:46:25.428772 (+ 22247us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:25.429033 (+   261us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:46:25.715496 (+286463us) log.cc:842] Serialized 14 byte log entry
0925 16:46:25.955162 (+239666us) log.cc:842] Serialized 14 byte log entry
0925 16:46:27.105393 (+1150231us) spinlock_profiling.cc:243] Waited 1.33 ms on lock 0x7b1800223240. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:46:27.105530 (+   137us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:27.105572 (+    42us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:27.105614 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.105678 (+    64us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:27.105771 (+    93us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":24897,"prepare.queue_time_us":108010,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":6707,"raft.queue_time_us":13691,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":4490,"spinlock_wait_cycles":3065984,"thread_start_us":432859,"threads_started":2,"wal-append.queue_time_us":855702}
I20260925 16:46:27.113018  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.113906  9702 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:27.115685  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:26.873509 17329 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:26.872277 17091 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.099364 17556 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.118000  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:26.953822 17524 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.027333 17451 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.144317  9665 leader_election.cc:398] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25.
I20260925 16:46:26.920285 17549 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:27.026923 17500 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:26.909263 17567 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.126667  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.127904  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.138890  8974 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:26.914561 17330 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.140762  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:27.151501  8966 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:27.127377 17568 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:27.160646 17568 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.119962 17547 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:27.161053 17408 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.161077 17568 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:27.161603 17408 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:26.856181 16996 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.287s
I20260925 16:46:27.164005 17411 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.164520 17411 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.165139  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57624 (request call id 15) took 1828 ms. Trace:
I20260925 16:46:27.165518  9044 rpcz_store.cc:276] 0925 16:46:25.336948 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.337106 (+   158us) service_pool.cc:227] Handling call
0925 16:46:27.164974 (+1827868us) spinlock_profiling.cc:243] Waited 51.9 ms on lock 0x7b54000d43d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:27.165061 (+    87us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":119364096}
I20260925 16:46:27.166342 17411 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.168156 17330 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.148245 17451 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.170225  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.170461 17330 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.170884  9044 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:27.171097 17451 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.171442  9047 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260925 16:46:27.125619 17091 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:27.174170  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61361.3us
I20260925 16:46:27.175066 17091 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:27.149777  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 719666us
I20260925 16:46:27.176250  9089 leader_election.cc:398] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:27.176519 17531 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.177018 17531 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.177372  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:27.178879  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:27.179111  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:46:27.179888  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:27.180732 17509 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 1.444s	user 0.012s	sys 0.000s
I20260925 16:46:27.180939  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:27.181131 17519 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:27.181363 17478 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:27.181878 17478 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:27.182121 17506 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:27.182736 17478 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.183454 17506 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:27.184037  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3507) took 2760 ms. Trace:
I20260925 16:46:27.184149 17506 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:27.184500  8972 rpcz_store.cc:276] 0925 16:46:24.423274 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:24.423768 (+   494us) service_pool.cc:227] Handling call
0925 16:46:24.424190 (+   422us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:24.446183 (+ 21993us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:24.446208 (+    25us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:25.133711 (+687503us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b18004e3e20. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a
0925 16:46:25.134272 (+   561us) spinlock_profiling.cc:243] Waited 1.23 ms on lock 0x7b2c00056298. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:25.191666 (+ 57394us) log.cc:842] Serialized 26 byte log entry
0925 16:46:25.401553 (+209887us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:25.401606 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:25.401699 (+    93us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:27.180208 (+1778509us) spinlock_profiling.cc:243] Waited 4.46 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:27.183781 (+  3573us) raft_consensus.cc:1671] finished
0925 16:46:27.183810 (+    29us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:27.183961 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":55908,"raft.queue_time_us":22880,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":3091,"spinlock_wait_cycles":17235712,"thread_start_us":144797,"threads_started":1,"wal-append.queue_time_us":275610}
I20260925 16:46:27.187093 17545 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.155946 17413 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:27.179139 17531 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.188232 17413 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.145685 17524 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.190660 17524 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.159209 17529 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.159663 17406 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.180976  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:46:27.144673  9665 leader_election.cc:401] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Cancelling election due to peer responding with higher term
I20260925 16:46:27.170424  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2691) took 1808 ms. Trace:
I20260925 16:46:27.207859  9045 rpcz_store.cc:276] 0925 16:46:25.361874 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.362150 (+   276us) service_pool.cc:227] Handling call
0925 16:46:25.839922 (+477772us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:25.840620 (+   698us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.170235 (+1329615us) spinlock_profiling.cc:243] Waited 477 ms on lock 0x7b54000a73d0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:27.170373 (+   138us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1098013952}
I20260925 16:46:27.195387  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.196013  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:27.125541 17412 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:27.211860  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 67665.8us
I20260925 16:46:27.216302  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.216936  9694 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:27.217861  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:27.149775 17500 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:27.222229  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:27.161377 17414 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.226539  9122 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:27.226521  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.223187  8940 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:27.195526 17408 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.207463 17450 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.140132 17329 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.319247  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.185356 17567 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.207168 17344 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.206861 17337 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.231513  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.348459  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.348794  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.233273  9015 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:27.219609 17406 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.219725 17479 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:27.295280  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.355144  9702 raft_consensus.cc:2354] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19.
I20260925 16:46:27.207456 17411 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:27.295969  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61884.8us
I20260925 16:46:27.316640  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.150403 17549 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.220552 17409 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.294782 17451 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:27.336949  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 113833us
I20260925 16:46:27.336097 17450 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.344631 17508 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.345022 17502 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.345386 17329 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.345527  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:27.349814  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 116642us
I20260925 16:46:27.221195 17427 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:27.370194  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:27.371068 17283 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:46:27.351955 17520 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.373056 17520 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.373706  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:27.374516 17549 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.375069 17091 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:27.375494 17546 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.376189 17270 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:27.376031 17546 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.376667 17270 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.356190 17337 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.378188 17546 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.378731 17270 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.379056 17337 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.366460 17525 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.011s
I20260925 16:46:27.366693 17508 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.384120 17508 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.350502 17503 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:27.387542 17503 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.388067 17503 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:27.367789 17518 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.392419 17518 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.394915 17518 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.368072  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.396948  9123 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
W20260925 16:46:27.397166 17575 log.cc:924] Time spent T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260925 16:46:27.361274 17495 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:27.397827 17495 raft_consensus.cc:686] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:27.398900 17495 consensus_queue.cc:237] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.399547 17412 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.400964  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.401870  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:27.402413  8971 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:27.363253 17411 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.369719  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.405098 17504 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:27.405378  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:27.405702 17411 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.405583 17504 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.401254 17567 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.211400 17529 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.409530 17529 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.411314 17450 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.411546 17506 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:27.412317 17520 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.407529 17504 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.413476  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.414335  9119 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:27.401841  8972 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:27.365259  9117 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:46:27.421761  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.422123  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.422976  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.422925  8971 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:27.428113  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.414096  9122 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:27.346720 17566 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:27.341743 17408 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.232369 17414 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.419456  8970 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3511) took 2122 ms. Trace:
I20260925 16:46:27.434785  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.448377  9697 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:27.440258  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:27.445261  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:27.450109  9119 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:27.450855  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.452685  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.447405  8970 rpcz_store.cc:276] 0925 16:46:25.257328 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:25.257439 (+   111us) service_pool.cc:227] Handling call
0925 16:46:25.257684 (+   245us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:25.393064 (+135380us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.379459 (+1986395us) spinlock_profiling.cc:243] Waited 135 ms on lock 0x7b54003e8d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:27.379638 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":309891328}
I20260925 16:46:27.453512  9045 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 16.
I20260925 16:46:27.455583  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.456678  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.375522 17091 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:27.466233  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.466471 17091 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:27.466892  9042 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:27.467633  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.467942  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.513120  9123 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:27.349144 17344 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.452117 17564 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.556838 17564 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.452625 17227 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.558048 17227 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.560012 17227 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.563750 17228 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.564282 17228 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.565554  9696 raft_consensus.cc:2396] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 25 because replica has last-logged OpId of term: 23 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 14.
I20260925 16:46:27.431135 17502 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.568882  9043 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:27.460006 17329 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:27.573011 17329 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:27.573385 17329 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:27.553300 17406 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.459739 17408 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.509670 17565 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.582497 17565 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.583822 17408 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.585160 17565 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.585546  8966 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:27.555486 17344 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.567195 17091 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.593081 17228 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.593705 17091 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.604955 17479 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election lost for term 24. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25.
W20260925 16:46:27.609493  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 104856us
I20260925 16:46:27.609779 17106 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:27.612257 17564 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.612828 17274 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:27.618063 17500 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.622900  9123 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:27.612414 17414 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:27.639433  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:27.651068 17052 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:27.653297 17052 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.655377 17052 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.655783 17564 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:27.662299  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:27.663307  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.664520  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:27.673687  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.012s	sys 0.016s
W20260925 16:46:27.674160  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.012s	sys 0.016s
I20260925 16:46:27.675825  9090 leader_election.cc:398] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19.
I20260925 16:46:27.676333  9090 leader_election.cc:401] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:27.679049 17284 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:27.679384 17190 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:27.650810 17502 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:27.637725  9119 raft_consensus.cc:2396] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 23 because replica has last-logged OpId of term: 22 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 13.
W20260925 16:46:27.663271 17568 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.501s	user 0.007s	sys 0.003s
W20260925 16:46:27.673497 17424 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.011s	sys 0.015s
W20260925 16:46:27.689925 17519 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.061s	sys 0.152s
I20260925 16:46:27.690091 17190 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:27.738664  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:27.692148 17413 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.002s	sys 0.010s
W20260925 16:46:27.740399 17413 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.002s	sys 0.010s
I20260925 16:46:27.686446 17228 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.719686  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.727455  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:27.733650  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:27.746740  8970 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:27.734544  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.743270  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:27.737159 17519 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.555s	user 0.061s	sys 0.153s
I20260925 16:46:27.696084 17414 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.697911  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:27.739764 17424 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.011s	sys 0.015s
I20260925 16:46:27.754106  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.749392  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:27.741317 17284 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.711789 17551 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.737645 17523 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:27.664351 17564 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.711596 17412 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:27.760741  9118 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260925 16:46:27.780362  9118 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:27.782115  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.782917  9118 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:27.784802  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:27.751170  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 75500.6us
W20260925 16:46:27.766419  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51271.2us
I20260925 16:46:27.741576 17190 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:27.787977  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:27.785610  9118 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:27.773839  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.759639 17408 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 19
I20260925 16:46:27.800714  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:27.808399  9042 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:27.777329 17563 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:27.777555 17551 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.820530  9047 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 22. Current term is 23. Ops: [22.17-22.17]
I20260925 16:46:27.739549 17568 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.824668  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.787679 17523 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.747658 17228 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:27.792476  9123 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:27.805428 17564 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:27.829542  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:27.769132 17414 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.778012 17284 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:27.877532  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:28.224655  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4105) took 1029 ms. Trace:
W20260925 16:46:27.897462  8939 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.195:32851 timed out after 1.828s (SENT) [suppressed 42 similar messages]
I20260925 16:46:27.905414  9697 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:28.227161  9115 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:28.229161  9115 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:28.228554  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:27.871608  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:28.225656  8969 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.023s	sys 0.030s
W20260925 16:46:28.231153  8969 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.023s	sys 0.031s
I20260925 16:46:28.227955  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:28.232982  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 154588us
I20260925 16:46:28.225106  9044 rpcz_store.cc:276] 0925 16:46:27.195402 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.196011 (+   609us) service_pool.cc:227] Handling call
0925 16:46:27.226604 (+ 30593us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:27.230335 (+  3731us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:27.230390 (+    55us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:27.234575 (+  4185us) log.cc:842] Serialized 26 byte log entry
0925 16:46:27.763376 (+528801us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:27.763410 (+    34us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:27.763470 (+    60us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:28.224460 (+460990us) raft_consensus.cc:1671] finished
0925 16:46:28.224481 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:28.224600 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3277,"raft.queue_time_us":5583,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":63564,"thread_start_us":465517,"threads_started":1,"wal-append.queue_time_us":923538}
I20260925 16:46:28.237746  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:28.238953  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:28.249765  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 1.041s	user 0.022s	sys 0.080s
I20260925 16:46:28.250129  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:28.250571  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.022s	sys 0.080s
I20260925 16:46:28.251534  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:28.251817  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.05813e+06us
I20260925 16:46:28.253124  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:28.149103 17324 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.919s	user 0.007s	sys 0.020s
W20260925 16:46:28.255471  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 425972us
W20260925 16:46:28.179368 17495 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.741s	user 0.035s	sys 0.026s
I20260925 16:46:27.917969 17523 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:28.256876  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.265995  9124 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:28.266193  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.260555  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.260870  9122 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:28.229954  9115 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:28.267535  9115 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:28.261475  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:28.151165 17319 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.008s	sys 0.011s
I20260925 16:46:28.250865  9123 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:27.814697 17563 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:28.271334  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:27.833166 17325 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:28.273002  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.273552 17309 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:27.833781 17500 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:28.274899  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:28.308627  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet ee9de086f49c4026931c128637888218, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:28.275882  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:27.829178 17412 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:28.052867 17329 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:28.283342 17568 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:28.285672 17581 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:28.286904  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:28.264640 17324 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.036s	user 0.011s	sys 0.020s
I20260925 16:46:28.294803  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:28.322043  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:28.259877 17495 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.035s	sys 0.027s
I20260925 16:46:28.302565  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:28.301803  9117 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.857s	user 0.004s	sys 0.027s
W20260925 16:46:28.336894  9117 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.004s	sys 0.028s
I20260925 16:46:28.308099  9046 raft_consensus.cc:2379] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 26: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:28.311112  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.307523  9115 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260925 16:46:28.338416  9115 pending_rounds.cc:76] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 10
I20260925 16:46:28.338721  9115 pending_rounds.cc:97] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 17.11
I20260925 16:46:28.339008  9115 raft_consensus.cc:2866] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:28.312374  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:28.312673  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.316915  9042 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:28.280989 17319 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.937s	user 0.008s	sys 0.012s
I20260925 16:46:28.341500  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.342553  9119 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:28.343797  9695 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:28.345836  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:28.346901  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:28.326709  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.293016 17563 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:28.301028 17309 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:28.258587 17438 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.057s
W20260925 16:46:28.353232  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95981.3us
I20260925 16:46:28.353907  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:28.354578  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.279449 17413 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.057s
I20260925 16:46:28.360049  9049 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:28.422428  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:28.414270  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.643071  9042 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:28.362262  9124 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:28.644315  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.642237  9044 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:28.402504  9050 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260925 16:46:28.314548 17569 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.028s	sys 0.065s
I20260925 16:46:28.413930  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.464268  9121 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:28.326491 17479 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:28.591809 17586 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
W20260925 16:46:28.525326 17190 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.711s	user 0.010s	sys 0.001s
W20260925 16:46:28.558159 17587 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
W20260925 16:46:28.444597 17503 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 1.056s	user 0.009s	sys 0.003s
I20260925 16:46:28.402252 17549 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:28.382974 17324 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:28.352334 17409 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:28.359982 17407 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.088s	user 0.014s	sys 0.020s
W20260925 16:46:28.543080 17274 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.930s	user 0.010s	sys 0.002s
W20260925 16:46:28.656744 17569 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.293s	user 0.035s	sys 0.088s
I20260925 16:46:28.554286 17414 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:28.508983 17284 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:28.421006 17568 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:28.456172 17346 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:28.509050 17329 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:28.420306 17526 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:28.402365 17551 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:28.640971 17309 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:28.593875 17408 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.779s	user 0.011s	sys 0.000s
I20260925 16:46:28.362884 17424 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:28.593232 17525 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:28.520907 17583 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:28.657209 17438 consensus_queue.cc:1225] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 23.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260925 16:46:28.490242 17228 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:28.585632 17519 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.829s	user 0.053s	sys 0.058s
I20260925 16:46:28.679051 17479 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:28.333250 17581 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:28.691421 17595 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.238s	user 0.000s	sys 0.003s
I20260925 16:46:28.796537 17525 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:28.796703 17424 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:28.799405 17479 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:28.448072 17412 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:28.658269  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:28.964627  9116 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.008s	sys 0.025s
I20260925 16:46:28.860426 17581 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:28.964155  9090 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.009s	sys 0.008s
W20260925 16:46:28.988636  9090 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.641s	user 0.009s	sys 0.013s
W20260925 16:46:28.988075  9116 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.764s	user 0.009s	sys 0.030s
I20260925 16:46:28.990131 17274 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:28.946871  8939 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.004s	sys 0.010s
W20260925 16:46:28.964733  9089 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.666s	user 0.006s	sys 0.009s
W20260925 16:46:28.964465  9087 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.013s
W20260925 16:46:28.957927  9045 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.632s	user 0.000s	sys 0.010s
W20260925 16:46:28.967978  9665 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.645s	user 0.005s	sys 0.008s
W20260925 16:46:28.956324  9016 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.007s	sys 0.003s
W20260925 16:46:28.965391  9666 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.023s	sys 0.018s
W20260925 16:46:28.957502  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.011s	sys 0.011s
I20260925 16:46:29.001683  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4243) took 1183 ms. Trace:
I20260925 16:46:29.002190 17382 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:28.999596  9087 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.729s	user 0.001s	sys 0.015s
I20260925 16:46:28.991477 17274 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:29.004269  9089 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.007s	sys 0.010s
W20260925 16:46:28.694729 17407 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.474s	user 0.015s	sys 0.025s
W20260925 16:46:29.004485  9666 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.645s	user 0.024s	sys 0.024s
W20260925 16:46:29.005122  9665 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.006s	sys 0.009s
W20260925 16:46:29.005429  9016 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.746s	user 0.007s	sys 0.005s
W20260925 16:46:28.999926  8939 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.005s	sys 0.015s
W20260925 16:46:29.008605  9045 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.002s	sys 0.011s
W20260925 16:46:28.800829 17519 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.045s	user 0.053s	sys 0.060s
W20260925 16:46:29.011428  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.571s	user 0.018s	sys 0.015s
I20260925 16:46:28.841977 17413 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:28.859349 17592 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.174s	user 0.000s	sys 0.000s
W20260925 16:46:28.856231 17588 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
W20260925 16:46:28.801280 17593 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.273s	user 0.000s	sys 0.001s
I20260925 16:46:28.964110  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.685729 17190 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.002185  9116 rpcz_store.cc:276] 0925 16:46:27.817884 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.818034 (+   150us) service_pool.cc:227] Handling call
0925 16:46:27.890860 (+ 72826us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:27.918880 (+ 28020us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:27.918914 (+    34us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:28.223430 (+304516us) log.cc:842] Serialized 26 byte log entry
0925 16:46:29.000870 (+777440us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:29.001019 (+   149us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:29.001185 (+   166us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:29.001257 (+    72us) raft_consensus.cc:1671] finished
0925 16:46:29.001285 (+    28us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:29.001568 (+   283us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27531,"raft.queue_time_us":27890,"raft.run_cpu_time_us":105,"raft.run_wall_time_us":105,"thread_start_us":765621,"threads_started":1,"wal-append.queue_time_us":653794}
I20260925 16:46:29.021876 17408 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19.
I20260925 16:46:29.023623 17424 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.024284 17525 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.024693  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4110) took 1062 ms. Trace:
W20260925 16:46:29.025039 17325 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.024s	sys 0.056s
I20260925 16:46:29.025197 17274 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:29.025621  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 760683us
I20260925 16:46:28.830082 17583 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:29.017908 17609 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:28.695742 17549 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:29.029788  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 682889us
I20260925 16:46:29.030079 17610 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.029837 17519 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.032601  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.697252 17293 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:28.957576  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:28.958002  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:29.038875 17325 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.025s	sys 0.056s
I20260925 16:46:29.041947 17325 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:29.042145  9050 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:29.042573 17293 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.043880  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.045100 17583 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:29.045212 17549 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:29.045858 17190 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.048143 17382 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.048830  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.048903  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3939) took 1606 ms. Trace:
I20260925 16:46:29.044126 17325 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:29.060643  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 1.16311e+06us
I20260925 16:46:29.035878  9048 rpcz_store.cc:276] 0925 16:46:27.962707 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:28.243967 (+281260us) service_pool.cc:227] Handling call
0925 16:46:28.274224 (+ 30257us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:28.341341 (+ 67117us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:28.341385 (+    44us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:28.401688 (+ 60303us) log.cc:842] Serialized 26 byte log entry
0925 16:46:29.024138 (+622450us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:29.024225 (+    87us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:29.024324 (+    99us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:29.024372 (+    48us) raft_consensus.cc:1671] finished
0925 16:46:29.024381 (+     9us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:29.024589 (+   208us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":153810,"raft.queue_time_us":67275,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":45916,"thread_start_us":575747,"threads_started":1,"wal-append.queue_time_us":461410}
I20260925 16:46:29.065974  9047 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:29.066525 17382 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.068312  9048 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:29.070366 17609 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.072213  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:29.073501 17609 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.074587 17610 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.084983  9047 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 11. (term mismatch)
I20260925 16:46:29.086428  9047 pending_rounds.cc:76] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 10
I20260925 16:46:29.089538 17413 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.089608 17519 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.093474 17519 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.093524  9696 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:29.093983  9696 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:29.098757  9116 raft_consensus.cc:3032] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:29.099185  9116 raft_consensus.cc:729] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:29.100402  9116 consensus_queue.cc:260] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.101012 17424 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.101908  9116 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.102015 17424 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.102526  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:29.104081 17432 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:29.104542 17432 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.104929 17432 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.106098 17424 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.108436 17293 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.100404 17568 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.109490  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:29.110741 17568 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:28.859826 17563 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.112376 17605 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:29.112856 17605 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.113075 17610 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.113298 17605 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:29.114145  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:29.114554  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 853103us
I20260925 16:46:29.115022  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.062539 17525 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.115963  9118 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:29.116346 17525 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.116187  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.118718  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.119056 17525 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.119585  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.050748  9117 rpcz_store.cc:276] 0925 16:46:27.442519 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.442644 (+   125us) service_pool.cc:227] Handling call
0925 16:46:27.443030 (+   386us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:27.443440 (+   410us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:27.443478 (+    38us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:27.444022 (+   544us) log.cc:842] Serialized 26 byte log entry
0925 16:46:28.337368 (+893346us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:28.337431 (+    63us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:28.337547 (+   116us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:29.048377 (+710830us) raft_consensus.cc:1671] finished
0925 16:46:29.048418 (+    41us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:29.048689 (+   271us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":104,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":892908,"threads_started":1,"wal-append.queue_time_us":1158375}
I20260925 16:46:29.119917  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:29.120020  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.120982  9118 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 29.
I20260925 16:46:29.121543 17549 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.123437 17413 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.123684 17261 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:29.125151 17319 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260925 16:46:29.125416 17613 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.126194 17613 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:29.128499  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63950.2us
I20260925 16:46:29.129181 17519 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.129925  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.130165 17519 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.132201 17600 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:29.132603 17600 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.095480  9696 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.133013 17600 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:29.133639  9089 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.134392  9696 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.088939  9047 pending_rounds.cc:97] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 18.11
I20260925 16:46:29.134668 17609 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:46:29.136319  9693 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2406) took 1719 ms. Trace:
I20260925 16:46:29.149446  9693 rpcz_store.cc:276] 0925 16:46:27.417020 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.423052 (+  6032us) service_pool.cc:227] Handling call
0925 16:46:27.456708 (+ 33656us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:27.458667 (+  1959us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:27.458709 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:27.459204 (+   495us) log.cc:842] Serialized 26 byte log entry
0925 16:46:28.026604 (+567400us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:28.026646 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:28.026712 (+    66us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:29.135801 (+1109089us) raft_consensus.cc:1671] finished
0925 16:46:29.135858 (+    57us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:29.136092 (+   234us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":133392,"raft.queue_time_us":2615,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":44202,"thread_start_us":476878,"threads_started":1,"wal-append.queue_time_us":978247}
I20260925 16:46:29.137579 17413 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:29.152555 17413 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.152849 17610 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:29.153301 17413 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:29.153559 17610 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.154258 17610 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:29.111451  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:29.139665  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.008s	sys 0.016s
W20260925 16:46:29.156602  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.846s	user 0.008s	sys 0.016s
W20260925 16:46:29.156716  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45442.9us
I20260925 16:46:29.156729 17548 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:29.141615 17563 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:29.142290  8941 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.725s	user 0.000s	sys 0.022s
W20260925 16:46:29.160053  8941 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.850s	user 0.000s	sys 0.023s
I20260925 16:46:29.160240 17293 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.161540 17602 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.161269 17293 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.162415 17602 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.163798  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.163867 17414 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.164153 17227 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:29.164270  9050 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:29.164847 17414 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.165514 17052 raft_consensus.cc:2741] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260925 16:46:29.166265  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.169304 17408 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:29.169471  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:29.170082  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.170024 17408 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.170856  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.172015  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.132802  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.173609 17408 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.174993 17414 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:28.695545 17503 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.176317 17602 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.155922  9047 raft_consensus.cc:2866] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:29.176772  9041 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:29.180241  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3544) took 1757 ms. Trace:
I20260925 16:46:29.180634  8969 rpcz_store.cc:276] 0925 16:46:27.422250 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.429419 (+  7169us) service_pool.cc:227] Handling call
0925 16:46:27.429745 (+   326us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:27.430145 (+   400us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:27.430182 (+    37us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:27.430649 (+   467us) log.cc:842] Serialized 26 byte log entry
0925 16:46:27.616547 (+185898us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b1800489400. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7199001e22 00007f719bbab5bb 00007f719bbb1063 00007f719bbb1411 00007f719befe5cf
0925 16:46:28.231624 (+615077us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:28.231663 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:28.231745 (+    82us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:28.690729 (+458984us) spinlock_profiling.cc:243] Waited 3.16 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:29.179786 (+489057us) raft_consensus.cc:1671] finished
0925 16:46:29.179826 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:29.179999 (+   173us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":8431,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":8967,"spinlock_wait_cycles":15975680,"thread_start_us":614902,"threads_started":1,"wal-append.queue_time_us":955632}
I20260925 16:46:29.183420 17503 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.191563 17346 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.193060 17052 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:29.194399 17346 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.196393 17583 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.197687  9124 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:29.198182  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.198539 17583 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:29.199234  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 54431.4us
I20260925 16:46:29.201450  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:29.203512 17503 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:29.167330 17345 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:29.205293 17345 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.208168 17293 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.206079 17613 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.207065 17549 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.224520  8967 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:29.228191  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.228763  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.229779  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.230139  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.231192  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:29.231870  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 222041us
I20260925 16:46:29.232349 17603 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:29.232570  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.233022 17603 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:29.234228 17603 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.237089 17052 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:29.239001 17345 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.240935  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.243841  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.245184 17106 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.245348 17604 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.245577 17336 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.245913 17106 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.246155 17604 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.246397 17336 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.248710  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.249011 17568 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:29.248816 17336 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.220566  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.249679 17568 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.256008 17519 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.256496 17604 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.250244  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:29.259894  9123 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:29.264045 17409 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:29.265019  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 146490us
I20260925 16:46:29.265076 17605 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.267375  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.269829 17284 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.270563  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.271818 17345 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260925 16:46:29.273307  8967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2705) took 2755 ms (client timeout 1730 ms). Trace:
I20260925 16:46:29.289127 17284 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:29.287896  8967 rpcz_store.cc:269] 0925 16:46:26.517901 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:26.518066 (+   165us) service_pool.cc:227] Handling call
0925 16:46:29.273001 (+2754935us) spinlock_profiling.cc:243] Waited 2.52 s on lock 0x7b540038d454. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:29.273154 (+   153us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5787898624}
I20260925 16:46:29.297773  9696 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
W20260925 16:46:29.301280 17547 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 23 current term: 23 is higher.
I20260925 16:46:29.302695  9123 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43572 (request call id 2100) took 1033 ms. Trace:
I20260925 16:46:29.303834  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.303107  9123 rpcz_store.cc:276] 0925 16:46:28.269452 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:28.302046 (+ 32594us) service_pool.cc:227] Handling call
0925 16:46:29.302444 (+1000398us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b540007e254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:29.302623 (+   179us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1614043904}
I20260925 16:46:29.312168 17261 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:29.312321 17114 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.312372 17549 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.313160 17114 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.314559 17382 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.315359 17114 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.315135 17382 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.316104  9702 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:29.317016 17503 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.317219 17382 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.317498  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1790) took 1499 ms. Trace:
I20260925 16:46:29.317775 17382 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.317693 17503 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.318476 17382 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.313256 17549 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.293840 17284 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.320274  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:29.320547  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:29.321343  9702 rpcz_store.cc:276] 0925 16:46:27.818453 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.818640 (+   187us) service_pool.cc:227] Handling call
0925 16:46:27.902499 (+ 83859us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:29.316546 (+1414047us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:29.317250 (+   704us) spinlock_profiling.cc:243] Waited 1.39 s on lock 0x7b540066dd54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:29.317434 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3198346496}
W20260925 16:46:29.323938  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58224.1us
I20260925 16:46:29.327559  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1789) took 1520 ms. Trace:
I20260925 16:46:29.296662 17519 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.273927 17600 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.293124 17432 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.327966  9696 rpcz_store.cc:276] 0925 16:46:27.807604 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:27.807907 (+   303us) service_pool.cc:227] Handling call
0925 16:46:27.808242 (+   335us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:29.093289 (+1285047us) spinlock_profiling.cc:243] Waited 643 ms on lock 0x7b54004e14a0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:46:29.299671 (+206382us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:29.311579 (+ 11908us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b54004e07d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:29.327518 (+ 15939us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2686342784}
I20260925 16:46:29.293329 17610 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.320734 17261 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.332149 17106 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.333408  9699 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:29.333480 17284 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 20.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
I20260925 16:46:29.336421 17382 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.335183  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:29.324398 17409 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.334826 17549 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.354538 17413 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.357110 17106 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:29.357542 17106 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:29.358505 17106 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.361271 17309 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.339881 17519 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:29.340726  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 120000us
I20260925 16:46:29.330844 17345 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:29.350246 17261 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:29.365166 17432 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.363668 17309 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.364092 17568 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.428993  9699 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:29.345161 17605 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.372298  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.372556 17503 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.385217 17600 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.381057 17613 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.438434  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.439075 17106 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:29.438786 17613 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.425932  9702 raft_consensus.cc:1226] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:29.367219  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:29.441093 17613 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.387277 17382 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:46:29.441954 17382 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.442353 17382 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:29.372051  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.417433 17583 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.444222  9050 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:29.444430 17583 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.373085  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.445231 17432 consensus_queue.cc:1046] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:29.364002  9046 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:29.446357 17432 raft_consensus.cc:3032] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:29.446450  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.446781 17432 raft_consensus.cc:729] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:29.447168  9046 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2706) took 1100 ms. Trace:
I20260925 16:46:29.373381  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.373483  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:29.373670  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.374017  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.393038 17519 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.447638 17432 consensus_queue.cc:260] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.447561  9046 rpcz_store.cc:276] 0925 16:46:28.346403 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:29.079970 (+733567us) service_pool.cc:227] Handling call
0925 16:46:29.446977 (+367007us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b5400226ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:29.447102 (+   125us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":508012928}
I20260925 16:46:29.378201  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:29.384807 17412 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:29.452265 17503 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:29.452885 17503 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.452232 17412 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.453230 17503 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:29.453864  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 133418us
W20260925 16:46:29.384581  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49616us
I20260925 16:46:29.404624 17413 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.366736 17409 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.350613  9044 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:29.420029 17602 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.331163 17190 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:29.460839  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 82773.1us
I20260925 16:46:29.464308  9665 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.467356  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.439685  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.469921  9701 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:29.479997  9050 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:29.466497 17414 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.017s
I20260925 16:46:29.465313 17602 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.484061 17414 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:29.484334  9666 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:29.485505 17602 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:29.486135  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 218843us
I20260925 16:46:29.465924 17519 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 25.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.021s
I20260925 16:46:29.487536  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.487758 17519 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:29.485447  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.484509 17414 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:29.488857  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:29.491375  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:29.459960 17620 log.cc:924] Time spent T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.068s	user 0.003s	sys 0.000s
I20260925 16:46:29.467849 17432 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:29.499360  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.464445 17412 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.457274 17583 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:29.464017 17600 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.505573  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:29.499948  9048 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:29.366326 17610 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.507895  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.511106  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.511538 17568 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:29.511754 17605 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:29.512287  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:29.512809  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:29.488756 17519 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:29.504539 17409 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:29.521811 17414 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:29.523227 17619 log.cc:924] Time spent T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.126s	user 0.004s	sys 0.000s
I20260925 16:46:29.529186 17605 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.529747 17605 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:29.531893 17600 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.532899 17409 raft_consensus.cc:686] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:29.533990 17547 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:29.534533 17547 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:29.534884 17547 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:29.534976 17600 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.523305 17414 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:29.536378  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.538823  9042 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260925 16:46:29.545930  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46074.8us
I20260925 16:46:29.514364 17052 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:29.426512 17261 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:29.548568  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 84404.7us
I20260925 16:46:29.567858 17601 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:29.568441 17601 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.568797  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.541486 17568 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:29.550046 17319 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election won for term 21
W20260925 16:46:29.577092  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66117.3us
I20260925 16:46:29.581533 17319 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:29.582580 17319 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.583846  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.584728 17628 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.071s
I20260925 16:46:29.590880 17424 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:29.592993 17261 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.534080 17409 consensus_queue.cc:237] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.569314 17601 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.603232  9090 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.545747 17190 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.606604 17382 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.611665 17382 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:29.616056  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47557.9us
W20260925 16:46:29.639885  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60879.7us
I20260925 16:46:29.638595 17052 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:29.618661 17345 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:29.654628 17601 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.654994 17345 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.658972 17052 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.660127 17345 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.660812 17602 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260925 16:46:29.645130 17581 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:29.665099  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.665496 17190 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.664527 17601 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.654618 17547 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.668767 17581 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:29.669615 17547 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.675589  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.678848  9049 raft_consensus.cc:1226] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:29.681921  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.681944  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.688467 17602 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:29.689183 17602 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:29.689553 17602 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:29.691937 17581 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:29.694710  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.695794  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:29.696080  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.706176  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.706878  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:29.708022  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.708755  9121 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:29.708057  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.710083  9043 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:29.673982 17583 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260925 16:46:29.714944  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95535.4us
I20260925 16:46:29.718837  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.719899  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.720557  9121 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:29.721408 17413 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:29.727353 17625 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:29.728001 17625 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:29.728962 17625 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.731238  9045 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:29.712529 17519 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.738068  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.738026  8871 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: config changed from index 4 to 14, term changed from 18 to 21, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193), VOTER 40a71744ceba4efe949720cb0f274853 (127.7.158.195) evicted. New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:29.741305 17503 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.742491  9048 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:29.742933  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.743376 17503 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.743930  9044 raft_consensus.cc:2396] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 20 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 9.
I20260925 16:46:29.744226  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:29.747509  9047 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:29.747637  9124 raft_consensus.cc:3037] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:29.744002  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.750984  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.758256 17547 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.759066 17547 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.761140 17547 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:29.764602  9116 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:29.712298 17414 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.040s
I20260925 16:46:29.716182 17583 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:29.766290 17600 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:29.767060 17600 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:29.766552 17583 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:29.773869  9043 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:29.784309  9666 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:29.789887  9699 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:29.790030  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.790995  9695 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:29.791299  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.792171 17345 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:29.792742 17106 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:29.792790  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.793329 17106 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:29.793752 17106 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:29.794787  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:29.794787 17568 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260925 16:46:29.717782 17581 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.070s
I20260925 16:46:29.795573 17568 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:29.796015 17568 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:29.796074 17581 consensus_queue.cc:1225] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer e3a3bc92ca0a4efa913eca1800a1550d log is divergent from this leader: its last log entry 25.20 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 19
I20260925 16:46:29.796456 17190 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:29.796697 17581 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:29.797171 17581 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:29.798014 17190 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:29.798442  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 85594.5us
I20260925 16:46:29.800096  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:29.800866 17106 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.801466  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:29.798024 17581 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.20, Last appended by leader: 20, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.802531 17600 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.807473 17581 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:29.807548 17600 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:29.809224  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.809841  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:29.803956 17632 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:29.812284 17632 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:29.812111 17628 consensus_queue.cc:1046] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:29.813773 17274 raft_consensus.cc:3032] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:29.814265 17274 raft_consensus.cc:729] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:29.812691 17632 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:29.814944 17632 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:29.815236 17274 consensus_queue.cc:260] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.816622 17274 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.819912 17227 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:29.820803 17227 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:29.821336 17227 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:29.822095 17345 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:29.822188 17227 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.823514 17227 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.824265  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.825137 17190 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:29.813798  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.820799 17052 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.005s
I20260925 16:46:29.825757 17519 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:29.827404  8871 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 21, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:29.829175  8871 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:29.830514  8871 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 19, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 19 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:29.836784  8871 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 21, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:29.837824  9116 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 20. Preceding OpId from leader: term: 25 index: 20. (term mismatch)
I20260925 16:46:29.842247  9089 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:29.838614  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 54391.5us
I20260925 16:46:29.844146  9116 pending_rounds.cc:76] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 19
I20260925 16:46:29.847525  8871 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 16, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 16 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:29.849320  9116 pending_rounds.cc:97] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 24.20
I20260925 16:46:29.850270  9116 raft_consensus.cc:2866] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:29.778329 17503 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:29.851527  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:29.853403  9124 raft_consensus.cc:2454] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:29.861917  8871 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 19 to 22, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:29.866595  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.847481 17409 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:29.871438  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:29.860219 17519 raft_consensus.cc:2741] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:46:29.873421  9048 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: [25.18-25.18]
I20260925 16:46:29.785837 17605 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.866374 17581 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:29.849393 17568 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.889820  9695 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
W20260925 16:46:29.890152  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95450.2us
I20260925 16:46:29.885494 17414 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.008s
I20260925 16:46:29.893931 17414 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:29.875782 17106 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.894251 17414 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:29.880823 17409 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:29.904376  9699 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 16. Current term is 17. Ops: []
I20260925 16:46:29.908660  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.897918 17284 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:29.896113 17581 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.918857  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:29.919651 17581 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.920032  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:29.920251  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:29.920678  9699 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:29.921450  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:29.922144  9701 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:29.922380  9117 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260925 16:46:29.922760 17414 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.924059 17414 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:29.926764  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:29.927331  9119 raft_consensus.cc:3037] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:29.926110  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:29.928960  9117 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:29.948344 17605 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:29.948259 17503 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260925 16:46:29.952217 17583 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:29.953063 17409 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.904464 17190 consensus_queue.cc:1046] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.029s
I20260925 16:46:29.961181  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:29.961824  9701 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:29.913856 17628 consensus_queue.cc:1046] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260925 16:46:29.972936  9699 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:29.981251  8967 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260925 16:46:29.955806 17284 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:29.986388 17274 raft_consensus.cc:3032] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:29.986804 17274 raft_consensus.cc:729] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:29.987090 17284 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:29.969931 17261 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Stepping down as leader of term 25
W20260925 16:46:29.989996  8867 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 221) took 73753 ms (client timeout 15000 ms). Trace:
I20260925 16:46:29.990075 17261 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:29.935562 17602 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.009610  9123 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:30.001763  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:29.992120  8871 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 19 to 20, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:29.987587 17274 consensus_queue.cc:260] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.011204 17274 raft_consensus.cc:3037] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:30.012526 17602 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:29.990468  8867 rpcz_store.cc:269] 0925 16:45:16.236689 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:16.242290 (+  5601us) service_pool.cc:227] Handling call
0925 16:46:29.989787 (+73747497us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:27.173489 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:27.174087 (+   598us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:27.174138 (+    51us) write_op.cc:435] Acquired schema lock
0925 16:46:27.174151 (+    13us) tablet.cc:660] Decoding operations
0925 16:46:27.174580 (+   429us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:27.174679 (+    99us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:27.174718 (+    39us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:46:27.174981 (+   263us) tablet.cc:699] Row locks acquired
0925 16:46:27.175017 (+    36us) write_op.cc:260] PREPARE: finished
0925 16:46:27.175181 (+   164us) write_op.cc:270] Start()
0925 16:46:27.175356 (+   175us) write_op.cc:276] Timestamp: P: 1790354787175112 usec, L: 0
0925 16:46:27.175389 (+    33us) op_driver.cc:331] REPLICATION: starting
0925 16:46:27.338351 (+162962us) log.cc:842] Serialized 536 byte log entry
0925 16:46:29.085979 (+1747628us) op_driver.cc:444] REPLICATION: finished
0925 16:46:29.320781 (+234802us) write_op.cc:301] APPLY: starting
0925 16:46:29.331063 (+ 10282us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:29.342836 (+ 11773us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:29.342985 (+   149us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:29.349003 (+  6018us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:29.354737 (+  5734us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0925 16:46:29.354796 (+    59us) write_op.cc:312] APPLY: finished
0925 16:46:29.355167 (+   371us) log.cc:842] Serialized 25 byte log entry
0925 16:46:29.356619 (+  1452us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:29.356721 (+   102us) write_op.cc:454] Released schema lock
0925 16:46:29.356781 (+    60us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:29.362407 (+  5626us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:29.362443 (+    36us) write_op.cc:454] Released schema lock
0925 16:46:29.411554 (+ 49111us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf27689 00007f719bec5804 00007f719bec57b3 00007f719bec5728 00007f719bec56e3 00007f719bec49cc 00007f719beeea16 00007f719bed65cb 00007f719bec0c8d 00007f719bec4665
Metrics: {"mutex_wait_us":1064567,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":194728,"apply.run_cpu_time_us":4794,"apply.run_wall_time_us":58920,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8301,"num_ops":1,"prepare.queue_time_us":474332,"prepare.run_cpu_time_us":139671,"prepare.run_wall_time_us":1816091,"raft.queue_time_us":26386,"raft.run_cpu_time_us":20244,"raft.run_wall_time_us":526901,"replication_time_us":1875936,"spinlock_wait_cycles":341228288,"thread_start_us":1984473,"threads_started":4,"wal-append.queue_time_us":1513714}]]}
I20260925 16:46:29.991307 17261 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.005837  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:30.016475  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:30.002525  9045 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:30.016561  8871 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 19, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 19 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.020955  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.022682  9116 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:30.014977 17261 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:30.029533  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.031548  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.038661  9699 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:30.019891 17106 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.008s
I20260925 16:46:30.020444 17583 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:30.032907 17319 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:30.052479  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:30.075337  9115 pending_rounds.cc:76] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 15
I20260925 16:46:30.111927  9115 pending_rounds.cc:97] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 22.16
I20260925 16:46:30.112244  9115 raft_consensus.cc:2866] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:30.065871  8871 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 22 to 25, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 25 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.054438  8972 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 19. Ops: []
I20260925 16:46:30.056035  8971 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:30.055926  8966 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:30.053507  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.058357  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.052546  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.058830  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.061553  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.059446  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.052829  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.055088  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.056449  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.046828 17601 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260925 16:46:30.116871  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.047032 17424 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:30.077231 17568 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:30.146438  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 75655.4us
I20260925 16:46:30.139737  8969 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:30.144860  8967 raft_consensus.cc:2396] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 12.
I20260925 16:46:30.074615 17632 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.150646  8871 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 22, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.142257  8970 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:30.146994  8973 raft_consensus.cc:2454] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
W20260925 16:46:30.145897 17637 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.215s	user 0.000s	sys 0.001s
I20260925 16:46:30.145627  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.161990  8975 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:30.163192  8871 catalog_manager.cc:5495] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 19. New cstate: current_term: 19 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:30.162469  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.167299 17632 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:30.168018  9049 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:30.164849  8871 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 23 to 26. New cstate: current_term: 26 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:30.172086  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 128756us
I20260925 16:46:30.175117  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.172961  9117 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:30.177160  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.177811  8871 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 11 to 18. New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.179840  9116 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:30.184048  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.185873  9122 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:30.186694 17627 raft_consensus.cc:3032] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:30.190194  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.191289  9699 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:46:30.192018  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.192153  9696 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:30.192677  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.193315  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.199283  9117 raft_consensus.cc:2379] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 24: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:30.194078  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.203135  9014 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:30.201023  9045 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:30.204254  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.206295  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.210005  9116 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:30.209561  9697 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:30.220826  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.221350  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.221968  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.222610  8975 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: [25.16-25.16]
I20260925 16:46:30.222697  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.222002  8971 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:30.223325  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.224110  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.224843  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.225481  8970 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:30.226050  8969 raft_consensus.cc:1226] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 22. Current term is 23. Ops: [21.15-22.16]
I20260925 16:46:30.226565  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.224880  8973 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 30: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:30.227414  8966 raft_consensus.cc:2396] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 26 because replica has last-logged OpId of term: 25 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 16.
I20260925 16:46:30.229697  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.231796  9694 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:30.228789 17628 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260925 16:46:30.232585  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.233023 17568 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:30.229136  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:30.233170  9118 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 13.
I20260925 16:46:30.234050  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.230572  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.235333  9700 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:30.235414  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:30.229177  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:30.236250  8973 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:30.229190 17274 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260925 16:46:30.236390  9702 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:30.237910  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:30.237669  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.225944  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.239964 17623 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:30.239880 17649 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:46:30.240449 17623 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:30.240880 17623 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:30.235093  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:30.241855  9043 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:30.222663  9698 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 15: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:30.237635  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.241742  8871 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 23. New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:30.245744 17601 raft_consensus.cc:2781] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:30.246305 17601 raft_consensus.cc:686] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:30.246645 17274 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:30.239914 17293 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.007s
I20260925 16:46:30.247154 17274 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:30.247231 17601 consensus_queue.cc:237] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.248034 17274 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.249519  9123 raft_consensus.cc:1226] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:30.250048 17274 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:30.250551  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.251989  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.252594  8967 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:30.252856 17345 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:30.253794 17190 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:30.254143 17190 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:30.254515  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.254654  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.255079  8968 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:30.254907 17190 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.256204 17190 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:30.256286  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.256932  8968 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:30.256932  9117 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:30.259114  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.259778  8871 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 21 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:30.262691  9014 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:30.207398 17627 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:30.264190 17633 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:30.264818 17633 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:30.263666 17293 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Stepping down as leader of term 16
I20260925 16:46:30.266216 17293 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:30.265961  9043 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260925 16:46:30.265934 17633 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.266834  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.273532 17293 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.274250  9122 raft_consensus.cc:2396] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 26 because replica has last-logged OpId of term: 25 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 17.
I20260925 16:46:30.274020 17642 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:30.274847 17261 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:30.275317 17261 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:30.276140 17261 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.277310 17261 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:30.277526  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.278360  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.280741  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.261085  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.275074 17627 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.287292 17627 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:30.273380  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.289471 17568 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260925 16:46:30.290512  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53000.1us
I20260925 16:46:30.291186  8941 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:30.292065 17568 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:30.292430 17568 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:30.292778 17568 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:30.296587  9119 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:30.298888  9014 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:30.299628 17261 raft_consensus.cc:2781] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:30.274885 17293 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:30.295210  8871 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 25 to 28, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 28 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:30.297566  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
W20260925 16:46:30.295408  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50432.3us
I20260925 16:46:30.304306  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.306558  8871 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 19, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 19 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.305757 17325 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.005s
I20260925 16:46:30.309489 17261 raft_consensus.cc:686] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:30.318332  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.319150  8970 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:30.320194  9702 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:30.319124 17261 consensus_queue.cc:237] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.322394  9124 raft_consensus.cc:1226] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260925 16:46:30.323977  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.324932  9698 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:30.326045  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.332115 17106 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:30.329785 17642 consensus_queue.cc:1046] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 18.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.003s
I20260925 16:46:30.336460  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.337117  8970 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:30.338017  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.338454  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.339200  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.340057  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.340384  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.341656  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.342886 17503 raft_consensus.cc:3032] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:30.343068  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.343362 17503 raft_consensus.cc:729] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:30.343766  8974 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:30.344309 17503 consensus_queue.cc:260] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.345695 17503 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:30.348486  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.349285  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.351933  8971 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260925 16:46:30.353590  8974 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:30.356197  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.333710  8871 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.362381  8967 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:30.365715  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.368332  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.368744  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.365772  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.366730 17274 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:46:30.388213  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 57925.8us
I20260925 16:46:30.388908  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.372651 17409 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:30.332779 17625 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260925 16:46:30.394722  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.388877 17284 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:30.413534  8967 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260925 16:46:30.428085 17605 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:30.428630 17605 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:30.429065 17605 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:30.434028 17274 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:46:30.434406 17274 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:30.403251 17547 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:30.435985 17547 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:30.436316 17547 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:30.397318 17325 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:30.452626 17325 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:30.453050 17325 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:30.453434  8970 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:30.453918  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.454494  8973 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:30.455253  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.455353  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:30.446727 17648 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260925 16:46:30.456277  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.456610  8970 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:30.482143  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.483126  8871 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 16 to 18, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:46:30.516868  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 122201us
I20260925 16:46:30.485425  8871 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.525920  8871 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 24, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.435276 17274 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.528802  8973 raft_consensus.cc:1261] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:46:30.550014  8967 raft_consensus.cc:1261] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260925 16:46:30.549010  8871 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 16 to 18, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:30.558108  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.517197 17409 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:30.526290 17583 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:30.615356  8973 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 29. Current term is 30. Ops: []
I20260925 16:46:30.521497 17623 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.595742 17274 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:30.630082  8966 raft_consensus.cc:2354] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:30.634507  8973 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: [22.14-22.14]
W20260925 16:46:30.636586  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87982.3us
I20260925 16:46:30.613114 17583 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.646104  8975 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:30.639532  9665 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.652871  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:30.664006 17652 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.314s	user 0.000s	sys 0.001s
I20260925 16:46:30.664248  8968 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 24 because replica has last-logged OpId of term: 23 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 18.
I20260925 16:46:30.666360 17623 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:30.666594 17547 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:30.671955 17660 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260925 16:46:30.671820 17666 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
W20260925 16:46:30.675964 17655 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260925 16:46:30.678452  8969 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:30.720079  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:30.721473 17659 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260925 16:46:30.721397 17666 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Stepping down as leader of term 21
W20260925 16:46:30.731226  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62484us
I20260925 16:46:30.690552 17663 raft_consensus.cc:2781] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
W20260925 16:46:30.748443  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 94669.2us
I20260925 16:46:30.655385 17409 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.751186  9665 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:30.758037  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 225d3432101a4758bb9a6b0efeae09c5 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:30.759831  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.760998  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.761830  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.762828  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.763211  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.763829  8967 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:30.764638  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.764922  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.765388  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.766036  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.766228 17583 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:30.766680  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.766153  9124 raft_consensus.cc:2354] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24.
I20260925 16:46:30.767956  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.768720  9121 raft_consensus.cc:2396] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 20 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260925 16:46:30.759737  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.771018  8968 raft_consensus.cc:2454] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:30.727801 17666 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:30.765419  8967 raft_consensus.cc:2396] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 24 because replica has last-logged OpId of term: 23 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 18.
I20260925 16:46:30.765494  8969 raft_consensus.cc:2362] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26. Re-sending same reply.
I20260925 16:46:30.780566  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.782961  8973 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:30.783123  8971 raft_consensus.cc:2454] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:30.796223  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:30.798936  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.799086 17649 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:30.799669 17649 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.800143  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.801923 17649 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:30.799602  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:30.804234  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.806017 17547 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:30.775946 17568 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.751260 17663 raft_consensus.cc:686] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:30.808473 17663 consensus_queue.cc:237] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.808907 17568 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:30.809960  8972 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:46:30.810971 17666 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.686806 17669 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.066s
I20260925 16:46:30.814354  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.815904  9119 raft_consensus.cc:1226] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: [19.13-19.13]
I20260925 16:46:30.818660  9116 raft_consensus.cc:1226] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
W20260925 16:46:30.820499  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 71184.9us
I20260925 16:46:30.821357  9665 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.823334  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:30.788967 17658 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.167s	user 0.000s	sys 0.003s
I20260925 16:46:30.826387 17667 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:30.826267 17325 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.826507  9120 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:30.747120 17605 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.824172  8974 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:30.829763  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.833534  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.838901 17583 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260925 16:46:30.832139 17547 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260925 16:46:30.841066 17547 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:30.841562 17547 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 13 FOLLOWER]: Advancing to term 14
I20260925 16:46:30.850572  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:30.851014  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:30.851329  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.851769 17583 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:30.852133 17583 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:30.852445 17583 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:30.859100  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d3ff365de6e84921a6af19e793363f70, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:30.859433  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d3ff365de6e84921a6af19e793363f70, TS 40a71744ceba4efe949720cb0f274853 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.860407 17583 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.863938  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.865142 17413 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:30.865499  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:30.865792  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:30.869659  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.870494 17413 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:30.875896 17666 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:30.878214 17413 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260925 16:46:30.879926 17605 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:30.880131 17583 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:30.881034 17672 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260925 16:46:30.882043  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:30.882649  9043 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:30.885393  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54446.3us
I20260925 16:46:30.889246  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.890149 17674 consensus_queue.cc:1046] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 27.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260925 16:46:30.890636  9090 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:30.891494  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.891737 17674 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:30.891964 17667 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:46:30.892540 17667 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:30.892567  9090 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:30.893014 17674 raft_consensus.cc:3032] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Stepping down as leader of term 27
I20260925 16:46:30.893388 17674 raft_consensus.cc:729] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:30.893721 17600 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:30.893610 17667 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.895131 17600 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
W20260925 16:46:30.895277  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57829us
I20260925 16:46:30.894770 17674 consensus_queue.cc:260] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.896008 17413 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:30.900590  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.905992  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.914714  9124 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:30.915145  9702 raft_consensus.cc:1226] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:30.916257  9701 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260925 16:46:30.920042  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:30.922930  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.920856  9124 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:30.896447 17583 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:30.896611 17600 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:30.936720  9120 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 18. (term mismatch)
I20260925 16:46:30.940642  9120 pending_rounds.cc:76] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 17
I20260925 16:46:30.940873  9120 pending_rounds.cc:97] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 25.18
I20260925 16:46:30.941104  9120 raft_consensus.cc:2866] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:30.942270 17413 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:30.943727 17547 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:30.944679 17600 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:30.945886 17547 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:30.946796 17674 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:30.948891  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:30.938660  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.938974  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:30.949915  9693 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 13. Current term is 14. Ops: []
I20260925 16:46:30.948872  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:30.950390  9701 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:30.935004  9043 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:30.952363  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.952365  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.953507  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.954351  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.954630  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.965294  8971 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:30.955489  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.966619  8973 raft_consensus.cc:2379] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:30.956168  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.950649  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.969674  9120 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:30.910545 17503 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.041s
I20260925 16:46:30.970470  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.992849  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.970587 17325 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:30.972913  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.993863  9701 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:30.994676  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:30.992885  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.995620  8968 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:30.995527  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:30.997534  8973 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260925 16:46:30.997782  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.998006  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.998932  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.999120  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:30.972880  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:30.972903  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:31.000088  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:30.971180 17669 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.031s
W20260925 16:46:31.001704  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 109199us
I20260925 16:46:30.951328 17583 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:31.002579  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.003328  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.004437  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.007606  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.008318  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:31.011919  8968 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:31.016762  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:31.002489 17325 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260925 16:46:31.009603 17651 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.642s	user 0.000s	sys 0.010s
I20260925 16:46:31.017457 17503 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.002107 17682 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:31.023669 17227 consensus_queue.cc:1035] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:31.014487 17683 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:31.009814 17413 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:31.016662 17583 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:31.014966 17633 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:31.031080  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4269) took 1001 ms. Trace:
W20260925 16:46:31.031517  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 347428us
I20260925 16:46:31.006032 17642 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
I20260925 16:46:31.034029 17681 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:46:31.039126  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 98779us
I20260925 16:46:31.034623 17424 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 29.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:31.041199 17633 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:31.050051 17683 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:31.039556  9115 rpcz_store.cc:276] 0925 16:46:30.029415 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:30.029949 (+   534us) service_pool.cc:227] Handling call
0925 16:46:30.075152 (+ 45203us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:30.122534 (+ 47382us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:30.122576 (+    42us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:30.140066 (+ 17490us) log.cc:842] Serialized 26 byte log entry
0925 16:46:30.295338 (+155272us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:30.295391 (+    53us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:30.295488 (+    97us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:30.948302 (+652814us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:31.030760 (+ 82458us) raft_consensus.cc:1671] finished
0925 16:46:31.030778 (+    18us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:31.031007 (+   229us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4982144,"thread_start_us":121776,"threads_started":1,"wal-append.queue_time_us":223678}
I20260925 16:46:31.054322  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.056051  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.038509 17682 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:31.061193  9122 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 29. Current term is 30. Ops: []
W20260925 16:46:31.061090  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56728.5us
W20260925 16:46:31.063256 17671 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260925 16:46:31.064056  9089 leader_election.cc:398] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18.
I20260925 16:46:31.039050 17413 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:31.055351 17674 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.065295  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:31.067375  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 69452.1us
I20260925 16:46:31.068481  8939 leader_election.cc:398] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24.
I20260925 16:46:31.069171  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.069559  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.070456  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.074555  9115 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260925 16:46:31.074798  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.065670 17682 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:31.052870 17627 consensus_queue.cc:1046] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 25.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.026s
I20260925 16:46:31.067137 17413 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:31.084082  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.076139 17683 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:31.077601 17325 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:31.082067 17190 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.096868 17325 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:31.097411 17325 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:31.073652 17668 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:31.082356 17681 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:31.098845 17681 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.100786 17681 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:31.077471 17663 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.103058 17623 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:31.078624 17662 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:31.108560  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.062515 17600 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:31.109505  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44336.4us
I20260925 16:46:31.119503  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:31.131175  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 51958.5us
I20260925 16:46:31.109405 17663 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.080717 17568 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.038s
I20260925 16:46:31.149013  9119 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260925 16:46:31.150604  8941 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:31.117828 17284 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:31.154588 17409 consensus_queue.cc:1035] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:31.134567 17583 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:46:31.188678  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56031.2us
I20260925 16:46:31.149358 17662 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:31.192239  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.191121  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.133164 17669 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.063s
I20260925 16:46:31.161902 17284 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:31.200928  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 125639us
W20260925 16:46:31.201334  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 193803us
I20260925 16:46:31.203133  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.209359 17661 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:31.209393  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:31.210171 17661 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:31.211393 17661 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.217267  9090 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.153276 17547 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.046s
I20260925 16:46:31.193315 17190 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:31.133617 17633 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.227133  9116 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:31.228526  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.216035 17681 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:31.239606 17284 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.241037  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:31.241365 17284 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:31.244401 17600 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:31.220311 17688 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:31.245375 17688 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:31.245582 17634 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:31.245784 17688 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:31.246013 17634 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:31.247392 17190 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:31.248546 17190 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.249740  9119 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:31.238844 17668 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:31.254380 17668 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:31.255187 17668 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.256567 17668 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:31.217056 17261 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260925 16:46:31.268980 17634 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.269603 17688 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.199054 17568 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.072s
I20260925 16:46:31.217346 17583 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.259006 17682 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.255013 17325 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.301033  9121 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 24. Current term is 25. Ops: []
W20260925 16:46:31.307536  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 81460.8us
I20260925 16:46:31.308377  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.309093  9115 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:31.311208 17686 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:31.313172 17413 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.273350 17568 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Stepping down as leader of term 13
I20260925 16:46:31.315438 17568 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:31.316208  9116 raft_consensus.cc:1226] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:31.316411  9119 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:46:31.351409 17325 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:31.224139 17642 consensus_queue.cc:1046] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 29.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.125s
W20260925 16:46:31.358520 17699 consensus_queue.cc:1159] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "40a71744ceba4efe949720cb0f274853" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 18 index: 11 } }
I20260925 16:46:31.363799 17686 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260925 16:46:31.368007 17688 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:31.369580 17568 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.370890 17568 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:46:31.374720  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 182564us
W20260925 16:46:31.375798  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 67518.3us
I20260925 16:46:31.375944 17583 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260925 16:46:31.377561  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:31.388058  9090 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.378468 17413 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:31.380214 17634 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
W20260925 16:46:31.381481  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 346529us
W20260925 16:46:31.385666  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 310958us
I20260925 16:46:31.411655  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.412352  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.413940  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.348923 17681 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:31.407593  8974 raft_consensus.cc:595] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.417562  8974 raft_consensus.cc:603] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:31.389168  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.389569 17688 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:31.382719 17683 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.424870  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.426601  9090 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:31.440335  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 211885us
I20260925 16:46:31.409479 17662 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:31.441123  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.418725 17691 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:31.482702  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:31.484305  9693 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
W20260925 16:46:31.486219  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74664.3us
I20260925 16:46:31.486964  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:31.492708  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 51659.7us
I20260925 16:46:31.492973  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:31.434674 17600 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:31.441388 17413 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:31.416708 17666 consensus_queue.cc:1046] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.031s
I20260925 16:46:31.497896  9702 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:31.488324 17652 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260925 16:46:31.495826  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:31.503558  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:31.497723  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.440469 17688 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:31.494794  9701 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 27: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:31.511123  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.495088 17601 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 LEADER]: Stepping down as leader of term 29
I20260925 16:46:31.493616 17708 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.503804 17683 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:31.512712 17696 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:31.539881  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49c7db4b3fda45159275230bc247b929"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:31.503536 17503 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.030s
I20260925 16:46:31.525138 17681 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:31.521803 17601 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:31.527099 17623 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.508767 17699 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 24.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260925 16:46:31.547912  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.551083  8974 raft_consensus.cc:595] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.551473  8974 raft_consensus.cc:603] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:31.551311  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.508977 17688 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.569474 17701 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:31.570222  9116 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
W20260925 16:46:31.570461  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 79656.5us
I20260925 16:46:31.572352 17699 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:31.572788 17699 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:31.573664 17699 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.575239 17699 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:31.577204 17688 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:31.577811 17688 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260925 16:46:31.579631 17623 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:31.580087  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:31.580879  9044 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:31.581708 17601 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 29, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.592950 17633 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:31.540735 17662 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.596518 17682 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:31.599443  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48209.7us
W20260925 16:46:31.565588  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 132737us
I20260925 16:46:31.571345  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.602223  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.603714  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.606326  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:31.600101  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:31.620229  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 85452.2us
I20260925 16:46:31.624801  9120 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260925 16:46:31.598784 17681 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:31.634747  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63492.3us
I20260925 16:46:31.618963 17284 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:31.619107 17625 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:31.606196 17413 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:31.621342 17701 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:31.641480  8939 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.620787 17628 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:31.627460 17698 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:31.629825 17600 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:31.618757 17700 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260925 16:46:31.651286 17413 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.643124 17601 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:31.656354 17714 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.011s
I20260925 16:46:31.683285  9049 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:31.659785 17710 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:31.661542 17681 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.621628 17409 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.023s
W20260925 16:46:31.663471 17705 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.094s	user 0.001s	sys 0.002s
I20260925 16:46:31.648193 17628 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:31.681527  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.683950 17625 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260925 16:46:31.645916 17701 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:31.683459 17600 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:31.683279 17190 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:31.711687  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67911.7us
I20260925 16:46:31.717386  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.718866  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.713968  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.717000  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.720782  8974 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:31.715907  9120 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:31.722158  8972 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260925 16:46:31.723237  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:31.693830 17710 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:31.734890  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49017.4us
I20260925 16:46:31.707490 17503 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:31.737816  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:31.738941  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:31.740232  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:31.732252 17718 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:31.703814 17702 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:31.747129  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:31.748489  8967 raft_consensus.cc:2396] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 27 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260925 16:46:31.711251 17668 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:31.711438 17628 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:31.724613 17600 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:31.760954  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:31.718215 17701 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:31.764743  8969 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:31.765455  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:31.762952  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.767123  8975 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:31.773310 17706 raft_consensus.cc:3032] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:31.773963 17706 raft_consensus.cc:729] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:31.786895  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 69953.2us
I20260925 16:46:31.788014  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:31.790174  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 54361.8us
I20260925 16:46:31.791067  9666 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.764619 17661 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:31.768076 17227 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:31.809237  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.814733  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:31.810026  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47702.7us
I20260925 16:46:31.734449 17190 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.817521  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.806535  8971 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 14.
I20260925 16:46:31.775080 17706 consensus_queue.cc:260] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.829659 17716 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:31.831226 17721 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260925 16:46:31.888070 17628 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.889256  8974 raft_consensus.cc:595] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.889628  8974 raft_consensus.cc:603] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:31.891289  8975 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260925 16:46:31.756484 17503 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.892257  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:31.820525 17718 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:31.893954 17718 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.894757 17701 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.816138 17715 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:31.768692 17702 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.896812 17701 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:31.897794 17600 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:31.898144 17702 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:31.808130 17688 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.823134 17634 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:31.864111 17719 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260925 16:46:31.874799 17711 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.307s	user 0.003s	sys 0.000s
I20260925 16:46:31.930735  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:31.876381 17190 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:31.839690 17710 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:31.850350 17683 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
W20260925 16:46:31.846199 17717 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260925 16:46:31.807312 17686 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:31.879853 17623 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:31.806293 17409 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:31.911655  8972 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260925 16:46:31.918977  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:31.941125  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:31.928548  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:31.934969  8973 raft_consensus.cc:1261] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260925 16:46:31.935943 17600 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:31.962405  8969 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 25. Current term is 26. Ops: [25.20-25.20]
I20260925 16:46:31.960039  9701 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:31.933089 17627 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:31.973026  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 44620.9us
I20260925 16:46:31.977458  9089 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.978855  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:31.983736  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:31.987073  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:31.941826 17662 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Leader election won for term 14
I20260925 16:46:31.993883  8972 raft_consensus.cc:1261] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:31.996325  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:32.001116  8975 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:31.962544 17698 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:31.970391 17706 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:31.942076 17227 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:31.970584 17683 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:31.972993 17667 consensus_queue.cc:1159] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "225d3432101a4758bb9a6b0efeae09c5" responder_term: 19 status { last_received { term: 19 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 19 index: 15 } }
I20260925 16:46:31.962307 17547 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.042s
I20260925 16:46:32.001948 17274 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:31.998263 17583 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:31.997068 17600 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:31.959321 17693 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260925 16:46:32.008875 17642 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:32.007196 17696 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:32.082950 17710 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:31.972859 17623 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.101492  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.082505 17662 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:31.993916 17627 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.111562  9696 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:32.116730  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.119925  9044 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:32.121846  9043 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 26 index: 18. (index mismatch)
I20260925 16:46:32.106967 17503 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.128618  8968 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 17. Current term is 18. Ops: []
I20260925 16:46:32.129595  9693 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:32.100077 17642 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:32.131093  9698 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:32.100639 17681 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.038s
I20260925 16:46:32.152995  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.091840 17698 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.156071 17698 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.159085  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:32.121268 17583 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.098405 17274 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.159739 17683 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.120798 17633 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:32.122170 17261 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:32.221017  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:32.216333 17662 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.142294 17642 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:32.162328 17227 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.16, Last appended by leader: 16, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.212239 17583 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.120844 17284 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.046s
I20260925 16:46:32.145327 17628 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.231483 17623 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:32.233762 17601 consensus_meta.cc:287] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.544s	user 0.008s	sys 0.000s
I20260925 16:46:32.164916 17413 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260925 16:46:32.236615 17633 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.240473  9048 raft_consensus.cc:1261] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:32.139859 17503 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.104s
I20260925 16:46:32.244853 17627 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:32.246573 17274 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:32.254305  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85678.8us
I20260925 16:46:32.256177 17732 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.304589 17732 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.306725 17732 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:32.168622  9047 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:46:32.307117  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:32.307613  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:32.307796  9044 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:32.308306  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:32.308422  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:32.308969  8940 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:32.308980  9048 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:32.130134 17718 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.221493  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.313500 17583 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.314532  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.315177  9693 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:32.316409  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:32.317015 17106 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:32.318068 17261 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.320178 17623 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:32.320559 17623 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:32.321656 17623 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.323793 17503 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:32.324157 17503 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:32.324414 17623 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:32.324958 17503 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.326221 17503 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:32.265710  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 270840us
I20260925 16:46:32.292493 17625 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:32.298429  9014 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.004s	sys 0.009s
I20260925 16:46:32.315093 17740 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260925 16:46:32.333287  9014 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.648s	user 0.005s	sys 0.010s
W20260925 16:46:32.334286  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 649516us
I20260925 16:46:32.340596 17284 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:32.340997 17284 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:32.341322 17284 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:32.339339  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:32.343370  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:32.340262  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 103049us
I20260925 16:46:32.343411  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:32.347530  9047 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:32.348501  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:32.321596 17261 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:32.356746  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 53273.4us
I20260925 16:46:32.360267  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.360872  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:32.332821 17674 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:32.361351  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 45028.5us
I20260925 16:46:32.348342 17409 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.370976  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.372890  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:32.375466  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.374837  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.379591  9123 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:32.379479  9124 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:32.382198  9041 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:32.387496  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.388372  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:32.350255 17601 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:32.397512  9116 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:32.398674  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:32.358983 17667 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:32.398674  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.363319 17628 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:32.360826 17682 raft_consensus.cc:3032] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:32.363988 17274 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:32.377487 17740 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:32.393033 17686 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.028s
I20260925 16:46:32.339512 17625 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.381650 17668 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:32.377279 17741 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:32.453295  9048 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260925 16:46:32.415992 17732 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.481954  9042 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260925 16:46:32.485018  9042 pending_rounds.cc:76] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 17
I20260925 16:46:32.485306  9042 pending_rounds.cc:97] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260925 16:46:32.485582  9042 raft_consensus.cc:2866] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:32.378880 17674 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.443187 17740 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:32.406018 17706 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.048s
I20260925 16:46:32.426224 17682 raft_consensus.cc:729] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:32.444747 17668 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:32.408509 17669 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.075s
I20260925 16:46:32.396626 17409 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:32.525595  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 137564us
I20260925 16:46:32.415787 17601 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.534986  9047 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260925 16:46:32.414335 17667 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.444360 17702 consensus_queue.cc:1035] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.076s
W20260925 16:46:32.535097  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 141592us
I20260925 16:46:32.521520 17662 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:32.513011 17661 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:32.520071 17740 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:32.443070 17274 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:32.549368  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 149569us
I20260925 16:46:32.524417 17668 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:32.553110  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:32.556974  9702 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:32.517055 17696 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260925 16:46:32.534862 17743 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.449359 17741 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.520726 17413 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260925 16:46:32.512377 17732 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.568653  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:32.578055  8968 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260925 16:46:32.608423  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:32.636544  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62037.9us
I20260925 16:46:32.636981  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:32.637689  8972 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:32.639966  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.640731  8974 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:32.642410  8969 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
W20260925 16:46:32.643294  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 74690.5us
I20260925 16:46:32.562501 17713 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:32.565635 17583 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:32.638818 17325 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.650967  9045 raft_consensus.cc:1226] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:32.651971  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.647917  9119 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260925 16:46:32.659528  9119 pending_rounds.cc:76] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 13
I20260925 16:46:32.607436 17701 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:32.659881  9119 pending_rounds.cc:97] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260925 16:46:32.664070  9119 raft_consensus.cc:2866] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:32.638667 17706 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.008s
I20260925 16:46:32.555024 17662 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.567536 17661 consensus_queue.cc:1035] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.088s
I20260925 16:46:32.648736 17713 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:32.692256  8975 raft_consensus.cc:595] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:32.663609 17701 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:32.692818  8975 raft_consensus.cc:603] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:32.699664 17757 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:32.700687 17750 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:32.701089  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.701944  9119 raft_consensus.cc:2379] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 28: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:32.701344 17750 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:32.704119 17747 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.221s	user 0.000s	sys 0.001s
W20260925 16:46:32.704686 17749 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.152s	user 0.000s	sys 0.001s
W20260925 16:46:32.706830 17748 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.124s	user 0.000s	sys 0.000s
I20260925 16:46:32.708154 17674 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:32.708369 17274 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.709067 17274 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:32.709285 17667 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:32.696324 17601 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.710371  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.664465 17583 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.713394 17583 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.714363 17691 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.714432 17409 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:32.673256 17683 consensus_queue.cc:1046] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260925 16:46:32.679220 17633 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:32.717365 17744 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.189s	user 0.001s	sys 0.000s
I20260925 16:46:32.674055 17325 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.720616 17325 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:32.721379  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.724700  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.725248  9119 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
W20260925 16:46:32.727030  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 118705us
I20260925 16:46:32.732542  9041 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260925 16:46:32.732872  8972 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:32.691491 17713 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:32.742519  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.746796  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.714926 17691 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.786684  8968 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:32.790016  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:32.790216  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.797888  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.792217  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.798862  8974 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 17: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:32.727031 17701 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:32.582561 17743 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.796487  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.803551  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:32.800002  9089 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:32.734421 17625 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.808739  8974 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:32.799464 17642 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.505s	user 0.010s	sys 0.000s
I20260925 16:46:32.811079  8968 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:32.814762  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:32.806070  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:32.818776  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.819375  9042 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:32.818876  8969 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:32.821671  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:32.788426 17750 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:32.828356  9694 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:32.792917 17568 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260925 16:46:32.833652  8974 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
W20260925 16:46:32.832252  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 438364us
W20260925 16:46:32.835863 17623 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.511s	user 0.010s	sys 0.002s
I20260925 16:46:32.837110 17753 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:32.838164 17662 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:32.838398  9122 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 13 FOLLOWER]: Advancing to term 14
W20260925 16:46:32.839111 17503 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.001s
W20260925 16:46:32.901189  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 56448.1us
I20260925 16:46:32.840065  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.908231  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:32.839869 17682 consensus_queue.cc:260] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:32.845505 17752 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260925 16:46:32.917245  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:32.820525 17696 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election won for term 27
W20260925 16:46:32.850507  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 188904us
W20260925 16:46:32.855746  9121 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.006s	sys 0.007s
W20260925 16:46:32.926501  9121 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.584s	user 0.006s	sys 0.008s
I20260925 16:46:32.805670 17683 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.028s
I20260925 16:46:32.903358  8974 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:32.898823  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:32.907999  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.845242 17681 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:32.818580 17409 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:32.916662  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:32.939316  9048 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:32.817190 17284 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:32.920252  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:32.973683  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45496.9us
I20260925 16:46:32.916944 17750 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:32.818828 17642 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:32.950812  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 3986) took 1038 ms. Trace:
I20260925 16:46:33.004006  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.005726  8970 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:32.932238 17688 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:32.989290  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.022535  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.025413  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:32.938850 17409 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:33.036638  8969 raft_consensus.cc:1226] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 25. Current term is 26. Ops: [25.20-25.20]
I20260925 16:46:32.948508 17741 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:32.992404  9121 rpcz_store.cc:276] 0925 16:46:31.912460 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:31.912644 (+   184us) service_pool.cc:227] Handling call
0925 16:46:31.912965 (+   321us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:31.913386 (+   421us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:31.913426 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:31.958269 (+ 44843us) log.cc:842] Serialized 26 byte log entry
0925 16:46:32.094028 (+135759us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:32.120952 (+ 26924us) log.cc:842] Serialized 14 byte log entry
0925 16:46:32.342761 (+221809us) spinlock_profiling.cc:243] Waited 17.1 ms on lock 0x7b1800579dc0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:46:32.926914 (+584153us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:32.927016 (+   102us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:32.927078 (+    62us) raft_consensus.cc:1671] finished
0925 16:46:32.950536 (+ 23458us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:32.950735 (+   199us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":45101,"prepare.queue_time_us":26814,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":222268,"raft.run_cpu_time_us":247,"raft.run_wall_time_us":12865,"spinlock_wait_cycles":39263488,"thread_start_us":687092,"threads_started":2,"wal-append.queue_time_us":178579}
I20260925 16:46:32.940711 17681 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:32.980397 17732 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:32.988586 17750 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:33.052551 17681 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:33.057168 17773 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 20.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260925 16:46:33.037951 17752 log.cc:924] Time spent T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260925 16:46:32.981707 17696 raft_consensus.cc:686] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:33.130640  9693 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:33.055954 17768 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.074353 17661 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:33.078367  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 88133.6us
I20260925 16:46:33.139099  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.078558 17780 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.096s
W20260925 16:46:33.082408  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 147609us
W20260925 16:46:33.109658  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 195813us
I20260925 16:46:33.118654  9016 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:32.982342 17662 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.082s
I20260925 16:46:33.047145 17409 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:33.148052  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:33.143169 17642 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.106981 17750 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:33.059340 17605 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.078428 17756 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.080039 17702 consensus_queue.cc:1035] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.070s
I20260925 16:46:32.908862 17753 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.155627  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.156224  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.165812  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.166188  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.133562 17628 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:33.145854  8968 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:33.140390 17683 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.180447  9696 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:33.182721  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.188078  9121 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:33.191862  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.193707  9015 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:33.058393 17740 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.149685 17710 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.157341 17743 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.169275 17773 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.230103  8974 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:46:33.170406 17642 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:33.168941 17691 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.238447 17788 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.239603 17785 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:33.240568 17790 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:33.241165  8966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3582) took 1325 ms. Trace:
I20260925 16:46:33.241333 17783 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:46:33.274152  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 111526us
I20260925 16:46:33.144253 17768 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.242630 17227 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:33.243247 17773 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.247742  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.255360  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:33.147033 17661 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.241786 17769 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:33.172230 17605 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.294416 17605 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.181453 17771 consensus_queue.cc:1046] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 23.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.118s
W20260925 16:46:33.297539  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 49900.4us
I20260925 16:46:33.299906  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.214356 17683 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.234615 17710 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.301447  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:33.301998  9116 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:33.302295 17683 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.302475 17710 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:33.302841 17683 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.303006 17710 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:33.270522  8966 rpcz_store.cc:276] 0925 16:46:31.915397 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:31.915572 (+   175us) service_pool.cc:227] Handling call
0925 16:46:31.915997 (+   425us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:31.962969 (+ 46972us) raft_consensus.cc:1520] Early marking committed up to index 14
0925 16:46:32.355664 (+392695us) spinlock_profiling.cc:243] Waited 11.5 ms on lock 0x7b18003aa8c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fe4345 00007f71a1e1ba39 00007f71990018bb 00007f7198fffcbf 00007f7198fff155 00007f719f8ff167 00007f719bf34807 00007f719bf43f0f 00007f719bf43e88
0925 16:46:32.446613 (+ 90949us) log.cc:842] Serialized 14 byte log entry
0925 16:46:32.658502 (+211889us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:32.684585 (+ 26083us) log.cc:842] Serialized 52 byte log entry
0925 16:46:32.684756 (+   171us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:32.685018 (+   262us) log.cc:842] Serialized 14 byte log entry
0925 16:46:32.692089 (+  7071us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:32.692200 (+   111us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:33.240912 (+548712us) raft_consensus.cc:1671] finished
0925 16:46:33.240939 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:33.241107 (+   168us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":20077,"prepare.queue_time_us":194155,"prepare.run_cpu_time_us":69,"prepare.run_wall_time_us":70,"raft.queue_time_us":109255,"raft.run_cpu_time_us":235,"raft.run_wall_time_us":5950,"spinlock_wait_cycles":26402560,"thread_start_us":226326,"threads_started":2,"wal-append.queue_time_us":772855}
I20260925 16:46:33.304482  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.280434 17284 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:33.308821  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 319618us
I20260925 16:46:33.176378 17756 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.312701  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.316741  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.321480  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.254894 17642 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.327481  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.351516  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.303318 17683 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.305819 17702 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260925 16:46:33.355445  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 170090us
I20260925 16:46:33.358687  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.303505 17710 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.232640 17696 consensus_queue.cc:237] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.326953  9116 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:33.361523  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:33.364405  8939 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:33.364811  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:33.269822 17788 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.366873  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.328639 17284 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:33.370088  9041 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:33.380208  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:33.380985  9119 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:46:33.381008 17779 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.308s	user 0.001s	sys 0.000s
W20260925 16:46:33.388379 17778 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260925 16:46:33.390522 17770 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:33.390988 17770 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:33.391320 17770 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:33.392822 17755 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:33.402179 17788 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:33.425093  9122 consensus_meta.cc:287] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.517s	user 0.009s	sys 0.002s
W20260925 16:46:33.393712 17776 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.175s	user 0.000s	sys 0.001s
W20260925 16:46:33.404256 17777 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260925 16:46:33.416707  9121 raft_consensus.cc:2396] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 24 because replica has last-logged OpId of term: 23 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 13.
I20260925 16:46:33.402894  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:57364 (request call id 68) took 1427 ms. Trace:
I20260925 16:46:33.428822  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55050 (request call id 2745) took 1441 ms. Trace:
I20260925 16:46:33.428406  8975 rpcz_store.cc:276] 0925 16:46:31.975506 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:31.976076 (+   570us) service_pool.cc:227] Handling call
0925 16:46:33.402610 (+1426534us) spinlock_profiling.cc:243] Waited 690 ms on lock 0x7b54003c50d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf24bc3 00007f71a0e6e81a 00007f719a561d04 00007f719a561c92 00007f719a561bc1 00007f719a561b3c 00007f719a560df2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:33.402777 (+   167us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1587997952}
I20260925 16:46:33.432602  9049 rpcz_store.cc:276] 0925 16:46:31.978459 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:31.978622 (+   163us) service_pool.cc:227] Handling call
0925 16:46:33.419453 (+1440831us) spinlock_profiling.cc:243] Waited 702 ms on lock 0x7b54002b6bd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:33.419617 (+   164us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1615006592}
I20260925 16:46:33.425355  9695 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:33.407958 17755 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:33.412087 17673 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.015s
I20260925 16:46:33.412096 17764 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:33.378221 17768 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:33.443620  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 249996us
I20260925 16:46:33.441121  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:33.438078  9122 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260925 16:46:33.408789 17661 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.411603 17710 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.424283 17642 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.410243 17753 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.415254 17773 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:33.413420 17683 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.417870 17699 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:33.445004  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.407666 17409 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.453886  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.439739 17755 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:33.454454 17634 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:33.464121 17756 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.440377 17715 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:33.474476 17755 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.460371  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.452088  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.476197  8968 raft_consensus.cc:1226] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 17. Current term is 18. Ops: [17.15-17.15]
W20260925 16:46:33.459282  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 62348.1us
I20260925 16:46:33.450161 17800 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.450567 17740 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.478729  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.480237  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.482592  9049 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:33.484037  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.485471 17773 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:33.485832 17701 consensus_meta.cc:287] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.673s	user 0.011s	sys 0.000s
I20260925 16:46:33.485947 17773 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.486316 17701 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.486662  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.487458  9042 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:33.488292  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.482903  9115 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:33.499365  9041 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 30.
I20260925 16:46:33.501168  9090 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.462512 17699 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.503043  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42268 (request call id 2464) took 1163 ms. Trace:
I20260925 16:46:33.504195 17699 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.509586 17600 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:33.509963 17600 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:33.510154  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.510723 17600 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.511343  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.512002 17674 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:46:33.512476  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.514369 17642 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:33.514869 17642 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.516280  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.516916  9047 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:33.478453 17809 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:33.517302  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.489063 17808 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.517946  9044 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:33.518062 17808 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.520808 17701 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:33.488379 17668 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.851s	user 0.011s	sys 0.000s
I20260925 16:46:33.503425  9698 rpcz_store.cc:276] 0925 16:46:32.339985 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:32.340099 (+   114us) service_pool.cc:227] Handling call
0925 16:46:32.340363 (+   264us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:32.539095 (+198732us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:32.539145 (+    50us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:32.539207 (+    62us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:32.539256 (+    49us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:33.502821 (+963565us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b540048b2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:33.502864 (+    43us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:33.502981 (+   117us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":450374912}
I20260925 16:46:33.523039  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1655) took 1378 ms. Trace:
I20260925 16:46:33.523290  9694 raft_consensus.cc:2354] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 28. Current term is 29.
I20260925 16:46:33.523412  9043 rpcz_store.cc:276] 0925 16:46:32.146289 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:32.150229 (+  3940us) service_pool.cc:227] Handling call
0925 16:46:32.150528 (+   299us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:32.346412 (+195884us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:32.346451 (+    39us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:32.346493 (+    42us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:32.346524 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:33.522807 (+1176283us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54002616d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:33.522847 (+    40us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:33.522951 (+   104us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":450054528}
I20260925 16:46:33.523458  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.521616 17668 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.526633  8969 raft_consensus.cc:2354] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19.
I20260925 16:46:33.525813  9702 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2286) took 1180 ms. Trace:
I20260925 16:46:33.527403 17668 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.527578  9702 rpcz_store.cc:276] 0925 16:46:32.345089 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:32.345224 (+   135us) service_pool.cc:227] Handling call
0925 16:46:33.525654 (+1180430us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b5400537fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:33.525743 (+    89us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":450683776}
I20260925 16:46:33.529052 17409 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.490393 17661 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260925 16:46:33.516952 17642 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.520112 17808 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.530643 17600 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:33.525827 17770 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.533504 17770 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.534600 17601 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:33.535094 17601 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.536983 17601 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.540781  9016 leader_election.cc:398] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 28. Current term is 29.
I20260925 16:46:33.541155  9016 leader_election.cc:401] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:33.542414 17699 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 29
I20260925 16:46:33.481756 17634 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:33.549166 17634 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:33.554399 17791 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.176s	user 0.000s	sys 0.002s
I20260925 16:46:33.558693  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.598273  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:33.607848  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 106752us
I20260925 16:46:33.607764  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:33.613276  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:33.617646  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48556.9us
I20260925 16:46:33.618690  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.621127  9089 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.622069 17413 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:33.622426  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:33.622905 17682 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:33.623266 17413 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260925 16:46:33.623725 17413 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:33.624100 17413 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Advancing to term 31
I20260925 16:46:33.619906  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:33.624847 17681 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.625560 17706 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:33.625907 17706 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.626247 17706 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:33.626816 17681 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:33.629402  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.630134  9693 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:33.615461 17661 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:33.615561 17788 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:33.632586 17788 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.633266 17413 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:33.635069  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 270757us
W20260925 16:46:33.637086  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 259831us
I20260925 16:46:33.638006 17793 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.638499 17796 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:33.638638  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 267485us
I20260925 16:46:33.641063  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.641306  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:33.642045  9121 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:33.635413 17794 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:33.648808  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.649515  9694 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:33.649570  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:33.650153  9698 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:33.651782  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.635739  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:33.643324  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:33.648380  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.614460 17780 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.648422 17409 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.659833 17409 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.660580  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.660970 17750 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.661868 17409 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:33.662212 17713 consensus_meta.cc:287] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.866s	user 0.007s	sys 0.013s
I20260925 16:46:33.662786 17755 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.662904 17750 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.482788 17800 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.664997  9118 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:33.638994 17796 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.665611 17799 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:33.666019 17799 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:33.666342 17799 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:33.666500 17764 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:33.667181 17796 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.638496 17793 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.668695 17804 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.669267 17804 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.669904 17793 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:33.670969  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:33.671367 17804 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.671562  9045 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:33.673758 17730 raft_consensus.cc:3032] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:33.674505 17715 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.674664 17730 raft_consensus.cc:729] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:33.675028 17715 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.675503 17730 consensus_queue.cc:260] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.676010  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:33.676628  9116 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:33.676736 17730 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:33.677634 17715 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.673864  9698 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 28.
I20260925 16:46:33.634814 17788 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.662616 17713 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.673702 17780 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.603065 17547 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260925 16:46:33.703934  9048 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e"
dest_uuid: "8dc3391062084f45a6ba62d28d340722"
mode: GRACEFUL
new_leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
 from {username='slave'} at 127.0.0.1:57624
I20260925 16:46:33.704561  9048 raft_consensus.cc:595] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Received request to transfer leadership to TS e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.704854  9048 raft_consensus.cc:603] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260925 16:46:33.705158  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.705678  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.684171  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.685030  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.616925 17773 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:33.693336  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:33.685750  9045 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:33.698174  9116 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 28.
I20260925 16:46:33.714525  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:33.656251  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.639832 17600 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:33.701330  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:33.715874  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59895us
I20260925 16:46:33.712126  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:33.720052  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.656746 17681 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:33.721366  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.729080  8971 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 30.
I20260925 16:46:33.729422  9693 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:33.730257  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.730575  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:33.723850  9666 leader_election.cc:398] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19.
I20260925 16:46:33.691608 17750 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.726334  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.737233  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:33.739571  9050 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:33.740514  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.742317  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.704149 17106 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.752660  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:33.755614  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.760177  9119 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:33.721521 17600 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:33.721346 17661 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:33.761253  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.761754  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.711202 17700 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.766603  9121 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:33.774953  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:33.775426  8971 raft_consensus.cc:2379] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 19: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:33.725378 17794 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:33.783823  9050 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:33.779404  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.775485 17600 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:33.815021  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.803625  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.811708  8973 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:33.822820 17810 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:33.812031 17700 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.768168 17106 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.824810 17700 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:33.825238  8939 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.825451  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.826452 17794 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.825263  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:33.812134  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.835608  9089 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.805619  9117 raft_consensus.cc:3037] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:33.840698  8966 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:33.841768  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:33.853000  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.845791  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:33.739563 17681 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.855937  8939 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:33.752107 17750 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.781499 17800 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:33.864615 17808 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:33.858103  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 134216us
I20260925 16:46:33.800819 17795 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:33.880301  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:33.880244  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.891034  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:33.899081  8971 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:33.899389  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:33.901069  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:33.901551  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:33.912204  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59321us
I20260925 16:46:33.914062  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.915589  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.918284  9121 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:33.843006 17756 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:33.878432 17778 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260925 16:46:33.907349  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:33.926878  9117 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 29.
W20260925 16:46:33.927464  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47267.1us
I20260925 16:46:33.930685  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:33.874205 17743 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:33.918457  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:33.857877 17804 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:33.945327  9047 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:33.878005 17773 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:33.879908 17741 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.952634 17741 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.953209  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.953894  9117 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:33.954807  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:33.955108 17741 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:33.956856  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 49597us
I20260925 16:46:33.899816 17793 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:33.954784  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:34.026221  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 68655.1us
I20260925 16:46:34.026587  9117 raft_consensus.cc:2379] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:34.030282  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:33.917491 17707 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:34.033951  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 115562us
W20260925 16:46:34.044040  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 68950.2us
I20260925 16:46:34.051162  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.058750  9120 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:33.943136 17633 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:33.929726 17785 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:33.927345 17800 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:33.901919 17799 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:34.055094  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 100350us
I20260925 16:46:34.033600 17674 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:33.885149 17808 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:33.962322 17788 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:34.036149 17413 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 31 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.022596 17701 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:34.133960  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 103819us
W20260925 16:46:34.086632  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60761.7us
I20260925 16:46:34.076385  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:33.919567 17662 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:46:34.080657  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 165155us
I20260925 16:46:34.095367  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.160526  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:34.142649  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 55076.1us
I20260925 16:46:34.161764  9665 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:34.061185 17661 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:34.072350 17713 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.025444 17804 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:34.058861  9015 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.193:40071 timed out after 1.540s (SENT) [suppressed 15 similar messages]
I20260925 16:46:34.085000 17807 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:34.087231 17793 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:34.084417 17763 log.cc:924] Time spent T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260925 16:46:34.074295 17770 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:34.195097 17770 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:34.194941 17793 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.195644 17770 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:34.162957  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:34.066020 17743 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:34.200837 17743 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.203714 17799 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.204380 17799 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:34.204936 17799 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:34.029230 17666 consensus_queue.cc:1046] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260925 16:46:34.205830  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:34.208040 17807 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:34.065703 17633 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.209252 17633 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:33.941651 17756 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.155858  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:46:34.219074  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 63355.5us
I20260925 16:46:34.078739 17568 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:34.028714 17790 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.130s
I20260925 16:46:34.086102 17817 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:34.131125 17625 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:34.237393  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.237723  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:34.239629  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:34.240370  9698 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:34.160564  9120 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:34.074793 17780 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.157544 17674 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:33.934942 17795 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:34.182135  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3596) took 1440 ms (client timeout 1540 ms). Trace:
W20260925 16:46:34.254242  8970 rpcz_store.cc:269] 0925 16:46:32.741850 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:32.742229 (+   379us) service_pool.cc:227] Handling call
0925 16:46:34.181914 (+1439685us) spinlock_profiling.cc:243] Waited 262 ms on lock 0x7b54001e3554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:34.182055 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":602945280}
I20260925 16:46:34.174656 17708 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:34.168238 17786 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:34.175163 17627 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:34.175346 17758 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.186411  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:34.278322  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.187897  8973 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
mode: GRACEFUL
new_leader_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:57364
I20260925 16:46:34.278784  8967 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Advancing to term 31
W20260925 16:46:34.188530 17816 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.229s	user 0.000s	sys 0.000s
I20260925 16:46:34.296190  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.231912 17808 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.297144  9699 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
W20260925 16:46:34.189682 17818 log.cc:924] Time spent T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.118s	user 0.000s	sys 0.000s
W20260925 16:46:34.190704 17813 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.139s	user 0.000s	sys 0.000s
I20260925 16:46:34.192193 17106 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.091156 17785 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.193583  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.169472 17413 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260925 16:46:34.214448  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 59279us
I20260925 16:46:34.220103  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:34.312995  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 254152us
I20260925 16:46:34.163311 17668 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:34.222718 17568 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:34.301211 17822 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:46:34.226898  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 31 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:34.333699  9050 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Advancing to term 31
I20260925 16:46:34.226955 17666 raft_consensus.cc:3032] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Stepping down as leader of term 17
I20260925 16:46:34.227627 17667 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.077900 17600 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.193614 17649 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:34.251494  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:34.205853 17799 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.256479  9665 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:34.225296 17325 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:34.221494 17700 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:34.257565  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:34.361748  9693 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:34.258294  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.255515  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.276378  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:34.299371  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.245529 17628 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:34.336143 17568 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:34.368656  9123 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:34.279187  8973 raft_consensus.cc:595] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Received request to transfer leadership to TS 40a71744ceba4efe949720cb0f274853
I20260925 16:46:34.300859  8969 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:34.256472 17807 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:34.248693 17715 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:34.386216  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.245221 17661 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.223769  9047 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:34.323307  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:34.332376  9698 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
W20260925 16:46:34.187925 17823 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.122s	user 0.001s	sys 0.000s
I20260925 16:46:34.339011 17787 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.339797 17756 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:34.279949 17708 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.296994 17750 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.345000  9117 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:34.221572 17547 raft_consensus.cc:2781] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election won for term 29
I20260925 16:46:34.337256 17666 raft_consensus.cc:729] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:34.329592 17681 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:34.359345  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 102966us
I20260925 16:46:34.363528  8967 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 31.
W20260925 16:46:34.363602  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87339.7us
I20260925 16:46:34.413676  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:34.414386  8967 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:34.372800  9050 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 31.
I20260925 16:46:34.295527 17627 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.417814  9090 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:34.336979 17668 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:34.388093  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 64885.1us
I20260925 16:46:34.421130  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:34.250517 17817 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.444988 17817 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:34.446542 17699 consensus_meta.cc:287] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.904s	user 0.009s	sys 0.002s
I20260925 16:46:34.446652  8970 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 14.
I20260925 16:46:34.447006 17699 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 28. Current term is 29.
I20260925 16:46:34.349720 17667 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.357944 17649 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.406924  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.382272 17106 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:34.300495 17758 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.383680 17797 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:34.422772  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.373315 17325 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.424866  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.428025  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:34.429034 17600 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.408519 17807 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:34.435163 17682 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.812s	user 0.010s	sys 0.000s
I20260925 16:46:34.435883 17804 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.536862 17708 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:34.538682 17627 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.539147 17758 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:34.436698 17795 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.401525 17715 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.408618 17787 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.438061 17785 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:34.440474 17706 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.814s	user 0.006s	sys 0.005s
I20260925 16:46:34.540642 17706 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.542119 17787 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.542376 17649 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.465993 17793 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:34.543186  9695 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:34.543337 17793 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:34.544342  9697 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:34.544411 17793 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.449591  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.546058  9123 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:34.361366 17700 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:34.547192  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.406031 17764 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:34.547520 17700 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:34.547878 17764 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:34.547906  9123 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:34.469080  9693 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:34.549696  9123 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:34.456094  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.552090  9048 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:34.552263  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4317) took 1105 ms. Trace:
I20260925 16:46:34.552613  9119 rpcz_store.cc:276] 0925 16:46:33.446486 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.446627 (+   141us) service_pool.cc:227] Handling call
0925 16:46:33.457807 (+ 11180us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:33.760682 (+302875us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.552072 (+791390us) spinlock_profiling.cc:243] Waited 302 ms on lock 0x7b5400040954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:34.552215 (+   143us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":694827392}
I20260925 16:46:34.552964  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.553745  9048 raft_consensus.cc:2379] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:34.556206 17800 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:34.556756 17800 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.557690  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1739) took 1810 ms. Trace:
I20260925 16:46:34.558027  8972 rpcz_store.cc:276] 0925 16:46:32.747089 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:32.808699 (+ 61610us) service_pool.cc:227] Handling call
0925 16:46:32.855295 (+ 46596us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:32.910922 (+ 55627us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:32.910965 (+    43us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:32.933394 (+ 22429us) log.cc:842] Serialized 26 byte log entry
0925 16:46:33.115990 (+182596us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:33.116046 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:33.116138 (+    92us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:33.553700 (+437562us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:33.664679 (+110979us) raft_consensus.cc:1671] finished
0925 16:46:33.664706 (+    27us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:34.557526 (+892820us) spinlock_profiling.cc:243] Waited 43.3 ms on lock 0x7b54001e2650. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:34.557638 (+   112us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":64382,"raft.queue_time_us":70638,"raft.run_cpu_time_us":151,"raft.run_wall_time_us":14144,"spinlock_wait_cycles":106493568,"thread_start_us":92512,"threads_started":1,"wal-append.queue_time_us":376949}
I20260925 16:46:34.402220 17661 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.484969 17633 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.486704  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.385772 17628 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.435185 17745 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:34.518023 17772 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:34.522977 17623 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:34.525867 17756 raft_consensus.cc:979] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: : Instructing follower 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:34.530109 17325 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.532509 17770 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.533492  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:34.428074 17674 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:34.539026  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.392684 17691 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:34.542752 17706 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:34.443257 17730 consensus_meta.cc:287] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.766s	user 0.011s	sys 0.000s
I20260925 16:46:34.388619  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260925 16:46:34.545262  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48387.5us
I20260925 16:46:34.452216  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:34.548519 17764 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:34.467437  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.553484  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:34.480337  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.482005  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.472218  8967 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:34.416045 17413 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.084s
I20260925 16:46:34.475689 17106 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:34.568842  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:34.571405  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 116333us
I20260925 16:46:34.582283  9695 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:34.613947  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.675381  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:34.649024  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:34.560555 17741 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:34.743484  9046 raft_consensus.cc:2396] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260925 16:46:34.745178  8973 raft_consensus.cc:2379] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:34.740483  9042 raft_consensus.cc:2454] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 29.
I20260925 16:46:34.586985 17547 raft_consensus.cc:686] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:34.530189 17669 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 26.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.096s
I20260925 16:46:34.772889  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:34.761861  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 86617.1us
I20260925 16:46:34.753153  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.753850  9694 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:34.791355  9702 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
W20260925 16:46:34.787973  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 43611.8us
I20260925 16:46:34.488900 17797 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:34.788265  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 234877us
I20260925 16:46:34.802599  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.803951  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:34.795418  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:34.797195 17633 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:34.797672 17770 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.784698 17833 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:34.822304 17833 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.822845 17833 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:34.825372 17667 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.621371 17772 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.800731 17700 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.666330 17628 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.813831  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:34.649588 17627 raft_consensus.cc:1067] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Signalling peer 40a71744ceba4efe949720cb0f274853 to start an election
I20260925 16:46:34.815568  9046 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260925 16:46:34.815570  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2302) took 1172 ms. Trace:
I20260925 16:46:34.842504 17730 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:34.842921 17730 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:34.840178  9695 rpcz_store.cc:276] 0925 16:46:33.642915 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.643049 (+   134us) service_pool.cc:227] Handling call
0925 16:46:34.815415 (+1172366us) spinlock_profiling.cc:243] Waited 886 ms on lock 0x7b5400537fd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:34.815505 (+    90us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2037661952}
I20260925 16:46:34.844259  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:34.626696 17623 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.809106 17769 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:34.820713  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:34.821319 17782 consensus_queue.cc:1046] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:46:34.827293 17668 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.799679 17691 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:34.880055 17691 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:34.816135  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:34.668200 17715 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.835813  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.567638 17666 consensus_queue.cc:260] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.802737 17783 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.071s
I20260925 16:46:34.846118  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1749) took 1022 ms. Trace:
I20260925 16:46:34.743120 17106 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:34.839381 17795 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:34.851387 17661 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.848681 17730 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.854645 17743 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260925 16:46:34.856928 17800 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:34.857822 17794 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:34.851409 17842 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:46:34.897126 17623 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.898216  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.898798 17783 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:34.899142 17783 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:34.860288 17568 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.879261 17833 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:34.899914 17783 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.900931 17797 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:34.901238 17701 consensus_queue.cc:1159] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 23 status { last_received { term: 21 index: 16 } last_committed_idx: 16 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:34.901669 17730 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:34.866061  9045 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260925 16:46:34.902664 17783 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:34.864363  9046 raft_consensus.cc:1226] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:34.903081  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:34.905010  9116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2178) took 1182 ms. Trace:
I20260925 16:46:34.905395 17708 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.001s
I20260925 16:46:34.905938 17753 consensus_queue.cc:1046] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260925 16:46:34.906993 17708 raft_consensus.cc:3032] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:34.907370 17708 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:34.869256 17700 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:34.869839  8967 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:34.779955 17741 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.878417 17782 consensus_queue.cc:1225] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 27.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260925 16:46:34.879072  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1752) took 1054 ms. Trace:
I20260925 16:46:34.924275  8969 rpcz_store.cc:276] 0925 16:46:33.824916 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.849065 (+ 24149us) service_pool.cc:227] Handling call
0925 16:46:34.878931 (+1029866us) spinlock_profiling.cc:243] Waited 399 ms on lock 0x7b5400135e54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:34.879025 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":917458688}
I20260925 16:46:34.879487 17849 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:34.883548  8975 rpcz_store.cc:276] 0925 16:46:33.823923 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.209716 (+385793us) service_pool.cc:227] Handling call
0925 16:46:34.209994 (+   278us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:34.487538 (+277544us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:34.487585 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:34.487643 (+    58us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:34.487688 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.845830 (+358142us) spinlock_profiling.cc:243] Waited 277 ms on lock 0x7b54003e8354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:34.845893 (+    63us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:34.846054 (+   161us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":637765504}
I20260925 16:46:34.841328 17547 consensus_queue.cc:237] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.18, Last appended by leader: 18, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.883301 17691 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:34.886502 17795 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:34.885387  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:34.892849 17667 consensus_queue.cc:1159] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8dc3391062084f45a6ba62d28d340722" responder_term: 17 status { last_received { term: 17 index: 15 } last_committed_idx: 14 last_received_current_leader { term: 17 index: 15 } }
I20260925 16:46:34.901579 17568 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:34.868739 17821 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.697s	user 0.003s	sys 0.000s
I20260925 16:46:34.907815 17772 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:34.908584  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4007) took 1030 ms. Trace:
I20260925 16:46:35.036607  9124 rpcz_store.cc:276] 0925 16:46:33.878539 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.202097 (+323558us) service_pool.cc:227] Handling call
0925 16:46:34.533589 (+331492us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:34.533837 (+   248us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:34.533874 (+    37us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:34.533931 (+    57us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:34.533975 (+    44us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.534053 (+    78us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:34.908427 (+374374us) spinlock_profiling.cc:243] Waited 331 ms on lock 0x7b54001c8c50. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:34.908534 (+   107us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":761604352}
W20260925 16:46:35.037498  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 152202us
W20260925 16:46:34.910070 17831 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.731s	user 0.006s	sys 0.000s
I20260925 16:46:34.910598  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:34.905366  9116 rpcz_store.cc:276] 0925 16:46:33.722226 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.722343 (+   117us) service_pool.cc:227] Handling call
0925 16:46:33.722628 (+   285us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:33.727463 (+  4835us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:33.727493 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:33.727922 (+   429us) log.cc:842] Serialized 26 byte log entry
0925 16:46:34.069227 (+341305us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:34.069273 (+    46us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.904500 (+835227us) spinlock_profiling.cc:243] Waited 4.48 ms on lock 0x7b54001c8754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:34.904680 (+   180us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:34.904731 (+    51us) raft_consensus.cc:1671] finished
0925 16:46:34.904748 (+    17us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:34.904960 (+   212us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":5380,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":13732,"spinlock_wait_cycles":10355712,"thread_start_us":232232,"threads_started":1,"wal-append.queue_time_us":427872}
I20260925 16:46:34.914381  9043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1675) took 1315 ms. Trace:
I20260925 16:46:34.918764  9045 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:34.636116 17807 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:34.923482  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 107428us
I20260925 16:46:35.034106  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:35.035944  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3612) took 1091 ms. Trace:
W20260925 16:46:35.094048  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 251280us
I20260925 16:46:35.093330  8975 rpcz_store.cc:276] 0925 16:46:33.944898 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.932661 (+987763us) service_pool.cc:227] Handling call
0925 16:46:35.035407 (+102746us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.035583 (+   176us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.035615 (+    32us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.035659 (+    44us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:35.035718 (+    59us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.035773 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.035887 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:35.012005 17661 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:34.893764 17764 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.096307  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.101502  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.012282 17625 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.012408 17673 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:35.102739  9702 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260925 16:46:34.926708 17700 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:35.110183  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.111454  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.020996 17782 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.047530 17634 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:35.103646  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:35.092734  9043 rpcz_store.cc:276] 0925 16:46:33.599452 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.599606 (+   154us) service_pool.cc:227] Handling call
0925 16:46:33.600092 (+   486us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:33.600496 (+   404us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:33.600536 (+    40us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:34.535274 (+934738us) spinlock_profiling.cc:243] Waited 7.46 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:34.535724 (+   450us) log.cc:842] Serialized 26 byte log entry
0925 16:46:34.623444 (+ 87720us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:34.623494 (+    50us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.623584 (+    90us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:34.914074 (+290490us) raft_consensus.cc:1671] finished
0925 16:46:34.914093 (+    19us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:34.914314 (+   221us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":2535,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":9687,"spinlock_wait_cycles":17162624,"thread_start_us":87300,"threads_started":1,"wal-append.queue_time_us":376144}
I20260925 16:46:35.118619  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.119838  9702 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:35.120376  9693 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 27 because replica has last-logged OpId of term: 25 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 19.
I20260925 16:46:35.120682  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:35.114347  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.121971  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:35.135878  9698 raft_consensus.cc:2379] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:35.047531 17781 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.140838  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:35.099105 17661 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:35.170749  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4006) took 1513 ms. Trace:
I20260925 16:46:35.106428 17833 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.169984  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:35.179378  9115 rpcz_store.cc:276] 0925 16:46:33.657047 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.657222 (+   175us) service_pool.cc:227] Handling call
0925 16:46:33.657531 (+   309us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:33.681840 (+ 24309us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:33.681869 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:33.694025 (+ 12156us) log.cc:842] Serialized 26 byte log entry
0925 16:46:33.884542 (+190517us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:33.884598 (+    56us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.534580 (+649982us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b5400166554. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:34.534628 (+    48us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:34.868085 (+333457us) spinlock_profiling.cc:243] Waited 5.45 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:35.143675 (+275590us) raft_consensus.cc:1671] finished
0925 16:46:35.143734 (+    59us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.170673 (+ 26939us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":470,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":8273,"spinlock_wait_cycles":67693568,"thread_start_us":159354,"threads_started":1,"wal-append.queue_time_us":332591}
I20260925 16:46:35.136879  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:35.198644  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61845us
I20260925 16:46:35.199625  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:35.022053 17849 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:35.180533 17831 log.cc:924] Time spent T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260925 16:46:35.280205 17623 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:35.280714 17772 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:35.280920 17741 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.285612  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:35.132480 17568 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.093552 17708 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.116144 17700 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.331195  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:35.110287 17673 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.113654 17625 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.140372 17668 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.189s
I20260925 16:46:35.187770 17661 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:35.343091  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:35.335210 17855 log.cc:924] Time spent T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.413s	user 0.000s	sys 0.000s
I20260925 16:46:35.187976 17781 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.134693 17782 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.292052 17794 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:35.379722  8969 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:35.222076  9702 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:35.362040 17858 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:35.449671  9044 raft_consensus.cc:3032] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:35.443866  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3600) took 1741 ms. Trace:
I20260925 16:46:35.459707  9044 raft_consensus.cc:729] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:35.458307  8974 rpcz_store.cc:276] 0925 16:46:33.702536 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.702643 (+   107us) service_pool.cc:227] Handling call
0925 16:46:33.733393 (+ 30750us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:33.781916 (+ 48523us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:33.781948 (+    32us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:33.782368 (+   420us) log.cc:842] Serialized 26 byte log entry
0925 16:46:34.004661 (+222293us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:34.063146 (+ 58485us) log.cc:842] Serialized 14 byte log entry
0925 16:46:34.087686 (+ 24540us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.087844 (+   158us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:34.909567 (+821723us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:35.362459 (+452892us) raft_consensus.cc:1671] finished
0925 16:46:35.443546 (+ 81087us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.443784 (+   238us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":126439,"prepare.queue_time_us":57894,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":72680,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":16985,"spinlock_wait_cycles":155457664,"thread_start_us":100593,"threads_started":1,"wal-append.queue_time_us":340316}
I20260925 16:46:35.356220 17743 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:35.473268  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 332363us
I20260925 16:46:35.467823  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:35.461570  9044 consensus_queue.cc:260] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.17, Last appended by leader: 17, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.476227  9044 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:35.358976 17741 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.477859  9702 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:35.485702  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.492427 17764 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.497267  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:35.362651 17627 consensus_queue.cc:1046] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.115s
I20260925 16:46:35.347203 17568 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.502259  8969 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260925 16:46:35.503511  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4214) took 1046 ms. Trace:
I20260925 16:46:35.512213  9044 raft_consensus.cc:1261] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 17. Preceding OpId from leader: term: 27 index: 17. (term mismatch)
I20260925 16:46:35.585997  9044 pending_rounds.cc:76] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 16
I20260925 16:46:35.586735  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1754) took 1115 ms. Trace:
I20260925 16:46:35.521015 17862 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.471858 17858 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.531101 17745 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:35.537365  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 52220.4us
I20260925 16:46:35.586830  9044 pending_rounds.cc:97] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 26.17
W20260925 16:46:35.592584  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 304543us
I20260925 16:46:35.587332  8974 rpcz_store.cc:276] 0925 16:46:34.471843 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.546986 (+1075143us) service_pool.cc:227] Handling call
0925 16:46:35.586239 (+ 39253us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.586422 (+   183us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.586447 (+    25us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.586490 (+    43us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:35.586517 (+    27us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.586566 (+    49us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.586680 (+   114us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:35.585253  9041 rpcz_store.cc:276] 0925 16:46:34.457134 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.494993 (+ 37859us) service_pool.cc:227] Handling call
0925 16:46:34.495407 (+   414us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:34.543499 (+ 48092us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:34.543561 (+    62us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:34.543620 (+    59us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:34.543671 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.503205 (+959534us) spinlock_profiling.cc:243] Waited 47.8 ms on lock 0x7b54000bf4d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:35.503271 (+    66us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.503442 (+   171us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":109994880}
I20260925 16:46:35.592931  9044 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:35.594159  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55050 (request call id 2771) took 1375 ms. Trace:
I20260925 16:46:35.529911 17649 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.594713  9044 rpcz_store.cc:276] 0925 16:46:34.218549 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.219117 (+   568us) service_pool.cc:227] Handling call
0925 16:46:34.219463 (+   346us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.449579 (+1230116us) spinlock_profiling.cc:243] Waited 35.6 ms on lock 0x7b5400403920. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719beba730 00007f719bf2c300 00007f719bf2d371 00007f719bf29edf 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc
0925 16:46:35.593854 (+144275us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.594097 (+   243us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":81886592}
I20260925 16:46:35.555203 17795 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.463222 17794 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.604550 17649 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:35.590432 17859 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.109s	user 0.000s	sys 0.003s
W20260925 16:46:35.591583 17840 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.389s	user 0.005s	sys 0.001s
I20260925 16:46:35.491947 17634 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:35.585773  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2785) took 1362 ms. Trace:
I20260925 16:46:35.481988 17743 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.585459 17623 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:35.617345  9698 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1843) took 1195 ms. Trace:
I20260925 16:46:35.638350  9698 rpcz_store.cc:276] 0925 16:46:34.422318 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.422499 (+   181us) service_pool.cc:227] Handling call
0925 16:46:35.617157 (+1194658us) spinlock_profiling.cc:243] Waited 657 ms on lock 0x7b54006ae0d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:35.617290 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1511613184}
I20260925 16:46:35.618134  9696 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2304) took 1381 ms. Trace:
I20260925 16:46:35.613549 17719 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.619808  9699 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2309) took 1372 ms. Trace:
W20260925 16:46:35.620589  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2788) took 1344 ms (client timeout 1751 ms). Trace:
W20260925 16:46:35.623636 17732 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 27 current term: 27 is higher.
I20260925 16:46:35.598381 17745 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:35.627573 17686 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:35.627784 17424 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.633934  8969 rpcz_store.cc:276] 0925 16:46:34.222973 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.501529 (+1278556us) service_pool.cc:227] Handling call
0925 16:46:35.501881 (+   352us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.585087 (+ 83206us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.585686 (+   599us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:35.494033 17741 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.639346  9696 rpcz_store.cc:276] 0925 16:46:34.237136 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.248623 (+ 11487us) service_pool.cc:227] Handling call
0925 16:46:34.248931 (+   308us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:34.493584 (+244653us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:34.493689 (+   105us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:34.493759 (+    70us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:34.493790 (+    31us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.617916 (+1124126us) spinlock_profiling.cc:243] Waited 244 ms on lock 0x7b54004731d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:35.617963 (+    47us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.618082 (+   119us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":562146560}
I20260925 16:46:35.608489 17862 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.649482  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:49998 (request call id 2774) took 1931 ms. Trace:
I20260925 16:46:35.653139 17568 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.658671 17700 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.660418 17625 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.662227 17794 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.663028 17673 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:35.666632 17730 consensus_meta.cc:287] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.764s	user 0.003s	sys 0.008s
W20260925 16:46:35.669924 17691 consensus_meta.cc:287] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.622s	user 0.008s	sys 0.000s
I20260925 16:46:35.671289 17782 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.673347 17743 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.674613 17781 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.689870 17858 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.692375 17623 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.639215 17634 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.698328  9699 rpcz_store.cc:276] 0925 16:46:34.247076 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.304398 (+ 57322us) service_pool.cc:227] Handling call
0925 16:46:34.331985 (+ 27587us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:34.616281 (+284296us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:34.616328 (+    47us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:34.616386 (+    58us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:34.616431 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.619582 (+1003151us) spinlock_profiling.cc:243] Waited 284 ms on lock 0x7b54006667d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:35.619628 (+    46us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.619761 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":653222656}
W20260925 16:46:35.698429  8973 rpcz_store.cc:269] 0925 16:46:34.276038 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.406714 (+130676us) service_pool.cc:227] Handling call
0925 16:46:35.620405 (+1213691us) spinlock_profiling.cc:243] Waited 210 ms on lock 0x7b54003561d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:35.620535 (+   130us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":483118848}
I20260925 16:46:35.702615  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:35.714511  8971 rpcz_store.cc:276] 0925 16:46:33.718236 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.930193 (+211957us) service_pool.cc:227] Handling call
0925 16:46:33.930646 (+   453us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:33.944430 (+ 13784us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:33.944459 (+    29us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:34.053890 (+109431us) log.cc:842] Serialized 26 byte log entry
0925 16:46:34.419002 (+365112us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:34.419047 (+    45us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:34.419130 (+    83us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:35.535941 (+1116811us) spinlock_profiling.cc:243] Waited 20.7 ms on lock 0x7b2400198848. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198e5acf4 00007f7198e58dfb 00007f7198ee7559 00007f7198ee71e5 00007f7198ee682d 00007f719bb9546e 00007f719bbacc0c 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551
0925 16:46:35.649113 (+113172us) raft_consensus.cc:1671] finished
0925 16:46:35.649136 (+    23us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.649408 (+   272us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":117298,"raft.queue_time_us":26290,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":13303,"spinlock_wait_cycles":47520128,"thread_start_us":200628,"threads_started":1,"wal-append.queue_time_us":1009694}
W20260925 16:46:35.712404 17783 consensus_meta.cc:287] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.809s	user 0.010s	sys 0.000s
I20260925 16:46:35.734763  8969 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3615) took 1164 ms. Trace:
W20260925 16:46:35.761514  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58991.7us
I20260925 16:46:35.761698  8969 rpcz_store.cc:276] 0925 16:46:34.569964 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.713093 (+1143129us) service_pool.cc:227] Handling call
0925 16:46:35.713452 (+   359us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.713656 (+   204us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.713692 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.713747 (+    55us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:35.713790 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.713845 (+    55us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.734630 (+ 20785us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:35.762759 17862 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.763456  8969 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:35.763756 17862 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:35.764261 17862 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.697768 17849 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:35.749840  8970 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2784) took 1527 ms (client timeout 1854 ms). Trace:
W20260925 16:46:35.765440  8970 rpcz_store.cc:269] 0925 16:46:34.222460 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.255216 (+ 32756us) service_pool.cc:227] Handling call
0925 16:46:35.749642 (+1494426us) spinlock_profiling.cc:243] Waited 83.5 ms on lock 0x7b54002fe754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:35.749783 (+   141us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":191997824}
I20260925 16:46:35.766059  8973 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: [25.16-26.17]
I20260925 16:46:35.723587 17686 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.713856 17719 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.756649 17741 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.712539 17770 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:35.781489  8973 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3619) took 1210 ms. Trace:
I20260925 16:46:35.791652  8973 rpcz_store.cc:276] 0925 16:46:34.571292 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.760034 (+1188742us) service_pool.cc:227] Handling call
0925 16:46:35.760462 (+   428us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:35.781161 (+ 20699us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.781425 (+   264us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:35.774933  8971 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3620) took 1124 ms. Trace:
I20260925 16:46:35.788717  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.790648  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:35.793215  9044 raft_consensus.cc:2354] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19.
I20260925 16:46:35.793172  8971 rpcz_store.cc:276] 0925 16:46:34.650049 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.760734 (+1110685us) service_pool.cc:227] Handling call
0925 16:46:35.774180 (+ 13446us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.774387 (+   207us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.774423 (+    36us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.774476 (+    53us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:35.774517 (+    41us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.774734 (+   217us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.774868 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:46:35.794307  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.750293 17673 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:35.797991  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.798812  9047 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:35.798091  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.805507  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.810012  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.761546 17783 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:35.818033  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.818186  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.782120 17642 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:35.725919 17424 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.823518  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.825664  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.784606 17864 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:35.827637  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.753159 17691 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.940004  8941 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:35.946787  8975 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1753) took 1999 ms. Trace:
I20260925 16:46:35.947337  8975 rpcz_store.cc:276] 0925 16:46:33.947826 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.095363 (+1147537us) service_pool.cc:227] Handling call
0925 16:46:35.114020 (+ 18657us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.114299 (+   279us) raft_consensus.cc:1520] Early marking committed up to index 12
0925 16:46:35.476312 (+362013us) log.cc:842] Serialized 14 byte log entry
0925 16:46:35.946367 (+470055us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.946435 (+    68us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:35.946500 (+    65us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:35.946596 (+    96us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:35.946730 (+   134us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":14791,"prepare.queue_time_us":582058,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":8337,"thread_start_us":751605,"threads_started":2}
I20260925 16:46:35.947151  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:46:35.961944 17862 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.966909 17719 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.969067 17424 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.934760 17864 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.972874 17864 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.799099 17770 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:35.977944  8966 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:35.978381  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:35.981081  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.981839  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.981711  9696 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:35.984711  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:35.984954  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:35.985757  9013 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.041s	sys 0.074s
I20260925 16:46:35.985947  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:35.986157  9013 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.692s	user 0.041s	sys 0.074s
I20260925 16:46:35.975206 17770 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:35.815899 17673 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:35.999009  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:36.000003  9697 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:36.002372  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:35.923894 17642 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:35.988150 17106 consensus_meta.cc:287] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 1.090s	user 0.011s	sys 0.000s
I20260925 16:46:36.010056  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.983815 17794 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:36.005980  9016 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.010811  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.983594 17649 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:35.999569 17700 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260925 16:46:36.001191 17865 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:36.029966  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:36.023329  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 477999us
I20260925 16:46:36.010578 17719 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:36.038021  9047 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:36.039840  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:36.003243 17845 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.641s	user 0.026s	sys 0.058s
I20260925 16:46:36.010404 17851 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260925 16:46:36.035418 17661 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.578s	user 0.006s	sys 0.005s
W20260925 16:46:36.012169 17807 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.035s	sys 0.043s
I20260925 16:46:36.038846 17707 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:36.014495 17871 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.032824 17864 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:36.062199  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:36.050931  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:36.062999  9041 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:36.063262  8973 raft_consensus.cc:2379] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:36.051280  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:36.065614  8971 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:36.054240  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:36.054978  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:36.067274  8975 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:36.055359  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:36.068055  8970 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 21
I20260925 16:46:36.038748 17719 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:36.049355 17807 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.039s	sys 0.054s
I20260925 16:46:36.043902 17424 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:36.093277  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:36.070072  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:36.045331 17845 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.682s	user 0.026s	sys 0.059s
I20260925 16:46:36.040643 17794 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:36.014891 17106 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.097625  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:36.051761 17707 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.105093  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:36.107393  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:36.092617 17719 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:36.108735  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:36.092042 17623 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.122501  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:36.122534  9041 raft_consensus.cc:1226] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:36.049423 17851 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:36.109248  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:36.097175 17634 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.125114  9696 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:36.098737 17686 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.048367 17661 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.049845 17783 consensus_queue.cc:1046] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 23.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.052s
I20260925 16:46:36.131112  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:36.070084 17871 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.142248  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:36.134048  9700 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2314) took 1037 ms. Trace:
I20260925 16:46:36.136863  8968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3613) took 2191 ms. Trace:
I20260925 16:46:36.138672  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42256 (request call id 2317) took 1040 ms. Trace:
I20260925 16:46:36.126173 17691 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.137965  8967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:41948 (request call id 1755) took 1665 ms. Trace:
I20260925 16:46:36.112993 17872 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.182505  9700 rpcz_store.cc:276] 0925 16:46:35.096199 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.096362 (+   163us) service_pool.cc:227] Handling call
0925 16:46:35.110320 (+ 13958us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.365692 (+255372us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.365738 (+    46us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.365810 (+    72us) raft_consensus.cc:1631] Marking committed up to 18
0925 16:46:35.365853 (+    43us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:36.133896 (+768043us) spinlock_profiling.cc:243] Waited 255 ms on lock 0x7b540073da54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:36.133928 (+    32us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:36.134009 (+    81us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":586755328}
I20260925 16:46:36.190645  9694 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:36.073948 17864 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.198377  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:36.215062  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:36.185333  9695 rpcz_store.cc:276] 0925 16:46:35.098544 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.098659 (+   115us) service_pool.cc:227] Handling call
0925 16:46:35.098912 (+   253us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.357880 (+258968us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.357924 (+    44us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.357990 (+    66us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:35.358032 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:36.138420 (+780388us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b5400532354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:36.138480 (+    60us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:36.138612 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":594999040}
W20260925 16:46:36.218986  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 189400us
I20260925 16:46:36.235682 17673 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.236387 17642 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.238386 17833 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:36.238857 17833 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:36.239288 17833 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
W20260925 16:46:36.246656  9122 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 4012) took 2091 ms (client timeout 1644 ms). Trace:
W20260925 16:46:36.247201  9122 rpcz_store.cc:269] 0925 16:46:34.154882 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.193338 (+ 38456us) service_pool.cc:227] Handling call
0925 16:46:36.246370 (+2053032us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b54000113d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:36.246533 (+   163us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4085776640}
I20260925 16:46:36.255059 17345 raft_consensus.cc:3032] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:36.255539 17345 raft_consensus.cc:729] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:36.256263 17877 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260925 16:46:36.257694  8970 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:36.259033  9666 leader_election.cc:398] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19.
I20260925 16:46:36.259341  9666 leader_election.cc:401] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260925 16:46:36.262599  9043 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:36.180992 17874 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.213686 17852 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.197021  8967 rpcz_store.cc:276] 0925 16:46:34.472591 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.802226 (+329635us) service_pool.cc:227] Handling call
0925 16:46:36.137743 (+1335517us) spinlock_profiling.cc:243] Waited 66.5 ms on lock 0x7b540020ec54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:36.137900 (+   157us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":152855808}
I20260925 16:46:36.128129 17649 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:36.256371 17345 consensus_queue.cc:260] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.273372  9044 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:36.132995 17851 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:36.276012 17649 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.278792 17649 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.182643  8968 rpcz_store.cc:276] 0925 16:46:33.945291 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.091442 (+1146151us) service_pool.cc:227] Handling call
0925 16:46:35.091813 (+   371us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.366233 (+274420us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:46:35.632336 (+266103us) log.cc:842] Serialized 14 byte log entry
0925 16:46:36.039392 (+407056us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:36.039441 (+    49us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:36.039489 (+    48us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:36.136581 (+ 97092us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b5400137754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:36.136643 (+    62us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:36.136797 (+   154us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":5995,"prepare.queue_time_us":370155,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":7283,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":8239,"spinlock_wait_cycles":630528384,"thread_start_us":666420,"threads_started":2,"wal-append.queue_time_us":495846}
W20260925 16:46:36.280398  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 1.86253e+06us
I20260925 16:46:36.292115  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:36.274335 17812 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 2.347s	user 0.019s	sys 0.018s
W20260925 16:46:36.270440 17745 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.549s	user 0.001s	sys 0.008s
W20260925 16:46:36.283248  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 68305.3us
I20260925 16:46:36.287305  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.300580 17661 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.312312  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:36.315928  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:36.323570  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:36.324317  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:36.285960 17583 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:36.331310  8940 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:36.333122  9122 raft_consensus.cc:1226] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: [26.17-26.17]
I20260925 16:46:36.333626  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:36.324503  9695 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:36.341485  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.296226 17345 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:36.337668  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.281013 17874 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.349944 17710 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:36.360281  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.342460  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:36.288318 17880 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:36.280483 17852 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.326833 17868 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:36.344820  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:36.199080 17794 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.348529  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.361505  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.349639  9123 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:46:36.393247  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 48504.4us
W20260925 16:46:36.350800  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.92269e+06us
I20260925 16:46:36.361183  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.330469 17755 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:36.275348 17872 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.343585 17696 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.361819  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.350651  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:36.394367  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:36.361032  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:36.363586  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:36.343825 17743 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:36.343744 17691 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:36.575852 17691 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:36.576305 17691 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:36.392202 17710 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.581394 17710 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:36.431687  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 79988us
W20260925 16:46:36.436112 17884 log.cc:924] Time spent T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.247s	user 0.000s	sys 0.000s
W20260925 16:46:36.437085 17889 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.164s	user 0.000s	sys 0.000s
W20260925 16:46:36.437780 17882 log.cc:924] Time spent T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260925 16:46:36.438540 17890 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260925 16:46:36.350366 17780 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:36.440014 17755 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:36.390025 17707 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.583818 17755 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:36.360746 17785 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:36.583640 17780 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.550175 17858 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.584762 17755 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.585793 17780 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.497016 17852 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.362556 17106 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.440575 17788 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:36.587076 17788 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.589151 17788 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.440932  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:36.441303 17803 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:36.589875  9124 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:36.589989 17803 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.592363 17803 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.441474 17800 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.392514 17868 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:36.593304 17868 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:36.593099 17800 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.441646  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.442780 17864 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.444293 17871 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.446503 17874 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:36.448071 17879 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.342s	user 0.001s	sys 0.000s
I20260925 16:46:36.392976 17804 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:36.392205 17849 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.461879 17872 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.344125 17810 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:36.472640  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:36.485302  9115 raft_consensus.cc:3037] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:36.344197 17797 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:36.482793  9700 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
W20260925 16:46:36.483494  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89201.1us
I20260925 16:46:36.549562  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.677525  9119 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:36.571058  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.571934 17688 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 FOLLOWER]: Leader election won for term 31
I20260925 16:46:36.572105 17719 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.315320 17745 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.574823 17696 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.353590 17583 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:36.692710  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 480026us
I20260925 16:46:36.584952 17858 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.348282 17761 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:36.582384  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.321623  9698 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
W20260925 16:46:36.635200  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 436910us
I20260925 16:46:36.360924  9118 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:36.665283  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:36.595513 17800 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.680240  9124 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
W20260925 16:46:36.681478  9042 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1674) took 3076 ms (client timeout 2035 ms). Trace:
I20260925 16:46:36.683056  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.683342  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.683626  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.684192  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:36.681018  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 110086us
I20260925 16:46:36.614516 17845 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19.
I20260925 16:46:36.699506  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.360299 17413 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:36.712133  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 129826us
I20260925 16:46:36.672363 17852 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:36.719568  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.719583  9090 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.721027  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.721849  9124 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
W20260925 16:46:36.712579  9042 rpcz_store.cc:269] 0925 16:46:33.597863 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:33.598020 (+   157us) service_pool.cc:227] Handling call
0925 16:46:36.674457 (+3076437us) spinlock_profiling.cc:243] Waited 838 ms on lock 0x7b54002a3d54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:36.674608 (+   151us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1928045440}
I20260925 16:46:36.353689 17682 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:36.726763  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.727455  9120 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:36.695295 17674 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:36.728909  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:36.739449  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.739677  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.739923  9119 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:36.663044 17804 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.671224 17851 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.672163 17849 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.739629  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.753328  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.748158  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:36.738758 17759 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 1.216s	user 0.005s	sys 0.022s
I20260925 16:46:36.718488 17788 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
W20260925 16:46:36.775961 17833 consensus_meta.cc:287] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.520s	user 0.005s	sys 0.005s
I20260925 16:46:36.776065 17788 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:36.776404 17833 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.777366 17788 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.778506 17833 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.780517 17851 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.782023  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:36.782801  9696 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:36.711251 17688 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:36.784657 17769 raft_consensus.cc:3032] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:36.784245 17688 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.785053 17769 raft_consensus.cc:729] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:36.785912 17769 consensus_queue.cc:260] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.787168 17769 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:36.755160  9124 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:36.788357 17696 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.755148  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.789011  9120 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
W20260925 16:46:36.761445 17759 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.005s	sys 0.022s
I20260925 16:46:36.789775  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.728195 17261 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:36.750411  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.685364 17810 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.730177 17803 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:36.762233  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.760444 17800 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:36.766072 17583 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.767818 17719 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.768499 17745 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.729543 17682 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.726615 17413 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.730051 17852 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.774693 17868 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.782171 17849 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.782976  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:36.732292 17674 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:36.793911  9124 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:36.790969  9119 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:36.802376 17261 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:36.807466  9115 raft_consensus.cc:2454] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:36.802754 17803 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:36.826561  9124 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260925 16:46:36.800980 17424 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:36.824978  9115 raft_consensus.cc:1261] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260925 16:46:36.816227  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.833933  9695 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:36.834157  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.805470 17800 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:36.832669  9119 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 22 index: 15. (index mismatch)
I20260925 16:46:36.841611 17804 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.843750  9115 raft_consensus.cc:1226] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:36.824199 17674 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:36.825273 17261 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:36.833308 17803 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:36.835615 17424 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:36.842727 17800 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:36.864114  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.869325  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:36.834381  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.027s	sys 0.014s
I20260925 16:46:36.862852  9116 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70"
dest_uuid: "40a71744ceba4efe949720cb0f274853"
 from {username='slave'} at 127.0.0.1:45950
I20260925 16:46:36.870703  9116 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:46:36.871165  9116 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:36.871770  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.027s	sys 0.014s
I20260925 16:46:36.884975 17868 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.888500 17810 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.864061 17858 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:36.900839  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.911092  9116 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:36.910458  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 184116us
I20260925 16:46:36.850241 17691 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.918932  9116 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:36.910003  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 196532us
W20260925 16:46:36.922942  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 193070us
I20260925 16:46:36.897768 17726 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:36.926147  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:36.913250 17868 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.937300 17691 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.924499 17745 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.946528  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:36.941622  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.942098  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:36.949555 17899 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:36.939293 17804 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:36.952065  9116 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:36.961284  8966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3618) took 2390 ms (client timeout 1945 ms). Trace:
W20260925 16:46:36.961723  8966 rpcz_store.cc:269] 0925 16:46:34.570927 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.803628 (+232701us) service_pool.cc:227] Handling call
0925 16:46:36.961095 (+2157467us) spinlock_profiling.cc:243] Waited 1.17 s on lock 0x7b5400225954. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:36.961205 (+   110us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2698215680}
I20260925 16:46:36.964679  9666 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:36.942271 17682 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:36.943607 17858 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:36.959844 17870 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:36.994145  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.994753  9117 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:37.004912  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.005654  8968 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:36.940445 17726 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:36.945142 17868 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.959890 17745 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.008458  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.012630  8968 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:37.009693  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.010133  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.010380  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.014639  8970 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:37.010310  9116 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:37.006321  8966 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:36.992228 17413 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:36.964308 17899 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:36.992630 17910 raft_consensus.cc:2781] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:37.022845  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:36.974728 17804 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.021386  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.024223  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.022321  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.022255  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.015915  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.021445  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.023527  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.025594  8975 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:37.025000  8969 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:37.026320  8973 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:37.029465  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:37.029896  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
W20260925 16:46:37.031172 17908 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260925 16:46:37.031646 17726 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.037122 17708 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:37.040336  8975 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 28: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:37.040759 17409 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:37.041145 17409 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:37.041544 17409 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:37.041769 17870 consensus_queue.cc:1046] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:37.042660 17870 raft_consensus.cc:3032] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Stepping down as leader of term 27
I20260925 16:46:37.042958 17870 raft_consensus.cc:729] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:37.043771 17870 consensus_queue.cc:260] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.045567 17870 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:37.046617 17868 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.052836  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.052680 17261 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.053217  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.053978  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.054296  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.054524  9119 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:37.055271  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.060580  9115 raft_consensus.cc:2362] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23. Re-sending same reply.
I20260925 16:46:37.055522  9124 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:37.064572  8939 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.064813  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.065266  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.021406 17900 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.068984 17804 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.026687 17910 raft_consensus.cc:686] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:37.060621 17745 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.071873  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.074425 17800 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.056981 17899 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.054666 17261 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.076143  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1686) took 1131 ms. Trace:
I20260925 16:46:37.078183  8939 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.083803 17910 consensus_queue.cc:237] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.080080 17345 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:37.078606 17413 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:37.089869  8939 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.089125  9050 rpcz_store.cc:276] 0925 16:46:35.944927 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.950379 (+  5452us) service_pool.cc:227] Handling call
0925 16:46:35.950760 (+   381us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.975972 (+ 25212us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.976002 (+    30us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.976041 (+    39us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:35.976069 (+    28us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:37.075931 (+1099862us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b54002616d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:37.075973 (+    42us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:37.076094 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":57406336}
I20260925 16:46:37.107784  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.108259 17745 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:46:37.111192  9694 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42256 (request call id 2323) took 2006 ms (client timeout 1534 ms). Trace:
W20260925 16:46:37.111764  9694 rpcz_store.cc:269] 0925 16:46:35.105155 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.116020 (+ 10865us) service_pool.cc:227] Handling call
0925 16:46:37.110996 (+1994976us) spinlock_profiling.cc:243] Waited 1.07 s on lock 0x7b540071e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:37.111128 (+   132us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2459076992}
I20260925 16:46:37.115163 17755 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.115619 17916 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:37.087847 17674 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.094452 17345 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:37.115672 17755 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.119017 17674 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.082167 17900 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.116091 17916 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:37.120203 17916 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:37.121037 17900 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.082777 17424 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.107738 17413 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.116638 17852 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:37.124518 17424 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.124249 17803 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.125792  9118 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 27 because replica has last-logged OpId of term: 25 index: 20, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 19.
W20260925 16:46:37.118005  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 459892us
I20260925 16:46:37.127780  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:37.128976  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.129303  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.131422  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.118569 17345 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:37.136250  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.138617 17804 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:37.139279 17804 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:37.140355 17804 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 26.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.094573 17899 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:37.145007  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.145372  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.147418  9694 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:37.149567  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.152763  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.154557  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.151616  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.154160  8939 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.159479  8939 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.161038  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.131742 17803 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.118183 17409 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.169909 17409 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.171097  9696 raft_consensus.cc:2354] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
I20260925 16:46:37.156509 17745 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:37.170877 17345 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.172312 17800 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.174031 17345 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.145882 17708 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.031s
I20260925 16:46:37.175825 17916 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.183992 17753 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.186493  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.187220 17759 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:37.162356 17900 consensus_queue.cc:1035] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.027s
I20260925 16:46:37.190557  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.187542  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.191860  9695 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:37.193244  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:37.193799 17887 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.914s	user 0.009s	sys 0.036s
I20260925 16:46:37.194008  9694 raft_consensus.cc:2379] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:37.196229  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.197676  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.198339  9699 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:37.198777  9044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 4248) took 1089 ms. Trace:
I20260925 16:46:37.199445  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:37.199558  9698 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 28.
I20260925 16:46:37.199812  9044 rpcz_store.cc:276] 0925 16:46:36.108899 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:36.109035 (+   136us) service_pool.cc:227] Handling call
0925 16:46:37.198634 (+1089599us) spinlock_profiling.cc:243] Waited 144 ms on lock 0x7b54001707d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:37.198725 (+    91us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":330574208}
I20260925 16:46:37.198587  8974 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50010 (request call id 3614) took 2629 ms. Trace:
I20260925 16:46:37.200596  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.200886  8974 rpcz_store.cc:276] 0925 16:46:34.569630 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.594213 (+1024583us) service_pool.cc:227] Handling call
0925 16:46:35.612253 (+ 18040us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:35.639921 (+ 27668us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.639952 (+    31us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:35.639990 (+    38us) raft_consensus.cc:1631] Marking committed up to 14
0925 16:46:35.640030 (+    40us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:37.198117 (+1558087us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b540020e254. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:37.198155 (+    38us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:37.198529 (+   374us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":63214848}
I20260925 16:46:37.204721  8939 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.209059  9695 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:37.214576  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.186585 17916 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.215031 17413 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.212396 17726 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:37.210215 17753 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:37.226521 17753 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.228111  8939 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.229931  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.226909 17753 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:37.231889  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.213076 17708 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:37.233899  8939 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.233170  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:37.237171  8939 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:37.240613  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.241091  8975 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:37.230912 17345 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.241734 17745 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:37.242621  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.243984  8969 raft_consensus.cc:1226] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:37.241191  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.233776 17759 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:37.248353  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.248927  9122 raft_consensus.cc:2362] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24. Re-sending same reply.
I20260925 16:46:37.249831  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.250790  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.233677 17726 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.245721 17870 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:37.247212  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.256944  8969 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:37.257929 17793 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:37.258483  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 580966us
I20260925 16:46:37.258589 17793 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.259249  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.260615 17876 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.261240 17793 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.261397 17876 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.263283  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.264182 17803 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:37.240226 17900 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:37.240116 17741 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:37.265635 17808 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:37.272261 17741 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:37.266377  9115 raft_consensus.cc:3032] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:37.273479  9115 raft_consensus.cc:729] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:37.273156 17741 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.274204  9115 consensus_queue.cc:260] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.20, Last appended by leader: 20, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.275074  8972 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1751) took 3450 ms. Trace:
I20260925 16:46:37.275295  9115 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:37.233913 17916 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.022s
I20260925 16:46:37.267669  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.283489  9115 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 20. (term mismatch)
I20260925 16:46:37.284017  9115 pending_rounds.cc:76] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 19
I20260925 16:46:37.284327  9115 pending_rounds.cc:97] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 26.20
I20260925 16:46:37.284690  9115 raft_consensus.cc:2866] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:37.286181 17666 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:37.288846 17910 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.287569 17761 consensus_queue.cc:1046] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260925 16:46:37.289342 17910 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.290241 17761 raft_consensus.cc:3032] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:37.290606 17761 raft_consensus.cc:729] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:37.291335 17910 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:37.268154  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.264115 17876 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.268978  8939 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.239524 17730 raft_consensus.cc:2741] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260925 16:46:37.276764  8972 rpcz_store.cc:276] 0925 16:46:33.824622 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.875623 (+1051001us) service_pool.cc:227] Handling call
0925 16:46:35.750536 (+874913us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:35.753183 (+  2647us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:35.753216 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:35.753672 (+   456us) log.cc:842] Serialized 26 byte log entry
0925 16:46:36.095740 (+342068us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:36.095791 (+    51us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:36.095853 (+    62us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:37.193308 (+1097455us) spinlock_profiling.cc:243] Waited 3.56 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:37.198649 (+  5341us) raft_consensus.cc:1671] finished
0925 16:46:37.198680 (+    31us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:37.274795 (+ 76115us) spinlock_profiling.cc:243] Waited 874 ms on lock 0x7b54002fe750. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf29a09 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:37.274943 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2257,"raft.queue_time_us":3360,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":2019411712,"thread_start_us":341698,"threads_started":1,"wal-append.queue_time_us":429857}
I20260925 16:46:37.304215  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.304716 17917 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:37.305110  8974 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:37.306173 17668 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:37.306690 17668 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:37.305223 17917 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:37.243192 17708 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:37.310324  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.311357  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.311548  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.312186  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.312206  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.314880  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:37.270078 17900 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:37.317725  9121 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4327) took 3490 ms. Trace:
I20260925 16:46:37.320709  8967 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 16: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:37.338022  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.338856  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.336251  8969 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:37.340229  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.321507 17852 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260925 16:46:37.322432  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 530294us
I20260925 16:46:37.323371  9115 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:37.324195  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.324733 17787 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.326645 17894 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.326893  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.352263  9049 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:37.352581  9047 raft_consensus.cc:2379] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:37.340937  8967 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:37.327346  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.328078  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.354041  9044 raft_consensus.cc:2379] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 27: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:37.330778  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 416608us
I20260925 16:46:37.328754  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.331670  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.331427  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.343819  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.355275  9045 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:37.344192  9666 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:37.355319  8969 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:37.342455  9048 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:37.357153  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.358209  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.360386  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.361488  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.357183  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.362901  8968 raft_consensus.cc:2354] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
I20260925 16:46:37.363041  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.364069  9044 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:37.364883  8969 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:37.365111  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:37.369135  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.369340  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.369753 17764 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:37.370428  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.371202  9697 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 25: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:37.371428  9700 raft_consensus.cc:1226] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19. Ops: []
W20260925 16:46:37.372510 17926 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:46:37.372645 17907 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:37.373214 17907 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.373117 17787 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.373807 17907 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:37.292956 17667 consensus_queue.cc:1046] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.079s
I20260925 16:46:37.313091 17803 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260925 16:46:37.376140 17803 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:37.376578 17803 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:37.370535 17909 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.379760 17625 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:37.379528 17909 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.380236 17625 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:37.380692 17625 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:37.381855 17909 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.352049 17852 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.384267 17755 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.384378 17852 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:37.317413 17876 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.069s
I20260925 16:46:37.392194  9014 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.392647 17696 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:37.393539  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.395843  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.396708  9043 raft_consensus.cc:1226] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:37.397382  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.399047  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.399214  9700 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:37.363731  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.400138  9048 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
W20260925 16:46:37.351141  9089 connection.cc:232] RPC call timeout handler was delayed by -1.0172692230000848s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2304s for a response
I20260925 16:46:37.333781  9121 rpcz_store.cc:276] 0925 16:46:33.818797 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:34.200949 (+382152us) service_pool.cc:227] Handling call
0925 16:46:34.201180 (+   231us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:34.211994 (+ 10814us) raft_consensus.cc:1520] Early marking committed up to index 13
0925 16:46:34.229432 (+ 17438us) log.cc:842] Serialized 14 byte log entry
0925 16:46:34.409877 (+180445us) log.cc:842] Serialized 14 byte log entry
0925 16:46:34.918319 (+508442us) spinlock_profiling.cc:243] Waited 13.3 ms on lock 0x7b1800177400. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:36.272346 (+1354027us) spinlock_profiling.cc:243] Waited 26.9 ms on lock 0x7b1800177400. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:46:36.272576 (+   230us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:36.272643 (+    67us) raft_consensus.cc:1631] Marking committed up to 13
0925 16:46:36.272705 (+    62us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:37.265347 (+992642us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b1800177400. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:37.308598 (+ 43251us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b5400165b54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:37.308667 (+    69us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:37.308829 (+   162us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1885678,"prepare.queue_time_us":18058,"prepare.run_cpu_time_us":89,"prepare.run_wall_time_us":75,"raft.queue_time_us":1892271,"raft.run_cpu_time_us":420,"raft.run_wall_time_us":52443,"spinlock_wait_cycles":131414272,"thread_start_us":163757,"threads_started":1,"wal-append.queue_time_us":683285,"wal-append.run_cpu_time_us":1303,"wal-append.run_wall_time_us":1001480}
I20260925 16:46:37.403772  9045 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:37.394753  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50640.3us
I20260925 16:46:37.404472  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.405514  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.375468 17787 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.407433  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:35.959173  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:37.409242 17633 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:37.412748  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.413133 17707 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:37.413686 17910 raft_consensus.cc:2781] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:37.291512 17761 consensus_queue.cc:260] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.414561  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.369784 17642 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.415308  9043 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:37.417325  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.420020  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.480558  9049 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for term 24 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:37.420717  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.421375  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.422483  9696 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:37.422964  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.423637 17917 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.424424  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.424994 17788 consensus_queue.cc:1035] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:37.350385 17900 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:37.358220  8967 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:37.529309  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.317788  8972 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:37.427382  9090 leader_election.cc:398] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
I20260925 16:46:37.427769 17708 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.430966  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.446261 17633 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:37.538857  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 107986us
I20260925 16:46:37.434909  9117 raft_consensus.cc:3037] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:37.436342  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.440016  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.539888  9666 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.447804  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.393543 17696 raft_consensus.cc:3032] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:37.469067  8975 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:37.474012 17907 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.477036  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:37.545199  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 108926us
I20260925 16:46:37.545574  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.546188  9047 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:37.546422  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.546921  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.547428  9047 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:37.502112  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.502267  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: true dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.553540  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.553839  9049 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:46:37.529481  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105135us
I20260925 16:46:37.529763  9700 raft_consensus.cc:2379] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 19: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:37.530447  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:37.531330  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 94990.6us
I20260925 16:46:37.307574 17668 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 23.15, Last appended by leader: 15, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.535840  9090 leader_election.cc:401] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Cancelling election due to peer responding with higher term
I20260925 16:46:37.537295  9043 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:37.566063  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.568503  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.569121  9117 raft_consensus.cc:2454] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:37.536988 17787 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:37.434465  9697 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260925 16:46:37.540082  8966 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:37.446264  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:37.500336  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 85862us
I20260925 16:46:37.580502  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.581802  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.552503 17667 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:46:37.582609  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 155427us
I20260925 16:46:37.543820 17633 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:37.583472 17755 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:37.554365 17707 consensus_queue.cc:1046] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260925 16:46:37.584450 17800 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 26. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
I20260925 16:46:37.584997 17707 raft_consensus.cc:3032] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:37.548768 17696 raft_consensus.cc:729] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:37.533689 17743 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:37.554860  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.590062  8941 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:37.528810 17642 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.401748 17894 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:37.586423  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46719.4us
I20260925 16:46:37.587823  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.547456  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:37.588399  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 155994us
I20260925 16:46:37.531917 17876 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260925 16:46:37.537412 17808 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.594398  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:37.555398 17865 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.599362  9044 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 28: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:37.585117 17800 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.012s
I20260925 16:46:37.600970  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:37.604756  9049 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:37.605671  9043 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:37.586304 17833 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.537009  9041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4251) took 1402 ms. Trace:
W20260925 16:46:37.601508  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54121us
I20260925 16:46:37.589509 17849 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:37.606132  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.592394 17743 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:37.585420 17707 raft_consensus.cc:729] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:37.585963 17874 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.587471 17910 raft_consensus.cc:686] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:37.601675  9699 raft_consensus.cc:1226] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:37.596479  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.609469  9047 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:37.610179  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.611153  9115 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:37.598107 17682 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:37.591903 17899 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.610464  9041 rpcz_store.cc:276] 0925 16:46:36.130682 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:36.131353 (+   671us) service_pool.cc:227] Handling call
0925 16:46:36.131625 (+   272us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:36.131843 (+   218us) raft_consensus.cc:1520] Early marking committed up to index 20
0925 16:46:36.267640 (+135797us) log.cc:842] Serialized 14 byte log entry
0925 16:46:36.720274 (+452634us) log.cc:842] Serialized 14 byte log entry
0925 16:46:37.069004 (+348730us) spinlock_profiling.cc:243] Waited 4.12 ms on lock 0x7b18004c99c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7199002764 00007f7199005b11 00007f7199005ac9 00007f7199005a59 00007f7199005a21 00007f7199004d1d 00007f71a2266204 00007f71a2266039 00007f7198fe4dc6
0925 16:46:37.307316 (+238312us) spinlock_profiling.cc:243] Waited 3.33 ms on lock 0x7b18004c99c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198f794ca 00007f71a265af99 00007f7198e3d990 00007f7198fff864 00007f7198fff155 00007f719bf223d0 00007f719bf34576 00007f719bf450d7 00007f719bf45058
0925 16:46:37.533149 (+225833us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:37.533213 (+    64us) raft_consensus.cc:1631] Marking committed up to 20
0925 16:46:37.533270 (+    57us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:37.533356 (+    86us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:37.533465 (+   109us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":376395,"prepare.queue_time_us":195937,"prepare.run_cpu_time_us":83,"prepare.run_wall_time_us":85,"raft.queue_time_us":643406,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":14578,"spinlock_wait_cycles":17142272,"thread_start_us":723566,"threads_started":3,"wal-append.queue_time_us":548519}
I20260925 16:46:37.658993  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.605136 17583 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260925 16:46:37.653445  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56038.7us
I20260925 16:46:37.659818  9041 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260925 16:46:37.602985 17719 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.655812  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.644243  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.603271 17772 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:37.600441 17836 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:37.644181  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:37.655495  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 59088.4us
W20260925 16:46:37.652289  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 47756.9us
I20260925 16:46:37.662530  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.641294 17413 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:37.600325 17861 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:37.663931  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.665282  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.661024  9047 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 31.
I20260925 16:46:37.705782  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.707160  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.707396  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.710201  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.643898 17743 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:37.636245 17804 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:37.605321 17934 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260925 16:46:37.715461  8871 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 347) took 14075 ms (client timeout 15000 ms). Trace:
I20260925 16:46:37.656764 17874 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.719122  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.654448 17872 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.644937 17781 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.615099 17865 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.666497 17701 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:37.667366 17583 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.663745 17836 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:37.715548 17757 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:37.657305 17808 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.084s
W20260925 16:46:37.720893  8871 rpcz_store.cc:269] 0925 16:46:23.634603 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:23.634820 (+   217us) service_pool.cc:227] Handling call
0925 16:46:37.710240 (+14075420us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:30.914835 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:30.915488 (+   653us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:30.915538 (+    50us) write_op.cc:435] Acquired schema lock
0925 16:46:30.915559 (+    21us) tablet.cc:660] Decoding operations
0925 16:46:30.918185 (+  2626us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:30.918324 (+   139us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:30.918391 (+    67us) tablet.cc:683] Acquiring locks for 23 operations
0925 16:46:30.942664 (+ 24273us) tablet.cc:699] Row locks acquired
0925 16:46:30.942704 (+    40us) write_op.cc:260] PREPARE: finished
0925 16:46:30.942882 (+   178us) write_op.cc:270] Start()
0925 16:46:30.943058 (+   176us) write_op.cc:276] Timestamp: P: 1790354790942815 usec, L: 0
0925 16:46:30.943076 (+    18us) op_driver.cc:331] REPLICATION: starting
0925 16:46:30.943816 (+   740us) log.cc:842] Serialized 9077 byte log entry
0925 16:46:31.127483 (+183667us) op_driver.cc:444] REPLICATION: finished
0925 16:46:31.272746 (+145263us) write_op.cc:301] APPLY: starting
0925 16:46:31.272827 (+    81us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:31.596738 (+323911us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:31.596849 (+   111us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:31.890119 (+293270us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:31.890425 (+   306us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=46,key_file_lookups=46,delta_file_lookups=46,mrs_lookups=0
0925 16:46:31.890481 (+    56us) write_op.cc:312] APPLY: finished
0925 16:46:31.892001 (+  1520us) log.cc:842] Serialized 204 byte log entry
0925 16:46:31.892156 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:31.892344 (+   188us) write_op.cc:454] Released schema lock
0925 16:46:31.892401 (+    57us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:31.892727 (+   326us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:31.892754 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":401904,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":144984,"apply.run_cpu_time_us":31854,"apply.run_wall_time_us":620595,"cfile_cache_hit":94,"cfile_cache_hit_bytes":100129,"num_ops":23,"prepare.queue_time_us":105090,"prepare.run_cpu_time_us":11840,"prepare.run_wall_time_us":47399,"raft.queue_time_us":71888,"raft.run_cpu_time_us":23643,"raft.run_wall_time_us":73615,"replication_time_us":184294,"thread_start_us":269721,"threads_started":4,"wal-append.queue_time_us":72037,"wal-append.run_cpu_time_us":9692,"wal-append.run_wall_time_us":1885805}]]}
I20260925 16:46:37.640642 17833 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.758867  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.770040  9015 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:37.737653 17864 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:37.764767  9702 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:37.720670 17934 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:37.715533 17634 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.669021 17719 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.716758 17804 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.767720  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.653045 17696 consensus_queue.cc:260] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.746326 17649 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:37.749893 17583 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:37.750188 17836 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:37.770658  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 164591us
I20260925 16:46:37.752519 17757 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:37.788606  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 122238us
I20260925 16:46:37.782792  9666 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.787141  9089 leader_election.cc:398] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 26. Current term is 27.
I20260925 16:46:37.749722 17893 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.028s
I20260925 16:46:37.784096  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.797930  9117 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:37.753015 17781 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.777825 17934 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:37.775825 17909 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:37.746533 17872 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.775537 17864 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:37.789996  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.787744 17634 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:37.780189 17701 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:37.790881  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
W20260925 16:46:37.805464 17933 log.cc:924] Time spent T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.161s	user 0.000s	sys 0.001s
I20260925 16:46:37.805552 17719 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.833117  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.807163 17894 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.835425  8868 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 18, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 18 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:37.837289 17761 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:37.807785  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (TS 40a71744ceba4efe949720cb0f274853 not found in new config with opid_index 14) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:37.808212 17642 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.808553  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.837613  8868 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 21, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 21 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:37.811051 17625 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.832711 17932 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:37.856671 17764 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:37.856927 17932 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.857712 17625 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.765013 17707 consensus_queue.cc:260] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.858705 17707 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:37.859135  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87066.9us
I20260925 16:46:37.859529 17932 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.862460 17900 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.863559  8973 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:37.787796 17413 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.044s
I20260925 16:46:37.887327  8968 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:37.815613 17803 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:37.816183 17936 log.cc:924] Time spent T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
I20260925 16:46:37.769927 17910 consensus_queue.cc:237] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.816797 17666 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:46:37.817484 17753 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.000s
I20260925 16:46:37.785750 17804 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:37.823115  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.893679  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:37.821390  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.797421 17757 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:37.826887  9042 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260925 16:46:37.894519  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.895658  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.828696  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.828766  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 27 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:37.826335 17861 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:37.896731  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.817386 17893 raft_consensus.cc:3032] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Stepping down as leader of term 25
W20260925 16:46:37.806833 17928 log.cc:924] Time spent T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260925 16:46:37.810583  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:37.830600 17701 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:37.833407 17870 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:37.830440 17864 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:37.845331 17872 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.846379  9046 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:37.844941 17633 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:37.846820  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 140999us
I20260925 16:46:37.847244 17772 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:37.848639  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 122875us
I20260925 16:46:37.849220  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.813103 17852 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.865443  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:37.825497 17874 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.917342 17772 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.890561  8966 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260925 16:46:37.890452  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.896660  9042 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 17. (term mismatch)
I20260925 16:46:37.922473  9042 pending_rounds.cc:76] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Aborting all ops after (but not including) 16
I20260925 16:46:37.922731  9042 pending_rounds.cc:97] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: Aborting uncommitted NO_OP operation due to leader change: 22.17
I20260925 16:46:37.922953  9042 raft_consensus.cc:2866] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:37.923303 17852 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:37.924013  9695 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:37.924275  9042 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 31 index: 18. (index mismatch)
I20260925 16:46:37.926573  9043 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:37.927393  9698 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:37.927879 17625 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:37.911979 17944 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:46:37.834398 17939 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:37.930225 17939 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:37.930795 17939 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:37.899883  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.900228  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.932669 17770 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:37.901042  8972 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
W20260925 16:46:37.934207  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85069.6us
I20260925 16:46:37.935920 17754 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:37.796732 17797 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:37.906888  9123 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:37.904917  8868 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:37.938592  8868 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:37.940281  8862 maintenance_manager.cc:419] P ba21ddca249c4cf39e72526cc8696c60: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033396
I20260925 16:46:37.940567 17413 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:37.941277 17413 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.941792  8868 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 17 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:37.943298 17413 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:37.864265 17424 consensus_queue.cc:1159] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "225d3432101a4758bb9a6b0efeae09c5" responder_term: 18 status { last_received { term: 18 index: 14 } last_committed_idx: 14 last_received_current_leader { term: 18 index: 14 } }
I20260925 16:46:37.906849 17701 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:37.945045  8940 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:37.946142 17929 log.cc:924] Time spent T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260925 16:46:37.929119 17625 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260925 16:46:37.949252 17876 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:37.837318 17682 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:37.951009  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.952160  9700 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:37.953878 17682 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260925 16:46:37.888984 17942 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.091s
I20260925 16:46:37.935951  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:37.902768 17753 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.957477 17753 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:37.958022  8971 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:37.958815  8868 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:37.929797 17853 raft_consensus.cc:3032] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:37.933132 17770 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:37.955873 17852 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:37.966101  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:37.967401  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:37.903918 17893 raft_consensus.cc:729] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:37.979154  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.972389  9696 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:37.971302  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:37.980677  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:37.980674  8868 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 13 to 17. New cstate: current_term: 17 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:37.982643  8868 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:37.992443 17708 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Leader pre-election won for term 32
I20260925 16:46:37.994226  9047 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:37.995183  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:37.954718 17833 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:37.901958 17934 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:37.971676 17853 raft_consensus.cc:729] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:37.902092 17941 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.098s
I20260925 16:46:37.989362 17625 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:38.013494  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:38.014828  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.001827 17893 consensus_queue.cc:260] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:37.992867 17708 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:37.977526 17899 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:38.006340  8868 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 15 to 16, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:38.011390  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:37.990294 17852 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:37.998383 17741 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:37.996899 17932 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:38.025195  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:37.999048 17907 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.021768  9015 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:38.025895  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.033195  8868 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 12 to 20. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:37.993183 17819 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.034s
I20260925 16:46:38.033545  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:38.039942  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:38.043380  9696 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:38.020676 17942 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:38.020810 17708 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 31 FOLLOWER]: Advancing to term 32
I20260925 16:46:37.998498 17800 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.037s
I20260925 16:46:38.049618  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:38.050518  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:38.057235  9047 raft_consensus.cc:2354] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21.
I20260925 16:46:38.020417 17900 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:38.041949  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.059130  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:38.024479 17601 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:38.022876 17902 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260925 16:46:38.053820  8868 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 10 to 13, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 13 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:38.063300  8921 auto_rebalancer.cc:254] failed to send replica move request: Illegal state: Replica 8dc3391062084f45a6ba62d28d340722 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 24 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:38.066664  8940 leader_election.cc:398] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21.
I20260925 16:46:38.067281  8940 leader_election.cc:401] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260925 16:46:38.038303 17833 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:38.019016 17868 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260925 16:46:38.081282  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:38.083987 17872 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:38.084403 17872 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:38.084767 17872 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:38.088142  9702 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2489) took 2107 ms (client timeout 2180 ms). Trace:
W20260925 16:46:38.088544  9702 rpcz_store.cc:269] 0925 16:46:35.981011 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:35.981577 (+   566us) service_pool.cc:227] Handling call
0925 16:46:38.087944 (+2106367us) spinlock_profiling.cc:243] Waited 1.78 s on lock 0x7b5400691754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:38.088065 (+   121us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4098564864}
I20260925 16:46:38.089808  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:38.094370 17865 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:38.035260 17759 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
I20260925 16:46:38.041966 17781 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.047040 17942 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:38.102478 17942 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.080273 17745 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.024s
I20260925 16:46:38.103792 17942 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:38.104001 17947 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260925 16:46:38.053148 17853 consensus_queue.cc:260] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.106914  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:38.107517  9048 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:38.108857 17849 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:38.108803  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:38.109606  9697 raft_consensus.cc:1226] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:38.112048 17803 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.112962 17852 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.114069 17583 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.057284 17668 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:38.117121 17934 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:38.070629 17633 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.071393 17907 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:38.081243 17833 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:38.017921 17770 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.180070 17743 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:38.192353  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 83624.5us
I20260925 16:46:38.208859 17706 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:38.209965 17583 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:38.212795  9046 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:38.228163  9041 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:38.230206 17770 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:38.230883  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:38.230752 17583 consensus_queue.cc:1046] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:38.231379  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:38.231974 17800 raft_consensus.cc:3032] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:38.232345 17800 raft_consensus.cc:729] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:38.232630  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:38.233105 17800 consensus_queue.cc:260] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.234508  9119 raft_consensus.cc:1226] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:38.235532 17800 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:38.236331  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.242389 17803 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:38.242880 17803 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.245872 17803 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:38.245811  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:38.250597  9124 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 14. Current term is 15. Ops: []
I20260925 16:46:38.252729 17804 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.253849  9115 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:38.255457 17804 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:38.256306 17700 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:38.260263  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.260990  9116 raft_consensus.cc:3037] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:38.262956 17666 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:38.264405 17849 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Stepping down as leader of term 14
I20260925 16:46:38.264781 17849 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:38.212198 17833 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:38.267903  9014 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.269003  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:38.214008 17706 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:38.271123  9042 raft_consensus.cc:1226] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:38.266592 17701 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.277446  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:38.296859  9014 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:38.288590  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:38.302017 17726 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:38.302557 17726 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.283627 17865 consensus_queue.cc:1046] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 24.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:38.310981 17743 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.313621 17708 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.286981 17706 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:38.218986 17916 consensus_queue.cc:1159] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "8dc3391062084f45a6ba62d28d340722" responder_term: 20 status { last_received { term: 18 index: 14 } last_committed_idx: 14 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:38.317498  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:38.320266  9049 raft_consensus.cc:2379] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:38.287676 17849 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.215373 17836 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.284833 17907 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:38.281505 17633 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
W20260925 16:46:38.324512  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 300202us
I20260925 16:46:38.316828 17934 consensus_queue.cc:1046] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.007s
I20260925 16:46:38.335340  9116 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:38.335850  9047 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 31 FOLLOWER]: Advancing to term 32
I20260925 16:46:38.322907 17708 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 32 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:38.326470  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 310123us
I20260925 16:46:38.337598  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:38.338867  9045 raft_consensus.cc:1226] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 18. Current term is 19. Ops: []
W20260925 16:46:38.345921  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 57412.4us
I20260925 16:46:38.364573  9014 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:38.366462  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:38.366679  9047 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 32.
I20260925 16:46:38.354063  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:38.336594 17699 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:38.374419 17803 raft_consensus.cc:2741] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260925 16:46:38.387193 17726 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.393980  9050 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:38.403201  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.404937  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.407028  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 32 candidate_status { last_received { term: 29 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.430519 17864 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.433624  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:38.434232 17872 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.435509 17409 raft_consensus.cc:3032] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:38.435974  8973 raft_consensus.cc:1261] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:38.436123 17409 raft_consensus.cc:729] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:38.437091  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:38.437247 17409 consensus_queue.cc:260] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.437943  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:38.438266 17706 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.438691 17409 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:38.431551  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.434540  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:38.434244  8975 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:38.447147  9119 raft_consensus.cc:2354] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21.
I20260925 16:46:38.446565  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:38.372949 17934 raft_consensus.cc:2781] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:38.403105 17753 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:38.456342  8939 leader_election.cc:398] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21.
I20260925 16:46:38.457573 17902 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:38.462292 17836 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.468180  8940 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 32 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:38.469185  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.470862  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:38.469862  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 65156.2us
W20260925 16:46:38.472721  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 133270us
I20260925 16:46:38.368880 17952 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:38.496934  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 128869us
I20260925 16:46:38.498133  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:38.503805  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:38.505784  9693 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260925 16:46:38.499969  9015 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:38.471625 17642 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:38.480033 17876 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 FOLLOWER]: Leader election won for term 32
I20260925 16:46:38.488829 17944 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:38.488080 17868 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260925 16:46:38.508111 17808 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:38.478791 17934 raft_consensus.cc:686] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:38.529876 17952 raft_consensus.cc:2741] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election decision vote started in defunct term 23: won
I20260925 16:46:38.530144 17931 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:38.479111 17764 consensus_queue.cc:1035] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.053s
I20260925 16:46:38.566083  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.479835 17836 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.051s
I20260925 16:46:38.526311  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.535959 17706 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:38.491472 17781 consensus_queue.cc:1046] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 25.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.047s
W20260925 16:46:38.568725  8861 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.358s	user 0.004s	sys 0.005s
I20260925 16:46:38.721436 17864 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:38.722527 17872 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.525218  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:38.724186  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.724833 17788 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:46:38.716394 17757 consensus_meta.cc:287] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.809s	user 0.008s	sys 0.002s
I20260925 16:46:38.711727 17952 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:38.725458 17757 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.726029 17952 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.521176 17803 consensus_queue.cc:1046] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.025s
I20260925 16:46:38.728387 17944 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:38.724289  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 199214us
I20260925 16:46:38.727448 17757 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:38.729959  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:38.730940  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:38.731628 17803 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:38.732272 17803 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260925 16:46:38.732868  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:38.731508  9089 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.538803 17876 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:38.736415 17788 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260925 16:46:38.737277 17876 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 29.17, Last appended by leader: 17, Current term: 32, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.738562  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.739542 17788 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:38.739998 17788 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:38.740399 17788 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:38.728477 17952 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:38.741076  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 214866us
I20260925 16:46:38.741882  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.771111  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:38.774228  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:38.782485  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:38.769040 17741 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260925 16:46:38.743664 17761 consensus_meta.cc:287] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.906s	user 0.008s	sys 0.003s
W20260925 16:46:38.769482 17939 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.838s	user 0.000s	sys 0.010s
W20260925 16:46:38.790555  9048 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.023s	sys 0.036s
W20260925 16:46:38.797508  9048 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.553s	user 0.023s	sys 0.036s
I20260925 16:46:38.769390 17803 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:38.782002 17800 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:38.549417 17808 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.803201  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:46:38.777664 17944 ts_tablet_manager.cc:1905] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260925 16:46:38.804021  9117 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:38.800122 17730 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:38.812269 17952 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260925 16:46:38.849242 17761 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.005s
I20260925 16:46:38.803938 17741 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:38.810012 17941 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:38.799795 17726 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
W20260925 16:46:38.858064  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 366811us
I20260925 16:46:38.799953 17939 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.860327  9044 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
W20260925 16:46:38.913089  9041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 4267) took 1250 ms (client timeout 1610 ms). Trace:
W20260925 16:46:38.913645  9041 rpcz_store.cc:269] 0925 16:46:37.662389 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.665061 (+  2672us) service_pool.cc:227] Handling call
0925 16:46:38.912907 (+1247846us) spinlock_profiling.cc:243] Waited 417 ms on lock 0x7b54001afc54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:38.913030 (+   123us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":959865088}
I20260925 16:46:38.817858 17934 consensus_queue.cc:237] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:38.944792 17808 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:38.854882 17730 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.850654 17942 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.053s
I20260925 16:46:38.955533  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 1.014s	user 0.037s	sys 0.006s Metrics: {"bytes_written":5759,"delete_count":0,"lbm_write_time_us":739,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":140029,"threads_started":1,"update_count":216,"wal-append.queue_time_us":319441}
I20260925 16:46:38.957696  8862 maintenance_manager.cc:419] P ba21ddca249c4cf39e72526cc8696c60: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.302106
I20260925 16:46:38.811683 17803 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:38.983446  9122 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:38.983974  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:38.993966  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 185017us
W20260925 16:46:38.874049  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 343418us
W20260925 16:46:38.857709  9016 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.003s	sys 0.008s
W20260925 16:46:38.995347  9016 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.003s	sys 0.008s
I20260925 16:46:38.992807  9695 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:38.997313  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:38.909055  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1705) took 1491 ms. Trace:
I20260925 16:46:38.998306  9045 rpcz_store.cc:276] 0925 16:46:37.417327 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.577876 (+160549us) service_pool.cc:227] Handling call
0925 16:46:37.578182 (+   306us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:38.350225 (+772043us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:38.908780 (+558555us) spinlock_profiling.cc:243] Waited 760 ms on lock 0x7b540008e654. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:38.908981 (+   201us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1748883840}
I20260925 16:46:38.910697  9049 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:55054 (request call id 4269) took 1196 ms. Trace:
I20260925 16:46:38.999922  9049 rpcz_store.cc:276] 0925 16:46:37.714545 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.810348 (+ 95803us) service_pool.cc:227] Handling call
0925 16:46:38.910473 (+1100125us) spinlock_profiling.cc:243] Waited 416 ms on lock 0x7b54000dfa54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:38.910629 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":956280576}
I20260925 16:46:38.916828 17941 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:38.996397  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 769292us
I20260925 16:46:39.004410  9089 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:39.012648  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:39.015213  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 401361a5d37b4eefa49285e758f2f67b, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:39.013672  9123 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260925 16:46:39.019109  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:39.019963  9046 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 19
I20260925 16:46:39.007912 17849 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:38.975471 17753 consensus_queue.cc:1046] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260925 16:46:39.028892  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:39.029693  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:39.015270 17700 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.756s	user 0.010s	sys 0.000s
W20260925 16:46:39.037566  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 120701us
I20260925 16:46:39.027611 17696 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:39.019085 17781 consensus_queue.cc:1046] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.030s
I20260925 16:46:39.043015 17979 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:39.012068 17800 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.026s
I20260925 16:46:39.041414 17700 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 20. Current term is 21.
I20260925 16:46:39.035965 17952 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
W20260925 16:46:39.074610  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 70320.7us
W20260925 16:46:39.055925  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 149809us
I20260925 16:46:39.061071 17932 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260925 16:46:39.062168 17952 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:39.076931 17833 consensus_meta.cc:287] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.789s	user 0.007s	sys 0.003s
I20260925 16:46:39.084767 17952 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:39.097931 17979 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:39.098487 17979 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.100538 17979 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.074357 17700 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.016s
I20260925 16:46:39.090199 17833 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:39.055891 17941 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:39.111047 17833 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:39.205207 17962 log.cc:924] Time spent T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260925 16:46:39.206822 17984 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260925 16:46:39.091313 17939 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:39.215807 17960 log.cc:924] Time spent T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: Append to log took a long time: real 0.214s	user 0.002s	sys 0.000s
I20260925 16:46:39.093360 17852 consensus_queue.cc:1046] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.127s
I20260925 16:46:39.105657 17803 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.221484 17852 raft_consensus.cc:3032] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:39.221859 17852 raft_consensus.cc:729] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:39.260699 17952 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.263491 17952 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.317562  9048 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43114 (request call id 1715) took 1074 ms. Trace:
I20260925 16:46:39.222803 17852 consensus_queue.cc:260] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.323097 17852 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:39.338449 17764 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:39.339641 17764 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.352512  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.356642  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.357823  9693 raft_consensus.cc:2354] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19.
I20260925 16:46:39.358171  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:39.359709  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.360587  8966 raft_consensus.cc:3037] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:39.356820  9014 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.7.158.195:32851 timed out after 1.569s (SENT) [suppressed 15 similar messages]
I20260925 16:46:39.372184 17916 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.373087 17916 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.374405  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.375319  9699 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:39.378996  8972 raft_consensus.cc:1261] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 19. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:39.379436  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.380435  8967 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:39.379027  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.382050  8969 raft_consensus.cc:2379] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 25: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:39.349558 17764 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.392932  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4065) took 1944 ms. Trace:
I20260925 16:46:39.363806 17804 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:39.394289  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:39.397701  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:39.403365 17803 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:39.403951  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:39.404590 17803 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.406504  9016 leader_election.cc:398] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19.
I20260925 16:46:39.406903  9016 leader_election.cc:401] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:39.410782 17944 ts_tablet_manager.cc:1918] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 18.13
I20260925 16:46:39.414848 17944 log.cc:1196] T adae4a9dd16346529fe4ff004abc3603 P 40a71744ceba4efe949720cb0f274853: Deleting WAL directory at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/wals/adae4a9dd16346529fe4ff004abc3603
I20260925 16:46:39.399458  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:39.318790  9048 rpcz_store.cc:276] 0925 16:46:38.243235 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.243342 (+   107us) service_pool.cc:227] Handling call
0925 16:46:38.243630 (+   288us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:38.243827 (+   197us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:38.243850 (+    23us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:38.244301 (+   451us) log.cc:842] Serialized 26 byte log entry
0925 16:46:38.798006 (+553705us) raft_consensus.cc:1631] Marking committed up to 19
0925 16:46:39.051902 (+253896us) log.cc:842] Serialized 14 byte log entry
0925 16:46:39.054957 (+  3055us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:39.055358 (+   401us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:39.316550 (+261192us) raft_consensus.cc:1671] finished
0925 16:46:39.316642 (+    92us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:39.317143 (+   501us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":80727,"prepare.queue_time_us":160409,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":43,"raft.queue_time_us":19397,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":3720,"thread_start_us":646476,"threads_started":2,"wal-append.queue_time_us":715228}
I20260925 16:46:39.418184  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:39.420053  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 376997us
I20260925 16:46:39.401104  9118 rpcz_store.cc:276] 0925 16:46:37.448440 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.448631 (+   191us) service_pool.cc:227] Handling call
0925 16:46:37.528651 (+ 80020us) raft_consensus.cc:1457] Updating replica for 2 ops
0925 16:46:37.536101 (+  7450us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:37.536135 (+    34us) raft_consensus.cc:1525] Triggering prepare for 2 ops
0925 16:46:38.357252 (+821117us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18005794c0. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a1ea18b1 00007f71a1eae661 00007f7198fcff96 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a
0925 16:46:39.018524 (+661272us) spinlock_profiling.cc:243] Waited 2.5 ms on lock 0x7b2c000d80e8. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:39.042620 (+ 24096us) log.cc:842] Serialized 52 byte log entry
0925 16:46:39.329438 (+286818us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:39.330445 (+  1007us) log.cc:842] Serialized 14 byte log entry
0925 16:46:39.331090 (+   645us) log.cc:842] Serialized 14 byte log entry
0925 16:46:39.331324 (+   234us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:39.364140 (+ 32816us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:39.369196 (+  5056us) raft_consensus.cc:1671] finished
0925 16:46:39.369211 (+    15us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:39.392720 (+ 23509us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1645,"prepare.queue_time_us":56657,"prepare.run_cpu_time_us":91,"prepare.run_wall_time_us":92,"raft.queue_time_us":78467,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":2134,"spinlock_wait_cycles":35618304,"thread_start_us":253306,"threads_started":1,"wal-append.queue_time_us":152408}
I20260925 16:46:39.412734  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 4372) took 1182 ms. Trace:
I20260925 16:46:39.424513  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:39.423580  9122 rpcz_store.cc:276] 0925 16:46:38.230442 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.230638 (+   196us) service_pool.cc:227] Handling call
0925 16:46:39.412335 (+1181697us) spinlock_profiling.cc:243] Waited 752 ms on lock 0x7b54001c8c54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:39.412519 (+   184us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1729226624}
I20260925 16:46:39.430495 17934 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:39.431663 17907 raft_consensus.cc:3032] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:39.432130 17934 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260925 16:46:39.432261 17907 raft_consensus.cc:729] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:39.433773 17907 consensus_queue.cc:260] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:39.437393  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 80755.2us
I20260925 16:46:39.438078 17941 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.438725 17941 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:39.439805 17965 log.cc:924] Time spent T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.523s	user 0.014s	sys 0.030s
I20260925 16:46:39.441660 17941 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:39.442574  9117 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 26: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:39.390681 17916 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.446381  9042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4275) took 1162 ms. Trace:
I20260925 16:46:39.446907  9042 rpcz_store.cc:276] 0925 16:46:38.283526 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.285970 (+  2444us) service_pool.cc:227] Handling call
0925 16:46:38.286352 (+   382us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:38.296165 (+  9813us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:38.296193 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:38.307148 (+ 10955us) log.cc:842] Serialized 26 byte log entry
0925 16:46:38.563173 (+256025us) raft_consensus.cc:1631] Marking committed up to 12
0925 16:46:38.872957 (+309784us) log.cc:842] Serialized 14 byte log entry
0925 16:46:38.994795 (+121838us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:38.994871 (+    76us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:39.438829 (+443958us) spinlock_profiling.cc:243] Waited 43.6 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:39.445657 (+  6828us) raft_consensus.cc:1671] finished
0925 16:46:39.445858 (+   201us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:39.446172 (+   314us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":131007,"prepare.queue_time_us":394999,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":43,"raft.queue_time_us":154920,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":185,"spinlock_wait_cycles":100293504,"thread_start_us":232825,"threads_started":1,"wal-append.queue_time_us":498688}
I20260925 16:46:39.450871  9117 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:39.451956  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:39.452797  9693 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:39.454461 17917 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:39.455853 17804 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.456466 17804 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.458470 17804 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.458889 17701 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:39.460279 17963 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.651s	user 0.004s	sys 0.020s
I20260925 16:46:39.460659  9044 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:39.460893  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:39.462257  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2225) took 1207 ms. Trace:
W20260925 16:46:39.463025 17968 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.451s	user 0.016s	sys 0.013s
I20260925 16:46:39.462679  9124 rpcz_store.cc:276] 0925 16:46:38.254512 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.254609 (+    97us) service_pool.cc:227] Handling call
0925 16:46:38.254868 (+   259us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:38.255150 (+   282us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:38.255178 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:38.255624 (+   446us) log.cc:842] Serialized 26 byte log entry
0925 16:46:38.508800 (+253176us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:38.508842 (+    42us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:38.508910 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:39.459356 (+950446us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:39.461731 (+  2375us) raft_consensus.cc:1671] finished
0925 16:46:39.461752 (+    21us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:39.462085 (+   333us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":895,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":346057472,"thread_start_us":252641,"threads_started":1,"wal-append.queue_time_us":290713}
I20260925 16:46:39.467624 17804 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:39.477692 17669 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:39.478626 17669 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.510414  8966 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:39.544699 17669 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:39.551836 17788 consensus_meta.cc:287] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.787s	user 0.009s	sys 0.012s
I20260925 16:46:39.552331 17788 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:39.553306 17849 consensus_meta.cc:287] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.517s	user 0.008s	sys 0.009s
I20260925 16:46:39.554893 17788 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.560621  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:39.564891  9049 raft_consensus.cc:2354] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:39.565774  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:39.566756  9122 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:39.568401 17668 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:39.568795  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 162570us
I20260925 16:46:39.569120 17668 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:39.569816  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 58582.9us
I20260925 16:46:39.572131 17853 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:39.574152  9046 consensus_meta.cc:287] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.553s	user 0.000s	sys 0.015s
I20260925 16:46:39.571592 17668 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.541399 17907 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:39.593602  9693 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:39.541006 17803 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.602085  8970 raft_consensus.cc:1226] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:39.601197  8967 raft_consensus.cc:2454] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:39.608494  9049 raft_consensus.cc:1226] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
W20260925 16:46:39.609383  8973 consensus_meta.cc:287] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.547s	user 0.008s	sys 0.008s
I20260925 16:46:39.609845  8973 raft_consensus.cc:2454] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:39.610791  9044 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260925 16:46:39.612864 17944 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:43368 (request call id 11) took 2013 ms. Trace:
I20260925 16:46:39.593784  9046 raft_consensus.cc:2454] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:39.613262 17944 rpcz_store.cc:276] 0925 16:46:37.604105 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.705216 (+101111us) service_pool.cc:227] Handling call
0925 16:46:37.891640 (+186424us) ts_tablet_manager.cc:1145] Deleting tablet adae4a9dd16346529fe4ff004abc3603
0925 16:46:37.891849 (+   209us) ts_tablet_manager.cc:1065] Acquired tablet manager lock
0925 16:46:39.261364 (+1369515us) tablet_metadata.cc:641] Metadata flushed
0925 16:46:39.410151 (+148787us) tablet_metadata.cc:641] Metadata flushed
0925 16:46:39.612751 (+202600us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":296305,"tablet-delete.queue_time_us":53610,"thread_start_us":53869,"threads_started":1}
I20260925 16:46:39.621563  9122 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:39.607537  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.603089 17764 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:39.596246 17941 consensus_queue.cc:1046] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 24.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260925 16:46:39.621928 17934 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for earlier term 18. Current term is 19.
I20260925 16:46:39.702046  9697 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:46:39.630066  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:39.739663 17642 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:39.740710 17642 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:39.744959 17625 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:39.745703 17625 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.748020 17754 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:39.748826 17754 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.740720 17797 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.753440 17797 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.719944 17701 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.755813 17707 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.755671 17701 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.756717 17707 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.758270 17701 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.759359 17707 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:39.760056 17696 consensus_meta.cc:287] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.704s	user 0.006s	sys 0.007s
W20260925 16:46:39.760802  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50236.1us
I20260925 16:46:39.762655 17864 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:39.762418 17601 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:39.763044 17864 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:39.764086 17764 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.766721 17764 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:39.768101 18009 log.cc:924] Time spent T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260925 16:46:39.771920 17625 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.772531  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:39.775273  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.776062  9694 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:46:39.776873  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.777101  9700 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260925 16:46:39.780943 17424 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:39.783496  9014 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:39.801594  8968 raft_consensus.cc:3037] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:39.804268 17625 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.743592 17642 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.822762  9693 raft_consensus.cc:1226] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:39.839972 17880 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.840847 17880 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.807304 17755 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:39.848073 17754 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:39.848922  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 249450us
I20260925 16:46:39.849516  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.850768  9700 raft_consensus.cc:2396] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 28 because replica has last-logged OpId of term: 27 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 26 index: 20.
I20260925 16:46:39.859393  9042 raft_consensus.cc:1226] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
W20260925 16:46:39.862977 18004 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260925 16:46:39.860203  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:39.861888  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:39.860138  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:39.866715 17894 raft_consensus.cc:3032] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:39.867223 17894 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:39.843472 17880 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.852344  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:39.869650  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 86371.7us
I20260925 16:46:39.807427 17625 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.876319  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.877501 18002 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:39.877758  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.878350  8970 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 14 FOLLOWER]: Advancing to term 15
I20260925 16:46:39.878079 18002 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.878098  8975 raft_consensus.cc:1226] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260925 16:46:39.852692 17601 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.884459 17601 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.885865 18002 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.886133  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.881958  9117 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260925 16:46:39.884902  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.885432  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:39.888062  9116 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:39.892213  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:39.893018  9042 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:39.892225  8971 raft_consensus.cc:1226] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 19. Current term is 20. Ops: [18.11-19.12]
I20260925 16:46:39.892329  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:39.894979  9122 raft_consensus.cc:3037] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:39.855654 17701 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.896111 17701 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.898365 17701 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.898818 17754 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:39.899075  8968 raft_consensus.cc:2454] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:39.900292  9044 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:39.902002  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.903577  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.899338 17754 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.904247  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 16.
I20260925 16:46:39.902894  9124 raft_consensus.cc:2454] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:39.906042 17754 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.906584 17754 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:39.887724 17601 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.907601 17852 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:39.907331 17754 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.908066  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.908265 17852 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.909337 17707 raft_consensus.cc:2781] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:39.909562 17754 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.910243 17852 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:39.911041  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:39.911254 17701 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.911811  8966 raft_consensus.cc:2354] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:39.912541 17708 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:39.913874  8971 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:39.915171  8971 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 20: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:39.868710 17954 raft_consensus.cc:3032] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:39.899399 17625 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:39.910665  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:39.922789  8970 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 15.
I20260925 16:46:39.957827  9122 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:39.917359 17642 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:39.921236 17954 raft_consensus.cc:729] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:39.970609  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.972424  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.967242  9120 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:39.967293  8974 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:39.975497  8975 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 15. (term mismatch)
I20260925 16:46:39.868408 17894 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:39.951794 17707 raft_consensus.cc:686] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:39.976009  8975 pending_rounds.cc:76] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting all ops after (but not including) 14
I20260925 16:46:39.911800 17701 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:39.984710  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.985414  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:39.982739  8975 pending_rounds.cc:97] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: Aborting uncommitted NO_OP operation due to leader change: 19.15
I20260925 16:46:39.987330  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.987498  8975 raft_consensus.cc:2866] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:39.956359 17601 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:39.986817  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.981381  9124 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:39.992086  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:39.983474  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:39.994148  9702 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:40.004276 17759 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:40.005115 17759 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.008040 17948 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.008605 17948 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.009162  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.009671 17899 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.010193 17899 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:40.011301  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 245866us
I20260925 16:46:40.011979 17917 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:40.012519 17707 consensus_queue.cc:237] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.012959 17876 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260925 16:46:40.013464  9050 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:55054 (request call id 4281) took 1552 ms. Trace:
I20260925 16:46:40.014493 17601 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.016028 17819 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:40.016505 17819 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:40.016770 17601 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.017766 17819 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.026319  8968 raft_consensus.cc:1226] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:40.024042  9015 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:40.024492  9697 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1865) took 1747 ms (client timeout 1530 ms). Trace:
W20260925 16:46:40.031898  9697 rpcz_store.cc:269] 0925 16:46:38.277007 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.277152 (+   145us) service_pool.cc:227] Handling call
0925 16:46:40.024248 (+1747096us) spinlock_profiling.cc:243] Waited 1.27 s on lock 0x7b540068ae54. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:40.024396 (+   148us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2919398144}
I20260925 16:46:40.030784  9116 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:40.001188 17674 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.001786 17894 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:40.048218  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.054788  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.012547 17917 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.058373  9693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.013857  9050 rpcz_store.cc:276] 0925 16:46:38.461218 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.464912 (+  3694us) service_pool.cc:227] Handling call
0925 16:46:38.465211 (+   299us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:38.465733 (+   522us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:38.465766 (+    33us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:39.533614 (+1067848us) spinlock_profiling.cc:243] Waited 14.1 ms on lock 0x7b2c0000f228. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719a90de11 00007f719a91d442 00007f719bf65c11 00007f719bf2a58a 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772
0925 16:46:39.563803 (+ 30189us) log.cc:842] Serialized 26 byte log entry
0925 16:46:39.839545 (+275742us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:39.839580 (+    35us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:39.846597 (+  7017us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:40.013049 (+166452us) raft_consensus.cc:1671] finished
0925 16:46:40.013069 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:40.013289 (+   220us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":79,"raft.run_cpu_time_us":69,"raft.run_wall_time_us":70,"spinlock_wait_cycles":32505216,"thread_start_us":275243,"threads_started":1,"wal-append.queue_time_us":313242}
I20260925 16:46:40.019560 17819 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:40.023820 17708 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:40.024084 17668 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:40.059263  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.063853 18006 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:40.065008 18013 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
I20260925 16:46:40.065346  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.067902 17759 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.070482 17954 consensus_queue.cc:260] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.071364  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:40.071765  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 89380.3us
I20260925 16:46:40.071935  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.072988 17755 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:40.073379  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.062081 17917 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:40.108706  8967 raft_consensus.cc:2354] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:40.001609 17642 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.100862  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:40.017688 17601 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.127899 18015 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260925 16:46:40.128435 17601 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.130422 17601 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:40.131040  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 98237.8us
I20260925 16:46:40.093358  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
W20260925 16:46:40.110168  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 46830.5us
I20260925 16:46:40.110625  9116 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:40.111436 17754 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.112480  9697 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:40.116110  9666 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.116003 17708 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.116693 18007 consensus_queue.cc:1035] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 19, Time since last communication: 0.001s
I20260925 16:46:40.117486 17668 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.118191  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.118670 18006 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.120196 18017 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:40.176255  8972 raft_consensus.cc:1261] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260925 16:46:40.120533 17701 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.121534 17954 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:40.127435  8973 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50010 (request call id 3661) took 1693 ms (client timeout 1838 ms). Trace:
I20260925 16:46:40.130630 17730 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.136801  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.056753 18016 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.170553  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.176559  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:40.183149  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 121477us
W20260925 16:46:40.183096  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67242.3us
W20260925 16:46:40.179934  8973 rpcz_store.cc:269] 0925 16:46:38.433788 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.436892 (+  3104us) service_pool.cc:227] Handling call
0925 16:46:40.127193 (+1690301us) spinlock_profiling.cc:243] Waited 625 ms on lock 0x7b54001b3354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:40.127349 (+   156us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1437103872}
W20260925 16:46:40.185480  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 71595.5us
I20260925 16:46:40.167234 17876 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260925 16:46:40.187608  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50879.6us
I20260925 16:46:40.067842 17674 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:40.189087 17853 consensus_meta.cc:287] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.616s	user 0.010s	sys 0.002s
I20260925 16:46:40.189433 18010 raft_consensus.cc:2781] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election won for term 19
I20260925 16:46:40.190138 17708 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.190073 17754 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.187846  9700 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:40.180076 17547 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:40.205417  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.190891 17668 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.205021 17547 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:40.210294 17547 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:40.210824 18018 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:40.211241 18018 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.211519 17917 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.213671 17917 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.215920 17754 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.217257 17980 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.218351  9016 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.218009 17980 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.191862 17876 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.193871 17730 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:40.249928 17730 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.250481 17730 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:40.250946  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.251674 17547 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.252864 18017 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.254992 18017 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.255949  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.256117  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.256618 17754 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:40.256858  8939 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.226568 17601 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:40.258176 17601 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.259086  9015 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:40.256897  8973 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 26: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:40.260959  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.267457  9042 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:40.260272 17601 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:40.271518  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 66176.2us
I20260925 16:46:40.279270  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.279373  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.225137 17876 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:40.211560 18018 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:40.219666 17642 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.287671  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.286280  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:40.290139  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.294586 17730 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.265411 17547 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.304843 17547 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:40.305264 17980 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.305723  9700 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:40.305352 17547 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.306561 18006 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.307263  9046 raft_consensus.cc:2454] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:40.308624  9016 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.310453 18025 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.310988 18025 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.311790  9701 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:40.307541 17547 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.315100 17674 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.315369 18025 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.316442 17972 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.316928 17972 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.318337 18034 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:40.296897  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75186.6us
I20260925 16:46:40.298605 17932 raft_consensus.cc:2781] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:40.300110 17787 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:40.282066 17934 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:40.210299 18016 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.303834 17902 raft_consensus.cc:2781] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:40.325852  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:40.329772  9014 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:40.285557 18010 raft_consensus.cc:686] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:40.318917 18034 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.320386 17894 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:40.325261 17787 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.329274 17902 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:40.329066 17980 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.332050 17642 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
W20260925 16:46:40.340976  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 135376us
I20260925 16:46:40.332407 17932 raft_consensus.cc:686] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:40.345234 17669 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:40.336567 17894 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.354832 18016 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.348665 17730 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.349254  9047 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 29 index: 17. Preceding OpId from leader: term: 32 index: 18. (index mismatch)
I20260925 16:46:40.356660  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.339659 17787 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:40.354077 17893 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:40.351436 17902 raft_consensus.cc:3037] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:40.364070 17601 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.364728 17601 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.366536  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.366710 17601 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.367129  9697 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:40.367259  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.367832  9694 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:40.356544 17931 raft_consensus.cc:2781] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:40.357048 17980 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.349743 17972 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:40.368024  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 797334us
I20260925 16:46:40.328071 18017 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260925 16:46:40.346694  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.359627 17894 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:40.360916  9699 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:40.355068 17932 consensus_queue.cc:237] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.377627  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.351847 17642 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:40.396049  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.402617  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.403060  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.410120  8968 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:40.413120  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.414191  8966 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.415287  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.429991  8973 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
I20260925 16:46:40.397293 17642 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:40.418300  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.433740 17876 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:40.434851  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 49c7db4b3fda45159275230bc247b929, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:40.435242  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 49c7db4b3fda45159275230bc247b929, TS 8dc3391062084f45a6ba62d28d340722 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.419288  9702 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: []
I20260925 16:46:40.440019  8966 raft_consensus.cc:2379] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:40.440392  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.440056  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.422214 18018 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.398772  9046 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:40.422945 17899 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.397889 17601 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:40.426227  9047 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 31. Current term is 32. Ops: [31.18-31.18]
I20260925 16:46:40.063933  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:40.483250  9120 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45954 (request call id 4363) took 2873 ms (client timeout 1569 ms). Trace:
I20260925 16:46:40.443156  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:40.441901  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.442050  8970 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
W20260925 16:46:40.471906  8974 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:49998 (request call id 2799) took 3128 ms (client timeout 1826 ms). Trace:
W20260925 16:46:40.459089  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 72294.7us
I20260925 16:46:40.450336  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42240 (request call id 1874) took 1006 ms. Trace:
W20260925 16:46:40.512303  9120 rpcz_store.cc:269] 0925 16:46:37.609855 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.609973 (+   118us) service_pool.cc:227] Handling call
0925 16:46:40.482950 (+2872977us) spinlock_profiling.cc:243] Waited 2.1 s on lock 0x7b5400166054. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:40.483131 (+   181us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4826511104}
W20260925 16:46:40.514312  8974 rpcz_store.cc:269] 0925 16:46:37.343822 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:37.343951 (+   129us) service_pool.cc:227] Handling call
0925 16:46:40.471599 (+3127648us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b54003566d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:40.471806 (+   207us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":5643568896}
I20260925 16:46:40.450907 18016 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:40.518407 18016 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.519269 18025 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.519936 18025 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:40.481514  9701 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42240 (request call id 1868) took 1751 ms (client timeout 1739 ms). Trace:
W20260925 16:46:40.522385  9701 rpcz_store.cc:269] 0925 16:46:38.730533 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:38.730671 (+   138us) service_pool.cc:227] Handling call
0925 16:46:40.481268 (+1750597us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540062e154. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:40.481438 (+   170us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":3383068032}
I20260925 16:46:40.515770  9695 rpcz_store.cc:276] 0925 16:46:39.443514 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:39.447498 (+  3984us) service_pool.cc:227] Handling call
0925 16:46:40.449642 (+1002144us) spinlock_profiling.cc:243] Waited 23.8 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ebc79b 00007f71a0ebc821 00007f71a0e802b0 00007f71a0e6b7f9 00007f71a0e6b2a2 00007f719a551684
0925 16:46:40.449835 (+   193us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:40.449999 (+   164us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:40.450023 (+    24us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:40.450059 (+    36us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:40.450135 (+    76us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:40.450187 (+    52us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:40.450273 (+    86us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":54816128}
I20260925 16:46:40.524659  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.529469  8971 raft_consensus.cc:1226] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 LEADER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 31. Current term is 32. Ops: [31.18-31.18]
W20260925 16:46:40.532943  8858 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 469151us
W20260925 16:46:40.531258  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 131468us
I20260925 16:46:40.462455 17864 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.536033  8967 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.536625 17864 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:40.537711  8975 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.538345  8975 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:40.535717  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:40.459345 18017 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:40.551187  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.546484  8970 raft_consensus.cc:2396] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:40.546698  8968 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.529038  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:40.553459  9047 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:40.443468 18034 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:40.555984  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.550468  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.451061 17931 raft_consensus.cc:686] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:40.561766  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.457064 17797 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:40.489289 17948 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.520540 18016 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.446902 17980 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:40.561408  9694 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:40.562418  8974 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:40.563217  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.567384  8972 raft_consensus.cc:2379] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 17: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:40.568424  8973 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.569332  8970 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.572780  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5"
I20260925 16:46:40.564914  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:40.574452  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.568992  9045 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:40.576000  8973 raft_consensus.cc:2379] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 225d3432101a4758bb9a6b0efeae09c5 in this term.
I20260925 16:46:40.573218  8970 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:40.550397 18017 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.468055 17902 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.482211 17787 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.584884  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.533684 17894 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.552443 17601 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.589238  9666 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.590085  9120 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 15: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:40.588114  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:40.596956  8968 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 19.
I20260925 16:46:40.582079 17804 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.588452  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.575560 17907 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.592308  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:40.590372  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 23 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.581481 18017 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:40.582659 17980 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:40.599187  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.594126 17893 consensus_queue.cc:1035] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.009s
I20260925 16:46:40.601500 17971 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:40.603881 17971 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.604290 17971 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:40.612155 17719 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:40.613731 17601 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.618036 17910 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.636740  8974 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.619112 17942 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.652498  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.621932  9089 leader_election.cc:398] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:40.653275  9696 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:40.624007 18025 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.585891 17876 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.626571  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.442368 18010 consensus_queue.cc:237] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.627440  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.628253  9116 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260925 16:46:40.608613 17583 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.630674  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.631464  9047 raft_consensus.cc:2454] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:40.627866 18038 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:40.621755 18018 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.634757  8969 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.662796  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:40.636973  9117 raft_consensus.cc:2396] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 28 because replica has last-logged OpId of term: 27 index: 21, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 19.
I20260925 16:46:40.619858  9050 raft_consensus.cc:1226] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:40.637392  8974 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:40.651995  9045 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:43114 (request call id 1725) took 1196 ms. Trace:
I20260925 16:46:40.620862 17894 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.653326  9089 leader_election.cc:401] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260925 16:46:40.622087  8972 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "225d3432101a4758bb9a6b0efeae09c5" is_pre_election: true
I20260925 16:46:40.652284  9124 raft_consensus.cc:3032] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 LEADER]: Stepping down as leader of term 31
I20260925 16:46:40.668107  9124 raft_consensus.cc:729] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:40.664552  9045 rpcz_store.cc:276] 0925 16:46:39.437384 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:39.460521 (+ 23137us) service_pool.cc:227] Handling call
0925 16:46:40.633929 (+1173408us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54002512d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:40.634023 (+    94us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2546731392}
I20260925 16:46:40.663206  8969 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
W20260925 16:46:40.667510  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 78778.3us
I20260925 16:46:40.671535  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:40.660586 18004 log.cc:924] Time spent T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:46:40.655529 17980 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.682292  9116 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:40.674607  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:40.682195  9042 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:40.688937  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.689160  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.629364 17907 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.690158  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:40.692224  9123 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:40.692128 18038 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.694415 18038 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:40.696632 18032 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.101s	user 0.000s	sys 0.001s
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:435: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 6
I20260925 16:46:40.700502  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
I20260925 16:46:40.634027 17804 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.702781 17804 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:40.705508 18036 consensus_queue.cc:1046] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 28.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260925 16:46:40.705991  8941 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.707204 18036 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:40.708882  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.709896 17979 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:40.709363 18036 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:40.711254 17902 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.712890 17931 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.713340 18036 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.715231  9120 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 23 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:40.674383 17759 raft_consensus.cc:2781] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:40.718395 17759 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:40.718714  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.718914  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.719599  9042 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:40.711254 17787 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.720753 17625 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:40.721521  9042 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:40.719466  9044 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:40.670063 17583 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.723855 17601 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.666658 17642 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.709641  9115 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:40.725356  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.725817 17642 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:40.726446  9046 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:40.726555  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.727306  9115 raft_consensus.cc:2379] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:40.729053  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.688283  9124 consensus_queue.cc:260] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 31.18, Last appended by leader: 18, Current term: 31, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:40.709601  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 87861.3us
I20260925 16:46:40.718773 17759 raft_consensus.cc:3037] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:40.730003  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.748073  8940 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:40.733708  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.733847  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.708266  9123 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:40.691485 17980 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.676122 17942 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.735642  8939 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.736589  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.762012  9695 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:40.756368  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 82423.4us
I20260925 16:46:40.739979  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:40.737381  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:40.762995  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 505ce6aba0e14faabdb5e6135e200af6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:40.736542  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.750010  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.756333  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:40.756650  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:40.661496 17910 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.749224  9696 raft_consensus.cc:2454] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:40.761880  9049 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:40.769593  9016 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.772462  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.774391  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:40.774610  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.775995  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.777222  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.780812  9124 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 31 FOLLOWER]: Advancing to term 32
I20260925 16:46:40.783175  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:40.783425  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:40.784067  9118 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:40.784242  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.784551  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.785943  8939 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:40.784572  9048 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:40.771056 18034 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:40.793430  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.790102 17743 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:40.771250 18025 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260925 16:46:40.800869  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.810410  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.811717  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.813524  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.808552  9122 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:40.788858 18007 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:40.788691 17642 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:40.793637 17625 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:40.819564  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:40.818523  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55686.4us
I20260925 16:46:40.824942  9123 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:40.797935 17845 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:40.801739 17743 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.876151  9117 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:40.876241  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.876996  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.815181 17325 consensus_queue.cc:1046] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 26.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.014s
I20260925 16:46:40.877349  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.896185  9122 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:40.828663 17845 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.896391  9090 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.806856 17797 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:40.814848 17583 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.827409 17625 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:40.829671 17642 raft_consensus.cc:686] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
W20260925 16:46:40.890018 18013 log.cc:924] Time spent T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:40.806725 17971 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.895159 17755 raft_consensus.cc:2781] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:40.889652 17601 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.899569 17845 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:40.953846  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 45167us
I20260925 16:46:40.954715  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.908432 17625 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:40.947072  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.898272 18034 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260925 16:46:40.959220  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 83078.4us
I20260925 16:46:40.914137 17583 raft_consensus.cc:2741] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260925 16:46:40.911489 17797 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:40.912678 17743 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:40.958458  9089 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:40.964157 17726 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.947073 17668 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:40.962946  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53420.1us
I20260925 16:46:40.967239  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:40.961824  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.920643 18046 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:40.971031  9702 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:40.967847  9090 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:40.952049 17755 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:40.962198 17980 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:40.980958  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 245662us
W20260925 16:46:40.987128  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 206623us
I20260925 16:46:40.989717  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.907207 17979 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260925 16:46:40.969355 18034 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:40.999513  9118 raft_consensus.cc:2454] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:40.993111  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:40.983294 17917 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:40.983690 18044 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:40.994848  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.000314 17761 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:41.001154 17726 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.003391 17907 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:40.972983 17797 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:41.036864  9015 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.004182 18045 consensus_queue.cc:1046] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.206s
I20260925 16:46:41.011104 17803 raft_consensus.cc:3032] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:41.012575  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.013921 17971 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.014988  8967 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: [20.15-20.15]
I20260925 16:46:41.016510 17764 raft_consensus.cc:3032] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:41.017818  9702 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:41.019506 17910 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:40.979240 18007 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:41.021238  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.021986  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.021682 18017 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:40.957782 17700 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:41.028047  9047 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
I20260925 16:46:41.029261  9116 raft_consensus.cc:1226] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:41.027501  9122 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:41.035355  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.033888  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.040570  9124 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 31 index: 18. Preceding OpId from leader: term: 32 index: 18. (term mismatch)
I20260925 16:46:41.043900  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:40.992199 17755 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:40.962023 17601 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.058014  9124 pending_rounds.cc:76] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 17
I20260925 16:46:41.044901  9694 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:41.064455  9124 pending_rounds.cc:97] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 31.18
I20260925 16:46:41.046756  9123 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:41.052212  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.033128 18034 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:41.033321 17917 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.042078 17583 raft_consensus.cc:2781] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:41.061427 17642 consensus_queue.cc:237] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.049168 18007 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.063863  9120 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 15.
W20260925 16:46:41.080469  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 114834us
I20260925 16:46:41.088133  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.080650  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.044461 17899 raft_consensus.cc:3032] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Stepping down as leader of term 28
I20260925 16:46:41.044520 17803 raft_consensus.cc:729] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:41.084131  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 91484us
I20260925 16:46:41.048683 17764 raft_consensus.cc:729] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:41.064782  9044 raft_consensus.cc:2354] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:41.096572  9700 raft_consensus.cc:1226] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: []
I20260925 16:46:41.091744  9047 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:41.098276  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.093997  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.060915 18046 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.047993 17907 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:41.087057 17917 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:41.092855  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.064827  9124 raft_consensus.cc:2866] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:41.111773  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.061586 17942 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.116201  9665 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.119006  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.127394  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.128121  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.042460 17761 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.087792 17876 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.090034 17899 raft_consensus.cc:729] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:41.131444  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.089738 18007 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 16
W20260925 16:46:41.133342  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 89854.1us
I20260925 16:46:41.132880  9122 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:41.138998  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.139808 17718 consensus_queue.cc:1046] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 27.19, Next index: 20, Last known committed idx: 19, Time since last communication: 0.050s
I20260925 16:46:41.140115 17970 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:41.140625 17726 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.140848 17939 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.026572 17668 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.102187 17787 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:41.200050 17787 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.200510 17787 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.192598 17971 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:41.141574 17803 consensus_queue.cc:260] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.124532 17988 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:41.132781 17934 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:41.205900 17803 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:41.189422  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 166240us
I20260925 16:46:41.208595  9089 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.210165 17942 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:41.210330  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.125197 18036 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.211966 18036 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.214051 17718 raft_consensus.cc:3032] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Stepping down as leader of term 27
I20260925 16:46:41.214164 18036 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.193094 17970 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.215524 17970 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:41.211319 17979 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:41.210848 17942 consensus_queue.cc:1046] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260925 16:46:41.214526 17718 raft_consensus.cc:729] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.218338 17718 consensus_queue.cc:260] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.219851 17718 raft_consensus.cc:3037] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:41.139451 17876 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.220335 18046 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.222836 17764 consensus_queue.cc:260] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.223400 18023 consensus_queue.cc:1046] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260925 16:46:41.224191 17764 raft_consensus.cc:3037] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.225535 17601 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.133810 17864 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:41.191073  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.130371 17583 raft_consensus.cc:686] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.097517 18044 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.197628 17939 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:41.197575 17953 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.106s
I20260925 16:46:41.198402 17666 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:41.199586 17668 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.186370  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.227780  9089 leader_election.cc:398] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:41.239348  9089 leader_election.cc:401] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Cancelling election due to peer responding with higher term
W20260925 16:46:41.194957  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 56101.5us
I20260925 16:46:41.240489  9014 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:41.242164 17601 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:41.242642 17601 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.243021  9122 raft_consensus.cc:1261] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:41.243542 17601 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 23.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.195875  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62873us
I20260925 16:46:41.228057  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:41.192902  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 53549us
I20260925 16:46:41.189071 17836 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:41.233990 17939 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.249404  9665 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.251048  9665 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.245599 17934 consensus_queue.cc:1035] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:41.247859  9702 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:41.243335 17797 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.255861  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 367513us
I20260925 16:46:41.260957 17759 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:41.262473  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50849.5us
I20260925 16:46:41.263087 17804 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader election lost for term 21. Reason: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22.
I20260925 16:46:41.235208 17876 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.264544 18007 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.248548  9121 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:41.272090 17583 consensus_queue.cc:237] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.340099 17952 raft_consensus.cc:3032] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:41.348237 18002 raft_consensus.cc:2781] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:41.316285 17911 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:41.348944 18002 raft_consensus.cc:686] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:41.312611  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.242807 18045 consensus_queue.cc:1046] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260925 16:46:41.349881 18002 consensus_queue.cc:237] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.348546 17952 raft_consensus.cc:729] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.292341 18017 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.298190 17666 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:41.351372 17952 consensus_queue.cc:260] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.349197 17911 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.352913 17952 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:41.295975 17899 consensus_queue.cc:260] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.354905 17899 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:41.354807  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.355276  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.355741 17911 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.356148 18017 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.356312  9700 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:41.356590 18017 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.315145  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.357450  9694 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:41.252193 18023 raft_consensus.cc:3032] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:41.358462 18023 raft_consensus.cc:729] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:41.358868 18007 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071)
I20260925 16:46:41.359201 18023 consensus_queue.cc:260] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.359350 17880 consensus_queue.cc:1159] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" responder_term: 29 status { last_received { term: 28 index: 20 } last_committed_idx: 20 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 28. Current term is 29. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260925 16:46:41.360711 18023 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.351863 18045 raft_consensus.cc:3032] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:41.361292 18045 raft_consensus.cc:729] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.314306  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:41.363023  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 112082us
I20260925 16:46:41.364144  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.357007 18017 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:41.192727 17701 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:41.273124 17787 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.364001  9124 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 18.
W20260925 16:46:41.376650  9695 consensus_meta.cc:287] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.610s	user 0.010s	sys 0.000s
I20260925 16:46:41.252928  9048 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:41.380687  9016 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.378928  9120 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:41.386456  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:41.384542  9695 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:41.392249  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.297638 18044 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.410176 17759 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.416186  9089 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:41.420684 17797 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.334787 17788 raft_consensus.cc:3032] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Stepping down as leader of term 19
I20260925 16:46:41.421343 17788 raft_consensus.cc:729] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.422168 17788 consensus_queue.cc:260] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.432569 17761 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.284459 17743 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.440889 17743 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.383675 18045 consensus_queue.cc:260] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.442762 18045 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:41.444149 17755 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.313730 17971 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.397646  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.381244 17980 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260925 16:46:41.452064  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54490.7us
I20260925 16:46:41.388880 17910 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:41.366834 18034 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.399281 17911 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.464682  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.300755 17845 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.463205  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47106.7us
I20260925 16:46:41.449620 17788 raft_consensus.cc:3037] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.471987  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.450335 17757 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:41.473424  9696 raft_consensus.cc:2354] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:46:41.449514 17755 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.486089  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.495947  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.498030  9694 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:41.498031  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.499169  9701 raft_consensus.cc:2354] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:41.499457  9700 raft_consensus.cc:1226] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:41.499504  9698 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 22: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:41.460676 17931 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.636s	user 0.026s	sys 0.059s
I20260925 16:46:41.457419 17325 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.464977 17911 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.472246 17804 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Leader election won for term 15
I20260925 16:46:41.485651 17880 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:41.502594 17931 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.026s	sys 0.059s
I20260925 16:46:41.454823 17971 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.514487  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.518685  9696 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:41.499796 17757 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.507076 17325 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.523742  9090 leader_election.cc:398] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 15 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16.
I20260925 16:46:41.508338 17911 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.528316  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.528755  8941 leader_election.cc:398] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:41.529209  8941 leader_election.cc:401] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:46:41.526227  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.531800  9700 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:41.510540 17917 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.538995  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.539750  9696 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.528331 17325 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.522378 17804 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:41.535326 17787 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.560534 17845 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:41.560418 17804 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.561486 18034 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:41.564479 17625 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.588s	user 0.009s	sys 0.000s
I20260925 16:46:41.565042 17787 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:41.565619 17787 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.566439 17666 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:41.544215 17970 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.545207  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:41.568325  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:41.561705  9696 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:41.569937  9016 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.549129 17907 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:41.516963 17880 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.576406 17880 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.537616 17988 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:41.578183 17988 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.578559 17988 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:41.551862 17759 consensus_queue.cc:1046] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:41.535778 17743 raft_consensus.cc:3037] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:41.580119  9120 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:41.579931  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.555243 18017 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.592022  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:41.592792  9700 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:41.594385  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:41.590878  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 457722us
I20260925 16:46:41.580499 17931 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:41.595734  9014 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.596669 17700 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260925 16:46:41.590149  9119 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.010s	sys 0.022s
W20260925 16:46:41.599409  9119 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.868s	user 0.010s	sys 0.022s
W20260925 16:46:41.599789  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 98862.4us
I20260925 16:46:41.603717  9089 leader_election.cc:398] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Vote denied by peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071) with higher term. Message: Invalid argument: T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.604418  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.564925 17625 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.601569 17759 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:41.599174 17907 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:41.579089 17787 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.616559 17682 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.602792 17931 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:41.596817 17757 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.620486  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.612358 17759 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.633683  9700 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:41.615902 17880 raft_consensus.cc:3032] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:41.634779  9089 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.612658 17917 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:41.630836  9666 thread.cc:636] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.027s	sys 0.010s
W20260925 16:46:41.638757  9666 thread.cc:602] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.513s	user 0.027s	sys 0.010s
W20260925 16:46:41.636384  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 500993us
W20260925 16:46:41.639086  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 553151us
I20260925 16:46:41.596362 17939 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.644227  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.635808 17759 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:41.651811  9118 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.572s	user 0.006s	sys 0.037s
I20260925 16:46:41.652712  9123 raft_consensus.cc:3037] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:41.636617 17880 raft_consensus.cc:729] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:41.652987  9118 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.573s	user 0.006s	sys 0.037s
I20260925 16:46:41.649883 18046 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:41.655435  8868 catalog_manager.cc:5042] ChangeConfig:REMOVE_PEER RPC for tablet adae4a9dd16346529fe4ff004abc3603 with cas_config_opid_index 4: aborting the task: latest config opid_index 14; task opid_index 4
I20260925 16:46:41.676517  9123 raft_consensus.cc:2454] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:41.680338  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.686105  9050 raft_consensus.cc:1261] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260925 16:46:41.682309  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.684268  8940 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.687747  9042 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:41.688330  9048 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:41.687644  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.690012  9044 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:41.653322 17601 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:41.653527 17917 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.654187 17876 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.674407 17668 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:41.698621  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 63967.2us
I20260925 16:46:41.679352 17971 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:41.704680  9666 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.729372  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.653363 18002 consensus_queue.cc:1046] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260925 16:46:41.731361  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.739107  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.643612 17931 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.708082 17700 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:41.754714  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.694280  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:41.764304  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:41.710538 17876 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.730762 18017 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.738200 17910 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:41.777453 17876 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:41.766920 17718 consensus_meta.cc:287] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: Time spent flushing consensus metadata: real 0.544s	user 0.009s	sys 0.001s
I20260925 16:46:41.741283 18007 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:41.790532  9700 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260925 16:46:41.791517  9116 raft_consensus.cc:1261] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 20 index: 12. (term mismatch)
I20260925 16:46:41.729868 17917 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.764329 17971 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:41.728628 17668 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.809859  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.791975  9116 pending_rounds.cc:76] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 11
I20260925 16:46:41.811450  9116 pending_rounds.cc:97] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 19.12
I20260925 16:46:41.811803  9116 raft_consensus.cc:2866] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:41.710748 17601 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:41.788509 17803 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:41.807673  9118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2246) took 1092 ms. Trace:
I20260925 16:46:41.772723 17907 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.751658 17880 consensus_queue.cc:260] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:41.791255 18059 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260925 16:46:41.783581 17325 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.828246  9696 raft_consensus.cc:1261] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:41.878254  9665 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:41.842644  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.930231  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.930651  9701 raft_consensus.cc:2354] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.928941  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:41.932879  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 54740us
W20260925 16:46:41.857003  8861 tablet_replica.cc:1402] Time spent flushing the Log queue took a long time: real 0.510s	user 0.004s	sys 0.017s
I20260925 16:46:41.827798  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:41.853274  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:41.832315  8868 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 342) took 48971 ms (client timeout 15000 ms). Trace:
W20260925 16:46:41.798118  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 103955us
I20260925 16:46:41.950381  9042 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
W20260925 16:46:41.900136 17583 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.032s	sys 0.041s
I20260925 16:46:41.965798  9090 leader_election.cc:398] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.966269  9043 raft_consensus.cc:2354] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:41.798195 17902 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:41.775215 17911 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:41.974414  9089 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:41.827798 17409 raft_consensus.cc:2741] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260925 16:46:41.969656  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:41.850199 17917 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.971237  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.971956  9090 leader_election.cc:401] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260925 16:46:41.981287  9700 raft_consensus.cc:2354] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26.
I20260925 16:46:41.981534  9048 raft_consensus.cc:2379] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:41.972311  9050 raft_consensus.cc:1226] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:41.805203 17682 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.975561  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.976629  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.815351 17803 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.970497  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.985759  8941 leader_election.cc:398] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26.
I20260925 16:46:41.986063  8941 leader_election.cc:401] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260925 16:46:41.806849 17970 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:41.820191 17788 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:41.848645 17625 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.876912 17718 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.933740 17743 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 19. Current term is 20.
I20260925 16:46:41.798547 17971 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:41.965975 17761 raft_consensus.cc:2781] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:41.980332 17932 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:41.830364 17934 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:41.832080 17939 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:41.990655  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:41.936754 18017 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:41.976225 17583 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 0.610s	user 0.037s	sys 0.044s
I20260925 16:46:41.986791  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:41.966382 17952 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:41.830633 17836 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.154s
I20260925 16:46:41.974097 18045 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:41.815479  9118 rpcz_store.cc:276] 0925 16:46:40.715024 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:41.040845 (+325821us) service_pool.cc:227] Handling call
0925 16:46:41.043003 (+  2158us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:41.048130 (+  5127us) raft_consensus.cc:1520] Early marking committed up to index 21
0925 16:46:41.654326 (+606196us) log.cc:842] Serialized 14 byte log entry
0925 16:46:41.806097 (+151771us) raft_consensus.cc:1525] Triggering prepare for 0 ops
0925 16:46:41.806461 (+   364us) raft_consensus.cc:1631] Marking committed up to 21
0925 16:46:41.806668 (+   207us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:41.806980 (+   312us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:41.807456 (+   476us) inbound_call.cc:173] Queueing success response
Metrics: {"prepare.queue_time_us":735708,"raft.queue_time_us":18442,"thread_start_us":715451,"threads_started":2}
I20260925 16:46:42.021154  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:41.985949 17682 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:41.957592  8868 rpcz_store.cc:269] 0925 16:45:52.861307 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:52.861527 (+   220us) service_pool.cc:227] Handling call
0925 16:46:41.832181 (+48970654us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:38.858993 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:38.956351 (+ 97358us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:38.956385 (+    34us) write_op.cc:435] Acquired schema lock
0925 16:46:38.956400 (+    15us) tablet.cc:660] Decoding operations
0925 16:46:38.957342 (+   942us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:38.957428 (+    86us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:38.957454 (+    26us) tablet.cc:683] Acquiring locks for 11 operations
0925 16:46:38.958374 (+   920us) tablet.cc:699] Row locks acquired
0925 16:46:38.958402 (+    28us) write_op.cc:260] PREPARE: finished
0925 16:46:38.958550 (+   148us) write_op.cc:270] Start()
0925 16:46:38.958682 (+   132us) write_op.cc:276] Timestamp: P: 1790354798958511 usec, L: 0
0925 16:46:38.958706 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:46:38.961900 (+  3194us) log.cc:842] Serialized 4382 byte log entry
0925 16:46:39.264625 (+302725us) op_driver.cc:444] REPLICATION: finished
0925 16:46:39.272783 (+  8158us) write_op.cc:301] APPLY: starting
0925 16:46:39.272888 (+   105us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:39.282549 (+  9661us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:39.282660 (+   111us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:39.865469 (+582809us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:39.866004 (+   535us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=44,mrs_lookups=0
0925 16:46:39.866065 (+    61us) write_op.cc:312] APPLY: finished
0925 16:46:39.866709 (+   644us) log.cc:842] Serialized 105 byte log entry
0925 16:46:39.866945 (+   236us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:39.892928 (+ 25983us) write_op.cc:454] Released schema lock
0925 16:46:39.892996 (+    68us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:39.893370 (+   374us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:39.893412 (+    42us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4384108,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":7788,"apply.run_cpu_time_us":20898,"apply.run_wall_time_us":621206,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50041,"cfile_init":1,"lbm_read_time_us":478,"lbm_reads_lt_1ms":4,"num_ops":11,"prepare.queue_time_us":592477,"prepare.run_cpu_time_us":4071,"prepare.run_wall_time_us":155833,"replication_time_us":305799,"thread_start_us":290674,"threads_started":2}]]}
I20260925 16:46:42.073277 17988 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.027415 17625 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.075239 18036 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:42.064783 17804 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for earlier term 20. Current term is 21.
I20260925 16:46:41.993495 17917 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260925 16:46:42.077127  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.077704  9124 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:41.974889 17902 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:42.079895 17902 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:41.989852 17803 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:42.079195 17682 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.081578  8867 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 28 to 29, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 29 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:42.083878 17682 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.086862  9115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45954 (request call id 4410) took 1373 ms. Trace:
I20260925 16:46:42.065146 17939 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:42.087237  9115 rpcz_store.cc:276] 0925 16:46:40.713548 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:40.877756 (+164208us) service_pool.cc:227] Handling call
0925 16:46:40.895110 (+ 17354us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:40.958412 (+ 63302us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:40.958457 (+    45us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:40.968714 (+ 10257us) log.cc:842] Serialized 26 byte log entry
0925 16:46:41.472593 (+503879us) raft_consensus.cc:1631] Marking committed up to 11
0925 16:46:41.472630 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:41.472698 (+    68us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:42.086648 (+613950us) raft_consensus.cc:1671] finished
0925 16:46:42.086672 (+    24us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:42.086809 (+   137us) inbound_call.cc:173] Queueing success response
Metrics: {"raft.queue_time_us":38820,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":7968,"thread_start_us":488783,"threads_started":1,"wal-append.queue_time_us":661017}
I20260925 16:46:42.089211  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.089242 17902 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.090452  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.090600  9123 raft_consensus.cc:2379] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:42.093417  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 51484.6us
I20260925 16:46:42.095284  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.095985  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.000380  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 23 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.971885 17907 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.103626  9041 raft_consensus.cc:2396] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 25 because replica has last-logged OpId of term: 24 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 23 index: 15.
I20260925 16:46:42.104043  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:41.978103 17642 consensus_queue.cc:1035] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260925 16:46:42.108668  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.107517  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.060268  9122 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
W20260925 16:46:42.035845  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:42.112550  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76779.1us
I20260925 16:46:42.065974  9117 raft_consensus.cc:1226] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:42.070138 17666 raft_consensus.cc:3032] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Stepping down as leader of term 20
I20260925 16:46:42.070241  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.116292  9118 raft_consensus.cc:3037] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.098335  9042 raft_consensus.cc:2354] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23.
I20260925 16:46:42.091302 17902 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.099188  9120 raft_consensus.cc:2379] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:42.139302  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.097599  9124 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:42.029538 17932 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.108522 18025 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.144069 17932 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.022922 17971 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:42.103497  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.160421  9050 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:42.091740 17952 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.113152  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.114132  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.075367 17988 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:42.116881  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.185912  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.186882  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 73746.3us
W20260925 16:46:42.187544  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:42.188087  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.188418  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.189369  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.032905 17761 raft_consensus.cc:686] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:42.139000  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 81301.6us
W20260925 16:46:42.192725  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 79645us
I20260925 16:46:42.144140 18025 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.115975 17743 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.030999 18017 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.090986  9115 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.115814 17666 raft_consensus.cc:729] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:42.152724  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.326529  9047 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.148452  9118 raft_consensus.cc:2454] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:42.154385  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.025641 17718 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.023211 17788 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:42.160254  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 421179us
W20260925 16:46:42.154408 18023 consensus_meta.cc:287] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.793s	user 0.009s	sys 0.003s
I20260925 16:46:42.099601 18045 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.161442  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.191404  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.029947 17934 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.260955  9117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2256) took 1287 ms. Trace:
I20260925 16:46:42.311071  9116 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:42.320361  9698 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:42.319676  9123 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:42.195086 17978 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:42.157366  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.255254 17325 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.259001 17932 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:46:42.353566 18061 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.200s	user 0.000s	sys 0.000s
I20260925 16:46:42.354871  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4089) took 1765 ms. Trace:
I20260925 16:46:42.334718  9666 leader_election.cc:398] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:42.260362 18065 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.308439 18044 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:42.337065  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.319272 17836 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.342157  9117 rpcz_store.cc:276] 0925 16:46:40.976482 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:41.057452 (+ 80970us) service_pool.cc:227] Handling call
0925 16:46:41.086876 (+ 29424us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:42.116094 (+1029218us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:42.260709 (+144615us) spinlock_profiling.cc:243] Waited 979 ms on lock 0x7b5400010754. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:42.260895 (+   186us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":2251123968}
I20260925 16:46:42.327893 17911 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.319658 17601 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.341225  9701 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:42.321386 17953 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.377902  9016 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:42.320102 18046 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:42.381997 17876 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.577s	user 0.006s	sys 0.001s
I20260925 16:46:42.382339 18046 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.356587  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.353585 17952 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.350498  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:42.383881 18075 log.cc:924] Time spent T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
W20260925 16:46:42.384778 18074 log.cc:924] Time spent T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.231s	user 0.000s	sys 0.001s
I20260925 16:46:42.386126  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.377087  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.326557 17701 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.348457  9050 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:42.376494 17836 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.381008 17666 consensus_queue.cc:260] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.382515 17876 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.383572  9698 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 20: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:42.358090 17700 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.335424 17788 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:42.356300 18067 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.196s	user 0.000s	sys 0.000s
I20260925 16:46:42.355193  9119 rpcz_store.cc:276] 0925 16:46:40.589942 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:40.596443 (+  6501us) service_pool.cc:227] Handling call
0925 16:46:40.627660 (+ 31217us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:40.703197 (+ 75537us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:40.703227 (+    30us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:40.703656 (+   429us) log.cc:842] Serialized 26 byte log entry
0925 16:46:41.599855 (+896199us) raft_consensus.cc:1631] Marking committed up to 17
0925 16:46:41.599892 (+    37us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:41.599998 (+   106us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:42.354671 (+754673us) raft_consensus.cc:1671] finished
0925 16:46:42.354701 (+    30us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:42.354821 (+   120us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":2948,"raft.queue_time_us":18939,"raft.run_cpu_time_us":67,"raft.run_wall_time_us":68,"thread_start_us":868064,"threads_started":1,"wal-append.queue_time_us":1294531}
I20260925 16:46:42.388420  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.413759  9121 raft_consensus.cc:3037] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 20
I20260925 16:46:42.387517  9049 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:42.339152 17743 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.389693 17911 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:42.359562 18078 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:42.408880  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.399596 17701 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.440858 17934 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.441462 17701 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.411580  9666 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:42.414455 17700 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.442694  9666 leader_election.cc:398] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
I20260925 16:46:42.442914 17625 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639) with higher term. Message: Invalid argument: T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26.
I20260925 16:46:42.443470 17325 raft_consensus.cc:2781] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:42.443747 17700 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.443867  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.444977 18078 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.446882 18078 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.450369 17971 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.376408 17757 consensus_queue.cc:1035] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260925 16:46:42.420344 17666 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:42.420892 17836 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:42.421279 18069 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260925 16:46:42.422083 17876 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.423425 18077 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:42.423740 17743 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.423959  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.476212 18077 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:42.402091 17761 consensus_queue.cc:237] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.476815 18077 raft_consensus.cc:3037] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:42.423586  9049 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:42.424786 18017 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.425197 18025 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.426415 18045 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.262269  8867 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 17 to 23, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 23 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:42.377852 17978 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260925 16:46:42.390571 17953 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.358717 17980 consensus_queue.cc:1035] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.046s
I20260925 16:46:42.429451 17718 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.430614 18046 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.430514 17803 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.404419 17907 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.420888  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.442981  9666 leader_election.cc:401] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Cancelling election due to peer responding with higher term
I20260925 16:46:42.413638  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.444012 17325 raft_consensus.cc:686] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:42.356839 18065 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.352468 17668 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.452584 17880 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:42.455149 18076 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260925 16:46:42.504061 17917 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
W20260925 16:46:42.396139  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45726us
I20260925 16:46:42.431565 17911 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:42.459945  9118 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
W20260925 16:46:42.464468  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 490089us
I20260925 16:46:42.465798  9047 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:42.469993 17971 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.471951  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.472911  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.473753  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.475566  9695 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 23: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
W20260925 16:46:42.462909 17759 consensus_meta.cc:287] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.805s	user 0.002s	sys 0.007s
I20260925 16:46:42.549507  9047 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 21. Current term is 22. Ops: []
I20260925 16:46:42.499557  9115 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
W20260925 16:46:42.549752  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:42.512463  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 69915.2us
I20260925 16:46:42.522033 17666 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:42.457558  9120 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260925 16:46:42.543363  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.537416  9121 raft_consensus.cc:2454] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
W20260925 16:46:42.517396  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 554457us
I20260925 16:46:42.567338  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.539741 17911 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:42.598120  9665 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:42.598618  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.573367  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.593118  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.525074 17718 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:42.605459  9698 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.601497  9044 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
W20260925 16:46:42.636087  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 285692us
W20260925 16:46:42.640676  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 450824us
W20260925 16:46:42.641645  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 296390us
W20260925 16:46:42.643357  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 299653us
I20260925 16:46:42.647262  9694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.649317  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.650086  9121 raft_consensus.cc:2379] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:42.652187  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.574677 18017 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:42.656149  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.653265  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.560127 17759 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.663070  9694 raft_consensus.cc:1261] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
W20260925 16:46:42.666752  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 117043us
I20260925 16:46:42.666399  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.661427  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.596081 18002 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.058s
I20260925 16:46:42.621795 17718 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.692925 18044 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260925 16:46:42.653064 17836 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:42.703276  9015 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.657617 17325 consensus_queue.cc:237] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.692167 17907 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:42.698931  9699 raft_consensus.cc:1226] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 15. Current term is 16. Ops: []
I20260925 16:46:42.671233  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.657188 18078 raft_consensus.cc:2781] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:42.705066  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.698173 17803 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.717208  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.718333  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.717338 18084 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.723930 18084 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:42.727459  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.733309  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.733862  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.733920  9047 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:46:42.667519 18017 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.741145  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.749495  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.728616 18078 raft_consensus.cc:686] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:42.706594 18082 consensus_queue.cc:1035] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.039s
I20260925 16:46:42.703631 17836 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.740043 17953 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.766147  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:42.766287  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.739293 18091 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:42.811547  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.812826  9699 raft_consensus.cc:2396] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:46:42.815348  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.815953  9042 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:42.732282 18045 consensus_queue.cc:1046] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260925 16:46:42.818447  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.819113  9047 raft_consensus.cc:2379] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:42.822672  9049 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:42.827472  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:42.830049  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 64006.4us
I20260925 16:46:42.831580  8939 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:42.834570  9044 raft_consensus.cc:1226] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 20. Current term is 21. Ops: []
I20260925 16:46:42.787846 18065 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.850620  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:42.812486 17743 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:42.790745 17899 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.856482  9048 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:42.861786  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 191018us
I20260925 16:46:42.692360  8867 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:42.862712  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 194100us
I20260925 16:46:42.863624  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.873538  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.834267 17953 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:42.825155 17788 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.881829 18084 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:42.883090 17788 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.883850  9124 raft_consensus.cc:1226] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20. Ops: []
I20260925 16:46:42.884752  9695 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42268 (request call id 2544) took 1157 ms. Trace:
I20260925 16:46:42.885152  9695 rpcz_store.cc:276] 0925 16:46:41.727804 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:41.728002 (+   198us) service_pool.cc:227] Handling call
0925 16:46:42.884534 (+1156532us) spinlock_profiling.cc:243] Waited 709 ms on lock 0x7b540048b2d4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:42.884667 (+   133us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1630466304}
I20260925 16:46:42.886224  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2269) took 1276 ms. Trace:
I20260925 16:46:42.886471 17911 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.886569  9124 rpcz_store.cc:276] 0925 16:46:41.609945 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:42.195885 (+585940us) service_pool.cc:227] Handling call
0925 16:46:42.256152 (+ 60267us) raft_consensus.cc:1457] Updating replica for 0 ops
0925 16:46:42.884235 (+628083us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:42.886011 (+  1776us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400041ad4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2af51 00007f719bf2999e 00007f71a0e6b2e9 00007f719a551684 00007f719a551612 00007f719a551541 00007f719a5514bc 00007f719a550772 00007f719a35494c 00007f719a353d86
0925 16:46:42.886157 (+   146us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1443096832}
I20260925 16:46:42.884430 18077 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.866273 17743 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.889328 18077 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:42.889670 17743 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.874989  9042 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
W20260925 16:46:42.894629  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.898325  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.900911  9120 raft_consensus.cc:1226] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Rejecting Update request from peer 8dc3391062084f45a6ba62d28d340722 for earlier term 26. Current term is 27. Ops: []
I20260925 16:46:42.905134  9118 raft_consensus.cc:1226] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: []
I20260925 16:46:42.905540  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.906649  9121 raft_consensus.cc:2396] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260925 16:46:42.906808  9089 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.907137  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.908183  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:42.895633  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.910316  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:42.910919  9697 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:42.921481  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.921753  8939 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.948432  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:42.948800  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:42.879171 17700 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:42.879874 17953 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:42.951821  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:42.952761  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:42.909852 18084 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:42.955469  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.963016  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:42.879908 17759 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:42.866065 17899 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:42.930595 17743 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:42.973119  8940 leader_election.cc:398] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23.
I20260925 16:46:42.948192 17788 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:42.994686  9697 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:42.976239  8940 leader_election.cc:401] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:42.971998  8941 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:42.976928  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:42.954514 17625 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:43.005875  8941 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:43.002740  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:42.962239 17953 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:42.963850 17718 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.020740  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:43.023106  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60170us
I20260925 16:46:43.026921  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:42.954368 18045 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.052s
I20260925 16:46:42.948916 17761 consensus_queue.cc:1046] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
W20260925 16:46:43.017481  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:43.002554 17911 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.028195 17741 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election won for term 26
W20260925 16:46:43.049124  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:42.951509 18090 consensus_queue.cc:1046] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 22.18, Next index: 19, Last known committed idx: 17, Time since last communication: 0.060s
I20260925 16:46:43.032618  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:42.991394 18091 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.004753 17907 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.072754 17907 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.074940 17907 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.009279 18086 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Advancing to term 23
W20260925 16:46:43.076829 18089 log.cc:924] Time spent T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260925 16:46:43.005548 18082 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:43.080401 18045 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.080955 18045 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.028855 17625 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:46:43.059099 18059 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.050s	user 0.000s	sys 0.001s
I20260925 16:46:43.010317 17970 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.002413 17743 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.011880 18066 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:43.016858 17788 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:42.975000 18084 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:42.911765 18078 consensus_queue.cc:237] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.076195 18094 log.cc:924] Time spent T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
I20260925 16:46:43.050034  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.099287 17409 raft_consensus.cc:3032] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Stepping down as leader of term 19
W20260925 16:46:43.095464  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.119978  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.029307 18108 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:43.099625  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 67124.5us
I20260925 16:46:43.107070 18025 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:43.107285  9122 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:45950 (request call id 4112) took 1499 ms. Trace:
I20260925 16:46:43.051483  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:43.092343 17741 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.121150  9123 raft_consensus.cc:1261] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:43.116267 18082 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Stepping down as leader of term 21
I20260925 16:46:43.009145 17700 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:43.108559 18112 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.109261 17788 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:43.114341 17836 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.092250 18091 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.119015 18077 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.114461 18066 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.133229  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.118556 17409 raft_consensus.cc:729] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:43.124575  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.106441 17970 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.138446  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:43.131409 18082 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:46:43.156544  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.136823 17788 raft_consensus.cc:3037] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:43.157374  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.158797  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:43.161343  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.162125  9695 raft_consensus.cc:2379] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 16: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:43.162423 18066 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.163872 17836 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:43.164837 18046 raft_consensus.cc:3032] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:43.165297 18046 raft_consensus.cc:729] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:43.165830 18082 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.166165 18046 consensus_queue.cc:260] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.167261 18082 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:43.160220 17700 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:43.168890 17970 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.170153  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.170764  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.170833  9124 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:43.180258  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:43.182204  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.134296 18002 consensus_queue.cc:1035] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.023s
I20260925 16:46:43.167448 18046 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:43.196615  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.149434 17899 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:43.206418  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55776.8us
I20260925 16:46:43.163916 18084 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.181466 17625 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:43.145565 18077 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.199767 17970 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election won for term 30
W20260925 16:46:43.251614  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55077.9us
I20260925 16:46:43.201499 17700 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:43.249258 17911 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:43.255039 18096 log.cc:924] Time spent T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.148s	user 0.000s	sys 0.001s
I20260925 16:46:43.115557  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 4.135s	user 0.116s	sys 0.072s Metrics: {"cfile_cache_miss":9,"cfile_cache_miss_bytes":27141,"cfile_init":3,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"lbm_read_time_us":2460,"lbm_reads_lt_1ms":21,"lbm_write_time_us":66768,"lbm_writes_1-10_ms":4,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":6,"reinsert_count":0,"thread_start_us":708327,"threads_started":3,"update_count":238,"wal-append.queue_time_us":480452,"wal-append.run_cpu_time_us":474,"wal-append.run_wall_time_us":1031559}
I20260925 16:46:43.303313  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.108914  8867 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 21 to 25, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.140173 18112 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.295876 18065 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.297801 17970 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.324538  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.327389  9047 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:43.329350  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:43.310619 18087 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:43.322077 17880 consensus_meta.cc:287] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
W20260925 16:46:43.331823  8921 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.348235 18083 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:43.348774 18083 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.349143 18083 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:43.349301 18120 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:43.358223 18017 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:43.361370 17666 consensus_meta.cc:287] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.791s	user 0.011s	sys 0.002s
I20260925 16:46:43.362370 17666 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election lost for term 19. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 19. Current term is 20.
W20260925 16:46:43.363037  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:43.363476  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 452931us
W20260925 16:46:43.364500  9666 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.366771 18091 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.330027 17970 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:43.326879 18045 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.378342 17978 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260925 16:46:43.381253 17978 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.381527  9048 raft_consensus.cc:1226] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 27. Current term is 28. Ops: []
I20260925 16:46:43.381708 17978 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 15 FOLLOWER]: Advancing to term 16
I20260925 16:46:43.383473  8862 maintenance_manager.cc:419] P ba21ddca249c4cf39e72526cc8696c60: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260925 16:46:43.389555 18112 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.390753 18077 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.391319  8867 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 27, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 27 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.392349  8861 maintenance_manager.cc:643] P ba21ddca249c4cf39e72526cc8696c60: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
I20260925 16:46:43.393112  8867 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 14 to 16, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.257002 17409 consensus_queue.cc:260] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.397545  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.336956 17743 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:43.399121  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 96553.6us
I20260925 16:46:43.403144  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.295236 17741 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:43.405936  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 151043us
I20260925 16:46:43.419028  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.420233  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:43.329553 18065 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.423615  9117 raft_consensus.cc:2454] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
W20260925 16:46:43.425844  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 325125us
I20260925 16:46:43.429124  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.430374  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.445485  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.446146  9701 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:43.402364 18002 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.426113 17899 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:43.476650  9665 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:43.478927  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.443387 17880 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:43.479688  9701 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:43.497530  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.501889  9048 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:43.502928  9014 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.454807 17743 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.508766 17668 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.509289 17668 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.425029 18084 consensus_queue.cc:1046] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 27.21, Next index: 22, Last known committed idx: 21, Time since last communication: 0.054s
I20260925 16:46:43.474499 18087 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:43.471271 17625 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.532660  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.536615  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.541049  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.544356  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.511849 17761 raft_consensus.cc:2781] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:43.504155 17880 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:43.549578  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:43.552194  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.468394 18002 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.556267  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.527020 18044 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:43.527207 18017 consensus_queue.cc:1046] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.032s
I20260925 16:46:43.590807  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:43.564143 18110 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.072s	user 0.000s	sys 0.001s
I20260925 16:46:43.521961 17743 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.559082 17761 raft_consensus.cc:686] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:43.564124 18123 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.098s	user 0.000s	sys 0.001s
I20260925 16:46:43.593513  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.562511 17718 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:43.619607  9048 raft_consensus.cc:2454] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 25.
I20260925 16:46:43.621701  9014 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:43.624862  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:43.557714 17880 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.656576  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.657193  9042 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:43.527315  8867 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:43.663255  8940 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:43.647625 17642 raft_consensus.cc:3032] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Stepping down as leader of term 26
I20260925 16:46:43.625398 18087 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.660017 17836 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:43.649475 17911 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:43.674429  8867 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 12 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:43.652231 17625 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.684944 18130 raft_consensus.cc:2781] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:43.651003 17668 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.658620 18121 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.664634 18088 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.700022 18130 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:43.702857 18126 log.cc:924] Time spent T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.159s	user 0.000s	sys 0.001s
W20260925 16:46:43.703569 18127 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260925 16:46:43.703840 18036 raft_consensus.cc:3032] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:43.697795 17899 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:43.724521 17899 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.724895 17899 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:43.713963 18036 raft_consensus.cc:729] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:43.728616 18036 consensus_queue.cc:260] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.729585 17700 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:43.729655 18036 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:43.696730 18086 consensus_meta.cc:287] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.620s	user 0.008s	sys 0.004s
I20260925 16:46:43.687585 17642 raft_consensus.cc:729] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:43.666389 18066 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.702874  8867 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 20. New cstate: current_term: 20 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:43.701264 17978 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.724050 18002 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.706346 18065 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.762146 18086 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23.
I20260925 16:46:43.710781 18130 raft_consensus.cc:3037] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:43.771266 17642 consensus_queue.cc:260] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.772658 17642 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:43.774578 17970 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.710961 18121 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.712692 18088 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.777985 17880 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.764022 18046 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.765978 18087 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.766165 17761 consensus_queue.cc:237] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.769064 17953 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.706s	user 0.008s	sys 0.003s
W20260925 16:46:43.798817  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 332550us
I20260925 16:46:43.127851  9122 rpcz_store.cc:276] 0925 16:46:41.607754 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:42.192137 (+584383us) service_pool.cc:227] Handling call
0925 16:46:42.259770 (+ 67633us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:42.260084 (+   314us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:42.260112 (+    28us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:42.342150 (+ 82038us) log.cc:842] Serialized 26 byte log entry
0925 16:46:42.759159 (+417009us) raft_consensus.cc:1631] Marking committed up to 16
0925 16:46:42.967261 (+208102us) log.cc:842] Serialized 14 byte log entry
0925 16:46:43.106874 (+139613us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:43.106944 (+    70us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:43.106991 (+    47us) raft_consensus.cc:1671] finished
0925 16:46:43.107003 (+    12us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:43.107229 (+   226us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3855,"prepare.queue_time_us":369425,"raft.queue_time_us":57221,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":7579,"thread_start_us":603672,"threads_started":3,"wal-append.queue_time_us":572075}
W20260925 16:46:43.806411  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 182359us
W20260925 16:46:43.881342 17788 consensus_meta.cc:287] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.681s	user 0.004s	sys 0.004s
I20260925 16:46:43.881784 17788 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.885146 17899 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.825893  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.890820 17788 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.837006 17978 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:43.850960 18083 consensus_meta.cc:287] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.501s	user 0.009s	sys 0.000s
I20260925 16:46:43.894240 18083 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.834501  8867 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 16 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 17 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:43.885984 18116 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:43.886643  9119 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 27 index: 19. (index mismatch)
I20260925 16:46:43.837774 18084 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:43.921339 18084 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.813602 18046 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.826363 17953 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.926234 18116 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:43.926964 17953 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.928318  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.813297 18002 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.892367 18078 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:43.929291  9048 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:43.929455 18078 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:43.806183 18082 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.623s	user 0.010s	sys 0.000s
I20260925 16:46:43.852149  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.937350 18083 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:43.940812 17601 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:43.814795 17743 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.897053  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:43.764814  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 288248us
I20260925 16:46:43.954459  9047 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260925 16:46:43.955719  9120 raft_consensus.cc:1261] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:43.958003  9696 raft_consensus.cc:1226] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Rejecting Update request from peer 40a71744ceba4efe949720cb0f274853 for earlier term 24. Current term is 25. Ops: []
I20260925 16:46:43.842777 18088 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.797494 18066 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.967141  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.966027  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.969699  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.973578  9044 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:43.964463  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:43.959453 17409 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:43.984520  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:43.988570  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:43.929353 18002 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.995036  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:43.995327  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:43.995805  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:43.974809 18083 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:43.997145 18108 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:43.996595 18083 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:43.997555 18108 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:43.997951 18108 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:43.999089 18083 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.001206 18002 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.003146 17803 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:44.003547 17803 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:44.003890 17803 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:44.006729  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:43.962829 18046 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:43.958542 17970 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.007531  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.978885 18084 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:44.014549  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:43.979897 18121 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:43.976956 18112 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.015799  9699 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:44.023490 18112 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.026171 18112 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:44.027769  8938 thread.cc:636] raft [worker] (thread pool) Time spent creating pthread: real 0.515s	user 0.012s	sys 0.005s
W20260925 16:46:44.028237  8938 thread.cc:602] raft [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.013s	sys 0.006s
I20260925 16:46:44.029333 18023 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.029793 18023 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.030516  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.031672 18023 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.032951  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:43.924369  8867 catalog_manager.cc:5495] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:44.035888 18115 raft_consensus.cc:3032] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Stepping down as leader of term 27
I20260925 16:46:43.983510 17743 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260925 16:46:44.036497 18115 raft_consensus.cc:729] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.038909 18115 consensus_queue.cc:260] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 27, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.041049 18115 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:44.045316  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.046159  9701 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 30: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:44.048403  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:43.990058 18082 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.049263 18082 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.052167  9701 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:44.055075 18082 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.036092  9048 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:44.056427 18108 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.052975 18152 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260925 16:46:44.063900  9118 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:44.064890 17899 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.034626  8867 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 11 to 13, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 13 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.061118  9699 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260925 16:46:44.056846  8940 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.074241  9045 raft_consensus.cc:2454] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:44.079857 17880 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:44.080341 17880 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:44.080838 17880 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:44.080971  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:44.080260  8867 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 18, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 18 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:44.082379  8867 catalog_manager.cc:5495] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 22, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 22 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.084110 18149 consensus_queue.cc:1035] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:44.092162  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.090512  8941 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.097886  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.099332  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.099985  9089 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.100780  9699 raft_consensus.cc:2379] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:44.101792  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:44.108338  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 53443.8us
I20260925 16:46:44.012030 18087 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.087869 17880 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.107795  9090 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.112658  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.114873  9044 raft_consensus.cc:2454] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
W20260925 16:46:44.165861  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.121256  9042 raft_consensus.cc:2396] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 27 because replica has last-logged OpId of term: 26 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 25 index: 17.
W20260925 16:46:44.166657  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.167476  9089 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
W20260925 16:46:44.167804  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 55233.2us
I20260925 16:46:44.123670  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.120026  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.125980  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.170214  9048 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:44.169803  9118 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 30
I20260925 16:46:44.125699  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:44.175979  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 68334.5us
I20260925 16:46:44.117573  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:44.177920  9701 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 21
I20260925 16:46:44.168854  9119 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:44.179387  9665 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.157387 18078 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:44.106549 17743 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:44.184283 17409 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260925 16:46:44.108233 18116 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:44.106468 17787 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:44.183852 18087 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.196233 17409 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.219303 17409 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Advancing to term 19
I20260925 16:46:44.117022 18112 raft_consensus.cc:2781] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election won for term 26
W20260925 16:46:44.208241  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 998312us
I20260925 16:46:44.222039  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.185042 18082 raft_consensus.cc:2781] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:44.181995 18046 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:44.181424 18088 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:44.218770 17787 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.117192 18083 consensus_queue.cc:1046] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.083s
I20260925 16:46:44.246140  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.227566  9120 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:44.227964  9118 raft_consensus.cc:2454] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 30.
I20260925 16:46:44.217131  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.248580  9043 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:46:44.249825  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.250037  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.250723  9115 raft_consensus.cc:2379] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 30: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:44.213967 17668 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.251524  9117 raft_consensus.cc:2379] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 27: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:44.253703  9665 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.264149  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.265228  9696 raft_consensus.cc:2396] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 22 because replica has last-logged OpId of term: 20 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260925 16:46:44.209826 18023 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.040s
I20260925 16:46:44.270131  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.271994  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.247062 18088 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.248025 17787 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:44.275501  9043 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:44.274894  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.250622 18147 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.115780  8867 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 13 to 18. New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.276942  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.276377  9041 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 24
I20260925 16:46:44.277652  9050 raft_consensus.cc:1261] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260925 16:46:44.256233 18112 raft_consensus.cc:686] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.279515  9049 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:44.255584 17759 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:44.260624 18066 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.284030  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:44.261224 17971 raft_consensus.cc:2781] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader election won for term 30
I20260925 16:46:44.261579 18044 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.270664 17907 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.274650 17953 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.304807  9124 raft_consensus.cc:3032] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Stepping down as leader of term 24
I20260925 16:46:44.278649 18088 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:44.277323 18082 raft_consensus.cc:686] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.284623 17934 raft_consensus.cc:482] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.309131  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.312872  9124 raft_consensus.cc:729] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:44.326716  9124 consensus_queue.cc:260] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.17, Last appended by leader: 17, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.328899  9124 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:44.309502  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.329620  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.262284 17668 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.309602  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:44.328936  9122 raft_consensus.cc:1261] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:44.327235  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.328088 17971 raft_consensus.cc:686] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:44.292022 18147 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.352079  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.354530  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.343875  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.359421  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.341218  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:44.361363  9695 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:44.314671 18108 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.307955 18148 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:44.342749 18130 consensus_meta.cc:287] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.571s	user 0.010s	sys 0.002s
I20260925 16:46:44.390450  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.293545 17759 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.371500 18156 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260925 16:46:44.329757 17880 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.394428 17701 raft_consensus.cc:482] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.397313  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.369297 17902 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:44.345919 18147 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:44.419155  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 168077us
I20260925 16:46:44.340976 17668 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:44.372188 18154 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:44.312243 18044 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.380671 17743 raft_consensus.cc:3037] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:44.316076 17907 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.318766 17953 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.333897 17761 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.074s
I20260925 16:46:44.428973  8939 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.364437  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:44.351732 17934 raft_consensus.cc:504] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.433103  9695 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:44.436120  9124 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
W20260925 16:46:44.422935  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 193490us
W20260925 16:46:44.441323  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:44.447046  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.447428  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.444044  8941 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:44.420179  9666 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.448441  9015 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.448946  9015 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.448999  9666 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:44.454193  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:44.454893  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.455192  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.456111  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:44.456398  9089 leader_election.cc:334] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.459479  9042 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
W20260925 16:46:44.459637  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.460079  9089 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.336212 18082 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.461290  9089 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.333819 17971 consensus_queue.cc:237] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.463881  9089 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.464339  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.409672 18130 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.452560  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:44.459192 18045 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 25 current term: 25 is higher.
I20260925 16:46:44.464951 17952 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.468586 17668 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.472842  8941 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.407469 18112 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 25.17, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.498381 18087 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.497016  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.499068  9695 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:44.499949  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.500077 17668 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.500061  8867 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 25. New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.502635 17668 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.502040  8867 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 25, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 25 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:44.504875 18044 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.505575 18044 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:44.424306 17701 raft_consensus.cc:504] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.523197 17701 leader_election.cc:288] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.525607 17759 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:44.526362 18143 log.cc:924] Time spent T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:44.527958 18155 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:44.533828  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 61048.2us
I20260925 16:46:44.535472 17700 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:44.537196  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.537636 17700 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:44.538317  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.539121  9695 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:44.472997 17907 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.467507  9048 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
W20260925 16:46:44.490337  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.557874  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 67577.6us
W20260925 16:46:44.558540  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.558946  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.558027  9701 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 21.
W20260925 16:46:44.559999  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.456285 17980 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260925 16:46:44.457460 18119 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.418725 17803 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.457170 18083 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:46:44.480381  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 51518.9us
I20260925 16:46:44.464424  9047 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
W20260925 16:46:44.497010  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.550170  9041 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:44.574911  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.575205  8941 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.496613 17880 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.561565 17666 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.496393 18147 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:44.575809  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 78819.6us
W20260925 16:46:44.581046  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.581519  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:44.582788  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.583268  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.560385  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.578254  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.538887 17700 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.586051  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.576799  8940 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.580493 18155 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.590597  9122 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 26 index: 16. (index mismatch)
I20260925 16:46:44.579428 18102 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260925 16:46:44.585121  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.596671  9089 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.598155  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.599004 18155 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260925 16:46:44.598608  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:44.601730  9089 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 68 similar messages]
I20260925 16:46:44.603749  8867 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 16 to 20, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:44.612948 18158 log.cc:924] Time spent T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260925 16:46:44.616428 18115 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.617146 18115 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.619879 18115 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.620867  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.621148 18115 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.621543  9701 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 16.
I20260925 16:46:44.621959 18115 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.622642  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:44.623440 17788 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:44.623855 17788 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:44.623934 18115 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:44.624153 18162 log.cc:924] Time spent T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260925 16:46:44.624248 17788 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:44.588771 17952 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:44.588661 18078 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.586081 18083 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:44.638257  8867 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:44.592783 17668 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:44.644583  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.646378  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.598280 18148 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:44.647770  9123 raft_consensus.cc:2396] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 for term 25 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260925 16:46:44.595875 18147 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
W20260925 16:46:44.659081  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 159192us
I20260925 16:46:44.661700  8867 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 15 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 19 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:44.632236 18155 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:44.594337 18087 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.052s
I20260925 16:46:44.635859 17953 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.668871  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.709794  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:44.713850 18164 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260925 16:46:44.715179  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.715785  9049 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:44.716326  9044 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.716521  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.717139  9044 raft_consensus.cc:2396] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 for term 20 because replica has last-logged OpId of term: 19 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260925 16:46:44.716840 17787 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:44.717614  9049 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:44.718160 18167 log.cc:924] Time spent T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:46:44.718969 17787 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.664855 17668 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:44.722522 17668 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.725605 17409 consensus_meta.cc:287] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260925 16:46:44.678270 18087 consensus_queue.cc:1225] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer 40a71744ceba4efe949720cb0f274853 log is divergent from this leader: its last log entry 24.17 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260925 16:46:44.726033 17409 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.742585  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.760244  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5837876dc21490e819ef69131e93921" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 29 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.760699  9050 raft_consensus.cc:1226] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 25. Current term is 26. Ops: []
I20260925 16:46:44.763332  8867 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 19 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:44.764495 17409 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.765249  8867 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 23 to 24, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:44.729054 17761 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.773293 17761 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:44.776157  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 327698us
I20260925 16:46:44.779036  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:44.781406  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.782428  9117 raft_consensus.cc:2379] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:46:44.794940  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.795492  9015 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.796329  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 203563us
I20260925 16:46:44.647101 18066 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.086s
I20260925 16:46:44.800900  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:44.802196  9116 pending_rounds.cc:76] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 16
I20260925 16:46:44.808735  9116 pending_rounds.cc:97] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 24.17
I20260925 16:46:44.809209  9116 raft_consensus.cc:2866] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:44.803066  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.803406  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.810868  9015 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.767086  8867 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 23 to 24, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 24 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:44.813236  9015 leader_election.cc:334] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.813771  9015 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:44.815261  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.816507  9015 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.817970  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.818490  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:44.779855 17761 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:44.824054  8867 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:44.796988 18084 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.837949  9016 leader_election.cc:302] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.842289  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 282283us
W20260925 16:46:44.843134  9666 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.841625  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.821269 17701 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:44.843603  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.822580 17642 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260925 16:46:44.822737 18121 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:44.851138  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.825578 17601 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.785815 18088 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.876909  9048 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260925 16:46:44.860834  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
W20260925 16:46:44.861212  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:44.865636  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:44.882794  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.883219  9015 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:44.873489 18134 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.879801  9695 raft_consensus.cc:3037] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:44.841388 17803 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.841078 18172 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:44.852016 18169 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:44.867193 17409 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:44.863102 18148 raft_consensus.cc:482] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:44.898762  9695 raft_consensus.cc:2454] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:46:44.860948 17907 raft_consensus.cc:2726] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
I20260925 16:46:44.877947 18115 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:44.842403 18084 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:44.907234 18046 consensus_meta.cc:287] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.661s	user 0.009s	sys 0.002s
I20260925 16:46:44.837291 18147 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:44.887873 17701 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader pre-election lost for term 33. Reason: could not achieve majority
I20260925 16:46:44.911607  9090 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:44.920938  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 77561us
W20260925 16:46:44.945663  9089 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.899436 18174 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:44.951812  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.952925  9089 leader_election.cc:334] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.956089  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.956805  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.958801 18082 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:44.964465  9117 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 13. (term mismatch)
I20260925 16:46:44.964980  9117 pending_rounds.cc:76] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Aborting all ops after (but not including) 12
I20260925 16:46:44.965260  9117 pending_rounds.cc:97] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Aborting uncommitted NO_OP operation due to leader change: 21.13
I20260925 16:46:44.965543  9117 raft_consensus.cc:2866] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:46:44.965703 18084 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:44.962510  9089 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.969460  9089 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:44.970649  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.971391  9089 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:44.972918  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:44.973522  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:44.957154 18046 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:44.983234  8940 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:44.949257 17743 consensus_meta.cc:287] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.504s	user 0.010s	sys 0.000s
I20260925 16:46:45.000523  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:44.954641 18083 raft_consensus.cc:2781] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election won for term 23
I20260925 16:46:44.904577 18134 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.001390  9043 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 22.
I20260925 16:46:45.008508  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.014379 18130 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.023679 18102 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.033294  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:44.980367 18155 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:46:45.004149 17902 consensus_meta.cc:287] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Time spent flushing consensus metadata: real 0.580s	user 0.011s	sys 0.000s
I20260925 16:46:44.985877 18084 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:44.922998 18115 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.068944 18115 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:44.920328 18148 raft_consensus.cc:504] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.073556 18148 leader_election.cc:288] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.074373 17788 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.075052  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:44.994858 17668 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:44.999830 18149 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:45.004801 17743 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260925 16:46:45.099808  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 263220us
I20260925 16:46:45.050613  8940 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.062063 17755 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.049913 18132 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:45.064973 17902 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:45.044715 18102 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:45.088778  9115 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:45.093730  9118 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:45.098237  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:45.101135  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 50612us
I20260925 16:46:45.110406  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.115203  9118 raft_consensus.cc:2379] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 225d3432101a4758bb9a6b0efeae09c5 in current term 20: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:45.103817  9695 raft_consensus.cc:1226] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 18. Current term is 19. Ops: []
I20260925 16:46:45.103943  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.107296 17788 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:45.119463  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 86304.5us
I20260925 16:46:45.089257 18129 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.122771 18129 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.124801  9041 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 24 index: 14. (index mismatch)
I20260925 16:46:45.095880 17803 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:45.128965  9120 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.129577  9120 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:45.130438  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:45.130797  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.131592  9695 raft_consensus.cc:3037] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:45.102854 18132 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.135928 18132 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.145510  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.142154 17934 leader_election.cc:288] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.165164  9122 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cdef8e15863049f59c35fc47250d99ee" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.165113  9116 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:45.125960 17803 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.122043 18083 raft_consensus.cc:686] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:45.119014 18148 raft_consensus.cc:482] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:45.180173  9014 leader_election.cc:302] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.172266  9695 raft_consensus.cc:2454] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 17.
I20260925 16:46:45.126927 18179 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:45.175340  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.125487 18129 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.159893 18088 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.163409 17902 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:45.101645 17668 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.102845 18149 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.168967 18172 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:45.195601  9090 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.199512 18108 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.177017 17803 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:45.212685  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 85178.1us
I20260925 16:46:45.195768 18174 raft_consensus.cc:2726] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:45.220221  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:45.178743 18098 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.034s
I20260925 16:46:45.221536 17668 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.223750 18083 consensus_queue.cc:237] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.235433 18088 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.234642  8940 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.236023 18088 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.237685 17743 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:45.237962 18088 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.238291 17743 consensus_queue.cc:1046] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 25.20, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
I20260925 16:46:45.238467 18179 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260925 16:46:45.240106 18088 raft_consensus.cc:3032] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Stepping down as leader of term 25
I20260925 16:46:45.240473 18088 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.240906  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.227459 18116 raft_consensus.cc:2781] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:45.241250 18088 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.242156 18116 raft_consensus.cc:686] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:45.242810 18088 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:45.243063 18116 consensus_queue.cc:237] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.209707 18066 consensus_queue.cc:1046] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.022s
I20260925 16:46:45.229142 18132 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.231755  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.184931 18193 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.056s
I20260925 16:46:45.214032 18082 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.230060 18149 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:45.209165 18172 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.226492  8941 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:45.198272 18148 raft_consensus.cc:504] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.228586 18189 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.247248  9050 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
I20260925 16:46:45.245890 18134 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.251245  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.257568  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f15ade9737ac41438bda476a00b4ad97" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 29 candidate_status { last_received { term: 27 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.258798  9043 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260925 16:46:45.259397 18066 raft_consensus.cc:3032] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Stepping down as leader of term 18
I20260925 16:46:45.259737  9046 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260925 16:46:45.255028  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.261972  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:45.270335  8941 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 43942.4us
I20260925 16:46:45.279912  9697 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260925 16:46:45.215725 18108 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.273931 18179 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.289523 18185 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:46:45.290140 18188 log.cc:924] Time spent T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260925 16:46:45.293653  8939 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.297421  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.300638 17899 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.312027 17899 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.300791 18148 leader_election.cc:288] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:45.281068 18190 log.cc:924] Time spent T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260925 16:46:45.264560 18172 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:45.277351 17668 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:45.272660 18066 raft_consensus.cc:729] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.317973  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.267922 18082 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.322686 17741 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.027s
I20260925 16:46:45.351636 18205 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:45.355670 18082 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.314989 18185 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.351804 18108 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.270854 18189 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.371915  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:45.372507  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 45773.3us
I20260925 16:46:45.382059  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:45.383718  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 60918.9us
I20260925 16:46:45.384724  8940 leader_election.cc:302] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.382933  9047 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 28.
W20260925 16:46:45.387861 18183 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260925 16:46:45.310645 18179 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.379604 17668 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.388984 17899 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:45.450963  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 59159.6us
I20260925 16:46:45.453624  9117 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4bcfed5db9a046b18c3437b749370a81" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.383250 18087 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.060s
I20260925 16:46:45.476852  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.477057  8940 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.478170  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.444237 18134 raft_consensus.cc:2726] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:45.481325  8939 leader_election.cc:302] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.390692 18066 consensus_queue.cc:260] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.471304 18082 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.448760 18088 consensus_queue.cc:1046] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260925 16:46:45.518028 17899 raft_consensus.cc:2726] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:45.541101 18176 raft_consensus.cc:3032] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Stepping down as leader of term 23
I20260925 16:46:45.541507 18176 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:45.542697  9119 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:45950 (request call id 4146) took 1313 ms. Trace:
I20260925 16:46:45.543071  9119 rpcz_store.cc:276] 0925 16:46:44.229350 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:44.229515 (+   165us) service_pool.cc:227] Handling call
0925 16:46:45.542532 (+1313017us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b540007d354. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beaf471 00007f719bf2e2ae 00007f71a0e6bc27 00007f719a553c04 00007f719a553b92 00007f719a553ac1 00007f719a553a3c 00007f719a552cf2 00007f719a35494c 00007f719a353d86 00007f719a35372f
0925 16:46:45.542648 (+   116us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":1991338240}
W20260925 16:46:45.544895 18170 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.631s	user 0.006s	sys 0.005s
I20260925 16:46:45.546574  9124 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:43572 (request call id 2303) took 1025 ms. Trace:
I20260925 16:46:45.546909  9124 rpcz_store.cc:276] 0925 16:46:44.521420 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:44.521569 (+   149us) service_pool.cc:227] Handling call
0925 16:46:44.521900 (+   331us) raft_consensus.cc:1457] Updating replica for 1 ops
0925 16:46:44.529052 (+  7152us) raft_consensus.cc:1520] Early marking committed up to index 0
0925 16:46:44.529101 (+    49us) raft_consensus.cc:1525] Triggering prepare for 1 ops
0925 16:46:44.529715 (+   614us) log.cc:842] Serialized 26 byte log entry
0925 16:46:44.647376 (+117661us) raft_consensus.cc:1631] Marking committed up to 15
0925 16:46:44.647415 (+    39us) raft_consensus.cc:1683] Filling consensus response to leader.
0925 16:46:44.647484 (+    69us) raft_consensus.cc:1654] Waiting on the replicates to finish logging
0925 16:46:45.544354 (+896870us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b44000232cc. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198f14a95 00007f7198f154b2 00007f719bbbd511 00007f719bbb8e1a 00007f719bbacbee 00007f719bbabf36 00007f719bbabb58 00007f719bbb5551 00007f719bbb5509 00007f719bbb5499
0925 16:46:45.546309 (+  1955us) raft_consensus.cc:1671] finished
0925 16:46:45.546329 (+    20us) raft_consensus.cc:1677] UpdateReplicas() finished
0925 16:46:45.546522 (+   193us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":6690,"raft.queue_time_us":8346,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"spinlock_wait_cycles":242273664,"thread_start_us":117251,"threads_started":1,"wal-append.queue_time_us":320832}
W20260925 16:46:45.549695 18171 log.cc:924] Time spent T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.661s	user 0.005s	sys 0.001s
W20260925 16:46:45.553714  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:45.554248  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 673820us
W20260925 16:46:45.554847  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.555209  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.521216 18108 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.542273 18176 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.471645 18149 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:46:45.558408 18082 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:45.514743 18196 log.cc:924] Time spent T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.139s	user 0.000s	sys 0.001s
I20260925 16:46:45.495087 18086 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.536096 18132 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.537880 18189 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:45.569576  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 88747.3us
W20260925 16:46:45.561313 18197 log.cc:924] Time spent T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.235s	user 0.005s	sys 0.000s
W20260925 16:46:45.576651  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 95383.3us
I20260925 16:46:45.482219 17743 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
I20260925 16:46:45.484499 17625 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.088s
W20260925 16:46:45.611537 18207 log.cc:924] Time spent T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
W20260925 16:46:45.587916  8921 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.614217 18185 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.593601 18108 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.616182 18179 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.597142 18149 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.619078 18082 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.619235 18149 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.526335 17668 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.586690 18102 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:45.622093 18198 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.247s	user 0.000s	sys 0.001s
I20260925 16:46:45.576257 17934 raft_consensus.cc:482] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:45.601545  8940 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.605064  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.617746 18108 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:45.608733  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 53906.6us
I20260925 16:46:45.623172 17934 raft_consensus.cc:504] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:45.626897  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.632810  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.629863  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.630705  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:45.634522  9123 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.632551 17761 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:45.641309  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.641516  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "505ce6aba0e14faabdb5e6135e200af6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.643260  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.644731  9119 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:45.645772  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:45.646898  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:45.647675  9043 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.634056 18108 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260925 16:46:45.653257  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8ee8e183d4e44c21804c9d95ed71dd2e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:45.670372  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 43496.8us
I20260925 16:46:45.643620 18179 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.674134  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:45.677059  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.681047  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.681829  9045 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:45.683259  8940 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.658082 18189 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:45.701923  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.703970  8940 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.702433 18102 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.709547 18065 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:45.667820 18172 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.714702 18172 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:45.701674 17761 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:45.720139  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.723011  9701 raft_consensus.cc:3037] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:45.726928  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 26 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:45.727710  9123 raft_consensus.cc:3037] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:45.746275 17934 leader_election.cc:288] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.746815  9089 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:45.749317 17803 consensus_meta.cc:287] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: Time spent flushing consensus metadata: real 0.519s	user 0.010s	sys 0.000s
I20260925 16:46:45.749904 17803 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:45.750459  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 362862us
I20260925 16:46:45.751991 18193 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260925 16:46:45.752388 18209 log.cc:924] Time spent T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:45.702370 18189 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.753247 18189 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:45.752396 18193 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.755774 18193 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:45.765364  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.769196  9121 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
W20260925 16:46:45.772208  8939 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 50615us
I20260925 16:46:45.780972  9043 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:45.782984  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a3daaf3df10a402a9f2af4eae42e46da" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.784893  9014 leader_election.cc:302] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.788792  9701 raft_consensus.cc:2454] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
W20260925 16:46:45.792078  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 166895us
I20260925 16:46:45.793129  9016 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.793334  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:45.717612 18179 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:45.796408  9123 raft_consensus.cc:2454] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 28.
I20260925 16:46:45.807360  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.808135  9695 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 22.
I20260925 16:46:45.809639  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.806756  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 24 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:45.810366  9697 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:45.810632  9696 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:45.814548 17788 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:45.816792  9701 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260925 16:46:45.815200  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 146291us
W20260925 16:46:45.845321  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 174116us
I20260925 16:46:45.845606  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.777158 18119 raft_consensus.cc:482] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:45.783018 17934 raft_consensus.cc:482] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:45.850560  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:45.851465  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:45.792068 18102 raft_consensus.cc:2726] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:45.815186 17788 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:45.817107 18174 raft_consensus.cc:2781] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:45.856645  9697 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.862886  9695 raft_consensus.cc:1261] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260925 16:46:45.850307 18179 raft_consensus.cc:482] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:45.868208 17971 thread.cc:636] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.005s	sys 0.024s
W20260925 16:46:45.868656 17971 thread.cc:602] wal-append [worker] (thread pool) Time spent starting thread: real 1.042s	user 0.005s	sys 0.024s
I20260925 16:46:45.870000  9696 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
W20260925 16:46:45.870877 17970 thread.cc:636] prepare [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.006s	sys 0.029s
W20260925 16:46:45.871299 17970 thread.cc:602] prepare [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.006s	sys 0.029s
I20260925 16:46:45.867333 18174 raft_consensus.cc:686] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:45.880633 18174 consensus_queue.cc:237] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.861402 17803 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:45.856159 17934 raft_consensus.cc:504] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.898515 17934 leader_election.cc:288] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.859232 18212 consensus_queue.cc:1046] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260925 16:46:45.901990  9696 raft_consensus.cc:1261] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260925 16:46:45.804842 18193 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.909416  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:45.911374  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.859058 18121 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
W20260925 16:46:45.916425  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 212549us
I20260925 16:46:45.914096  9014 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:45.906029  9090 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.920540  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07fa6fea161b4a24904740819d2f89fa" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:45.928493  8940 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.856333 18119 raft_consensus.cc:504] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.933568  9124 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:45.934401  8941 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:45.933312  9014 leader_election.cc:302] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:45.910377 18149 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:45.945256  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:45.951742  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
W20260925 16:46:45.931777 18170 log.cc:924] Time spent T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260925 16:46:45.923306 17803 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:45.931777 18172 raft_consensus.cc:2781] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:45.931375 18090 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:45.912873 18179 raft_consensus.cc:504] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.944036 18132 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:45.931538 17876 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.041s
W20260925 16:46:45.975040  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 54792us
I20260925 16:46:45.947481 18135 raft_consensus.cc:2726] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:45.921835 18121 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:45.972108 18147 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:45.973479 18090 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:45.997009 18090 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:45.973629 18108 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:45.977703 18172 raft_consensus.cc:686] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:45.955060 18149 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:46.002967  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72262.5us
I20260925 16:46:45.974200 18116 consensus_queue.cc:1035] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260925 16:46:45.995304 17978 raft_consensus.cc:3032] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Stepping down as leader of term 22
I20260925 16:46:45.966238 18219 consensus_queue.cc:1035] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.046s
W20260925 16:46:46.017853  9727 heartbeater.cc:644] Failed to heartbeat to 127.7.158.254:39187 (7 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.7.158.254:39187 timed out after 15.000s (SENT)
W20260925 16:46:46.018153 18224 log.cc:924] Time spent T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
W20260925 16:46:46.018963 18217 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260925 16:46:46.012243 18132 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:46.020049 18216 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260925 16:46:46.020145 18132 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:46.021450 18214 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260925 16:46:46.022451 18132 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:45.980657 17803 consensus_queue.cc:1035] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.025s
I20260925 16:46:46.028270 18193 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.030553 18121 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.008687 18147 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.014783 17978 raft_consensus.cc:729] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.034634  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.047089  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.047672  9042 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:46.047906  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.048918  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:46.050688  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 145563us
I20260925 16:46:46.053768  9123 raft_consensus.cc:1226] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 23. Current term is 24. Ops: []
W20260925 16:46:46.058872  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46610.4us
W20260925 16:46:46.063613  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 135938us
W20260925 16:46:46.065225  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.065476  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.065665  9089 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.066496  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.067091  9050 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 15.
I20260925 16:46:46.068781  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.069463  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.070066  9699 raft_consensus.cc:3037] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 29
I20260925 16:46:46.070963  9121 raft_consensus.cc:1226] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Rejecting Update request from peer 225d3432101a4758bb9a6b0efeae09c5 for earlier term 22. Current term is 23. Ops: [22.13-22.13]
I20260925 16:46:46.062184 18193 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:46.062703 17788 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:46.087570  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:46.089102 18232 log.cc:924] Time spent T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260925 16:46:46.060400 17409 consensus_queue.cc:1035] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.021s
I20260925 16:46:46.073642 18179 leader_election.cc:288] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:46.094806  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.105993  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeecf611404e405fa30831f973aec8f1" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:46.113884  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.114439  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.071929 17978 consensus_queue.cc:260] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.115927 17978 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Advancing to term 23
W20260925 16:46:46.117385 18231 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260925 16:46:46.120883 18147 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 14, Current term: 27, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.127272  9016 leader_election.cc:302] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.130613  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60973.3us
W20260925 16:46:46.130810  9089 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.131636  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.137153  9695 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:46.137072  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "82c043c282244d42a0ae912a76bcbe36" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:46.152827  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 1.26264e+06us
W20260925 16:46:46.153956  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.151057  9042 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 29.
W20260925 16:46:46.154495  9089 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.110365 18119 leader_election.cc:288] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.104487 18235 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260925 16:46:46.154898  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.157078  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 52048.1us
I20260925 16:46:46.160414  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:46.160203  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.073850 18172 consensus_queue.cc:237] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.18, Last appended by leader: 18, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.129341 18229 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:46.152290 18174 raft_consensus.cc:2726] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:46.169867  9042 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260925 16:46:46.176256  9089 leader_election.cc:334] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.178663  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.156163 18149 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.169306 18235 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:46.214699 17668 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:46.206318 17625 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260925 16:46:46.216398 17625 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:46.216790 17625 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Advancing to term 17
I20260925 16:46:46.218287 18189 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.219836 18144 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:46.221772 18090 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.230244 18090 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.240327  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.240960  9050 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.239681  9699 raft_consensus.cc:2454] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 29.
I20260925 16:46:46.209411 18121 raft_consensus.cc:482] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:46:46.249351  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 87308.9us
I20260925 16:46:46.250564  8941 leader_election.cc:302] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.254145  9090 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:46.256326  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:46.256803  9119 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:46:46.260407  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 79705.9us
I20260925 16:46:46.265211  9121 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:46.267379  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.268052  9700 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.257462 18116 raft_consensus.cc:2781] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader election won for term 29
I20260925 16:46:46.270318 18116 raft_consensus.cc:686] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:46.271131 18116 consensus_queue.cc:237] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.258415 18147 raft_consensus.cc:2726] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260925 16:46:46.278260 18147 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260925 16:46:46.284498  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
W20260925 16:46:46.268420  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.286326  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.286691  9666 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:46.264096  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 110494us
I20260925 16:46:46.288932  9119 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:46.290177  9700 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:46.290961  8939 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:46.300930  8941 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:46.252375 18121 raft_consensus.cc:504] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.287843 18229 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:46.295634 18189 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.311985 18229 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.308640 18185 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:46.318902 18185 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.319800 18185 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.308737 18249 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:46.326359 18121 leader_election.cc:288] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.327975  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.329622 18176 raft_consensus.cc:3037] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.332497  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.333192  9695 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Advancing to term 24
I20260925 16:46:46.333256  9697 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:46.333822  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436e4feae1ee4bf7932369f80db76c34" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.303736 17978 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:46.337152  9014 leader_election.cc:302] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.343331  9700 raft_consensus.cc:1261] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:46.297132 17625 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.349085  9695 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
W20260925 16:46:46.350634  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet d3ff365de6e84921a6af19e793363f70, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:46.358405  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet d3ff365de6e84921a6af19e793363f70, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:46.362542  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.354894 17931 consensus_queue.cc:1035] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
W20260925 16:46:46.367411  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.368229  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.350567 18184 raft_consensus.cc:2726] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:46.347605 17978 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.377033 18184 raft_consensus.cc:482] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.377565 18184 raft_consensus.cc:504] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.379786 18184 leader_election.cc:288] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.380496  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.380748  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "549559d524ae4003aa83f35d26b7f4b9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.382200  9014 leader_election.cc:302] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.382589  9042 raft_consensus.cc:1261] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
W20260925 16:46:46.374509  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.383967 18184 raft_consensus.cc:2726] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260925 16:46:46.383919  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.384727  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.386235  9043 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "72e548ac0b7b407dbc32d2018beb932d" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.387008  9043 raft_consensus.cc:2354] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:46.387409 18193 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:46.396621  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.399156  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.400111  9046 raft_consensus.cc:2379] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 24: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:46.373713 18082 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260925 16:46:46.423467 17625 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:46.432268 18250 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
W20260925 16:46:46.437557  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:46.439152 18229 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:46.354884 17953 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.022s
I20260925 16:46:46.446470  9695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:46.446699 17978 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.456274  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7e6790e980f40f8aeb12986a2ac7ed6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.460866  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:46.461727  9042 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:46:46.464850 17788 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:46.376545 18121 raft_consensus.cc:482] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:46.466233 18121 raft_consensus.cc:504] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.465394 17788 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.458986  9050 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
W20260925 16:46:46.470599  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.471040  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:46.483837  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.485023  9015 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:46.487897 17788 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.488849 18121 leader_election.cc:288] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.491189  9665 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:46.491499  9665 leader_election.cc:401] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Cancelling election due to peer responding with higher term
I20260925 16:46:46.492666  9042 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 17.
I20260925 16:46:46.493975  8940 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:46.496795  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7035ef77210644d1a724b7ba26706f52" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.501910  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:46.507054  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.499353 18229 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:46.499505 18239 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election lost for term 28. Reason: Vote denied by peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:46.484020 18116 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:46.509980 18229 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.512054 18229 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:46.515129 18211 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Leader election won for term 17
I20260925 16:46:46.515918 18211 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:46.517441 17899 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.517925 17899 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.520330 17899 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.521725  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:46.524075  9089 leader_election.cc:334] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.526916  9089 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.529192  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.502792 18119 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:46.538919  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b41a723075b4ed5b21758d5b37cd917" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.553917  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.546416 18116 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:46.564025  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.572587  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:46.516882 18211 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:46.531674  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.576493 18112 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:46.593530 18086 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.594100 18086 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.596689 18086 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.597576  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:46.629568  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 48339.2us
I20260925 16:46:46.560212  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 26.
I20260925 16:46:46.637116  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853
I20260925 16:46:46.637950  9015 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:46.650375  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f750a9cc810645b19ac831fe20c1010e" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:46.648653 18205 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:46.677876  8941 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.704955  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 173277us
W20260925 16:46:46.707067  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.GetConsensusState -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 47623.1us
I20260925 16:46:46.704926  9042 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260925 16:46:46.712031  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.703377 18205 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:46:46.727252  9015 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.728739  9015 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.706350 18121 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260925 16:46:46.710067 18144 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:46:46.789299 18268 log.cc:924] Time spent T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260925 16:46:46.790160 18186 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.729809 18205 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Advancing to term 27
W20260925 16:46:46.791029 18226 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260925 16:46:46.791728 17899 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.727233 18148 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
W20260925 16:46:46.805733  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:46.856431  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 499525us
W20260925 16:46:46.857204  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.814484 18066 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 18 FOLLOWER]: Advancing to term 19
W20260925 16:46:46.835232  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 105452us
I20260925 16:46:46.838419  9701 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
W20260925 16:46:46.851212  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.830250 18256 log.cc:924] Time spent T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.270s	user 0.001s	sys 0.000s
I20260925 16:46:46.857630  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:46.861044  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.863583  9015 leader_election.cc:334] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.864245  9015 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.865872  9015 leader_election.cc:334] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.866525  9015 leader_election.cc:302] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:46.852625 18258 log.cc:924] Time spent T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260925 16:46:46.859067 18088 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:46.869741  9666 leader_election.cc:334] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.890327  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:46.890929  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:46.870157 18098 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:46.854581 18186 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.873097 17899 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:46.888712  9042 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260925 16:46:46.904290  9702 raft_consensus.cc:1261] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 29 index: 22. (index mismatch)
I20260925 16:46:46.911507  9041 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:46.889365 18169 raft_consensus.cc:2726] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:46.884051 18121 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:46:46.905196 18090 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.030s
I20260925 16:46:46.912410 17788 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.022s
I20260925 16:46:46.939864 18082 consensus_queue.cc:1035] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.001s
I20260925 16:46:46.903482 18088 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.950915 17899 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.952178 18212 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:46.955531 18108 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.957324 18186 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:46.958600  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.961018 17931 raft_consensus.cc:482] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:46.974820  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:46.985733 17931 raft_consensus.cc:504] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:46.988243  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49c7db4b3fda45159275230bc247b929" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.989609  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c0923848b9b426eade76023fdecc31c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:46.997500 18088 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:46.994765 18090 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:46.991109 18108 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.003505 18090 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.011104 18090 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.011925  9119 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 27 index: 15. (index mismatch)
I20260925 16:46:47.013042 17931 leader_election.cc:288] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.013443  9115 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
I20260925 16:46:47.014055 18088 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.014528 18088 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.016281 18088 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.016526  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.017202  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.017252 18088 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:47.017634 18212 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.000s
I20260925 16:46:47.019654  8940 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.026372  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.030305 17755 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.031219  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.032021  9115 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 18.
I20260925 16:46:47.033388  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:47.034377 17978 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:47.034845 17978 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:47.035235 17978 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:46.994932 18205 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.037551 18205 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.038655  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.040726 18108 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.041082  8940 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.043221 18088 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:47.043408  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a2fce9318b914cda8815dd44730712b6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.047664  8940 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.048934  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.050984  9702 raft_consensus.cc:3032] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Stepping down as leader of term 15
I20260925 16:46:47.051303  9702 raft_consensus.cc:729] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 LEADER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:47.052155  9702 consensus_queue.cc:260] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.053923 18088 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:47.054057  9696 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:46:47.054613  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:47.055155  9115 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 27
I20260925 16:46:47.087667  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:47.088476  9042 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:47.086882 18108 raft_consensus.cc:482] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.092743  9045 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bbd44a1efa8149a7bbcd2a06b68c6ce8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.096069  9702 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 15 FOLLOWER]: Advancing to term 17
I20260925 16:46:47.110553  9042 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:47.115849  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.116699  9700 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 19.
I20260925 16:46:47.127796  8941 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.134626  8941 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.134799  8940 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:47.142262  9115 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 27.
I20260925 16:46:47.100803 17902 raft_consensus.cc:482] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.154775  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 24 index: 19. (index mismatch)
W20260925 16:46:47.155094 18279 log.cc:924] Time spent T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260925 16:46:47.157779 18088 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.001s
I20260925 16:46:47.141613 18176 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:47.143761 18234 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:47.144536 18223 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.098740 18108 raft_consensus.cc:504] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.147017 18186 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.053s
I20260925 16:46:47.151427 17902 raft_consensus.cc:504] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:47.219985  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 328479us
I20260925 16:46:47.199860 18234 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:47.230754  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.231210  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:47.232002 17409 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260925 16:46:47.238016  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.238451  9666 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:47.239490  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:47.240033  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:47.240236  8940 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 105523us
I20260925 16:46:47.228567 18176 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:47.247393 18176 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:47.264287  9046 raft_consensus.cc:1226] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Rejecting Update request from peer e3a3bc92ca0a4efa913eca1800a1550d for earlier term 15. Current term is 17. Ops: []
I20260925 16:46:47.267242  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.267798 18108 leader_election.cc:288] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.269388  9699 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.270092  9702 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:47.272979 17409 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:47.287317  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd5f4e4896584eaca2d16610e2afbda8" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 27 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.300647  9046 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260925 16:46:47.286298 17902 leader_election.cc:288] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.285071 18108 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.020s
I20260925 16:46:47.313758  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50e0cc681d6a47be89a47aef9f5e14f4" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.327463  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a54776b5e30341f1b8e3b9acd31b9027" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.327685 17409 consensus_queue.cc:1035] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:47.289561 18176 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 25.20, Last appended by leader: 20, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.328007  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:47.330619  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet 3c0923848b9b426eade76023fdecc31c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:47.332330  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet 3c0923848b9b426eade76023fdecc31c, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.332697 17409 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:47.337503  9666 leader_election.cc:398] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Vote denied by peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245) with higher term. Message: Invalid argument: T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d for earlier term 28. Current term is 29.
I20260925 16:46:47.337357  9016 leader_election.cc:302] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.336651  8939 leader_election.cc:302] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.342315  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.345134 17409 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:47.346987 18281 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260925 16:46:47.320160 18177 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260925 16:46:47.358616 17978 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.353667 18132 raft_consensus.cc:2726] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260925 16:46:47.349979 17907 raft_consensus.cc:2726] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:47.369349  9124 raft_consensus.cc:1261] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 25 index: 17. Preceding OpId from leader: term: 28 index: 19. (index mismatch)
W20260925 16:46:47.373215  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.373852  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:47.379981 18098 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:47.380016 17931 consensus_queue.cc:1035] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.006s
I20260925 16:46:47.388532  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:47.388607  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:47.389312  9700 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:47.389488  9116 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Advancing to term 20
I20260925 16:46:47.398609  9700 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:47.387379 17978 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Requested vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.391270 17743 raft_consensus.cc:482] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:47.404903 18290 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260925 16:46:47.407675 17743 raft_consensus.cc:504] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:47.431177  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:47.431636  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 140853us
I20260925 16:46:47.433087 17743 leader_election.cc:288] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.433025  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.449806  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb346a4d887940099443a0219edadef0" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.468607  9116 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 20.
I20260925 16:46:47.472824  8939 leader_election.cc:302] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.473907  8939 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853; no voters: 
I20260925 16:46:47.478235 18148 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:47.478773 18148 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:47.479609 18148 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.470451 17625 raft_consensus.cc:482] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.481029 17625 raft_consensus.cc:504] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.482961 17625 leader_election.cc:288] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:47.484998  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:47.469622 18293 log.cc:924] Time spent T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260925 16:46:47.492100 18234 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.493448 17931 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:47.493968 17931 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.494593  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.502790  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.503611  9119 raft_consensus.cc:2379] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 23: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:47.476580 18297 raft_consensus.cc:2726] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:46:47.497354  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.497655  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.495889 17931 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.521148 18066 raft_consensus.cc:482] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader e3a3bc92ca0a4efa913eca1800a1550d)
I20260925 16:46:47.522027 18066 raft_consensus.cc:504] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:47.524509 18066 leader_election.cc:288] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:47.525152  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "aa99d4dee31544f3b7bfe97ab9e9e3a3" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.534399  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:47.538084  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.542938  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9bced284cac6492d92b23e3fcf0b9c80" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:46:47.521373  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:47.546654  8941 leader_election.cc:302] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.555099  9015 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:47.550628  8868 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 12 to 15, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 15 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.560798  8868 catalog_manager.cc:5495] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 22 to 23, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:47.562709  8868 catalog_manager.cc:5495] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 25, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 25 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.567513  8868 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.569677  8868 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 18, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 18 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.572567  8868 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 20 to 22, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.580981  8868 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 23 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:47.583469  8868 catalog_manager.cc:5495] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 13 to 20. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
W20260925 16:46:47.579869 18299 log.cc:924] Time spent T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.055s	user 0.004s	sys 0.000s
I20260925 16:46:47.559686 17788 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:47.591620  8941 leader_election.cc:302] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.574579 18172 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:47.560297 18297 raft_consensus.cc:2726] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:47.593638  8868 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 17 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:47.596949  8941 leader_election.cc:302] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:47.601310  8868 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:47.602880  8868 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 22 to 25, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 25 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.605099  8868 catalog_manager.cc:5495] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.603969 18223 raft_consensus.cc:2726] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.605532 17978 raft_consensus.cc:2726] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:47.622321  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:47.630438  8868 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 18 to 22. New cstate: current_term: 22 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.637887  8868 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 15 to 19, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 19 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:47.641458  8868 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:47.653046  8867 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 346) took 17334 ms (client timeout 15000 ms). Trace:
W20260925 16:46:47.673190  7803 thread.cc:536] Waited for 1000ms trying to join with heartbeat (tid 9000)
I20260925 16:46:47.673414 18066 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:46:47.673895 18066 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.678767  8868 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 20 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:47.653561  8867 rpcz_store.cc:269] 0925 16:46:30.318775 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:30.318950 (+   175us) service_pool.cc:227] Handling call
0925 16:46:47.652948 (+17333998us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:45.378599 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:45.575712 (+197113us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:45.585762 (+ 10050us) write_op.cc:435] Acquired schema lock
0925 16:46:45.588331 (+  2569us) tablet.cc:660] Decoding operations
0925 16:46:45.746123 (+157792us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:45.746228 (+   105us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:45.746255 (+    27us) tablet.cc:683] Acquiring locks for 24 operations
0925 16:46:45.748208 (+  1953us) tablet.cc:699] Row locks acquired
0925 16:46:45.748253 (+    45us) write_op.cc:260] PREPARE: finished
0925 16:46:45.748406 (+   153us) write_op.cc:270] Start()
0925 16:46:45.748547 (+   141us) write_op.cc:276] Timestamp: P: 1790354805748350 usec, L: 0
0925 16:46:45.748568 (+    21us) op_driver.cc:331] REPLICATION: starting
0925 16:46:45.901166 (+152598us) log.cc:842] Serialized 9440 byte log entry
0925 16:46:46.264910 (+363744us) op_driver.cc:444] REPLICATION: finished
0925 16:46:46.379721 (+114811us) write_op.cc:301] APPLY: starting
0925 16:46:46.379821 (+   100us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:46.594924 (+215103us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:46.595107 (+   183us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:47.052982 (+457875us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:47.053302 (+   320us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=0,mrs_lookups=0
0925 16:46:47.053343 (+    41us) write_op.cc:312] APPLY: finished
0925 16:46:47.053742 (+   399us) log.cc:842] Serialized 212 byte log entry
0925 16:46:47.053906 (+   164us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:47.054111 (+   205us) write_op.cc:454] Released schema lock
0925 16:46:47.054171 (+    60us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:47.054509 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:47.054542 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":110403,"apply.run_cpu_time_us":35091,"apply.run_wall_time_us":675604,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104303,"cfile_init":1,"lbm_read_time_us":452,"lbm_reads_lt_1ms":4,"num_ops":24,"prepare.queue_time_us":53540,"prepare.run_cpu_time_us":26309,"prepare.run_wall_time_us":660063,"raft.queue_time_us":161232,"raft.run_cpu_time_us":27051,"raft.run_wall_time_us":118512,"replication_time_us":511670,"thread_start_us":238707,"threads_started":4,"wal-append.queue_time_us":148596}]]}
I20260925 16:46:47.710165  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.693435  8868 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 29 to 32, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 32 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:47.714241  8868 catalog_manager.cc:5495] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 reported cstate change: term changed from 24 to 27, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 27 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:47.729231  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ee9de086f49c4026931c128637888218" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.735316  8940 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.720266 18172 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:47.721555 18066 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:47.748360  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 105774us
W20260925 16:46:47.747135  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 111795us
I20260925 16:46:47.741487 17755 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:46:47.784055  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:46:47.827322 18205 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.828040 18205 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.830127 18205 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.831374  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.832224  9047 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:47.833127  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:47.837754 18066 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:46:47.838142 18066 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:47.838472 18066 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:47.839571  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.842872  9116 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 23.
I20260925 16:46:47.846640 18066 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.849175  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:47.849777  9046 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:47.856438 18066 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.860576  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:47.861222  9116 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:46:47.862816  9046 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:47.863957  8940 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:47.864723 18066 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:46:47.865211 18066 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Becoming Leader. State: Replica: 225d3432101a4758bb9a6b0efeae09c5, State: Running, Role: LEADER
I20260925 16:46:47.866015 18066 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.883461  9116 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 225d3432101a4758bb9a6b0efeae09c5 in term 24.
I20260925 16:46:47.890964  9700 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:47.892812 18205 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:47.899804  9116 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:47.902393 18177 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260925 16:46:47.923880  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:47.916612 18066 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:47.931988 18066 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:47.934342 18066 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:47.934850  9047 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 25 index: 20. Preceding OpId from leader: term: 27 index: 21. (index mismatch)
I20260925 16:46:47.937776  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:47.941043 18177 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260925 16:46:47.944796  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d5ba69a70184d858b847e046b24564c" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 28 candidate_status { last_received { term: 25 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:47.949975  8939 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:47.955225 18205 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:47.959281  9116 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 225d3432101a4758bb9a6b0efeae09c5: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:47.984906 17743 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260925 16:46:48.077059  8868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38634 (request call id 348) took 4569 ms. Trace:
I20260925 16:46:48.078684  8871 catalog_manager.cc:5495] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 20 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.086436  8871 catalog_manager.cc:5495] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.100596  8871 catalog_manager.cc:5495] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.103399  8871 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 21, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.084321  8868 rpcz_store.cc:276] 0925 16:46:43.507584 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:43.507939 (+   355us) service_pool.cc:227] Handling call
0925 16:46:48.076957 (+4569018us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:47.844319 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:47.844894 (+   575us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:47.844920 (+    26us) write_op.cc:435] Acquired schema lock
0925 16:46:47.844930 (+    10us) tablet.cc:660] Decoding operations
0925 16:46:47.846255 (+  1325us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:47.846326 (+    71us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:47.846363 (+    37us) tablet.cc:683] Acquiring locks for 18 operations
0925 16:46:47.869760 (+ 23397us) tablet.cc:699] Row locks acquired
0925 16:46:47.869782 (+    22us) write_op.cc:260] PREPARE: finished
0925 16:46:47.869934 (+   152us) write_op.cc:270] Start()
0925 16:46:47.870050 (+   116us) write_op.cc:276] Timestamp: P: 1790354807869879 usec, L: 0
0925 16:46:47.870072 (+    22us) op_driver.cc:331] REPLICATION: starting
0925 16:46:47.871974 (+  1902us) log.cc:842] Serialized 7083 byte log entry
0925 16:46:47.919820 (+ 47846us) op_driver.cc:444] REPLICATION: finished
0925 16:46:47.968211 (+ 48391us) write_op.cc:301] APPLY: starting
0925 16:46:47.968296 (+    85us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:47.993614 (+ 25318us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:47.993717 (+   103us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.012241 (+ 18524us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.012580 (+   339us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=36,key_file_lookups=36,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.012632 (+    52us) write_op.cc:312] APPLY: finished
0925 16:46:48.013066 (+   434us) log.cc:842] Serialized 164 byte log entry
0925 16:46:48.023884 (+ 10818us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.024074 (+   190us) write_op.cc:454] Released schema lock
0925 16:46:48.024136 (+    62us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.024474 (+   338us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.024504 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87255,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":48102,"apply.run_cpu_time_us":22074,"apply.run_wall_time_us":56837,"cfile_cache_hit":74,"cfile_cache_hit_bytes":79259,"num_ops":18,"prepare.queue_time_us":12193,"prepare.run_cpu_time_us":4791,"prepare.run_wall_time_us":29429,"replication_time_us":49648,"thread_start_us":39538,"threads_started":2}]]}
I20260925 16:46:48.110981  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:46:48.112300  7803 tablet_replica.cc:330] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.113202  7803 raft_consensus.cc:2229] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.113732  7803 raft_consensus.cc:2258] T 49c7db4b3fda45159275230bc247b929 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.105257  8871 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.126045  8871 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 26. New cstate: current_term: 26 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.127945  8871 catalog_manager.cc:5495] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 27, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 27 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.132247  8871 catalog_manager.cc:5495] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 17, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 17 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.137801  7803 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.137279  8871 catalog_manager.cc:5495] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 19 to 21, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.138844  7803 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.139884  7803 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.142576  7803 tablet_replica.cc:330] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.143770  8871 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 23 to 25, leader changed from 40a71744ceba4efe949720cb0f274853 (127.7.158.195) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.149713  8871 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 23, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.148527  7803 raft_consensus.cc:2229] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.152370  7803 pending_rounds.cc:62] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.152643  7803 pending_rounds.cc:68] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 27 index: 17 } timestamp: 7333293233795870720 op_type: NO_OP noop_request { }
I20260925 16:46:48.153085  7803 raft_consensus.cc:2866] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.153815  8871 catalog_manager.cc:5495] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.155221  8871 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 27 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.156169  7803 raft_consensus.cc:2258] T f15ade9737ac41438bda476a00b4ad97 P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.157784  8871 catalog_manager.cc:5495] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 29. New cstate: current_term: 29 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.179796  7803 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.184572  7803 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.185213  7803 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.192581  7803 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.193491  7803 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.194036  7803 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.196774  7803 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.197552  7803 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.198644  7803 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.201511  7803 tablet_replica.cc:330] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.202277  7803 raft_consensus.cc:2229] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.202847  7803 pending_rounds.cc:62] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.203066  7803 pending_rounds.cc:68] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 25 index: 17 } timestamp: 7333293229069107200 op_type: NO_OP noop_request { }
I20260925 16:46:48.203389  7803 raft_consensus.cc:2866] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.204258  7803 raft_consensus.cc:2258] T 4d5ba69a70184d858b847e046b24564c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.220141  7803 tablet_replica.cc:330] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.228984  7803 raft_consensus.cc:2229] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.229840  7803 pending_rounds.cc:62] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.230101  7803 pending_rounds.cc:68] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 24 index: 14 } timestamp: 7333293293027586048 op_type: NO_OP noop_request { }
I20260925 16:46:48.230476  7803 raft_consensus.cc:2866] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.230808  7803 raft_consensus.cc:2258] T d3ff365de6e84921a6af19e793363f70 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.233842  7803 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.234634  7803 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.236145  7803 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.238548  7803 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.239256  7803 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.239801  7803 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.246624  7803 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.248459  7803 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.248939  7803 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P 225d3432101a4758bb9a6b0efeae09c5 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.251478  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.252180  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.252674  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.255666  7803 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.256974  7803 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.258224  7803 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.260747 17743 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:48.261219 17743 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:48.263146 17743 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:48.264978  7803 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.266381  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:48.267639  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a92341cf5104c9eba99c812ba97c735" candidate_uuid: "225d3432101a4758bb9a6b0efeae09c5" candidate_term: 25 candidate_status { last_received { term: 23 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:48.277601  8940 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 225d3432101a4758bb9a6b0efeae09c5; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:48.278775 17743 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:48.304119  7803 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.305635  7803 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P 225d3432101a4758bb9a6b0efeae09c5 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.332461  8871 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 344) took 4020 ms. Trace:
I20260925 16:46:48.332978  8871 rpcz_store.cc:276] 0925 16:46:44.311910 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:44.317565 (+  5655us) service_pool.cc:227] Handling call
0925 16:46:48.332372 (+4014807us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:48.187968 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:48.188491 (+   523us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:48.188522 (+    31us) write_op.cc:435] Acquired schema lock
0925 16:46:48.188541 (+    19us) tablet.cc:660] Decoding operations
0925 16:46:48.189849 (+  1308us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:48.189918 (+    69us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:48.189947 (+    29us) tablet.cc:683] Acquiring locks for 14 operations
0925 16:46:48.190927 (+   980us) tablet.cc:699] Row locks acquired
0925 16:46:48.190943 (+    16us) write_op.cc:260] PREPARE: finished
0925 16:46:48.191073 (+   130us) write_op.cc:270] Start()
0925 16:46:48.191182 (+   109us) write_op.cc:276] Timestamp: P: 1790354808191027 usec, L: 0
0925 16:46:48.191197 (+    15us) op_driver.cc:331] REPLICATION: starting
0925 16:46:48.205288 (+ 14091us) log.cc:842] Serialized 5546 byte log entry
0925 16:46:48.207644 (+  2356us) op_driver.cc:444] REPLICATION: finished
0925 16:46:48.208082 (+   438us) write_op.cc:301] APPLY: starting
0925 16:46:48.208157 (+    75us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:48.219298 (+ 11141us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:48.219390 (+    92us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.250556 (+ 31166us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.250902 (+   346us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=28,key_file_lookups=28,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.259626 (+  8724us) write_op.cc:312] APPLY: finished
0925 16:46:48.265652 (+  6026us) log.cc:842] Serialized 129 byte log entry
0925 16:46:48.266420 (+   768us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.266581 (+   161us) write_op.cc:454] Released schema lock
0925 16:46:48.266638 (+    57us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.266963 (+   325us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.266998 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":17323,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":211,"apply.run_cpu_time_us":17185,"apply.run_wall_time_us":59329,"cfile_cache_hit":56,"cfile_cache_hit_bytes":58436,"num_ops":14,"prepare.queue_time_us":1744,"prepare.run_cpu_time_us":4334,"prepare.run_wall_time_us":17601,"replication_time_us":16345}]]}
I20260925 16:46:48.335258  7803 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.340718  7803 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.352487  7803 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.370879  8865 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 14 to 16, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 16 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.373278  8865 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:48.385219  7803 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.386404  7803 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.386920  7803 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.401250  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.402148  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.403383  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.415951  7803 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:46:48.416026  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.416795  7803 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.418601  7803 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.420678  7803 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.421415  7803 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.422353  7803 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.436633  7803 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.437431  7803 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.438385  7803 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.441500  7803 tablet_replica.cc:330] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.442176  7803 raft_consensus.cc:2229] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.442749  7803 raft_consensus.cc:2258] T 9a92341cf5104c9eba99c812ba97c735 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.445139  7803 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.445829  7803 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.446327  7803 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P 225d3432101a4758bb9a6b0efeae09c5 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.448889  7803 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.449555  7803 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.450500  7803 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.464773  7803 tablet_replica.cc:330] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.467387  7803 raft_consensus.cc:2229] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.468369  7803 raft_consensus.cc:2258] T ef3a95f58f62434d84bf19310c928a92 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.470803  7803 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.471558  7803 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.472514  7803 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.487155  7803 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.487917  7803 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.488956  7803 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.492635  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.493309  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.493803  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.496187  7803 tablet_replica.cc:330] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.496939  7803 raft_consensus.cc:2229] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.497475  7803 raft_consensus.cc:2258] T 505ce6aba0e14faabdb5e6135e200af6 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.507831  7803 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.516516  7803 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.525334  7803 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.527827  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.528541  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.529043  7803 pending_rounds.cc:62] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Trying to abort 1 pending ops.
I20260925 16:46:48.529268  7803 pending_rounds.cc:68] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5: Aborting op as it isn't in flight: id { term: 23 index: 14 } timestamp: 7333293276713717760 op_type: NO_OP noop_request { }
I20260925 16:46:48.529603  7803 raft_consensus.cc:2866] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted
I20260925 16:46:48.529901  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.532224  7803 tablet_replica.cc:330] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.532862  7803 raft_consensus.cc:2229] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.533305  7803 raft_consensus.cc:2258] T 8ee8e183d4e44c21804c9d95ed71dd2e P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.543073  9046 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:48.547379  7803 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.548275  7803 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.549324  7803 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P 225d3432101a4758bb9a6b0efeae09c5 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.537405  8865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 343) took 28701 ms (client timeout 15000 ms). Trace:
I20260925 16:46:48.551843  7803 tablet_replica.cc:330] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.552632  7803 raft_consensus.cc:2229] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.553751  7803 raft_consensus.cc:2258] T 401361a5d37b4eefa49285e758f2f67b P 225d3432101a4758bb9a6b0efeae09c5 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.556483  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.557224  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.558218  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.559446  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.561344  7803 tablet_replica.cc:330] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.562103  7803 raft_consensus.cc:2229] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.562659  7803 raft_consensus.cc:2258] T 4b41a723075b4ed5b21758d5b37cd917 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.565186  7803 tablet_replica.cc:330] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.565860  7803 raft_consensus.cc:2229] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.566637  7803 raft_consensus.cc:2258] T 088ac48c62d34a40b53987746a70b871 P 225d3432101a4758bb9a6b0efeae09c5 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.569298  7803 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.570019  7803 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.570981  7803 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P 225d3432101a4758bb9a6b0efeae09c5 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.566057  8871 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.574579  7803 tablet_replica.cc:330] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:46:48.575174  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.576308  7803 raft_consensus.cc:2229] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.576391  8871 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 21 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.577517  7803 raft_consensus.cc:2258] T 42b301336d224f89acb2543ae4e24a12 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.578202  8871 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:48.579422  9016 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c756d218cfc0470183a9fe1cc08a22ab. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:48.582471  9123 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260925 16:46:48.585300 18284 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:48.586905  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:48.550904  8865 rpcz_store.cc:269] 0925 16:46:19.836078 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:20.004056 (+167978us) service_pool.cc:227] Handling call
0925 16:46:48.537338 (+28533282us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:48.402868 (+     0us) spinlock_profiling.cc:243] Waited 1.08 ms on lock 0x7b5400002728. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f71a244be91 00007f71a244aafc 00007f719f94d7cc 00007f719f939603 00007f719f9392b8 00007f719f93dba1 00007f719f93db59 00007f719f93dae9 00007f719f93dab1 00007f719f93cdad 00007f71a2266204
0925 16:46:48.402950 (+    82us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:48.403410 (+   460us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:48.403441 (+    31us) write_op.cc:435] Acquired schema lock
0925 16:46:48.403453 (+    12us) tablet.cc:660] Decoding operations
0925 16:46:48.403925 (+   472us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:48.403976 (+    51us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:48.404005 (+    29us) tablet.cc:683] Acquiring locks for 2 operations
0925 16:46:48.404298 (+   293us) tablet.cc:699] Row locks acquired
0925 16:46:48.404333 (+    35us) write_op.cc:260] PREPARE: finished
0925 16:46:48.408130 (+  3797us) write_op.cc:270] Start()
0925 16:46:48.409982 (+  1852us) write_op.cc:276] Timestamp: P: 1790354808407894 usec, L: 0
0925 16:46:48.411372 (+  1390us) op_driver.cc:331] REPLICATION: starting
0925 16:46:48.423991 (+ 12619us) log.cc:842] Serialized 924 byte log entry
0925 16:46:48.435183 (+ 11192us) op_driver.cc:444] REPLICATION: finished
0925 16:46:48.437586 (+  2403us) write_op.cc:301] APPLY: starting
0925 16:46:48.437659 (+    73us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:48.438836 (+  1177us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:48.438872 (+    36us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.440000 (+  1128us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.440177 (+   177us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=4,key_file_lookups=4,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.440221 (+    44us) write_op.cc:312] APPLY: finished
0925 16:46:48.440411 (+   190us) log.cc:842] Serialized 33 byte log entry
0925 16:46:48.441982 (+  1571us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.442067 (+    85us) write_op.cc:454] Released schema lock
0925 16:46:48.442108 (+    41us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.442406 (+   298us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.442433 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":473131,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":2143,"apply.run_cpu_time_us":3664,"apply.run_wall_time_us":5082,"cfile_cache_hit":8,"cfile_cache_hit_bytes":8348,"num_ops":2,"prepare.queue_time_us":8585,"prepare.run_cpu_time_us":11368,"prepare.run_wall_time_us":41818,"replication_time_us":23714,"spinlock_wait_cycles":2489728}]]}
I20260925 16:46:48.580168  7803 tablet_replica.cc:330] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.599427  7803 raft_consensus.cc:2229] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.579757  8871 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 21 to 26. New cstate: current_term: 26 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.600382  7803 raft_consensus.cc:2258] T ee9de086f49c4026931c128637888218 P 225d3432101a4758bb9a6b0efeae09c5 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.600811  8871 catalog_manager.cc:5495] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 27 to 28, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.602792  8871 catalog_manager.cc:5495] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 17 to 26, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 26 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.603734  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.604480  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.604135  8871 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.605077  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.605546  8871 catalog_manager.cc:5495] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 26 to 28. New cstate: current_term: 28 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.607510  7803 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.612147  8870 catalog_manager.cc:5042] ChangeConfig:REMOVE_PEER RPC for tablet c694676902c54ad8bfe8e7fd5a725e33 with cas_config_opid_index 5: aborting the task: latest config opid_index 8; task opid_index 5
I20260925 16:46:48.606980  8871 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 15 to 17, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 17 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.616951 18284 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:48.616962  8871 catalog_manager.cc:5495] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 15 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 24 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.618974  8871 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 23 to 26, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.620496  8871 catalog_manager.cc:5495] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 25 to 27. New cstate: current_term: 27 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.628921  8871 catalog_manager.cc:5495] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.630520  8871 catalog_manager.cc:5495] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 16 to 22. New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.628981  9123 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Committing config change with OpId 20.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:48.632510  8871 catalog_manager.cc:5495] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 27 to 29. New cstate: current_term: 29 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:48.627554  8870 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38640 (request call id 341) took 79358 ms (client timeout 15000 ms). Trace:
W20260925 16:46:48.633987  8870 rpcz_store.cc:269] 0925 16:45:29.269313 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:29.274329 (+  5016us) service_pool.cc:227] Handling call
0925 16:45:29.733638 (+459309us) spinlock_profiling.cc:243] Waited 155 ms on lock 0x7b5400002dd4. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f719beafaf0 00007f719bf32f2a 00007f71a1e84d6c 00007f71a1f7ec3e 00007f71a0290fb4 00007f71a0290f42 00007f71a0290e71 00007f71a0290dec 00007f71a02900a2 00007f719a35494c 00007f719a353d86
0925 16:46:48.627458 (+78893820us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":858,"reported_tablets":47,"spinlock_wait_cycles":356358016}
I20260925 16:46:48.638943  7803 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.641139  7803 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P 225d3432101a4758bb9a6b0efeae09c5 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.643814  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.645783  8921 auto_rebalancer.cc:254] failed to send replica move request: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:48.648921  7803 tablet_replica.cc:330] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.645155  8871 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 27, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 27 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:48.650251  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.650707  7803 raft_consensus.cc:2229] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.650261  8871 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 22 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } }
I20260925 16:46:48.652352  7803 raft_consensus.cc:2258] T c71d03191b9f4a22a2ae4170c54fd018 P 225d3432101a4758bb9a6b0efeae09c5 [term 32 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.654392  8871 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:48.657622  7803 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.658321  7803 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:46:48.659528  7803 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.669863  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:48.670224  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:48.674595  7803 tablet_replica.cc:330] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.675431  7803 raft_consensus.cc:2229] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.675979  7803 raft_consensus.cc:2258] T e7e6790e980f40f8aeb12986a2ac7ed6 P 225d3432101a4758bb9a6b0efeae09c5 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.683069  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:48.685094  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:48.689357  7803 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.690225  7803 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.690876  7803 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P 225d3432101a4758bb9a6b0efeae09c5 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:46:48.693663  7803 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
I20260925 16:46:48.694389  7803 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 LEADER]: Raft consensus shutting down.
W20260925 16:46:48.694473  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.699805  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:48.704726  7803 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P 225d3432101a4758bb9a6b0efeae09c5 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.704902  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet eb346a4d887940099443a0219edadef0, TS 225d3432101a4758bb9a6b0efeae09c5 -> TS e3a3bc92ca0a4efa913eca1800a1550d move failed, destination replica disappeared from tablet's Raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:48.707885  7803 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5: stopping tablet replica
W20260925 16:46:48.704698  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.708621  7803 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:46:48.709322  7803 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P 225d3432101a4758bb9a6b0efeae09c5 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260925 16:46:48.717757  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.720556  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.759083  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.814558  8871 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:48.833194  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.833280  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.837901  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:48.882918  8873 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 16 to 19, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 19 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:48.901137  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:48.901044  9108 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:43368
W20260925 16:46:48.913070  8872 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 344) took 70746 ms (client timeout 15000 ms). Trace:
W20260925 16:46:48.914808  8872 rpcz_store.cc:269] 0925 16:45:38.166837 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:38.167113 (+   276us) service_pool.cc:227] Handling call
0925 16:46:48.912884 (+70745771us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":3654,"reported_tablets":47}
I20260925 16:46:48.932090  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet c694676902c54ad8bfe8e7fd5a725e33 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
I20260925 16:46:48.937726  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:48.946225  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.969527  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.981035  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:48.999842  8873 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 224) took 19243 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.012545  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): ChangeConfig:REMOVE_PEER RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:46:49.000253  8873 rpcz_store.cc:269] 0925 16:46:29.755989 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:29.756295 (+   306us) service_pool.cc:227] Handling call
0925 16:46:48.999387 (+19243092us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:48.915737 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:48.916240 (+   503us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:48.916290 (+    50us) write_op.cc:435] Acquired schema lock
0925 16:46:48.916309 (+    19us) tablet.cc:660] Decoding operations
0925 16:46:48.916655 (+   346us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:48.916713 (+    58us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:48.916743 (+    30us) tablet.cc:683] Acquiring locks for 1 operations
0925 16:46:48.916921 (+   178us) tablet.cc:699] Row locks acquired
0925 16:46:48.916940 (+    19us) write_op.cc:260] PREPARE: finished
0925 16:46:48.917077 (+   137us) write_op.cc:270] Start()
0925 16:46:48.917183 (+   106us) write_op.cc:276] Timestamp: P: 1790354808917036 usec, L: 0
0925 16:46:48.917205 (+    22us) op_driver.cc:331] REPLICATION: starting
0925 16:46:48.917768 (+   563us) log.cc:842] Serialized 536 byte log entry
0925 16:46:48.919611 (+  1843us) op_driver.cc:444] REPLICATION: finished
0925 16:46:48.920087 (+   476us) write_op.cc:301] APPLY: starting
0925 16:46:48.920165 (+    78us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:48.920949 (+   784us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:48.921047 (+    98us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:48.921735 (+   688us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:48.921928 (+   193us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=0,mrs_lookups=0
0925 16:46:48.921980 (+    52us) write_op.cc:312] APPLY: finished
0925 16:46:48.922148 (+   168us) log.cc:842] Serialized 25 byte log entry
0925 16:46:48.922295 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.922370 (+    75us) write_op.cc:454] Released schema lock
0925 16:46:48.922413 (+    43us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:48.922709 (+   296us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:48.922735 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":166261,"reported_tablets":39,"child_traces":[["op",{"apply.queue_time_us":273,"apply.run_cpu_time_us":2871,"apply.run_wall_time_us":2870,"cfile_cache_hit":4,"cfile_cache_hit_bytes":4174,"num_ops":1,"prepare.queue_time_us":4045,"prepare.run_cpu_time_us":2294,"prepare.run_wall_time_us":2301,"replication_time_us":2321}]]}
I20260925 16:46:49.021629 18323 ts_tablet_manager.cc:927] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.030318 18323 tablet_copy_client.cc:316] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:46:49.032397  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet c756d218cfc0470183a9fe1cc08a22ab from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:46:49.032927  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet c756d218cfc0470183a9fe1cc08a22ab from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-c756d218cfc0470183a9fe1cc08a22ab
I20260925 16:46:49.045712  9059 tablet_copy_source_session.cc:205] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:49.051893 18323 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c756d218cfc0470183a9fe1cc08a22ab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:46:49.074148  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet adae4a9dd16346529fe4ff004abc3603 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 4 (current committed config index is 14)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:49.075853  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet adae4a9dd16346529fe4ff004abc3603 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:49.156384  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:49.157286  9111 tablet_service.cc:1514] Processing DeleteTablet for tablet c694676902c54ad8bfe8e7fd5a725e33 with delete_type TABLET_DATA_TOMBSTONED (Replica with old config index 5 (current committed config index is 8)) from {username='slave'} at 127.0.0.1:43368
I20260925 16:46:49.159010  8858 catalog_manager.cc:4841] TS 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): tablet c694676902c54ad8bfe8e7fd5a725e33 (table test-workload [id=821a2d47e19d4e0ca3e68d6e78c035d1]) successfully deleted
W20260925 16:46:49.164582  8864 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 345) took 40883 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.167271  8864 rpcz_store.cc:269] 0925 16:46:08.281381 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:08.287388 (+  6007us) service_pool.cc:227] Handling call
0925 16:46:49.164476 (+40877088us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":61797,"reported_tablets":47}
I20260925 16:46:49.208443 18323 tablet_copy_client.cc:791] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:49.209196 18323 tablet_copy_client.cc:655] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:49.222862  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 60245.8us
I20260925 16:46:49.229568 18282 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.230072 18282 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.236927  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.245505 18282 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.262974  8866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 223) took 40788 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.272521  8866 rpcz_store.cc:269] 0925 16:46:08.474104 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:12.169513 (+3695409us) service_pool.cc:227] Handling call
0925 16:46:49.262768 (+37093255us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":27882,"reported_tablets":39}
I20260925 16:46:49.276288  8867 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 21 to 25. New cstate: current_term: 25 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.279599  8867 catalog_manager.cc:5495] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 13 to 17, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 17 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:49.280751 18323 tablet_copy_client.cc:531] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:49.281611  8867 catalog_manager.cc:5495] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:49.286023  9015 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260925 16:46:49.289537  9015 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.291728 18284 raft_consensus.cc:2726] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:46:49.292387  8869 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 222) took 75889 ms (client timeout 15000 ms). Trace:
W20260925 16:46:49.294332  8869 rpcz_store.cc:269] 0925 16:45:33.402838 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:45:33.403814 (+   976us) service_pool.cc:227] Handling call
0925 16:46:49.292187 (+75888373us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":1348913,"reported_tablets":39}
I20260925 16:46:49.293208  8867 catalog_manager.cc:5495] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 22 to 30, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 30 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.296613  8867 catalog_manager.cc:5495] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 19 to 23. New cstate: current_term: 23 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:49.304529 17788 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.305094 17788 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.306932 17788 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.312995  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.314177 18098 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.314697 18098 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.316753 18098 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.319602  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.320246  9047 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:49.322914  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.326181 17409 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:49.326588 17409 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.327020 17409 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:49.333233 18284 raft_consensus.cc:482] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.333832 18284 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.368290 18284 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.369940  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:49.388654  8939 connection.cc:441] server connection from 127.0.0.1:41948 torn down before Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:41948 (request call id 1928) could send its response
W20260925 16:46:49.390100  9089 connection.cc:535] client connection to 127.7.158.193:40071 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 16:46:49.412814  9015 connection.cc:535] client connection to 127.7.158.193:40071 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
W20260925 16:46:49.423996  9015 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.380870 17409 raft_consensus.cc:504] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.439301  9701 raft_consensus.cc:2379] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 18: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:49.439610 17409 leader_election.cc:288] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:49.441993  9666 connection.cc:698] client connection to 127.7.158.193:40071 send error: Network error: sendmsg error: Connection reset by peer (error 104)
I20260925 16:46:49.442487  9016 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.444265 18284 raft_consensus.cc:3037] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:49.445508  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "918e188b611843cb98bcddc996c7fc3a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:49.453647 17409 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.454272 17409 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.455634 17409 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.456328 18323 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:46:49.457522  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 125357us
W20260925 16:46:49.462072  9089 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.462694  9089 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.463382  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.464473 17788 raft_consensus.cc:2726] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:49.468660 18284 raft_consensus.cc:2726] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260925 16:46:49.524547 17788 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.528129 18327 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.529340 18327 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.531985 18326 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.532111 18282 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.535662 18325 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.536695 18325 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.540470 18098 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.526785 17788 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.541640 18098 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.542361 18325 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.545099 17788 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.533169 18326 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.564563 17788 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.565433 17788 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.533174 18282 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:49.577648  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:49.578349  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.580099  9666 leader_election.cc:334] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.586889 18327 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.587903 18098 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.592947 18326 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:49.593289  9015 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.593484 17788 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.595520  9046 raft_consensus.cc:2454] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:49.596005 18282 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.603534 18282 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.605909 18282 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.610319 18282 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.604501  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.615252  9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 196 similar messages]
I20260925 16:46:49.616068  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.617035  9047 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:49.621592  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.623234  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:49.623867  9015 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.623973  9696 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:49.626437 18326 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.634650  9016 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:49.636904  9089 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.638041  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.639653 18284 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:49.635803 18326 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.640398 18284 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:49.640781 18284 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.642333 18284 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:49.627223 17788 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.643405 18326 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.644161 17788 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.647035 17788 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.648483 18169 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.647641 17788 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.664297 18169 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.667127 18337 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.668075 18337 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.670719 18337 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.676391  9666 leader_election.cc:302] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.677706 18338 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.678539 18338 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.683261 18338 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.686789 18337 raft_consensus.cc:2781] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:49.688553 18337 raft_consensus.cc:686] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:49.689383 18169 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.664286 17788 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.690630 18337 consensus_queue.cc:237] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.701555 18335 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.702315 18335 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.701859 17788 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.709451  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.710414  9696 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 19.
I20260925 16:46:49.711884 18325 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.712759 18325 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.715660 18325 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.720599  8867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 347) took 2785 ms. Trace:
I20260925 16:46:49.723939  8867 rpcz_store.cc:276] 0925 16:46:46.934898 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:47.738855 (+803957us) service_pool.cc:227] Handling call
0925 16:46:49.720376 (+1981521us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:49.301256 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:49.301752 (+   496us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:49.301789 (+    37us) write_op.cc:435] Acquired schema lock
0925 16:46:49.301810 (+    21us) tablet.cc:660] Decoding operations
0925 16:46:49.302484 (+   674us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:49.302553 (+    69us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:49.302587 (+    34us) tablet.cc:683] Acquiring locks for 5 operations
0925 16:46:49.303164 (+   577us) tablet.cc:699] Row locks acquired
0925 16:46:49.303185 (+    21us) write_op.cc:260] PREPARE: finished
0925 16:46:49.303324 (+   139us) write_op.cc:270] Start()
0925 16:46:49.303462 (+   138us) write_op.cc:276] Timestamp: P: 1790354809303277 usec, L: 0
0925 16:46:49.303486 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:46:49.304042 (+   556us) log.cc:842] Serialized 2065 byte log entry
0925 16:46:49.305952 (+  1910us) op_driver.cc:444] REPLICATION: finished
0925 16:46:49.306379 (+   427us) write_op.cc:301] APPLY: starting
0925 16:46:49.306451 (+    72us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:49.309064 (+  2613us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:49.309149 (+    85us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:49.336350 (+ 27201us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:49.336570 (+   220us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=10,key_file_lookups=10,delta_file_lookups=0,mrs_lookups=0
0925 16:46:49.336617 (+    47us) write_op.cc:312] APPLY: finished
0925 16:46:49.336917 (+   300us) log.cc:842] Serialized 57 byte log entry
0925 16:46:49.337949 (+  1032us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:49.338048 (+    99us) write_op.cc:454] Released schema lock
0925 16:46:49.338090 (+    42us) write_op.cc:341] FINISH: Updating metrics
0925 16:46:49.367257 (+ 29167us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:49.367289 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":34339,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":245,"apply.run_cpu_time_us":7284,"apply.run_wall_time_us":61209,"cfile_cache_hit":20,"cfile_cache_hit_bytes":20870,"num_ops":5,"prepare.queue_time_us":111,"prepare.run_cpu_time_us":3033,"prepare.run_wall_time_us":3034,"replication_time_us":2393}]]}
I20260925 16:46:49.721403 18335 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.728865 18284 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.731783 18284 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.733942  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:46:49.696722  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.742216  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.742653  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.743058  9696 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:49.745041  9090 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.753193 18335 raft_consensus.cc:2726] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:49.753825 18335 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.754436 18335 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.756845 18335 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.760507  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.761499 18334 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.762037 18334 raft_consensus.cc:482] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.762653 18327 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.763597 18327 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.766803  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.766757 18327 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.769219 18325 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:49.772303 18325 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.772343  8868 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:50106 (request call id 225) took 2504 ms. Trace:
I20260925 16:46:49.772835 18325 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:49.773674  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.772985  8868 rpcz_store.cc:276] 0925 16:46:47.267324 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:48.110643 (+843319us) service_pool.cc:227] Handling call
0925 16:46:49.772077 (+1661434us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":171177,"reported_tablets":39}
W20260925 16:46:49.768326  9016 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 56389.6us
I20260925 16:46:49.780766 18284 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.780994 18339 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:49.781370 18284 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.781688 18339 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.783942 18169 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.784086  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.785075  9047 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:46:49.784837 18169 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.783496 18284 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.779868 18326 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.786480  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.787158 18169 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.787285  9696 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
I20260925 16:46:49.789572  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.767544 18334 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.791290  9700 raft_consensus.cc:3037] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:49.796062 18169 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.796692 18169 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.797199  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.797847  9701 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:49.798728  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.798982 18169 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.800567  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.800711  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "adae4a9dd16346529fe4ff004abc3603" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.801182  9041 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:49.801456  9046 raft_consensus.cc:2379] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 22: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:49.802169  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.802780  9048 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
W20260925 16:46:49.804122  9666 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.804711  9666 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:49.804721  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.805867  9015 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.806231  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.808612  9016 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.807904 18336 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.812038 18339 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.812297  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.812798 18336 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.812515 18337 raft_consensus.cc:2726] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:49.814800  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.815461  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:49.816383 18282 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:49.786541 18326 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.816949 18282 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.817442 18282 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:49.818737 18326 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.819909  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.823462 18340 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.824486 18339 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.829596  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.830412  9116 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 17.
I20260925 16:46:49.825006  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.826421 18337 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:49.825135  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.832671 18337 raft_consensus.cc:482] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.833156 18337 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
I20260925 16:46:49.823789  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:49.830021 18339 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.834487 17788 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.834843 17788 raft_consensus.cc:482] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.835215 17788 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.814829 18336 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.835858 18339 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.810626 18169 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.838160 18169 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.839586  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.828663  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.848054  9696 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
I20260925 16:46:49.840641  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.843324  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.848707  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.849526 18327 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:49.849879  9116 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:49.845515  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.846298  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.845997 17788 raft_consensus.cc:504] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.825587 18340 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.852937  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.853439 17788 leader_election.cc:288] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.828644 18325 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.853487 18340 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.853802 18335 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:49.850528 18326 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:49.849957 18327 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.854487 18335 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.854537  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.855114 18327 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:49.855244 18335 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:49.855579 18325 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.855772  9046 raft_consensus.cc:2396] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 for term 25 because replica has last-logged OpId of term: 22 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 12.
I20260925 16:46:49.859889  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "516644be414e4a399c722f9df11d3ff5" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.860450  9701 raft_consensus.cc:3037] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:49.861222 18334 raft_consensus.cc:504] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.863811 18326 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:49.866339  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.850696  9015 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.901472 18326 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.901786  9015 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.902515 18284 raft_consensus.cc:2726] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:46:49.902674  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52020.9us
W20260925 16:46:49.903450  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.904131  9015 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.863300 18327 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.872051  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.905912  9119 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:49.865201  9700 raft_consensus.cc:2454] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:49.870601  9701 raft_consensus.cc:2454] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 20.
W20260925 16:46:49.876660  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.906826 18327 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.907130  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:49.908061  9666 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.901549  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:49.908581  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:49.909015  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.909628  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.910351  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.910998  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.884212 18337 raft_consensus.cc:504] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.888478 18282 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.889061 18338 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.891422 18325 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.912441 18338 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.912516 18325 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.892868 18334 leader_election.cc:288] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.913530 18337 leader_election.cc:288] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.913911 18334 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:46:49.913563 18282 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.894253 18336 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.914568 18338 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:49.915009 18336 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.895988  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d1eb29a67e8482385d79fa193c4edd3" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.917083  9696 raft_consensus.cc:3037] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.914765 18325 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.918149  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:49.918746  9048 raft_consensus.cc:3037] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.900413 17409 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.919979 17409 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.921082 18325 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.921620 18325 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:49.922415 17409 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.923208  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:49.923650 18327 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:46:49.923888  9041 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 32.
I20260925 16:46:49.928643 18282 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.928591 18335 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.929376 18282 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.929734 18336 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.872393 18169 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:49.931505 18282 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.920550  9666 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.932683  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.933017  9666 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.933158  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:46:49.933996  9089 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.923972 18325 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:49.937222  9016 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.932165  9048 raft_consensus.cc:2454] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:49.937484  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.934762  9696 raft_consensus.cc:2454] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:49.937763  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:49.938257  9700 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 25: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:49.935091 17788 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:49.939527  9090 leader_election.cc:302] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:49.940203 17788 raft_consensus.cc:2781] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:49.940855 17788 raft_consensus.cc:686] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:49.941776 17788 consensus_queue.cc:237] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.942894  8868 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.957855  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "42b301336d224f89acb2543ae4e24a12" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.957376  8868 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 19 to 20, leader changed from e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) to 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193). New cstate: current_term: 20 leader_uuid: "225d3432101a4758bb9a6b0efeae09c5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:49.958761  9123 raft_consensus.cc:2379] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:49.962481  9115 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.944061 18326 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.964141  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.964800  9123 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 26.
I20260925 16:46:49.966670  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.967754  9014 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.967839  9665 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.968806 18334 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.969373 18284 raft_consensus.cc:2726] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:46:49.970512 18327 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260925 16:46:49.970654 18098 raft_consensus.cc:2726] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:49.970933 18327 raft_consensus.cc:482] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.971395 18327 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:49.975685 18340 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:49.964803  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.976784  9014 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.948545  9016 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.977118  9116 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:49.976271 18339 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:49.934664  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.948815 18325 raft_consensus.cc:2781] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:49.978929  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:49.979147 18325 raft_consensus.cc:686] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:49.969373 18334 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.980113 18325 consensus_queue.cc:237] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 19.17, Last appended by leader: 17, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.981029 18282 raft_consensus.cc:2781] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:49.981534 18282 raft_consensus.cc:686] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:49.980187  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:49.950024  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6e5cd4cb635e42ce8ee7624b47b5750a" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.949800 18169 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.984412 18169 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.982432 18282 consensus_queue.cc:237] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:49.954149  9015 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:49.963152  9115 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 32.
I20260925 16:46:49.976253 18340 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.986408  9015 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:49.987100 18336 raft_consensus.cc:2726] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260925 16:46:49.988080 18340 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.980070 18341 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:46:49.978212 18339 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:49.982599  9121 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:49.982896  9700 raft_consensus.cc:3037] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:46:49.991035 18339 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:49.985774  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:49.991856  9701 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 21: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:49.994635  9665 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:49.996340 18338 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:49.996665  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:49.997442  9046 raft_consensus.cc:2379] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 25: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:49.997327  9665 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:49.950387 18335 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:49.948382  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:49.999069  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 50788.5us
W20260925 16:46:49.999521  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:49.999940  9666 leader_election.cc:334] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.000360  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.003726 18338 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.004263 18338 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.006126 18338 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.006316 18327 raft_consensus.cc:504] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.006982 18169 raft_consensus.cc:2726] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:46:49.982458 18334 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:50.009615  9666 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.009773 18327 leader_election.cc:288] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.010442 18326 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.010625  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.011274  9701 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
I20260925 16:46:50.012454  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.014351  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.015087 18336 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260925 16:46:50.015360  9701 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.020112  9701 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:46:50.020820 18336 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.023810  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:50.018582  9700 raft_consensus.cc:2454] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 26.
I20260925 16:46:50.021606 18284 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:50.022713  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.021608 18326 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.024473  9123 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:50.025250  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:46:50.026222  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.021970  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.025943 18337 raft_consensus.cc:2741] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election decision vote started in defunct term 25: won
I20260925 16:46:50.024996 18284 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.028139 18284 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.028784  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.029651 18282 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260925 16:46:50.029732 17788 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:50.030207 18282 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.030400 17788 raft_consensus.cc:482] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.030817 18282 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 32 FOLLOWER]: Advancing to term 33
I20260925 16:46:50.027513 18334 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.031958 18334 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.030877 17788 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.032393 18334 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.025485 18326 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.036015 18326 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.036755  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dff93d0dcc5944b0b73fca3da91c5b2c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.037340  9123 raft_consensus.cc:3037] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Advancing to term 18
I20260925 16:46:50.041370 17788 raft_consensus.cc:504] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.047925  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.048743  9048 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:50.053575  9665 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.053941 18284 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.054577  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.055243  9048 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:46:50.024092 18336 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Advancing to term 27
W20260925 16:46:50.061054  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 126398us
W20260925 16:46:50.062484  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.062732  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.063498  9041 raft_consensus.cc:2379] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:50.046458  9123 raft_consensus.cc:2454] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 18.
I20260925 16:46:50.064865  9046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c694676902c54ad8bfe8e7fd5a725e33" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.066068 18327 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.066480 18327 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.067102 18327 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.071861 18169 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.071986 18284 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.072506 18169 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.073472  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.075265  9090 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.076061 18335 raft_consensus.cc:2781] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:46:50.076601 18335 raft_consensus.cc:686] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.077606 18335 consensus_queue.cc:237] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.076159 18346 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:50.071421 18334 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.085772  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "401361a5d37b4eefa49285e758f2f67b" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 24 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.086319  9123 raft_consensus.cc:3037] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.086757  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.088212  9089 leader_election.cc:302] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.097909 18326 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.098479 18326 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.074512 18169 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.088748 18346 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Leader pre-election won for term 33
I20260925 16:46:50.092764  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:50.095434 18337 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
W20260925 16:46:50.099081  9015 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.108431  9015 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.108848  9015 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:50.100485 18335 raft_consensus.cc:2781] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:50.110217 18335 raft_consensus.cc:686] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.110607 18336 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.111138 18335 consensus_queue.cc:237] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.112133 18334 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.100539 18326 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.113972  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.100628 18337 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.115558  9123 raft_consensus.cc:2454] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:50.117184 18337 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.097178  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.097002 18282 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.118218 18339 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:46:50.118587 18339 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.118925 18339 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:50.119297 18282 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.065454  9046 raft_consensus.cc:3037] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:50.096418  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.099956  9116 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
W20260925 16:46:50.120698  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.100122 18346 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.121508 18346 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 32 FOLLOWER]: Advancing to term 33
I20260925 16:46:50.117274 18336 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.100924  9665 leader_election.cc:302] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:46:50.123524  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.123785  9666 leader_election.cc:334] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.124521 18350 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260925 16:46:50.125962  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.126513  9089 leader_election.cc:334] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.126920  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.127451  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.127955  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
W20260925 16:46:50.128245  9089 leader_election.cc:334] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.102157 17788 leader_election.cc:288] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.135867 17788 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.138135  9116 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef3a95f58f62434d84bf19310c928a92" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 27 candidate_status { last_received { term: 26 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.138321  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.138700  9116 raft_consensus.cc:3037] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Advancing to term 27
I20260925 16:46:50.141907 17788 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.146004  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "66c62931d7564a9698d331185552eed5" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.146584  9700 raft_consensus.cc:3037] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.136053 18337 raft_consensus.cc:2781] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Leader election won for term 18
I20260925 16:46:50.152249 18337 raft_consensus.cc:686] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.153092 18337 consensus_queue.cc:237] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.158562 18346 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.160539  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.166646  9116 raft_consensus.cc:2454] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 27.
I20260925 16:46:50.160991 17788 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.149259  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.161474  9700 raft_consensus.cc:2454] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 25.
W20260925 16:46:50.168550  9015 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.168988  9015 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:50.172744  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:50.173322  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.173740  9015 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:50.177809  9090 leader_election.cc:302] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.179075  9014 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.181784  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.183915  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.185454  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.186800  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.191092 18169 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:50.194712 18340 raft_consensus.cc:2781] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.195371 18340 raft_consensus.cc:686] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.172001 18282 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.196866 18330 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.197314 18330 raft_consensus.cc:482] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.196552 18340 consensus_queue.cc:237] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.197090 18282 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.197669 18330 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.199110 18282 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.177738 18325 raft_consensus.cc:2726] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260925 16:46:50.201840  9048 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 24.
I20260925 16:46:50.202037  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:50.200577 18098 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:50.105142 18327 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.205497  9123 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 33: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:50.206007  9041 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.202842  9700 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 28.
W20260925 16:46:50.205632  9089 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.206127  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.205395 17409 raft_consensus.cc:2726] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
W20260925 16:46:50.210935  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.211024  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.211658  9047 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 27.
W20260925 16:46:50.211668  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.212457  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.213172  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.210086  9041 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:50.217731  9014 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.217746  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.218894 17788 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:46:50.219242 17788 raft_consensus.cc:482] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.219640  9696 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 28: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:50.219612 17788 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.208794 18325 raft_consensus.cc:2781] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.207645 18098 raft_consensus.cc:482] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.177320 18339 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.223549  9046 raft_consensus.cc:2454] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 22.
I20260925 16:46:50.217044 18282 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260925 16:46:50.227578  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:50.225610  8869 catalog_manager.cc:5495] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 19 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.222345 18169 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:50.228998  8869 catalog_manager.cc:5495] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 21 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.228299  9042 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 19.
I20260925 16:46:50.224550 18098 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:50.224932 18336 raft_consensus.cc:2781] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Leader election won for term 27
I20260925 16:46:50.231639 18169 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.235476 18169 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:50.240217  9089 leader_election.cc:334] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.240578 18327 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.227066 18282 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.241523 18282 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:50.244282 18346 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.243278  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.245580 18336 raft_consensus.cc:686] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.256574  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 33 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.257422  9050 raft_consensus.cc:2379] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Leader election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 33: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:50.259666 18282 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.265560 18336 consensus_queue.cc:237] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 26.16, Last appended by leader: 16, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.273542 18282 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.274397 17788 raft_consensus.cc:504] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.261297  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:50.275501  9015 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.276441  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.277210  9015 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 27 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.278038  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.278504  9015 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:46:50.284324 17788 leader_election.cc:288] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.285317  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 75260.1us
I20260925 16:46:50.286079  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.287453  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.288383 17409 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:50.288410  9666 leader_election.cc:302] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.288731 17409 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.289119 17409 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:50.271003 18323 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=15 overwritten=1 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:50.283217 18325 raft_consensus.cc:686] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.290773  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:50.286331 18282 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260925 16:46:50.294718  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6eaf0bf4e06942b0b3b3684cfa1f3cc6" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 21 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.295310  9047 raft_consensus.cc:3037] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.291003 18338 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260925 16:46:50.296517  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.293241 18327 raft_consensus.cc:2781] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:50.316164 18338 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260925 16:46:50.326472  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.327101  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 33 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.308508 18337 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260925 16:46:50.333845 18338 raft_consensus.cc:482] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.336402 18338 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.326153 18327 raft_consensus.cc:686] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.340924 18327 consensus_queue.cc:237] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.354719  9047 raft_consensus.cc:2454] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 28.
I20260925 16:46:50.360087 18339 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.361057 18098 raft_consensus.cc:504] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.335809 18337 raft_consensus.cc:482] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Starting leader election (detected failure of leader 225d3432101a4758bb9a6b0efeae09c5)
I20260925 16:46:50.363967 18337 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:50.365025  9089 leader_election.cc:302] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.317255 18169 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.372700 18098 leader_election.cc:288] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.372692 18169 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:50.374354  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.384343 18339 raft_consensus.cc:2781] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:46:50.385152 18339 raft_consensus.cc:686] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.386315 18339 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 21, Committed index: 21, Last appended: 27.21, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.388181 18323 tablet_bootstrap.cc:492] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:50.389207 18323 ts_tablet_manager.cc:1397] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.933s	user 0.052s	sys 0.021s
I20260925 16:46:50.389111 17409 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.334720 18340 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Leader election lost for term 33. Reason: could not achieve majority
I20260925 16:46:50.394809 18338 raft_consensus.cc:504] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:50.335409  9665 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 108624us
I20260925 16:46:50.391894  9696 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate 8dc3391062084f45a6ba62d28d340722 in current term 29: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:46:50.398029  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.398242  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:50.398715  9123 raft_consensus.cc:2379] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 28: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
I20260925 16:46:50.399300 17788 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:50.394829 18323 raft_consensus.cc:348] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:50.400753 18323 raft_consensus.cc:729] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:50.401639 18323 consensus_queue.cc:260] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:50.403899  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.410691 17409 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:46:50.408959  9089 leader_election.cc:334] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.409523  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 115281us
W20260925 16:46:50.414391  9089 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.418723  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "088ac48c62d34a40b53987746a70b871" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 23 candidate_status { last_received { term: 22 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.419301  9124 raft_consensus.cc:3037] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Advancing to term 23
I20260925 16:46:50.443368  9124 raft_consensus.cc:2454] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 23.
I20260925 16:46:50.316447 18330 raft_consensus.cc:504] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.451315 18330 leader_election.cc:288] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.445703  9014 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.456073  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3503b0ca8a04458ea73d2c6d127f2463" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:50.458348  9696 raft_consensus.cc:3037] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:46:50.462677 18284 raft_consensus.cc:2781] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Leader election won for term 23
W20260925 16:46:50.468701  9015 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.442536 18338 leader_election.cc:288] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.471616  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.476452  9701 raft_consensus.cc:1203] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Deduplicated request from leader. Original: 20.13->[20.14-20.14]   Dedup: 20.14->[]
I20260925 16:46:50.497751 18284 raft_consensus.cc:686] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.477706  9695 raft_consensus.cc:1261] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 19 index: 17. Preceding OpId from leader: term: 20 index: 18. (index mismatch)
I20260925 16:46:50.502200 18284 consensus_queue.cc:237] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.15, Last appended by leader: 15, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.486297  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.504169 18352 consensus_queue.cc:1035] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260925 16:46:50.506132  9700 raft_consensus.cc:1261] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260925 16:46:50.507395 17788 consensus_queue.cc:1035] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:50.507619 18323 ts_tablet_manager.cc:1428] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.118s	user 0.005s	sys 0.006s
I20260925 16:46:50.505038  9123 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.513420 18337 raft_consensus.cc:504] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.515329 18337 leader_election.cc:288] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:50.391112 18325 consensus_queue.cc:237] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 24.16, Last appended by leader: 16, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.519101  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.522243  9123 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:50.522889  9015 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:50.523942  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:50.530315  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 220033us
I20260925 16:46:50.531399  9696 raft_consensus.cc:2454] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:46:50.532371  9090 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.528887 18169 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
W20260925 16:46:50.535184  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.536643 17788 raft_consensus.cc:2781] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:46:50.537163 17788 raft_consensus.cc:686] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:50.538002 17788 consensus_queue.cc:237] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.518584 18364 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:46:50.547053  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:50.547552  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.548427  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.551610  9701 raft_consensus.cc:1261] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:50.554759  9050 raft_consensus.cc:1261] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:50.554811  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfcf558f0a6b4011a3cb46c3ebbe4a3e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.555569  9047 raft_consensus.cc:3037] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
I20260925 16:46:50.558810 18364 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.561760 18340 consensus_queue.cc:1035] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260925 16:46:50.562139 18364 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.564275  9047 raft_consensus.cc:2454] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:50.564713  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:50.565354  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 24.
I20260925 16:46:50.568831  9050 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 29 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.571743  9050 raft_consensus.cc:2379] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 29: Already voted for candidate 8dc3391062084f45a6ba62d28d340722 in this term.
I20260925 16:46:50.578701  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5db686f01e4748d0b9ce8fe3b96a5895" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 25 candidate_status { last_received { term: 24 index: 19 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.578998  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "12359c2bff0b46de91daa934c219103c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.579442  9047 raft_consensus.cc:3037] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.579733  9048 raft_consensus.cc:3037] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Advancing to term 28
I20260925 16:46:50.583491  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.584661 18336 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260925 16:46:50.585026 18336 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:50.585318 18336 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Advancing to term 25
W20260925 16:46:50.591756  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 57712.1us
I20260925 16:46:50.605594 18336 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:46:50.606673  9666 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.615969  9047 raft_consensus.cc:2454] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
W20260925 16:46:50.623908  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:50.615557  9048 raft_consensus.cc:2454] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:46:50.635620  9666 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
W20260925 16:46:50.640026  9666 leader_election.cc:334] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.640690  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.641228  9666 leader_election.cc:334] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.642490  9666 leader_election.cc:334] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.643133  9666 leader_election.cc:334] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.643784  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:50.634848  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): ChangeConfig:REMOVE_PEER RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:50.641240  8867 catalog_manager.cc:5495] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 17 to 18, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:50.653450  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c756d218cfc0470183a9fe1cc08a22ab received from {username='slave'} at 127.0.0.1:43114
I20260925 16:46:50.654049  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c756d218cfc0470183a9fe1cc08a22ab on tablet c756d218cfc0470183a9fe1cc08a22ab with peer e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:50.654501  7803 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:50.641638 18327 raft_consensus.cc:2726] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election lost for term 28. Reason: could not achieve majority
I20260925 16:46:50.667043  9047 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "92fef1a775d54176ae0a3f7d209be2bf" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:50.667605  9047 raft_consensus.cc:3037] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Advancing to term 20
W20260925 16:46:50.674553 18373 log.cc:924] Time spent T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260925 16:46:50.681470  9047 raft_consensus.cc:2454] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 20.
I20260925 16:46:50.696725 18337 consensus_queue.cc:1035] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:50.718710  9700 raft_consensus.cc:1261] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
I20260925 16:46:50.720711  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3ff365de6e84921a6af19e793363f70" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 25 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:50.721378  9123 raft_consensus.cc:3037] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Advancing to term 25
I20260925 16:46:50.722790 18334 consensus_queue.cc:1035] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260925 16:46:50.726444  9701 raft_consensus.cc:1261] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260925 16:46:50.718663 18336 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:50.730665  9123 raft_consensus.cc:2454] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 25.
I20260925 16:46:50.763648 18336 consensus_queue.cc:1035] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:50.763799  9014 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:50.766914  9666 leader_election.cc:302] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.779712  8869 catalog_manager.cc:5495] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 24 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.787168  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:46:50.788262  9666 leader_election.cc:302] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.790359  9666 leader_election.cc:302] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.791570 17409 raft_consensus.cc:2781] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election won for term 28
W20260925 16:46:50.793151  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.778666 18364 raft_consensus.cc:2781] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.783164 18337 raft_consensus.cc:2781] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
I20260925 16:46:50.795895  8869 catalog_manager.cc:5495] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 26 to 27, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 27 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:50.792862 18098 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260925 16:46:50.806176  9048 raft_consensus.cc:1261] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260925 16:46:50.820039  8869 catalog_manager.cc:5495] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 22 to 23, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 23 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:50.839439  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 47349.1us
I20260925 16:46:50.804822 18364 raft_consensus.cc:686] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:50.843010  9666 leader_election.cc:302] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:50.821228 18337 raft_consensus.cc:686] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.843525 17788 consensus_queue.cc:1035] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260925 16:46:50.850914 18326 raft_consensus.cc:2781] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader election won for term 20
W20260925 16:46:50.884996  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.888664 17409 raft_consensus.cc:686] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:50.896607  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.897372  9015 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:50.898007  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:50.883486 18326 raft_consensus.cc:686] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
W20260925 16:46:50.896847 18379 log.cc:924] Time spent T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260925 16:46:50.918696  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.926642 17409 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 27.15, Last appended by leader: 15, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:50.931759  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:50.944202  9115 raft_consensus.cc:1261] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260925 16:46:50.940681 18364 consensus_queue.cc:237] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:50.923309 18337 consensus_queue.cc:237] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.913946 18360 raft_consensus.cc:2781] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader election won for term 25
I20260925 16:46:50.950810 18326 consensus_queue.cc:237] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.978478  9123 raft_consensus.cc:1261] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 17. (index mismatch)
I20260925 16:46:50.968644 18360 raft_consensus.cc:686] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:50.980669 18360 consensus_queue.cc:237] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 24.19, Last appended by leader: 19, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:50.983587 18338 consensus_queue.cc:1035] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:51.003929  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.046492  9115 raft_consensus.cc:1261] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 24 index: 16. Preceding OpId from leader: term: 25 index: 17. (index mismatch)
I20260925 16:46:51.070179  9042 raft_consensus.cc:1261] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260925 16:46:51.073673 18361 consensus_queue.cc:1035] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.060s
I20260925 16:46:51.075116 18385 consensus_queue.cc:1035] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260925 16:46:51.078449 18350 consensus_queue.cc:1035] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260925 16:46:51.176690 18393 log.cc:924] Time spent T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260925 16:46:51.181280  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.192646  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.193558 18392 log.cc:924] Time spent T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260925 16:46:51.200904  9699 raft_consensus.cc:1261] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:46:51.203714  9042 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 21. Preceding OpId from leader: term: 28 index: 22. (index mismatch)
I20260925 16:46:51.218540 18334 consensus_queue.cc:1035] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.026s
I20260925 16:46:51.227129 18339 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 22, Last known committed idx: 21, Time since last communication: 0.032s
W20260925 16:46:51.277663  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 55079.7us
W20260925 16:46:51.281893  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 62532.7us
W20260925 16:46:51.343592  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 60252.2us
W20260925 16:46:51.368314  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 86101.3us
I20260925 16:46:51.374564  9124 raft_consensus.cc:1261] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 16. (index mismatch)
I20260925 16:46:51.349740  8867 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 27 to 28, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
W20260925 16:46:51.385396  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.389880 18398 log.cc:924] Time spent T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260925 16:46:51.401876  8867 catalog_manager.cc:5495] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 24 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 25 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:51.408457  8867 catalog_manager.cc:5495] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:51.410380  8867 catalog_manager.cc:5495] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 18 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.420539  8867 catalog_manager.cc:5495] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 25 to 26, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.430217  8867 catalog_manager.cc:5495] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 21, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.450379 18336 raft_consensus.cc:1050] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:51.471150  9119 raft_consensus.cc:1261] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
W20260925 16:46:51.425011  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.480554  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 55601us
I20260925 16:46:51.408123 18325 consensus_queue.cc:1035] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.027s
W20260925 16:46:51.512857  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.521991  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.522300  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 74607.9us
I20260925 16:46:51.523594  9121 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260925 16:46:51.529374  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.532786  9047 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 15. Preceding OpId from leader: term: 28 index: 16. (index mismatch)
W20260925 16:46:51.536000  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.542833 18336 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 12, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:51.552512  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.562714 18360 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:51.519603 18390 consensus_queue.cc:1035] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.048s
W20260925 16:46:51.573093  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.581058  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.587373  9050 raft_consensus.cc:1261] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:51.603432  9047 raft_consensus.cc:1261] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260925 16:46:51.581756  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.606658  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.611506  9045 raft_consensus.cc:1261] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 19. Preceding OpId from leader: term: 25 index: 20. (index mismatch)
W20260925 16:46:51.610193  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.617653 18412 log.cc:924] Time spent T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
W20260925 16:46:51.620620  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.621723 18330 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:51.622037 18369 consensus_queue.cc:1035] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:46:51.623749  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.646152  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.654908  7803 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:51.660221 18338 consensus_queue.cc:1035] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260925 16:46:51.662544  9701 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:51.648557 18385 consensus_queue.cc:1035] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.016s
I20260925 16:46:51.665743 18364 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260925 16:46:51.669437  9121 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260925 16:46:51.674157 18282 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260925 16:46:51.667074  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:51.684202  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.719206  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:51.765842 18282 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:51.769228  9015 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:51.770283  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.772524  9124 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:51.823736  9700 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:51.842007  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.889955 17409 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:51.890578 17409 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:51.892488 17409 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:51.901047  9042 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722" is_pre_election: true
I20260925 16:46:51.901707  9042 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
I20260925 16:46:51.910647  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:51.917810 17409 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:46:51.918183 17409 raft_consensus.cc:482] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:51.918475 17409 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:51.937884  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:51.926175 17409 raft_consensus.cc:504] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:51.940810 17409 leader_election.cc:288] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:51.942804  9048 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d89e555296ed40ef8f9abed67a87bde9" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "8dc3391062084f45a6ba62d28d340722"
I20260925 16:46:51.946609  9048 raft_consensus.cc:3037] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Advancing to term 26
W20260925 16:46:51.947008  9666 leader_election.cc:334] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:51.952208  8868 catalog_manager.cc:5495] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 19 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 20 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.954923  9048 raft_consensus.cc:2454] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:46:51.954790  8868 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 27 to 28, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 10 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.966355  8867 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38646 (request call id 349) took 1052 ms. Trace:
I20260925 16:46:51.966977  8867 rpcz_store.cc:276] 0925 16:46:50.913574 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:46:50.913722 (+   148us) service_pool.cc:227] Handling call
0925 16:46:51.966279 (+1052557us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0925 16:46:51.564589 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0925 16:46:51.565186 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0925 16:46:51.565238 (+    52us) write_op.cc:435] Acquired schema lock
0925 16:46:51.565258 (+    20us) tablet.cc:660] Decoding operations
0925 16:46:51.566160 (+   902us) write_op.cc:620] Acquiring the partition lock for write op
0925 16:46:51.566218 (+    58us) write_op.cc:641] Partition lock acquired for write op
0925 16:46:51.566241 (+    23us) tablet.cc:683] Acquiring locks for 6 operations
0925 16:46:51.566756 (+   515us) tablet.cc:699] Row locks acquired
0925 16:46:51.566770 (+    14us) write_op.cc:260] PREPARE: finished
0925 16:46:51.566911 (+   141us) write_op.cc:270] Start()
0925 16:46:51.567020 (+   109us) write_op.cc:276] Timestamp: P: 1790354811566870 usec, L: 0
0925 16:46:51.567044 (+    24us) op_driver.cc:331] REPLICATION: starting
0925 16:46:51.598181 (+ 31137us) log.cc:842] Serialized 2462 byte log entry
0925 16:46:51.736105 (+137924us) op_driver.cc:444] REPLICATION: finished
0925 16:46:51.856764 (+120659us) write_op.cc:301] APPLY: starting
0925 16:46:51.856846 (+    82us) tablet.cc:1365] starting BulkCheckPresence
0925 16:46:51.860822 (+  3976us) tablet.cc:1368] finished BulkCheckPresence
0925 16:46:51.860910 (+    88us) tablet.cc:1370] starting ApplyRowOperation cycle
0925 16:46:51.930085 (+ 69175us) tablet.cc:1381] finished ApplyRowOperation cycle
0925 16:46:51.930313 (+   228us) tablet_metrics.cc:531] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=0,mrs_lookups=0
0925 16:46:51.930355 (+    42us) write_op.cc:312] APPLY: finished
0925 16:46:51.930643 (+   288us) log.cc:842] Serialized 65 byte log entry
0925 16:46:51.930790 (+   147us) write_op.cc:489] Releasing partition, row and schema locks
0925 16:46:51.930895 (+   105us) write_op.cc:454] Released schema lock
0925 16:46:51.930939 (+    44us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":9704,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":114259,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29171,"num_ops":6,"prepare.queue_time_us":95695,"prepare.run_cpu_time_us":3705,"prepare.run_wall_time_us":42738,"replication_time_us":161875,"thread_start_us":151188,"threads_started":2}]]}
I20260925 16:46:51.962180  8868 catalog_manager.cc:5495] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 21 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 22 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:51.969992  9666 leader_election.cc:302] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
W20260925 16:46:51.980641  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:51.972621  8868 catalog_manager.cc:5495] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 17 to 18, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 18 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:51.987572  8859 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 87170.6us
I20260925 16:46:51.991072 18385 raft_consensus.cc:2781] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
W20260925 16:46:51.991127  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): ChangeConfig:REMOVE_PEER RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:51.991648 18385 raft_consensus.cc:686] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:46:51.992537 18385 consensus_queue.cc:237] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.012876  8869 catalog_manager.cc:5495] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 20 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 25 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:52.046027  8867 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.088716  8869 catalog_manager.cc:5495] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 24 to 25, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 25 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:52.099884  8869 catalog_manager.cc:5495] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 19 to 20, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 20 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:52.110915  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.115679  8869 catalog_manager.cc:5495] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 24 to 26, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 26 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:52.196475  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.200150  9042 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.214226  9700 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260925 16:46:52.215479  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.219163 18361 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:52.227311  9124 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260925 16:46:52.235508 18325 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.242857 18336 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:52.242722  9700 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.259902  9121 raft_consensus.cc:2932] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Committing config change with OpId 20.16: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.270654  8869 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 15 to 16, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 20 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:52.308988 18282 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.309521 18282 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.311299  8859 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet c756d218cfc0470183a9fe1cc08a22ab with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260925 16:46:52.316962  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:52.318305  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 21.
I20260925 16:46:52.311648 18282 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.326068  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:52.328513 18364 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260925 16:46:52.334154 18364 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.334506 18364 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:52.342496  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:52.376194  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.409610 18364 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.419977  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3c796634a27a4d74b87d6a0081b10018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:52.420655  9700 raft_consensus.cc:3037] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Advancing to term 22
W20260925 16:46:52.421605  9015 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.448040  9700 raft_consensus.cc:2454] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 22.
I20260925 16:46:52.448688 18364 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.470266  9042 raft_consensus.cc:1261] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:52.475631 18385 consensus_queue.cc:1035] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260925 16:46:52.484488  9016 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.485688 18364 raft_consensus.cc:2781] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Leader election won for term 22
I20260925 16:46:52.486176 18364 raft_consensus.cc:686] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:52.486960 18364 consensus_queue.cc:237] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.493988 18361 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.494692 18361 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:52.498818  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 34 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:46:52.499607  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 33.
I20260925 16:46:52.501479  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 
I20260925 16:46:52.502518 18390 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Leader pre-election won for term 34
I20260925 16:46:52.502945 18390 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.503326 18390 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 33 FOLLOWER]: Advancing to term 34
W20260925 16:46:52.530028  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.543546 18361 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:46:52.562904  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:52.590523 18390 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:52.604418 18390 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:52.605976  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c71d03191b9f4a22a2ae4170c54fd018" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 34 candidate_status { last_received { term: 32 index: 18 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:46:52.606779  9123 raft_consensus.cc:3037] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 33 FOLLOWER]: Advancing to term 34
W20260925 16:46:52.616504  9015 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.623522 18341 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.624269 18341 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.629566  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:52.630373  9700 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 28.
I20260925 16:46:52.635560  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:46:52.636653 18408 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election won for term 29
I20260925 16:46:52.637056 18408 raft_consensus.cc:482] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.637370 18408 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Advancing to term 29
W20260925 16:46:52.640297  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.640609 18341 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.646507  9123 raft_consensus.cc:2454] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 34.
W20260925 16:46:52.655506  7803 thread.cc:536] Waited for 3000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:52.649394  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.660446  9014 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 34 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.661548 18408 raft_consensus.cc:504] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.664846  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a47f8b3d2d0140999fc2b3d8be7d6166" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 29 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:52.665439  9700 raft_consensus.cc:3037] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Advancing to term 29
I20260925 16:46:52.670387 18361 raft_consensus.cc:2781] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 FOLLOWER]: Leader election won for term 34
I20260925 16:46:52.668344 18364 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:46:52.672505 18364 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:52.674149  9089 leader_election.cc:334] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.673844  8868 catalog_manager.cc:5495] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 20 to 22, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 22 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:52.677245  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:52.676575  9700 raft_consensus.cc:2454] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 29.
I20260925 16:46:52.670770 18408 leader_election.cc:288] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:46:52.677453 18361 raft_consensus.cc:686] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:52.683353 18361 consensus_queue.cc:237] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 32.18, Last appended by leader: 18, Current term: 34, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:46:52.686739  9090 leader_election.cc:302] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.687651 18408 raft_consensus.cc:2781] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Leader election won for term 29
I20260925 16:46:52.702803 18364 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:52.700974  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.705770  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:46:52.706744  9700 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 29.
I20260925 16:46:52.707729  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.709798 18390 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260925 16:46:52.710251 18390 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:46:52.710616 18390 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:52.688724 18408 raft_consensus.cc:686] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:46:52.711514 18408 consensus_queue.cc:237] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 29, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.741582  8868 catalog_manager.cc:5495] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 32 to 34, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 34 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:52.781683 18390 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:52.784423  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:52.801460  8868 catalog_manager.cc:5495] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 27 to 29, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 29 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:46:52.802175  9700 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfb224095e1141f88e8a13ce96fb8fbb" candidate_uuid: "8dc3391062084f45a6ba62d28d340722" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:46:52.803153  9700 raft_consensus.cc:3037] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Advancing to term 30
I20260925 16:46:52.803493 18390 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 election: Requested vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:46:52.803511  9015 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:52.816123  9700 raft_consensus.cc:2454] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8dc3391062084f45a6ba62d28d340722 in term 30.
I20260925 16:46:52.818492  9016 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5
I20260925 16:46:52.819738 18390 raft_consensus.cc:2781] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Leader election won for term 30
I20260925 16:46:52.820266 18390 raft_consensus.cc:686] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 LEADER]: Becoming Leader. State: Replica: 8dc3391062084f45a6ba62d28d340722, State: Running, Role: LEADER
I20260925 16:46:52.821163 18390 consensus_queue.cc:237] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:52.855362  8868 catalog_manager.cc:5495] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 reported cstate change: term changed from 28 to 30, leader changed from 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) to 8dc3391062084f45a6ba62d28d340722 (127.7.158.194). New cstate: current_term: 30 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:52.878420  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:52.953004  9700 raft_consensus.cc:1261] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260925 16:46:52.954528 18390 consensus_queue.cc:1035] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260925 16:46:52.967597  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.043846  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.117849  9700 raft_consensus.cc:1261] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 29 index: 21. (index mismatch)
I20260925 16:46:53.119808 18445 consensus_queue.cc:1035] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260925 16:46:53.184540  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:53.190397  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:53.302070  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.317652  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.366077  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.367955  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.370414  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:53.370967  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.370807  9119 raft_consensus.cc:1261] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 32 index: 18. Preceding OpId from leader: term: 34 index: 19. (index mismatch)
W20260925 16:46:53.371543  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.372929 18325 consensus_queue.cc:1035] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260925 16:46:53.398011  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.445380  9700 raft_consensus.cc:1261] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 28 index: 20. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260925 16:46:53.453576 18352 consensus_queue.cc:1035] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.000s
W20260925 16:46:53.518028  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.519279  9121 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.18, Last appended by leader: 17, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:53.524196  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.539853  9090 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: eb346a4d887940099443a0219edadef0. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.540035  9048 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260925 16:46:53.541880 18445 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260925 16:46:53.555032  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:53.559110  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.587363 18445 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Committing config change with OpId 26.19: config changed from index -1 to 19, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.592319  9048 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Committing config change with OpId 26.19: config changed from index -1 to 19, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:53.603276  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:46:53.616703  9121 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 22, Committed index: 22, Last appended: 28.22, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:53.633852  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:53.632714  8868 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 19, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:53.647414  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.655982  7803 thread.cc:536] Waited for 4000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:53.659271  9090 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6eaf0bf4e06942b0b3b3684cfa1f3cc6. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.662109  9048 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 22. Preceding OpId from leader: term: 28 index: 23. (index mismatch)
I20260925 16:46:53.663750 18341 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 23, Last known committed idx: 22, Time since last communication: 0.001s
W20260925 16:46:53.677030  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.706849 18341 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Committing config change with OpId 28.23: config changed from index -1 to 23, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.737538  9048 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.23: config changed from index -1 to 23, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.750145  9121 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 24.14, Last appended by leader: 13, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:53.756181  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:53.755290  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:53.765731  8869 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 23, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:53.828410  9090 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3c0923848b9b426eade76023fdecc31c. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.829895  9048 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260925 16:46:53.831990 18445 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260925 16:46:53.841256  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.858116 18445 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.866154  9047 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Committing config change with OpId 24.15: config changed from index -1 to 15, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:53.891489  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:53.896499  9048 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:53.900945  8868 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 15, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260925 16:46:53.910511  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:53.921293  9016 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639): Couldn't send request to peer e3a3bc92ca0a4efa913eca1800a1550d. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c6030f186a664452b127609fadec766b. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.923534  9124 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260925 16:46:53.925308 18364 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260925 16:46:53.926034  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:53.953212 18336 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
I20260925 16:46:53.954571  9124 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Committing config change with OpId 21.14: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:53.975180  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:53.980670  8868 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index -1 to 14, NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) added. New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } } }
W20260925 16:46:54.022416  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.026178  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.028198  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:54.033223  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:54.045190 18469 ts_tablet_manager.cc:927] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:54.064627  9699 consensus_queue.cc:237] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 28.16, Last appended by leader: 15, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:54.074785 18469 tablet_copy_client.cc:316] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:46:54.076591  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet eb346a4d887940099443a0219edadef0 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:46:54.077143  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet eb346a4d887940099443a0219edadef0 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-eb346a4d887940099443a0219edadef0
I20260925 16:46:54.121862  9134 tablet_copy_source_session.cc:205] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.130831 18469 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eb346a4d887940099443a0219edadef0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:46:54.153067  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.165113  9124 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260925 16:46:54.166962 18466 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:54.165134  9048 raft_consensus.cc:1261] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 28 index: 16. Preceding OpId from leader: term: 28 index: 17. (index mismatch)
I20260925 16:46:54.170689 18466 consensus_queue.cc:1035] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260925 16:46:54.229614 18469 tablet_copy_client.cc:791] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.230260 18469 tablet_copy_client.cc:655] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
I20260925 16:46:54.234879  9048 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.230057 18388 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Committing config change with OpId 28.17: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.254437  9124 raft_consensus.cc:2932] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Committing config change with OpId 28.17: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.260187 18473 ts_tablet_manager.cc:927] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:54.271111 18469 tablet_copy_client.cc:531] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.277393  8868 catalog_manager.cc:5495] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 10 to 17, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 17 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:54.284694  8860 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 12359c2bff0b46de91daa934c219103c with cas_config_opid_index 10: ChangeConfig:REMOVE_PEER succeeded (attempt 9)
I20260925 16:46:54.317757 18473 tablet_copy_client.cc:316] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:46:54.323100  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:46:54.323683  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-6eaf0bf4e06942b0b3b3684cfa1f3cc6
I20260925 16:46:54.351220  9134 tablet_copy_source_session.cc:205] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.353729 18469 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:46:54.356141 18473 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:46:54.391506  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:54.400224  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.414911 18473 tablet_copy_client.cc:791] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.415475 18473 tablet_copy_client.cc:655] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:54.424106  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.461993  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:54.485882  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.496204 18483 ts_tablet_manager.cc:927] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:46:54.499221 18485 ts_tablet_manager.cc:927] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Initiating tablet copy from peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:46:54.510051 18473 tablet_copy_client.cc:531] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.519477 18485 tablet_copy_client.cc:316] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.194:45245
I20260925 16:46:54.520330 18483 tablet_copy_client.cc:316] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Beginning tablet copy session from remote peer at address 127.7.158.195:32851
I20260925 16:46:54.521685  9059 tablet_copy_service.cc:140] P 8dc3391062084f45a6ba62d28d340722: Received BeginTabletCopySession request for tablet c6030f186a664452b127609fadec766b from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43114)
I20260925 16:46:54.522239  9059 tablet_copy_service.cc:161] P 8dc3391062084f45a6ba62d28d340722: Beginning new tablet copy session on tablet c6030f186a664452b127609fadec766b from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43114: session id = e3a3bc92ca0a4efa913eca1800a1550d-c6030f186a664452b127609fadec766b
I20260925 16:46:54.522264  9134 tablet_copy_service.cc:140] P 40a71744ceba4efe949720cb0f274853: Received BeginTabletCopySession request for tablet 3c0923848b9b426eade76023fdecc31c from peer e3a3bc92ca0a4efa913eca1800a1550d ({username='slave'} at 127.0.0.1:43572)
I20260925 16:46:54.522966  9134 tablet_copy_service.cc:161] P 40a71744ceba4efe949720cb0f274853: Beginning new tablet copy session on tablet 3c0923848b9b426eade76023fdecc31c from peer e3a3bc92ca0a4efa913eca1800a1550d at {username='slave'} at 127.0.0.1:43572: session id = e3a3bc92ca0a4efa913eca1800a1550d-3c0923848b9b426eade76023fdecc31c
I20260925 16:46:54.532568  9134 tablet_copy_source_session.cc:205] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.535477 18483 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3c0923848b9b426eade76023fdecc31c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:46:54.548954 18473 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
I20260925 16:46:54.561718  9059 tablet_copy_source_session.cc:205] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: Tablet Copy: opened 0 blocks and 1 log segments
I20260925 16:46:54.567090 18485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c6030f186a664452b127609fadec766b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:46:54.600801 18483 tablet_copy_client.cc:791] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.601428 18483 tablet_copy_client.cc:655] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:54.635447  9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 470 similar messages]
I20260925 16:46:54.611783 18483 tablet_copy_client.cc:531] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.652843 18485 tablet_copy_client.cc:791] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 0 data blocks...
I20260925 16:46:54.653575 18485 tablet_copy_client.cc:655] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Starting download of 1 WAL segments...
W20260925 16:46:54.655668  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:54.656522  7803 thread.cc:536] Waited for 5000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:54.665532 18485 tablet_copy_client.cc:531] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260925 16:46:54.716499 18485 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:46:54.724072  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.735904 18483 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap starting.
W20260925 16:46:54.777495  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:54.784116  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.852423 18469 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=21 overwritten=2 applied=19 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:54.853466 18469 tablet_bootstrap.cc:492] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:54.868713 18469 ts_tablet_manager.cc:1397] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.515s	user 0.053s	sys 0.016s
I20260925 16:46:54.872424 18469 raft_consensus.cc:348] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:54.876883 18469 raft_consensus.cc:729] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:54.877537 18469 consensus_queue.cc:260] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 19 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:54.899978  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260925 16:46:54.926069 18469 ts_tablet_manager.cc:1428] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.001s
I20260925 16:46:54.937907  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-eb346a4d887940099443a0219edadef0 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:46:54.938324  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-eb346a4d887940099443a0219edadef0 on tablet eb346a4d887940099443a0219edadef0 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:54.980810 18473 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=23 overwritten=0 applied=23 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:54.981770 18473 tablet_bootstrap.cc:492] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:54.982518 18473 ts_tablet_manager.cc:1397] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.435s	user 0.051s	sys 0.019s
I20260925 16:46:55.040203 18473 raft_consensus.cc:348] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
W20260925 16:46:55.045743  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:55.048130 18485 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:55.058025 18473 raft_consensus.cc:729] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:55.058389 18485 tablet_bootstrap.cc:492] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:55.062179 18485 ts_tablet_manager.cc:1397] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.346s	user 0.036s	sys 0.018s
I20260925 16:46:55.058840 18473 consensus_queue.cc:260] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 23, Last appended: 28.23, Last appended by leader: 23, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 23 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.071098 18483 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap replayed 1/1 log segments. Stats: ops{read=17 overwritten=2 applied=15 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:46:55.072163 18483 tablet_bootstrap.cc:492] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Bootstrap complete.
I20260925 16:46:55.072934 18483 ts_tablet_manager.cc:1397] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent bootstrapping tablet: real 0.347s	user 0.045s	sys 0.015s
I20260925 16:46:55.077082 18473 ts_tablet_manager.cc:1428] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.001s
I20260925 16:46:55.082280  9701 raft_consensus.cc:1203] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Deduplicated request from leader. Original: 28.22->[28.23-28.23]   Dedup: 28.23->[]
I20260925 16:46:55.083065 18485 raft_consensus.cc:348] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.085420 18485 raft_consensus.cc:729] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:55.086124 18485 consensus_queue.cc:260] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.091241  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-6eaf0bf4e06942b0b3b3684cfa1f3cc6 received from {username='slave'} at 127.0.0.1:43572
I20260925 16:46:55.092427  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-6eaf0bf4e06942b0b3b3684cfa1f3cc6 on tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:55.096274 18485 ts_tablet_manager.cc:1428] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.033s	user 0.005s	sys 0.001s
I20260925 16:46:55.098580  9059 tablet_copy_service.cc:342] P 8dc3391062084f45a6ba62d28d340722: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c6030f186a664452b127609fadec766b received from {username='slave'} at 127.0.0.1:43114
I20260925 16:46:55.099018  9059 tablet_copy_service.cc:433] P 8dc3391062084f45a6ba62d28d340722: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-c6030f186a664452b127609fadec766b on tablet c6030f186a664452b127609fadec766b with peer e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:46:55.113600 18483 raft_consensus.cc:348] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.114823 18483 raft_consensus.cc:729] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Becoming Follower/Learner. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Initialized, Role: LEARNER
I20260925 16:46:55.116775 18483 consensus_queue.cc:260] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: NON_VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: true } }
I20260925 16:46:55.117686  9701 raft_consensus.cc:1203] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Deduplicated request from leader. Original: 26.18->[26.19-26.19]   Dedup: 26.19->[]
I20260925 16:46:55.119551 18483 ts_tablet_manager.cc:1428] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: Time spent starting tablet: real 0.046s	user 0.004s	sys 0.001s
I20260925 16:46:55.137092  9134 tablet_copy_service.cc:342] P 40a71744ceba4efe949720cb0f274853: Request end of tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3c0923848b9b426eade76023fdecc31c received from {username='slave'} at 127.0.0.1:43572
I20260925 16:46:55.137581  9134 tablet_copy_service.cc:433] P 40a71744ceba4efe949720cb0f274853: ending tablet copy session e3a3bc92ca0a4efa913eca1800a1550d-3c0923848b9b426eade76023fdecc31c on tablet 3c0923848b9b426eade76023fdecc31c with peer e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:46:55.189525  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:55.379937  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:55.656960  7803 thread.cc:536] Waited for 6000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:55.731832  9701 raft_consensus.cc:1203] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Deduplicated request from leader. Original: 21.13->[21.14-21.14]   Dedup: 21.14->[]
I20260925 16:46:55.868785  9701 raft_consensus.cc:1203] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Deduplicated request from leader. Original: 24.14->[24.15-24.15]   Dedup: 24.15->[]
W20260925 16:46:55.872713  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:55.956952  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:55.974144 18503 raft_consensus.cc:1050] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:55.981359 18503 consensus_queue.cc:237] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 17, Current term: 26, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:55.992691 18445 raft_consensus.cc:1050] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
W20260925 16:46:56.000077  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.002668  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.006791 18445 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 23, Committed index: 23, Last appended: 28.23, Last appended by leader: 21, Current term: 28, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:56.026667 18499 raft_consensus.cc:1050] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:56.042058 18499 consensus_queue.cc:237] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 12, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:56.079213  9701 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:46:56.080492  9042 raft_consensus.cc:1261] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:46:56.080804 18500 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
I20260925 16:46:56.083590 18500 consensus_queue.cc:1035] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.001s
W20260925 16:46:56.087021  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:56.098167  9700 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 23. Preceding OpId from leader: term: 28 index: 24. (index mismatch)
I20260925 16:46:56.103116  9048 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 23. Preceding OpId from leader: term: 28 index: 24. (index mismatch)
I20260925 16:46:56.104609 18476 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
I20260925 16:46:56.106169 18476 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 24, Last known committed idx: 23, Time since last communication: 0.000s
W20260925 16:46:56.117025  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:56.139212  9124 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:46:56.142005 18497 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260925 16:46:56.140430  9701 raft_consensus.cc:1261] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEARNER]: Refusing update from remote peer 8dc3391062084f45a6ba62d28d340722: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260925 16:46:56.149602 18499 consensus_queue.cc:1035] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
W20260925 16:46:56.187620  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.193640 18445 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Committing config change with OpId 26.20: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.197155  9042 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Committing config change with OpId 26.20: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.208789  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:56.209370  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 46834.1us
W20260925 16:46:56.209867  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:56.210409  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.214803  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:46:56.226115  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260925 16:46:56.224962 18499 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Committing config change with OpId 21.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.229076  9700 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.251864  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260925 16:46:56.234863 18476 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Committing config change with OpId 28.24: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.236744  9699 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Committing config change with OpId 28.24: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.258419  9701 raft_consensus.cc:2932] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Committing config change with OpId 26.20: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.260387  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.265739  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.273661  8868 catalog_manager.cc:5495] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 19 to 20, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 26 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 20 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.277269  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.283663  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.292186  9124 raft_consensus.cc:2932] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Committing config change with OpId 21.15: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.306843  9045 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.24: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.310293  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.340977  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:56.360481  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:56.400408  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.440060 18503 raft_consensus.cc:1050] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: attempting to promote NON_VOTER e3a3bc92ca0a4efa913eca1800a1550d to VOTER
I20260925 16:46:56.442864 18503 consensus_queue.cc:237] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 13, Current term: 24, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:46:56.451327  8869 catalog_manager.cc:5495] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 14 to 15, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 21 leader_uuid: "8dc3391062084f45a6ba62d28d340722" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:46:56.459636  8869 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 reported cstate change: config changed from index 23 to 24, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 24 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } attrs { replace: true } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.493625  9121 consensus_queue.cc:237] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 24, Committed index: 24, Last appended: 28.24, Last appended by leader: 21, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:46:56.495718  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:46:56.500195  9700 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 24. Preceding OpId from leader: term: 28 index: 25. (index mismatch)
I20260925 16:46:56.502533 18445 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 16:46:56.514941  9045 raft_consensus.cc:1261] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 28 index: 24. Preceding OpId from leader: term: 28 index: 25. (index mismatch)
I20260925 16:46:56.517267 18476 consensus_queue.cc:1035] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 25, Last known committed idx: 24, Time since last communication: 0.000s
I20260925 16:46:56.529034  9045 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:56.530856  9699 raft_consensus.cc:1261] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEARNER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 24 index: 16. (index mismatch)
I20260925 16:46:56.535530 18500 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:56.536270 18501 consensus_queue.cc:1035] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260925 16:46:56.538830 18445 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Committing config change with OpId 28.25: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.542886  9699 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Committing config change with OpId 28.25: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.562958  9048 raft_consensus.cc:2932] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Committing config change with OpId 28.25: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New config: { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.564636  8858 catalog_manager.cc:5008] ChangeConfig:REMOVE_PEER RPC for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6 with cas_config_opid_index 24: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260925 16:46:56.569386  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:46:56.574669  8867 catalog_manager.cc:5495] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: config changed from index 24 to 25, VOTER 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193) evicted. New cstate: current_term: 28 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 25 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.584132  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:46:56.610412 18445 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.611438  9045 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
I20260925 16:46:56.630837  9699 raft_consensus.cc:2932] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Committing config change with OpId 24.16: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } } }
W20260925 16:46:56.649416  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.657596  7803 thread.cc:536] Waited for 7000ms trying to join with diag-logger (tid 8996)
I20260925 16:46:56.662406  8867 catalog_manager.cc:5495] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 reported cstate change: config changed from index 15 to 16, e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196) changed from NON_VOTER to VOTER. New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260925 16:46:56.706619  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.740687  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08003355e0 after lost signal to thread 7806
W20260925 16:46:56.741930  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08003627e0 after lost signal to thread 8907
W20260925 16:46:56.743258  9723 debug-util.cc:398] Leaking SignalData structure 0x7b0800370280 after lost signal to thread 9074
W20260925 16:46:56.744414  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08002d2d00 after lost signal to thread 9148
W20260925 16:46:56.745656  9723 debug-util.cc:398] Leaking SignalData structure 0x7b08002c17e0 after lost signal to thread 9726
W20260925 16:46:56.750540  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.772652  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.805395  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.834182  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.860075  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:56.910075  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:56.910454  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:57.027207  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:57.041932  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.102695  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:57.111449  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.329131  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.369786  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.590102  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.658049  7803 thread.cc:536] Waited for 8000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:57.792562  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.821094  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:57.903354  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.930056  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:57.936285  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:57.962109  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:58.076334  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:58.128289  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:58.438336  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.438819  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.446875  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:46:58.542366  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:58.603518  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:58.604288  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.619534  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.629009  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:58.658519  7803 thread.cc:536] Waited for 9000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:58.689980  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.703488  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.733548  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.829584  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.842803  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:58.863649  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:58.915657  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52060.7us
W20260925 16:46:58.937669  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:46:58.939105  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.030159  9089 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52901.3us
W20260925 16:46:59.082059  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:46:59.111155  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.159301  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:46:59.183068  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.268246  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.265918  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.347514  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.436690  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.553272  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.566746  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 76448.4us
W20260925 16:46:59.585872  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.596861  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.597566  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.597982  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.667946  7803 thread.cc:536] Waited for 10000ms trying to join with diag-logger (tid 8996)
W20260925 16:46:59.746060  9015 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 401 similar messages]
W20260925 16:46:59.761569  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.789655  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:46:59.894748  9090 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:37639, user_credentials={real_user=slave}} blocked reactor thread for 89034.7us
W20260925 16:46:59.951427  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:46:59.983875  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:00.123421  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.281334  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.304939  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.403571  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.598673  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.614475  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:00.620843  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:00.647027  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:00.668972  7803 thread.cc:536] Waited for 11000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:00.745507  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.023785  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:01.119482  9014 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:32851, user_credentials={real_user=slave}} blocked reactor thread for 203119us
W20260925 16:47:01.178469  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.209646  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 311015us
W20260925 16:47:01.231053  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.232520  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:01.237944  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.263886  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:01.311358  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.312565  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.336524  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.337136  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.343152  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.359925  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.372474  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.373059  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.420328  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.456229  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.516546  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.593842  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.620942  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:01.626143  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.670096  7803 thread.cc:536] Waited for 12000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:01.725512  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.760679  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.797322  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:01.840672  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:01.849951  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:01.875397  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:01.934966  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08003d30e0 after lost signal to thread 7806
W20260925 16:47:01.936259  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800341e60 after lost signal to thread 8907
W20260925 16:47:01.937685  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800303fa0 after lost signal to thread 9074
W20260925 16:47:01.938890  8904 debug-util.cc:398] Leaking SignalData structure 0x7b08003d17a0 after lost signal to thread 9148
W20260925 16:47:01.940501  8904 debug-util.cc:398] Leaking SignalData structure 0x7b0800270b80 after lost signal to thread 9726
W20260925 16:47:01.988538  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.150028  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.193483  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.218565  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.218920  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.265734  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.275393  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.277953  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.440948  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:02.670643  7803 thread.cc:536] Waited for 13000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:02.731850  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.740752  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.747674  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.857928  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:02.901554  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.140923  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.173547  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.240566  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.282320  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:03.380673  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.424815  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.567607  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.665174  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:03.671097  7803 thread.cc:536] Waited for 14000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:03.688489  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:03.720340  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.813181  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.818146  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.827809  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:03.829137  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.855569  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.870508  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.871965  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:03.892748  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.903453  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:03.958280  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:03.984484  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.003353  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:04.039425  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:04.088951  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.121546  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.212450  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:04.230886  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260925 16:47:04.412516  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:04.440266  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:45245, user_credentials={real_user=slave}} blocked reactor thread for 72117.2us
W20260925 16:47:04.463210  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:04.465927  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 52385.1us
W20260925 16:47:04.547988  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.554663  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.561818  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.604121  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:04.671586  7803 thread.cc:536] Waited for 15000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:04.731817  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.752346  9089 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 432 similar messages]
W20260925 16:47:04.776021  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.827373  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:04.844260  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:04.887858  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:05.061591  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.062386  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.150381  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.242648  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.410262  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.458516  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.465903  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:05.607292  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:05.672127  7803 thread.cc:536] Waited for 16000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:05.776561  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:05.790017  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:05.951224  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:05.963342  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:05.984755  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.013170  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.086997  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:06.148872  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.171327  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.211330  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:06.224658  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.383602  9015 consensus_peers.cc:487] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.407981  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.442850  9015 consensus_peers.cc:487] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.473594  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.485651  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.504439  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.506589  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.529356  9015 consensus_peers.cc:487] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.602787  9015 consensus_peers.cc:487] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.661893  9015 consensus_peers.cc:487] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.673028  7803 thread.cc:536] Waited for 17000ms trying to join with diag-logger (tid 8996)
W20260925 16:47:06.686462  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260925 16:47:06.703845  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:06.727540  9015 consensus_peers.cc:487] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:06.803339  9015 consensus_peers.cc:487] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.804845  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:06.898479  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:06.969731  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:07.039577  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:07.083627  9015 consensus_peers.cc:487] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.134152  9015 consensus_peers.cc:487] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.147176  9015 consensus_peers.cc:487] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.148881  9015 consensus_peers.cc:487] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.151520  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.164865  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.370256  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.423147  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.529165  9015 consensus_peers.cc:487] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.529580  9666 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45267.9us
W20260925 16:47:07.772329  9015 consensus_peers.cc:487] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.784970  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.825477  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:07.914283  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.902276  9015 consensus_peers.cc:487] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:07.948072  9015 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 45833.6us
I20260925 16:47:08.056759  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
W20260925 16:47:08.063215  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:08.236773  9015 consensus_peers.cc:487] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:08.311966  9015 consensus_peers.cc:487] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:08.387756  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:47:08.390859  9015 consensus_peers.cc:487] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:08.395368  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.406002  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.427109  9666 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.435892  9666 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.441694  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:08.442102  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:08.486351  9666 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.499527  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.549708  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.558154  9666 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.559106  9015 consensus_peers.cc:487] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:08.575454  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:08.577826  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.604665  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.605799  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.612655  9015 consensus_peers.cc:487] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:08.620065  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.624822  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:08.626001  7803 tablet_replica.cc:330] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.627624  7803 raft_consensus.cc:2229] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.628618  7803 raft_consensus.cc:2258] T f15ade9737ac41438bda476a00b4ad97 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.634011  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.634722  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:08.640230  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:08.634827  7803 tablet_replica.cc:330] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.644327  7803 raft_consensus.cc:2229] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.645615  7803 raft_consensus.cc:2258] T 49c7db4b3fda45159275230bc247b929 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.648450  7803 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.649367  7803 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:08.649812  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260925 16:47:08.650025  7803 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.654722  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.655165  7803 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
W20260925 16:47:08.655512  9666 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.663239  7803 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.664511  7803 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.666965  9089 consensus_peers.cc:487] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.667487  7803 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.668524  7803 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.669243  7803 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P 8dc3391062084f45a6ba62d28d340722 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.672235  7803 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.673142  7803 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.673892  7803 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.676734  7803 tablet_replica.cc:330] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.677814  7803 raft_consensus.cc:2229] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.678987  7803 raft_consensus.cc:2258] T 4d5ba69a70184d858b847e046b24564c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.681846  7803 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.682706  7803 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.683873  7803 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.686525  7803 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.687376  7803 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.688127  7803 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.690799  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
W20260925 16:47:08.690958  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.691723  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.693439  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.696249  7803 tablet_replica.cc:330] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.697115  7803 raft_consensus.cc:2229] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.698256  7803 raft_consensus.cc:2258] T d3ff365de6e84921a6af19e793363f70 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.701175  7803 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.702162  7803 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.703280  7803 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.706125  7803 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.707008  7803 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.707782  7803 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.710642  7803 tablet_replica.cc:330] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.711498  7803 raft_consensus.cc:2229] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.712913  7803 raft_consensus.cc:2258] T ef3a95f58f62434d84bf19310c928a92 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.715454  7803 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.716328  7803 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.716966  7803 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.719542  7803 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.720340  7803 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.720984  7803 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.723621  7803 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.724444  7803 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:08.725126  9015 consensus_peers.cc:487] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260925 16:47:08.725113  7803 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.728375  7803 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.729260  7803 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.729948  7803 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P 8dc3391062084f45a6ba62d28d340722 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.732738  7803 tablet_replica.cc:330] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.733678  7803 raft_consensus.cc:2229] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.735114  7803 raft_consensus.cc:2258] T c71d03191b9f4a22a2ae4170c54fd018 P 8dc3391062084f45a6ba62d28d340722 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.737941  7803 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.738749  7803 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.740018  7803 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.742671  7803 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.743573  7803 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.744280  7803 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P 8dc3391062084f45a6ba62d28d340722 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.746758  7803 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.747342  7803 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.747911  7803 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.750387  7803 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.751169  7803 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.752298  7803 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.755533  7803 tablet_replica.cc:330] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.756282  7803 raft_consensus.cc:2229] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.758167  7803 raft_consensus.cc:2258] T 9a92341cf5104c9eba99c812ba97c735 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.760877  7803 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.761647  7803 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.762264  7803 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.764776  7803 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.766316  7803 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.767004  7803 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.770165  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.771736  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.773458  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.777278  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.778029  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.779098  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.787894  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.789260  7803 tablet_replica.cc:330] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.790138  7803 raft_consensus.cc:2229] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.791224  7803 raft_consensus.cc:2258] T 505ce6aba0e14faabdb5e6135e200af6 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.796530  7803 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.797880  7803 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.798523  7803 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.801105  7803 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.801841  7803 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:08.802001  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.802663  7803 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.805173  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.806070  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.806996  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P 8dc3391062084f45a6ba62d28d340722 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.808601  9666 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.809791  7803 tablet_replica.cc:330] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.810585  7803 raft_consensus.cc:2229] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.811628  7803 raft_consensus.cc:2258] T 401361a5d37b4eefa49285e758f2f67b P 8dc3391062084f45a6ba62d28d340722 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.814229  7803 tablet_replica.cc:330] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.814978  7803 raft_consensus.cc:2229] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.816036  7803 raft_consensus.cc:2258] T 4b41a723075b4ed5b21758d5b37cd917 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.818535  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.819270  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.820175  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 8dc3391062084f45a6ba62d28d340722 [term 28 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.822556  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.822676  7803 tablet_replica.cc:330] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.823559  7803 raft_consensus.cc:2229] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.824754  7803 raft_consensus.cc:2258] T 088ac48c62d34a40b53987746a70b871 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.827176  7803 tablet_replica.cc:330] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.827930  7803 raft_consensus.cc:2229] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.828553  7803 raft_consensus.cc:2258] T 42b301336d224f89acb2543ae4e24a12 P 8dc3391062084f45a6ba62d28d340722 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.831123  7803 tablet_replica.cc:330] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.831924  7803 raft_consensus.cc:2229] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.832764  7803 raft_consensus.cc:2258] T ee9de086f49c4026931c128637888218 P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.835004  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.835685  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.836681  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P 8dc3391062084f45a6ba62d28d340722 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.839994  7803 tablet_replica.cc:330] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.840785  7803 raft_consensus.cc:2229] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.842152  7803 raft_consensus.cc:2258] T 8ee8e183d4e44c21804c9d95ed71dd2e P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.842831  9089 consensus_peers.cc:487] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:08.844779  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260925 16:47:08.845619  7803 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.846504  7803 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.848392  7803 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P 8dc3391062084f45a6ba62d28d340722 [term 30 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.849148  9666 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:08.851502  7803 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.852308  7803 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.853420  7803 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P 8dc3391062084f45a6ba62d28d340722 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.869637  7803 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.870414  7803 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.871482  7803 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 8dc3391062084f45a6ba62d28d340722 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.873858  7803 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.875015  7803 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.875739  7803 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.878283  7803 tablet_replica.cc:330] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.878959  7803 raft_consensus.cc:2229] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.880080  7803 raft_consensus.cc:2258] T e7e6790e980f40f8aeb12986a2ac7ed6 P 8dc3391062084f45a6ba62d28d340722 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.882532  7803 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.883172  7803 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:08.884186  7803 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P 8dc3391062084f45a6ba62d28d340722 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:08.886516  7803 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722: stopping tablet replica
I20260925 16:47:08.887168  7803 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:08.887894  7803 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P 8dc3391062084f45a6ba62d28d340722 [term 19 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:08.925184  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:08.941171  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.019028  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.022964  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:09.024192  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:09.045291  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
==================
WARNING: ThreadSanitizer: data race (pid=7803)
  Write of size 8 at 0x7ba0000005f0 by main thread:
    #0 close /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1679:3 (auto_leader_rebalancer-test+0x2b9183)
    #1 kudu::DiagnosticSocket::Close() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:104:3 (libkudu_util.so+0x3d2f0f)
    #2 kudu::rpc::AcceptorPool::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/acceptor_pool.cc:203:3 (libkrpc.so+0x120dd3)
    #3 kudu::rpc::Messenger::ShutdownInternal(kudu::rpc::Messenger::ShutdownMode) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:233:8 (libkrpc.so+0x160847)
    #4 kudu::rpc::Messenger::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:200:3 (libkrpc.so+0x160dfb)
    #5 kudu::kserver::KuduServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:192:17 (libkserver.so+0x13b65)
    #6 kudu::tserver::TabletServer::ShutdownImpl() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:193:17 (libtserver.so+0x2556df)
    #7 kudu::tserver::TabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.h:67:5 (libtserver.so+0x25ae89)
    #8 kudu::tserver::MiniTabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:124:14 (libtserver.so+0x311fb2)
    #9 kudu::cluster::InternalMiniCluster::ShutdownNodes(kudu::cluster::ClusterNodes) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:242:22 (libmini_cluster.so+0xd5f37)
    #10 kudu::cluster::MiniCluster::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/mini_cluster.h:84:5 (auto_leader_rebalancer-test+0x35b954)
    #11 kudu::master::LeaderRebalancerTest::TearDown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:113:17 (auto_leader_rebalancer-test+0x348292)
    #12 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #13 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #14 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2682:3 (libgtest.so.1.12.1+0x42b02)
    #15 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #16 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #17 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #18 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #19 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #20 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #21 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #22 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Previous read of size 8 at 0x7ba0000005f0 by thread T57:
    [failed to restore the stack]

  Location is file descriptor 95 created by main thread at:
    #0 socket /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:1638:3 (auto_leader_rebalancer-test+0x2bc13f)
    #1 kudu::DiagnosticSocket::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:87:13 (libkudu_util.so+0x3d301f)
    #2 kudu::rpc::AcceptorPool::Start(int) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/acceptor_pool.cc:159:3 (libkrpc.so+0x121305)
    #3 kudu::RpcServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/rpc_server.cc:297:5 (libserver_process.so+0x1336a9)
    #4 kudu::server::ServerBase::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1333:3 (libserver_process.so+0x145bc5)
    #5 kudu::kserver::KuduServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13b10)
    #6 kudu::tserver::TabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:160:3 (libtserver.so+0x2563a7)
    #7 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x3120f9)
    #8 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #10 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #11 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #12 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #13 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #14 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #15 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #16 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #17 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #18 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #19 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #20 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #21 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #22 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #23 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Thread T57 'diag-logger-907' (tid=9071, running) created by main thread at:
    #0 pthread_create /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966:3 (auto_leader_rebalancer-test+0x29f4e2)
    #1 kudu::Thread::StartThread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, unsigned long, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:638:15 (libkudu_util.so+0x43d62a)
    #2 kudu::Thread::Create(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.h:146:12 (libmaster.so+0x2d3a39)
    #3 kudu::server::DiagnosticsLog::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/diagnostics_log.cc:144:14 (libserver_process.so+0x1167ed)
    #4 kudu::server::ServerBase::StartMetricsLogging() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1185:3 (libserver_process.so+0x145294)
    #5 kudu::server::ServerBase::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1324:3 (libserver_process.so+0x145b34)
    #6 kudu::kserver::KuduServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13b10)
    #7 kudu::tserver::TabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:160:3 (libtserver.so+0x2563a7)
    #8 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x3120f9)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #11 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #12 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #13 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #14 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #15 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #16 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #17 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #18 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #19 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #20 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #21 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #22 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #23 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #24 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

SUMMARY: ThreadSanitizer: data race /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:104:3 in kudu::DiagnosticSocket::Close()
==================
==================
WARNING: ThreadSanitizer: data race (pid=7803)
  Write of size 4 at 0x7b40001c3cd8 by main thread:
    #0 kudu::DiagnosticSocket::Close() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:109:7 (libkudu_util.so+0x3d2f39)
    #1 kudu::rpc::AcceptorPool::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/acceptor_pool.cc:203:3 (libkrpc.so+0x120dd3)
    #2 kudu::rpc::Messenger::ShutdownInternal(kudu::rpc::Messenger::ShutdownMode) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:233:8 (libkrpc.so+0x160847)
    #3 kudu::rpc::Messenger::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:200:3 (libkrpc.so+0x160dfb)
    #4 kudu::kserver::KuduServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:192:17 (libkserver.so+0x13b65)
    #5 kudu::tserver::TabletServer::ShutdownImpl() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:193:17 (libtserver.so+0x2556df)
    #6 kudu::tserver::TabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.h:67:5 (libtserver.so+0x25ae89)
    #7 kudu::tserver::MiniTabletServer::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:124:14 (libtserver.so+0x311fb2)
    #8 kudu::cluster::InternalMiniCluster::ShutdownNodes(kudu::cluster::ClusterNodes) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:242:22 (libmini_cluster.so+0xd5f37)
    #9 kudu::cluster::MiniCluster::Shutdown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/mini_cluster.h:84:5 (auto_leader_rebalancer-test+0x35b954)
    #10 kudu::master::LeaderRebalancerTest::TearDown() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:113:17 (auto_leader_rebalancer-test+0x348292)
    #11 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #12 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #13 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2682:3 (libgtest.so.1.12.1+0x42b02)
    #14 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #15 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #16 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #17 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #18 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #19 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #20 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #21 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Previous read of size 4 at 0x7b40001c3cd8 by thread T57:
    [failed to restore the stack]

  Location is heap block of size 248 at 0x7b40001c3c00 allocated by main thread:
    #0 operator new(unsigned long) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_new_delete.cpp:64:3 (auto_leader_rebalancer-test+0x33ee9e)
    #1 std::__1::__libcpp_allocate(unsigned long, unsigned long) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/new:253:10 (libkrpc.so+0x126806)
    #2 std::__1::allocator<std::__1::__shared_ptr_emplace<kudu::rpc::AcceptorPool, std::__1::allocator<kudu::rpc::AcceptorPool> > >::allocate(unsigned long) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:1789:34 (libkrpc.so+0x16d651)
    #3 std::__1::enable_if<!(is_array<kudu::rpc::AcceptorPool>::value), std::__1::shared_ptr<kudu::rpc::AcceptorPool> >::type std::__1::make_shared<kudu::rpc::AcceptorPool, kudu::rpc::Messenger*, kudu::Socket*, kudu::Sockaddr&, int const&>(kudu::rpc::Messenger*&&, kudu::Socket*&&, kudu::Sockaddr&, int const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/c++/v1/memory:4290:45 (libkrpc.so+0x165e05)
    #4 kudu::rpc::Messenger::AddAcceptorPool(kudu::Sockaddr const&, std::__1::shared_ptr<kudu::rpc::AcceptorPool>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/messenger.cc:269:34 (libkrpc.so+0x16100d)
    #5 kudu::RpcServer::Bind() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/rpc_server.cc:262:5 (libserver_process.so+0x1331cb)
    #6 kudu::server::ServerBase::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1003:23 (libserver_process.so+0x142feb)
    #7 kudu::kserver::KuduServer::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:144:3 (libkserver.so+0x13181)
    #8 kudu::tserver::TabletServer::Init() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:106:3 (libtserver.so+0x255b62)
    #9 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:106:3 (libtserver.so+0x3120bb)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #11 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #12 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #13 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #14 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #15 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #16 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #17 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #18 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #19 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #20 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #21 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #22 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #23 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #24 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #25 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

  Thread T57 'diag-logger-907' (tid=9071, running) created by main thread at:
    #0 pthread_create /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/llvm-11.0.0.src/projects/compiler-rt/lib/tsan/rtl/tsan_interceptors_posix.cpp:966:3 (auto_leader_rebalancer-test+0x29f4e2)
    #1 kudu::Thread::StartThread(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, unsigned long, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.cc:638:15 (libkudu_util.so+0x43d62a)
    #2 kudu::Thread::Create(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::function<void ()>, scoped_refptr<kudu::Thread>*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/thread.h:146:12 (libmaster.so+0x2d3a39)
    #3 kudu::server::DiagnosticsLog::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/diagnostics_log.cc:144:14 (libserver_process.so+0x1167ed)
    #4 kudu::server::ServerBase::StartMetricsLogging() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1185:3 (libserver_process.so+0x145294)
    #5 kudu::server::ServerBase::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/server/server_base.cc:1324:3 (libserver_process.so+0x145b34)
    #6 kudu::kserver::KuduServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/kserver/kserver.cc:179:22 (libkserver.so+0x13b10)
    #7 kudu::tserver::TabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/tablet_server.cc:160:3 (libtserver.so+0x2563a7)
    #8 kudu::tserver::MiniTabletServer::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/mini_tablet_server.cc:107:3 (libtserver.so+0x3120f9)
    #9 kudu::cluster::InternalMiniCluster::AddTabletServer(kudu::HostPort const&) /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:234:3 (libmini_cluster.so+0xd5d39)
    #10 kudu::cluster::InternalMiniCluster::AddTabletServer() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:215:10 (libmini_cluster.so+0xd5855)
    #11 kudu::cluster::InternalMiniCluster::Start() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/mini-cluster/internal_mini_cluster.cc:112:5 (libmini_cluster.so+0xd4aea)
    #12 kudu::master::LeaderRebalancerTest::CreateAndStartCluster() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:101:22 (auto_leader_rebalancer-test+0x34586c)
    #13 kudu::master::LeaderRebalancerTest_AddTserver_Test::TestBody() /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:405:3 (auto_leader_rebalancer-test+0x342433)
    #14 void testing::internal::HandleSehExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x64e8f)
    #15 void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x64e8f)
    #16 testing::Test::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2674:5 (libgtest.so.1.12.1+0x42a91)
    #17 testing::TestInfo::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2853:11 (libgtest.so.1.12.1+0x43da8)
    #18 testing::TestSuite::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:3012:30 (libgtest.so.1.12.1+0x44d84)
    #19 testing::internal::UnitTestImpl::RunAllTests() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5870:44 (libgtest.so.1.12.1+0x59874)
    #20 bool testing::internal::HandleSehExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2599:10 (libgtest.so.1.12.1+0x65d4f)
    #21 bool testing::internal::HandleExceptionsInMethodIfSupported<testing::internal::UnitTestImpl, bool>(testing::internal::UnitTestImpl*, bool (testing::internal::UnitTestImpl::*)(), char const*) /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:2635:14 (libgtest.so.1.12.1+0x65d4f)
    #22 testing::UnitTest::Run() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/src/googletest-release-1.12.1/googletest/src/gtest.cc:5444:10 (libgtest.so.1.12.1+0x58e2c)
    #23 RUN_ALL_TESTS() /data0/somelongdirectorytoavoidrpathissues/src/kudu/thirdparty/installed/tsan/include/gtest/gtest.h:2293:73 (auto_leader_rebalancer-test+0x36966b)
    #24 main /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/test_main.cc:109:10 (auto_leader_rebalancer-test+0x36852c)

SUMMARY: ThreadSanitizer: data race /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/util/net/diagnostic_socket.cc:109:7 in kudu::DiagnosticSocket::Close()
==================
W20260925 16:47:09.101786  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.102504  9666 connection.cc:698] client connection to 127.7.158.194:45245 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260925 16:47:09.721315  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:09.731164 18608 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.731820 18608 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.734932 18608 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:09.758816  9666 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111) [suppressed 435 similar messages]
W20260925 16:47:09.764148  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:09.764734  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260925 16:47:09.765223  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:09.777781  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.780475 18609 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.780890 18605 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.781032 18609 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.781417 18605 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.783327 18609 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.784083 18605 leader_election.cc:288] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:09.787673 18592 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.787921 18610 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.789192 18592 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.790050 18610 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.791356 18592 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.792773 18610 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:09.795737  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:47:09.796419  9666 leader_election.cc:334] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.797132 18614 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.797638 18614 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.799871 18614 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:09.804932  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.805389  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.822000 18610 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260925 16:47:09.827736  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260925 16:47:09.834661  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:09.835201  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:09.835677  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:09.837203  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.837626  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.838474 18618 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260925 16:47:09.839391  9089 leader_election.cc:334] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.839794  9089 leader_election.cc:302] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.840534 18618 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:47:09.841202  9089 leader_election.cc:334] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.841660  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.842026  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.842694 18618 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:47:09.845386  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:09.848505  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:09.849174  9123 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 25.
W20260925 16:47:09.862737  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:09.863560  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.864593 18603 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260925 16:47:09.864960 18603 raft_consensus.cc:482] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.865274 18603 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:47:09.865727  9702 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:47:09.868163 18598 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.868757 18598 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.871560 18598 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:09.875887  9666 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.900892  8859 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.7.158.193:40071, user_credentials={real_user=slave}} blocked reactor thread for 104783us
W20260925 16:47:09.910470  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.915233 18603 raft_consensus.cc:504] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.918838  9702 raft_consensus.cc:2379] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 40a71744ceba4efe949720cb0f274853 in current term 26: Already voted for candidate e3a3bc92ca0a4efa913eca1800a1550d in this term.
I20260925 16:47:09.920153 18603 leader_election.cc:288] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.922143 18614 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.922988 18614 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:09.928118  9666 leader_election.cc:334] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.930932 18603 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.932255 18603 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.937290 18592 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.938308 18592 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.939643 18598 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.941152 18592 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.941265  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
W20260925 16:47:09.942139  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.942513 18598 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.943228 18618 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.943364  9119 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4c4320bf19c419d939def3dc1e1c3d8" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 26 candidate_status { last_received { term: 25 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:47:09.944335  9119 raft_consensus.cc:3037] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Advancing to term 26
I20260925 16:47:09.944183 18618 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.945034 18603 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.946875  9090 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
W20260925 16:47:09.952740  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.947001 18618 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:09.954582  9665 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:09.956382  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.957059 18601 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:09.957985  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:47:09.958655  9696 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 20.
I20260925 16:47:09.954603 18614 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.946997 18598 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:09.961925  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:09.962513  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.963418 18598 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:09.963572  9666 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.964138  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:09.965075  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.965668  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.966610 18598 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:47:09.968370  9090 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.972656 18614 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260925 16:47:09.973160 18614 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.973625 18614 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Advancing to term 21
I20260925 16:47:09.979151 18603 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.980034 18603 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:09.986284 18598 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.987054 18598 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:09.987890  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:09.989899 18598 leader_election.cc:288] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:09.990724 18618 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:09.970324  9119 raft_consensus.cc:2454] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 26.
I20260925 16:47:09.991439 18618 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:09.992337 18607 raft_consensus.cc:2726] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:09.992735  9121 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:09.993697 18618 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.991683  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:09.995215  9123 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:47:09.996433  9665 leader_election.cc:302] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:09.997161 18603 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:09.997712 18603 raft_consensus.cc:2781] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader election won for term 26
I20260925 16:47:09.998287 18603 raft_consensus.cc:686] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:47:09.998124 18614 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.002313 18614 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:10.004101  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c756d218cfc0470183a9fe1cc08a22ab" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:47:10.004856  9696 raft_consensus.cc:3037] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Advancing to term 21
W20260925 16:47:10.004259  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.009212  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:10.010192  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.010704  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.011420 18598 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:47:10.003216  9121 raft_consensus.cc:2379] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e3a3bc92ca0a4efa913eca1800a1550d in current term 21: Already voted for candidate 40a71744ceba4efe949720cb0f274853 in this term.
W20260925 16:47:10.011574  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.014885  9665 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.018896 18614 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:10.019495  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.020871  9666 leader_election.cc:302] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.018959 18603 consensus_queue.cc:237] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 25.19, Last appended by leader: 19, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.018309  9696 raft_consensus.cc:2454] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 21.
I20260925 16:47:10.022565 18598 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:47:10.023910 18598 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:10.025215  9090 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
W20260925 16:47:10.026099  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.026858 18614 raft_consensus.cc:2781] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader election won for term 21
I20260925 16:47:10.027765 18614 raft_consensus.cc:686] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
W20260925 16:47:10.029474  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.030027  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.030932 18607 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:10.030094 18614 consensus_queue.cc:237] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:10.032960  9089 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.044116  8869 catalog_manager.cc:5495] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 25 to 26, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 26 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:47:10.066047 18614 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.066354 18607 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.066979 18614 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.067167 18607 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.069633 18607 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:10.072786  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
I20260925 16:47:10.082408 18601 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:47:10.082701  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.082083  8867 catalog_manager.cc:5495] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 20 to 21, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 21 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:10.083101 18601 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:10.084324  9089 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.084749  9089 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 8dc3391062084f45a6ba62d28d340722, e3a3bc92ca0a4efa913eca1800a1550d
I20260925 16:47:10.085691 18607 raft_consensus.cc:2726] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260925 16:47:10.086094 18614 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.090154  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.090827  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.091192 18603 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.091784 18614 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:10.091879 18603 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.085917 18601 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.094478  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.096671 18603 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.096784  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.097270  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.097393 18614 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.098366 18607 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.098147 18614 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.099162 18607 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.100574 18618 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.101435 18603 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:47:10.101179 18618 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:10.106657  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.107415 18614 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.109015 18618 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.109751 18607 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.112882  7803 thread.cc:536] Waited for 1000ms trying to join with diag-logger (tid 9071)
W20260925 16:47:10.118468  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:10.119495  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.121893 18607 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.122571 18607 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:10.121912  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.125053 18607 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.121475  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.125013  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:10.126415  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:10.126869  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.127044 18618 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:10.127539  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.128007  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.127938 18603 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:10.129004  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.129403  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.130611 18614 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260925 16:47:10.130609 18618 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:47:10.141758  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:10.143277  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.143684  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
W20260925 16:47:10.144032  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:10.144433 18618 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:10.161139 18601 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.161839 18601 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.164780 18601 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:10.166050  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:10.166725  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 27.
I20260925 16:47:10.167549  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:47:10.168280 18601 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260925 16:47:10.168625 18601 raft_consensus.cc:482] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.168932 18601 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Advancing to term 28
W20260925 16:47:10.170076  9666 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.178059 18601 raft_consensus.cc:504] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.180845 18601 leader_election.cc:288] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:10.181535  9123 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7d3ede733d07420cb13e85c1792f036e" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 28 candidate_status { last_received { term: 27 index: 19 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853"
I20260925 16:47:10.182104  9123 raft_consensus.cc:3037] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Advancing to term 28
W20260925 16:47:10.185293  9666 leader_election.cc:334] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.189816  9123 raft_consensus.cc:2454] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 28.
I20260925 16:47:10.191195  9665 leader_election.cc:302] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.194350 18603 raft_consensus.cc:2781] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Leader election won for term 28
I20260925 16:47:10.194792 18603 raft_consensus.cc:686] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Becoming Leader. State: Replica: e3a3bc92ca0a4efa913eca1800a1550d, State: Running, Role: LEADER
I20260925 16:47:10.196003 18603 consensus_queue.cc:237] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 27.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.211951  8867 catalog_manager.cc:5495] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d reported cstate change: term changed from 27 to 28, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196). New cstate: current_term: 28 leader_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260925 16:47:10.234000 18614 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.234562 18614 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.236603 18614 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:10.247874 18618 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.248430 18618 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.250428 18618 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
W20260925 16:47:10.247596  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.251407  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" is_pre_election: true
W20260925 16:47:10.251914  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.252312  9696 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 23.
I20260925 16:47:10.252327  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.253983 18618 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:10.254779  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:47:10.256348 18618 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260925 16:47:10.256748 18618 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.257102 18618 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Advancing to term 24
I20260925 16:47:10.274399 18618 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.277525  9696 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d3b8dd7a0c64a6b99b7fd687634b17c" candidate_uuid: "40a71744ceba4efe949720cb0f274853" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "e3a3bc92ca0a4efa913eca1800a1550d"
I20260925 16:47:10.278110  9696 raft_consensus.cc:3037] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Advancing to term 24
W20260925 16:47:10.284745  9089 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.287684  9696 raft_consensus.cc:2454] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 40a71744ceba4efe949720cb0f274853 in term 24.
I20260925 16:47:10.288748  9090 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 
I20260925 16:47:10.290007 18618 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: Requested vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), e3a3bc92ca0a4efa913eca1800a1550d (127.7.158.196:37639)
I20260925 16:47:10.290577 18618 raft_consensus.cc:2781] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Leader election won for term 24
I20260925 16:47:10.291071 18618 raft_consensus.cc:686] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Becoming Leader. State: Replica: 40a71744ceba4efe949720cb0f274853, State: Running, Role: LEADER
I20260925 16:47:10.294927 18618 consensus_queue.cc:237] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:10.296949  9089 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.300940 18607 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.301528 18607 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:10.303366 18607 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.314658  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:10.315311  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.315686  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.316504 18607 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:10.340427 18592 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.341055 18592 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:10.343259 18592 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.354169  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.355763 18618 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:10.358829 18618 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
W20260925 16:47:10.361756  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:10.364017  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.364826 18603 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
I20260925 16:47:10.363169  8867 catalog_manager.cc:5495] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 reported cstate change: term changed from 23 to 24, leader changed from 8dc3391062084f45a6ba62d28d340722 (127.7.158.194) to 40a71744ceba4efe949720cb0f274853 (127.7.158.195). New cstate: current_term: 24 leader_uuid: "40a71744ceba4efe949720cb0f274853" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:10.365935 18618 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:10.381464  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:10.382165  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:10.382575  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:10.383235 18618 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:47:10.424098  9666 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:10.437636  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:10.561348  9089 consensus_peers.cc:487] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:10.632289  9121 raft_consensus.cc:1261] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 25 index: 19. Preceding OpId from leader: term: 26 index: 20. (index mismatch)
I20260925 16:47:10.633805 18592 consensus_queue.cc:1035] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260925 16:47:10.634842  9702 raft_consensus.cc:1261] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260925 16:47:10.636279 18618 consensus_queue.cc:1035] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260925 16:47:10.713965  9666 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:10.724586  9121 raft_consensus.cc:1261] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Refusing update from remote peer e3a3bc92ca0a4efa913eca1800a1550d: Log matching property violated. Preceding OpId in replica: term: 27 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260925 16:47:10.726385 18603 consensus_queue.cc:1035] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [LEADER]: Connected to new peer: Peer: permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
W20260925 16:47:10.801349  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:10.806766  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003a61e0 after lost signal to thread 7806
W20260925 16:47:10.808274  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08001eeec0 after lost signal to thread 8907
W20260925 16:47:10.809904  9145 debug-util.cc:398] Leaking SignalData structure 0x7b08003786a0 after lost signal to thread 9148
W20260925 16:47:10.811033  9145 debug-util.cc:398] Leaking SignalData structure 0x7b080043ff00 after lost signal to thread 9726
W20260925 16:47:10.838181  9089 consensus_peers.cc:487] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:10.850757  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:10.883798  9666 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:10.924000  9089 consensus_peers.cc:487] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:10.925452  9702 raft_consensus.cc:1261] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Refusing update from remote peer 40a71744ceba4efe949720cb0f274853: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260925 16:47:10.927734 18614 consensus_queue.cc:1035] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260925 16:47:10.937126  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:11.055939  9089 consensus_peers.cc:487] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:11.058575  9666 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.065871  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.104087  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.113406  7803 thread.cc:536] Waited for 2000ms trying to join with diag-logger (tid 9071)
W20260925 16:47:11.122695  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.172677  9089 consensus_peers.cc:487] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:11.230170  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:11.232715  9089 consensus_peers.cc:487] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.254878  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.256482  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.285049  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.306874  9089 consensus_peers.cc:487] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.314811  9666 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.321693  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.330442  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.432561  9666 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.439026  9666 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.449746  9089 consensus_peers.cc:487] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260925 16:47:11.495159 18603 raft_consensus.cc:482] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.495759 18603 raft_consensus.cc:504] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:11.497928 18603 leader_election.cc:288] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.515261  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:11.517285  9666 leader_election.cc:334] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:11.519160  9666 leader_election.cc:302] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.532491 18603 raft_consensus.cc:2726] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:11.540307  9666 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.544778  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:11.546025 18618 raft_consensus.cc:482] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.546492 18618 raft_consensus.cc:504] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.548100 18618 leader_election.cc:288] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.551754  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.552428  9089 leader_election.cc:334] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.552832  9089 leader_election.cc:302] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.553619 18618 raft_consensus.cc:2726] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
W20260925 16:47:11.576864  9089 consensus_peers.cc:487] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:11.601822  9089 consensus_peers.cc:487] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
W20260925 16:47:11.610680  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:11.718940 18618 raft_consensus.cc:482] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.719503 18618 raft_consensus.cc:504] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.721333 18618 leader_election.cc:288] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.730401  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:11.731094  9089 leader_election.cc:334] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:11.731511  9089 leader_election.cc:302] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.734989 18618 raft_consensus.cc:2726] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
W20260925 16:47:11.737747  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.738348  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.747332  9666 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:11.798269 18618 raft_consensus.cc:482] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.798815 18618 raft_consensus.cc:504] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.800864 18618 leader_election.cc:288] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:11.809101 18607 raft_consensus.cc:482] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.809688 18607 raft_consensus.cc:504] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.811822 18607 leader_election.cc:288] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.819928  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.824064  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:11.825726  9089 leader_election.cc:334] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.826213  9089 leader_election.cc:302] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.827059 18618 raft_consensus.cc:2726] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:11.833477  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.835738  9089 leader_election.cc:334] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.836126  9089 leader_election.cc:302] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.837612 18638 raft_consensus.cc:2726] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260925 16:47:11.851295  9089 consensus_peers.cc:487] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
I20260925 16:47:11.863571 18638 raft_consensus.cc:482] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.864316 18638 raft_consensus.cc:504] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.866559 18638 leader_election.cc:288] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:11.873481 18603 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.874020 18603 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:11.876016 18603 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.883131  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.883853  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.884279  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.885293 18603 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:11.886425  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:11.887897  9089 leader_election.cc:334] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:11.888304  9089 leader_election.cc:302] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 35 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:11.889019 18638 raft_consensus.cc:2726] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Leader pre-election lost for term 35. Reason: could not achieve majority
W20260925 16:47:11.925076  9089 consensus_peers.cc:487] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:11.926553  9666 consensus_peers.cc:487] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:11.964921 18638 raft_consensus.cc:482] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.965570 18638 raft_consensus.cc:504] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:11.967752 18638 leader_election.cc:288] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:11.970003 18603 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:11.970556 18603 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:11.973572 18603 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:11.978027  9666 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:11.994457  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
W20260925 16:47:11.995817  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.006042  9089 leader_election.cc:334] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.010015  9089 leader_election.cc:302] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.016180 18638 raft_consensus.cc:2726] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260925 16:47:12.012545  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:12.019351  9666 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 46: this message will repeat every 5th retry.
I20260925 16:47:12.024780 18607 raft_consensus.cc:482] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
W20260925 16:47:12.024962  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:12.025365  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.025324 18607 raft_consensus.cc:504] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.026150 18603 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:12.027681  9666 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:12.042275 18618 raft_consensus.cc:482] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.045728 18607 leader_election.cc:288] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:12.049297 18618 raft_consensus.cc:504] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.058674 18607 raft_consensus.cc:482] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.059312 18607 raft_consensus.cc:504] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.061496 18607 leader_election.cc:288] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
I20260925 16:47:12.058310 18618 leader_election.cc:288] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.068516  9089 consensus_peers.cc:487] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:12.069142  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.072155  9089 leader_election.cc:334] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.072582  9089 leader_election.cc:302] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.075217 18618 raft_consensus.cc:2726] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:12.082644  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.083210  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.083801  9089 leader_election.cc:334] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.084189  9089 leader_election.cc:302] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.084904 18618 raft_consensus.cc:2726] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:47:12.085836  9089 leader_election.cc:334] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.086272  9089 leader_election.cc:302] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.087072 18618 raft_consensus.cc:2726] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:12.087874  9089 consensus_peers.cc:487] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:12.096834  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260925 16:47:12.129994 18637 raft_consensus.cc:482] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.130601 18637 raft_consensus.cc:504] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } attrs { replace: true } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.134239  9124 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6030f186a664452b127609fadec766b" candidate_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "40a71744ceba4efe949720cb0f274853" is_pre_election: true
I20260925 16:47:12.134886  9124 raft_consensus.cc:2454] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e3a3bc92ca0a4efa913eca1800a1550d in term 21.
I20260925 16:47:12.140311 18603 raft_consensus.cc:482] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.140799 18603 raft_consensus.cc:504] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.143004 18603 leader_election.cc:288] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.143913  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.145687 18637 leader_election.cc:288] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:12.147868  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.197580 18637 raft_consensus.cc:482] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.198199 18637 raft_consensus.cc:504] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.202293 18637 leader_election.cc:288] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.207054  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
W20260925 16:47:12.215919  9089 consensus_peers.cc:487] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260925 16:47:12.282541 18618 raft_consensus.cc:482] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.283064 18618 raft_consensus.cc:504] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.284919 18618 leader_election.cc:288] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.302913  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.303488  9089 leader_election.cc:334] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.303830  9089 leader_election.cc:302] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.304489 18607 raft_consensus.cc:2726] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:12.360782 18607 raft_consensus.cc:482] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.361258 18607 raft_consensus.cc:504] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.363029 18607 leader_election.cc:288] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.367658  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.368371  9089 leader_election.cc:334] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.368721  9089 leader_election.cc:302] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.370386 18607 raft_consensus.cc:2726] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260925 16:47:12.423604 18603 raft_consensus.cc:482] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.424160 18603 raft_consensus.cc:504] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:12.426214 18603 leader_election.cc:288] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.433261  9089 consensus_peers.cc:487] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:12.442950  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.485697 18607 raft_consensus.cc:482] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.486217 18607 raft_consensus.cc:504] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.488094 18607 leader_election.cc:288] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.494194  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.495220  9089 leader_election.cc:334] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.495579  9089 leader_election.cc:302] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.498643 18607 raft_consensus.cc:2726] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:12.571866  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:47:12.616132 18607 raft_consensus.cc:482] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:12.616657 18607 raft_consensus.cc:504] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } }
I20260925 16:47:12.618835 18607 leader_election.cc:288] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:12.624462  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:12.633040  9089 leader_election.cc:334] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:12.633530  9089 leader_election.cc:302] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:12.634232 18607 raft_consensus.cc:2726] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260925 16:47:12.714257  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
W20260925 16:47:12.721733  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.722119  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.734726  8921 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.735030  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:47:12.744271  9665 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:12.755115  9665 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:12.776046  9665 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.788862  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:12.789978  7803 tablet_replica.cc:330] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.790716  7803 raft_consensus.cc:2229] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.791235  7803 raft_consensus.cc:2258] T 49c7db4b3fda45159275230bc247b929 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.793846  7803 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.794705  7803 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.795177  7803 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.797784  7803 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.798609  7803 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.799350  7803 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.801776  7803 tablet_replica.cc:330] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.802469  7803 raft_consensus.cc:2229] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.803563  7803 raft_consensus.cc:2258] T f15ade9737ac41438bda476a00b4ad97 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.806366  7803 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.807088  7803 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.807837  7803 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.810191  7803 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.811040  7803 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.812132  7803 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.814532  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.815302  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.816443  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.818553  7803 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.819077  7803 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.819836  7803 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.821990  7803 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.822636  7803 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.823254  7803 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.825870  7803 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.826423  7803 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.827059  7803 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P 40a71744ceba4efe949720cb0f274853 [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.831360  7803 tablet_replica.cc:330] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.832031  7803 raft_consensus.cc:2229] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:12.832333  9666 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:12.833014  7803 raft_consensus.cc:2258] T d3ff365de6e84921a6af19e793363f70 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.835947  9665 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.837165  7803 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.837895  7803 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.838477  7803 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P 40a71744ceba4efe949720cb0f274853 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.840816  7803 tablet_replica.cc:330] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.841398  7803 raft_consensus.cc:2229] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.842151  7803 raft_consensus.cc:2258] T 4d5ba69a70184d858b847e046b24564c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.844615  7803 tablet_replica.cc:330] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.845359  7803 raft_consensus.cc:2229] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.846067  7803 raft_consensus.cc:2258] T 088ac48c62d34a40b53987746a70b871 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.848538  7803 tablet_replica.cc:330] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.849291  7803 raft_consensus.cc:2229] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.850381  7803 raft_consensus.cc:2258] T 42b301336d224f89acb2543ae4e24a12 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.852334  7803 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.852913  7803 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.853832  7803 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.855743  7803 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.856259  7803 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.857020  7803 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.858880  7803 tablet_replica.cc:330] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.859417  7803 raft_consensus.cc:2229] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.859922  7803 raft_consensus.cc:2258] T ef3a95f58f62434d84bf19310c928a92 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.861845  7803 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.862360  7803 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.862787  7803 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.864549  7803 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.865058  7803 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.866006  7803 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P 40a71744ceba4efe949720cb0f274853 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.867978  7803 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.868459  7803 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.869170  7803 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.871618  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.872217  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:12.872265  9665 consensus_peers.cc:487] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.873711  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.876425  7803 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.877110  7803 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.877951  7803 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.880458  7803 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.880945  7803 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.881966  7803 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.885406  7803 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.886116  7803 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 LEADER]: Raft consensus shutting down.
W20260925 16:47:12.886319  9665 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.887223  7803 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.889705  7803 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.890342  7803 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.891345  7803 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.893735  7803 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.894374  7803 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.895448  7803 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.897862  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.898500  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.899919  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.900085  9665 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.902107  7803 tablet_replica.cc:330] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.902949  7803 raft_consensus.cc:2229] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.903445  7803 raft_consensus.cc:2258] T 505ce6aba0e14faabdb5e6135e200af6 P 40a71744ceba4efe949720cb0f274853 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.905827  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.906538  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.908257  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.910888  7803 tablet_replica.cc:330] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.911652  7803 raft_consensus.cc:2229] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.912448  7803 raft_consensus.cc:2258] T 8ee8e183d4e44c21804c9d95ed71dd2e P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.915004  7803 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.915642  7803 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.916324  7803 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.918587  7803 tablet_replica.cc:330] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.919248  7803 raft_consensus.cc:2229] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.919767  7803 raft_consensus.cc:2258] T 401361a5d37b4eefa49285e758f2f67b P 40a71744ceba4efe949720cb0f274853 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.922262  7803 tablet_replica.cc:330] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.922922  7803 raft_consensus.cc:2229] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.923612  7803 raft_consensus.cc:2258] T 4b41a723075b4ed5b21758d5b37cd917 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.925872  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.926574  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.927628  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P 40a71744ceba4efe949720cb0f274853 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.929981  7803 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.930640  7803 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.931651  7803 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P 40a71744ceba4efe949720cb0f274853 [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.933995  7803 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.934630  7803 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.935624  7803 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P 40a71744ceba4efe949720cb0f274853 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.937915  7803 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.938632  7803 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.939220  7803 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P 40a71744ceba4efe949720cb0f274853 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.941428  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.942097  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.944061  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P 40a71744ceba4efe949720cb0f274853 [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.946538  7803 tablet_replica.cc:330] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.947190  7803 raft_consensus.cc:2229] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.947765  7803 raft_consensus.cc:2258] T c71d03191b9f4a22a2ae4170c54fd018 P 40a71744ceba4efe949720cb0f274853 [term 34 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.950042  7803 tablet_replica.cc:330] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.950767  7803 raft_consensus.cc:2229] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.951412  7803 raft_consensus.cc:2258] T ee9de086f49c4026931c128637888218 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.953823  7803 tablet_replica.cc:330] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.954408  7803 raft_consensus.cc:2229] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.954965  7803 raft_consensus.cc:2258] T 9a92341cf5104c9eba99c812ba97c735 P 40a71744ceba4efe949720cb0f274853 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.956641  9665 consensus_peers.cc:487] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.957327  7803 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
W20260925 16:47:12.957520  9665 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.958218  7803 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:47:12.959839  7803 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P 40a71744ceba4efe949720cb0f274853 [term 17 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.960696  9665 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:12.962349  7803 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.963007  7803 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.963505  7803 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P 40a71744ceba4efe949720cb0f274853 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:12.965835  7803 tablet_replica.cc:330] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853: stopping tablet replica
I20260925 16:47:12.966426  7803 raft_consensus.cc:2229] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:12.967031  7803 raft_consensus.cc:2258] T e7e6790e980f40f8aeb12986a2ac7ed6 P 40a71744ceba4efe949720cb0f274853 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:12.998648  9665 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.039016  9665 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.086069  9665 consensus_peers.cc:487] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.138885  9665 consensus_peers.cc:487] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.157887  9666 leader_election.cc:334] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.158360  9666 leader_election.cc:302] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 40a71744ceba4efe949720cb0f274853, e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.159061 18637 raft_consensus.cc:2726] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260925 16:47:13.159384  9666 leader_election.cc:334] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.159900  9666 leader_election.cc:302] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.160516 18637 raft_consensus.cc:2726] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260925 16:47:13.160804  9666 leader_election.cc:334] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.161264  9666 leader_election.cc:302] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.161886 18637 raft_consensus.cc:2726] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:13.162312  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.163093  9666 leader_election.cc:334] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.163398  9666 leader_election.cc:302] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.164012 18637 raft_consensus.cc:2726] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Leader pre-election lost for term 31. Reason: could not achieve majority
W20260925 16:47:13.164331  9666 consensus_peers.cc:487] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.246841  9665 consensus_peers.cc:487] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Couldn't send request to peer 40a71744ceba4efe949720cb0f274853. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:13.300647  9666 consensus_peers.cc:487] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260925 16:47:13.350050  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
W20260925 16:47:13.392684  9666 consensus_peers.cc:487] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.397997  9666 consensus_peers.cc:487] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.540997  9666 consensus_peers.cc:487] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.551671  9666 consensus_peers.cc:487] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.561851  9666 consensus_peers.cc:487] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.605515  9666 consensus_peers.cc:487] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.647568  9666 consensus_peers.cc:487] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.698015  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:13.750305  9666 consensus_peers.cc:487] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:13.751686 18637 raft_consensus.cc:482] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:13.752171 18637 raft_consensus.cc:504] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.753870 18637 leader_election.cc:288] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:13.758191  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:13.758651  9666 leader_election.cc:334] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:13.758953  9666 leader_election.cc:302] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.759508 18637 raft_consensus.cc:2726] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260925 16:47:13.775764  9666 consensus_peers.cc:487] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:13.789054 18637 raft_consensus.cc:482] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.789573 18637 raft_consensus.cc:504] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.795042 18637 leader_election.cc:288] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.795485  9665 leader_election.cc:334] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.797003  9666 leader_election.cc:334] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:13.797439  9666 leader_election.cc:302] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.798139 18637 raft_consensus.cc:2726] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260925 16:47:13.820564  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 41: this message will repeat every 5th retry.
W20260925 16:47:13.821506  8921 auto_rebalancer.cc:254] failed to send replica move request: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.826228  8921 auto_rebalancer.cc:663] Could not move replica: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.826519  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.830880  8921 auto_rebalancer.cc:663] Could not move replica: Incomplete: tablet cdef8e15863049f59c35fc47250d99ee, TS 8dc3391062084f45a6ba62d28d340722 -> TS 225d3432101a4758bb9a6b0efeae09c5 move failed, destination replica disappeared from tablet's Raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:13.831182  8921 auto_rebalancer.cc:264] scheduled replica move failed to complete: Incomplete: tablet cdef8e15863049f59c35fc47250d99ee, TS 8dc3391062084f45a6ba62d28d340722 -> TS 225d3432101a4758bb9a6b0efeae09c5 move failed, destination replica disappeared from tablet's Raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
W20260925 16:47:13.883737  9666 consensus_peers.cc:487] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:13.921000  9666 consensus_peers.cc:487] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:13.940241 18637 raft_consensus.cc:482] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.940922 18637 raft_consensus.cc:504] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.943580 18637 leader_election.cc:288] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.946265  9665 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.946970  9666 leader_election.cc:334] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.947283  9666 leader_election.cc:302] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:47:13.947825 18637 raft_consensus.cc:2726] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:13.955842 18637 raft_consensus.cc:482] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.956284 18637 raft_consensus.cc:504] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.958122 18637 leader_election.cc:288] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.962448  9665 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
I20260925 16:47:13.963037 18637 raft_consensus.cc:482] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:13.963935  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:47:13.963587 18637 raft_consensus.cc:504] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.965256 18637 leader_election.cc:288] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.967674  9666 leader_election.cc:334] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:13.968298  9666 leader_election.cc:302] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:13.969033 18642 raft_consensus.cc:2726] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:47:13.969646  9665 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
I20260925 16:47:13.969748 18642 raft_consensus.cc:482] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
W20260925 16:47:13.971038  9666 leader_election.cc:334] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.970676 18642 raft_consensus.cc:504] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:13.971580  9666 leader_election.cc:302] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:47:13.972563 18637 raft_consensus.cc:2726] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260925 16:47:13.973590 18642 leader_election.cc:288] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
W20260925 16:47:13.977212  9665 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:13.978418  9666 leader_election.cc:334] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:13.978801  9666 leader_election.cc:302] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 40a71744ceba4efe949720cb0f274853
I20260925 16:47:13.979429 18637 raft_consensus.cc:2726] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260925 16:47:13.984300  9666 consensus_peers.cc:487] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Couldn't send request to peer 225d3432101a4758bb9a6b0efeae09c5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111). This is attempt 51: this message will repeat every 5th retry.
I20260925 16:47:14.048034  7803 tablet_server.cc:178] TabletServer@127.7.158.196:0 shutting down...
W20260925 16:47:14.053243  9666 consensus_peers.cc:487] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260925 16:47:14.057370  9666 consensus_peers.cc:487] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:14.057529 18642 raft_consensus.cc:482] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 8dc3391062084f45a6ba62d28d340722)
I20260925 16:47:14.058103 18642 raft_consensus.cc:504] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:14.059700 18642 leader_election.cc:288] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245)
W20260925 16:47:14.063004  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:14.063630  9666 leader_election.cc:334] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:14.064065  9666 leader_election.cc:302] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 225d3432101a4758bb9a6b0efeae09c5, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:14.064815 18637 raft_consensus.cc:2726] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260925 16:47:14.095429  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:14.096437  7803 tablet_replica.cc:330] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.097515  7803 raft_consensus.cc:2229] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.098215  7803 raft_consensus.cc:2258] T c6030f186a664452b127609fadec766b P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.100540  7803 tablet_replica.cc:330] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.101140  7803 raft_consensus.cc:2229] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.101778  7803 raft_consensus.cc:2258] T 6eaf0bf4e06942b0b3b3684cfa1f3cc6 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.103940  7803 tablet_replica.cc:330] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.104485  7803 raft_consensus.cc:2229] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.105226  7803 raft_consensus.cc:2258] T 12359c2bff0b46de91daa934c219103c P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.107326  7803 tablet_replica.cc:330] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.107904  7803 raft_consensus.cc:2229] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.108824  7803 raft_consensus.cc:2258] T c694676902c54ad8bfe8e7fd5a725e33 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:14.110867  9666 consensus_peers.cc:487] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d -> Peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Couldn't send request to peer 8dc3391062084f45a6ba62d28d340722. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260925 16:47:14.111151  7803 tablet_replica.cc:330] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.111850  7803 raft_consensus.cc:2229] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.112352  7803 raft_consensus.cc:2258] T f750a9cc810645b19ac831fe20c1010e P e3a3bc92ca0a4efa913eca1800a1550d [term 23 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.114219  7803 tablet_replica.cc:330] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.114768  7803 raft_consensus.cc:2229] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.115504  7803 raft_consensus.cc:2258] T a3daaf3df10a402a9f2af4eae42e46da P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.117295  7803 tablet_replica.cc:330] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.117832  7803 raft_consensus.cc:2229] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.118633  7803 raft_consensus.cc:2258] T 92fef1a775d54176ae0a3f7d209be2bf P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.120590  7803 tablet_replica.cc:330] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.121141  7803 raft_consensus.cc:2229] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.121569 18637 raft_consensus.cc:482] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:14.121822  7803 raft_consensus.cc:2258] T eb346a4d887940099443a0219edadef0 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.122078 18637 raft_consensus.cc:504] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:14.123867 18637 leader_election.cc:288] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:14.124478  7803 tablet_replica.cc:330] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.125336  7803 raft_consensus.cc:2229] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.126420  7803 raft_consensus.cc:2258] T 9bced284cac6492d92b23e3fcf0b9c80 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:14.127439  9665 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
W20260925 16:47:14.127929  9666 leader_election.cc:334] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:14.128270  9666 leader_election.cc:302] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:14.128820 18637 raft_consensus.cc:2726] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260925 16:47:14.128990  7803 tablet_replica.cc:330] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.129720  7803 raft_consensus.cc:2229] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.130467  7803 raft_consensus.cc:2258] T cd5f4e4896584eaca2d16610e2afbda8 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.132458  7803 tablet_replica.cc:330] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.132946  7803 raft_consensus.cc:2229] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.133340  7803 raft_consensus.cc:2258] T a47f8b3d2d0140999fc2b3d8be7d6166 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.135103  7803 tablet_replica.cc:330] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.135743  7803 raft_consensus.cc:2229] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.136243  7803 raft_consensus.cc:2258] T 516644be414e4a399c722f9df11d3ff5 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.138082  7803 tablet_replica.cc:330] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.138604  7803 raft_consensus.cc:2229] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.139025  7803 raft_consensus.cc:2258] T 436e4feae1ee4bf7932369f80db76c34 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.140770  7803 tablet_replica.cc:330] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.141336  7803 raft_consensus.cc:2229] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.142192  7803 raft_consensus.cc:2258] T 50e0cc681d6a47be89a47aef9f5e14f4 P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.144070  7803 tablet_replica.cc:330] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.144616  7803 raft_consensus.cc:2229] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.145417  7803 raft_consensus.cc:2258] T 7d3ede733d07420cb13e85c1792f036e P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.147840  7803 tablet_replica.cc:330] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.148619  7803 raft_consensus.cc:2229] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.149222  7803 raft_consensus.cc:2258] T 3c796634a27a4d74b87d6a0081b10018 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.151285  7803 tablet_replica.cc:330] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.151867  7803 raft_consensus.cc:2229] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.152642  7803 raft_consensus.cc:2258] T a54776b5e30341f1b8e3b9acd31b9027 P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.154371  7803 tablet_replica.cc:330] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.154860  7803 raft_consensus.cc:2229] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.155373  7803 raft_consensus.cc:2258] T 6e5cd4cb635e42ce8ee7624b47b5750a P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.157529  7803 tablet_replica.cc:330] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.158140  7803 raft_consensus.cc:2229] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.158672  7803 raft_consensus.cc:2258] T 7d1eb29a67e8482385d79fa193c4edd3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.160650  7803 tablet_replica.cc:330] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.161154  7803 raft_consensus.cc:2229] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.161726  7803 raft_consensus.cc:2258] T 3503b0ca8a04458ea73d2c6d127f2463 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.164290  7803 tablet_replica.cc:330] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.164878  7803 raft_consensus.cc:2229] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.165966  7803 raft_consensus.cc:2258] T 5db686f01e4748d0b9ce8fe3b96a5895 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.168503  7803 tablet_replica.cc:330] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.169090  7803 raft_consensus.cc:2229] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.169534  7803 raft_consensus.cc:2258] T 66c62931d7564a9698d331185552eed5 P e3a3bc92ca0a4efa913eca1800a1550d [term 25 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.171317  7803 tablet_replica.cc:330] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.171876  7803 raft_consensus.cc:2229] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.172730  7803 raft_consensus.cc:2258] T d89e555296ed40ef8f9abed67a87bde9 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.174476  7803 tablet_replica.cc:330] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.174985  7803 raft_consensus.cc:2229] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.175793  7803 raft_consensus.cc:2258] T aa99d4dee31544f3b7bfe97ab9e9e3a3 P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.177629  7803 tablet_replica.cc:330] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.178138  7803 raft_consensus.cc:2229] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.178880  7803 raft_consensus.cc:2258] T eeecf611404e405fa30831f973aec8f1 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.180761  7803 tablet_replica.cc:330] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.181267  7803 raft_consensus.cc:2229] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.181679  7803 raft_consensus.cc:2258] T 82c043c282244d42a0ae912a76bcbe36 P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.183470  7803 tablet_replica.cc:330] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.184005  7803 raft_consensus.cc:2229] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.184681  7803 raft_consensus.cc:2258] T a5837876dc21490e819ef69131e93921 P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.186484  7803 tablet_replica.cc:330] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.186931  7803 raft_consensus.cc:2229] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.187587  7803 raft_consensus.cc:2258] T cdef8e15863049f59c35fc47250d99ee P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.189822  7803 tablet_replica.cc:330] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.190531  7803 raft_consensus.cc:2229] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.191448  7803 raft_consensus.cc:2258] T 07fa6fea161b4a24904740819d2f89fa P e3a3bc92ca0a4efa913eca1800a1550d [term 17 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.193287  7803 tablet_replica.cc:330] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.193784  7803 raft_consensus.cc:2229] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.194595  7803 raft_consensus.cc:2258] T bfcf558f0a6b4011a3cb46c3ebbe4a3e P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.196358  7803 tablet_replica.cc:330] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.196822  7803 raft_consensus.cc:2229] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.197536  7803 raft_consensus.cc:2258] T 549559d524ae4003aa83f35d26b7f4b9 P e3a3bc92ca0a4efa913eca1800a1550d [term 28 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.199224  7803 tablet_replica.cc:330] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.199771  7803 raft_consensus.cc:2229] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.200480  7803 raft_consensus.cc:2258] T 4bcfed5db9a046b18c3437b749370a81 P e3a3bc92ca0a4efa913eca1800a1550d [term 27 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.202201  7803 tablet_replica.cc:330] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.202664  7803 raft_consensus.cc:2229] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.203068  7803 raft_consensus.cc:2258] T 4d3b8dd7a0c64a6b99b7fd687634b17c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.204999  7803 tablet_replica.cc:330] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.205013 18637 raft_consensus.cc:482] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 40a71744ceba4efe949720cb0f274853)
I20260925 16:47:14.205595  7803 raft_consensus.cc:2229] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.205586 18637 raft_consensus.cc:504] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "225d3432101a4758bb9a6b0efeae09c5" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 40071 } } peers { permanent_uuid: "8dc3391062084f45a6ba62d28d340722" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 45245 } attrs { replace: true } } peers { permanent_uuid: "40a71744ceba4efe949720cb0f274853" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 32851 } } peers { permanent_uuid: "e3a3bc92ca0a4efa913eca1800a1550d" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 37639 } attrs { promote: false } }
I20260925 16:47:14.206270  7803 raft_consensus.cc:2258] T bbd44a1efa8149a7bbcd2a06b68c6ce8 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.207655 18637 leader_election.cc:288] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071), 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245), 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851)
I20260925 16:47:14.209547  7803 tablet_replica.cc:330] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.210101  7803 raft_consensus.cc:2229] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.210685  7803 raft_consensus.cc:2258] T a2fce9318b914cda8815dd44730712b6 P e3a3bc92ca0a4efa913eca1800a1550d [term 20 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:14.211254  9665 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 40a71744ceba4efe949720cb0f274853 (127.7.158.195:32851): Network error: Client connection negotiation failed: client connection to 127.7.158.195:32851: connect: Connection refused (error 111)
I20260925 16:47:14.212929  7803 tablet_replica.cc:330] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
W20260925 16:47:14.213253  9666 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 8dc3391062084f45a6ba62d28d340722 (127.7.158.194:45245): Network error: Client connection negotiation failed: client connection to 127.7.158.194:45245: connect: Connection refused (error 111)
I20260925 16:47:14.213590  7803 raft_consensus.cc:2229] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.213826  9666 leader_election.cc:302] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: e3a3bc92ca0a4efa913eca1800a1550d; no voters: 40a71744ceba4efe949720cb0f274853, 8dc3391062084f45a6ba62d28d340722
I20260925 16:47:14.214229  7803 raft_consensus.cc:2258] T cfb224095e1141f88e8a13ce96fb8fbb P e3a3bc92ca0a4efa913eca1800a1550d [term 30 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.214504 18637 raft_consensus.cc:2726] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260925 16:47:14.214643  9666 leader_election.cc:334] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:14.216257  7803 tablet_replica.cc:330] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.216833  7803 raft_consensus.cc:2229] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.217374  7803 raft_consensus.cc:2258] T c756d218cfc0470183a9fe1cc08a22ab P e3a3bc92ca0a4efa913eca1800a1550d [term 21 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.219264  7803 tablet_replica.cc:330] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.219785  7803 raft_consensus.cc:2229] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.220202  7803 raft_consensus.cc:2258] T 72e548ac0b7b407dbc32d2018beb932d P e3a3bc92ca0a4efa913eca1800a1550d [term 29 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.221897  7803 tablet_replica.cc:330] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.222368  7803 raft_consensus.cc:2229] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.223176  7803 raft_consensus.cc:2258] T 7035ef77210644d1a724b7ba26706f52 P e3a3bc92ca0a4efa913eca1800a1550d [term 19 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.225046  7803 tablet_replica.cc:330] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.225570  7803 raft_consensus.cc:2229] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.226224  7803 raft_consensus.cc:2258] T adae4a9dd16346529fe4ff004abc3603 P e3a3bc92ca0a4efa913eca1800a1550d [term 22 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.228112  7803 tablet_replica.cc:330] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.228576  7803 raft_consensus.cc:2229] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.229327  7803 raft_consensus.cc:2258] T 918e188b611843cb98bcddc996c7fc3a P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.231199  7803 tablet_replica.cc:330] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.231742  7803 raft_consensus.cc:2229] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:14.232236  7803 raft_consensus.cc:2258] T 3c0923848b9b426eade76023fdecc31c P e3a3bc92ca0a4efa913eca1800a1550d [term 24 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.234064  7803 tablet_replica.cc:330] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.234519  7803 raft_consensus.cc:2229] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.235368  7803 raft_consensus.cc:2258] T e4c4320bf19c419d939def3dc1e1c3d8 P e3a3bc92ca0a4efa913eca1800a1550d [term 26 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.237066  7803 tablet_replica.cc:330] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d: stopping tablet replica
I20260925 16:47:14.237491  7803 raft_consensus.cc:2229] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 LEADER]: Raft consensus shutting down.
I20260925 16:47:14.238200  7803 raft_consensus.cc:2258] T dff93d0dcc5944b0b73fca3da91c5b2c P e3a3bc92ca0a4efa913eca1800a1550d [term 18 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:14.570350  7803 tablet_server.cc:194] TabletServer@127.7.158.196:0 shutdown complete.
I20260925 16:47:14.633877  7803 master.cc:537] Master@127.7.158.254:39187 shutting down...
W20260925 16:47:26.343786  8859 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111) [suppressed 554 similar messages]
W20260925 16:47:26.346998  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet c756d218cfc0470183a9fe1cc08a22ab: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:27.968436  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 12359c2bff0b46de91daa934c219103c: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
W20260925 16:47:30.130761  8859 catalog_manager.cc:4584] TS 225d3432101a4758bb9a6b0efeae09c5 (127.7.158.193:40071): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 6eaf0bf4e06942b0b3b3684cfa1f3cc6: Network error: Client connection negotiation failed: client connection to 127.7.158.193:40071: connect: Connection refused (error 111)
I20260925 16:47:31.671859  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:31.673975  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:31.674378  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P ba21ddca249c4cf39e72526cc8696c60: stopping tablet replica
I20260925 16:47:31.862498  7803 master.cc:552] Master@127.7.158.254:39187 shutdown complete.
I20260925 16:47:31.919056  7803 test_util.cc:175] -----------------------------------------------
I20260925 16:47:31.919247  7803 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1790354474930402-7803-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (315055 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260925 16:47:31.922453  7803 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.158.254:38107
I20260925 16:47:31.923453  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:47:31.929557 18656 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:31.930110 18657 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:31.931392 18659 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:47:31.932219  7803 server_base.cc:1034] running on GCE node
I20260925 16:47:31.936548  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:47:31.936743  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:47:31.936924  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354851936905 us; error 0 us; skew 500 ppm
I20260925 16:47:31.937481  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:47:31.940026  7803 webserver.cc:460] Webserver started at http://127.7.158.254:46805/ using document root <none> and password file <none>
I20260925 16:47:31.940519  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:47:31.940697  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:47:31.940980  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:47:31.942323  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/master-0-root/instance:
uuid: "3a71b1bb5de94141ba2f2500af109ed2"
format_stamp: "Formatted at 2026-09-25 16:47:31 on dist-test-slave-fknp"
I20260925 16:47:31.948382  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.003s
I20260925 16:47:31.951763 18664 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:31.952451  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260925 16:47:31.952759  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/master-0-root
uuid: "3a71b1bb5de94141ba2f2500af109ed2"
format_stamp: "Formatted at 2026-09-25 16:47:31 on dist-test-slave-fknp"
I20260925 16:47:31.953013  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:47:31.974920  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:47:31.976142  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:47:32.014732  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.254:38107
I20260925 16:47:32.014901 18715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.254:38107 every 8 connection(s)
I20260925 16:47:32.018998 18716 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.030459 18716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2: Bootstrap starting.
I20260925 16:47:32.034979 18716 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:32.039119 18716 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2: No bootstrap required, opened a new log
I20260925 16:47:32.041121 18716 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a71b1bb5de94141ba2f2500af109ed2" member_type: VOTER }
I20260925 16:47:32.041586 18716 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:32.041755 18716 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a71b1bb5de94141ba2f2500af109ed2, State: Initialized, Role: FOLLOWER
I20260925 16:47:32.042557 18716 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a71b1bb5de94141ba2f2500af109ed2" member_type: VOTER }
I20260925 16:47:32.042982 18716 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 16:47:32.043170 18716 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 16:47:32.043386 18716 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:32.047629 18716 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a71b1bb5de94141ba2f2500af109ed2" member_type: VOTER }
I20260925 16:47:32.048090 18716 leader_election.cc:302] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a71b1bb5de94141ba2f2500af109ed2; no voters: 
I20260925 16:47:32.049134 18716 leader_election.cc:288] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260925 16:47:32.049590 18719 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:32.051146 18719 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 1 LEADER]: Becoming Leader. State: Replica: 3a71b1bb5de94141ba2f2500af109ed2, State: Running, Role: LEADER
I20260925 16:47:32.051872 18719 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a71b1bb5de94141ba2f2500af109ed2" member_type: VOTER }
I20260925 16:47:32.052156 18716 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 16:47:32.058596 18720 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a71b1bb5de94141ba2f2500af109ed2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a71b1bb5de94141ba2f2500af109ed2" member_type: VOTER } }
I20260925 16:47:32.058480 18721 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a71b1bb5de94141ba2f2500af109ed2. Latest consensus state: current_term: 1 leader_uuid: "3a71b1bb5de94141ba2f2500af109ed2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a71b1bb5de94141ba2f2500af109ed2" member_type: VOTER } }
I20260925 16:47:32.059281 18720 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [sys.catalog]: This master's current role is: LEADER
I20260925 16:47:32.059325 18721 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [sys.catalog]: This master's current role is: LEADER
I20260925 16:47:32.061594 18728 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 16:47:32.069420 18728 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 16:47:32.070531  7803 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260925 16:47:32.078492 18728 catalog_manager.cc:1347] Generated new cluster ID: 2e8ee557925e4c91976a0a1db859b15d
I20260925 16:47:32.078806 18728 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 16:47:32.109457 18728 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 16:47:32.111375 18728 catalog_manager.cc:1504] Loading token signing keys...
I20260925 16:47:32.123343 18728 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2: Generated new TSK 0
I20260925 16:47:32.124060 18728 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 16:47:32.137661  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:47:32.144958 18737 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.145581 18738 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.146795 18740 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:47:32.148608  7803 server_base.cc:1034] running on GCE node
I20260925 16:47:32.151182  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:47:32.151364  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:47:32.151569  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354852151535 us; error 0 us; skew 500 ppm
I20260925 16:47:32.152246  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:47:32.154969  7803 webserver.cc:460] Webserver started at http://127.7.158.193:34921/ using document root <none> and password file <none>
I20260925 16:47:32.155498  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:47:32.155747  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:47:32.156036  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:47:32.157179  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/instance:
uuid: "4de55b75c594486d94ca1518de4b3e6f"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.162490  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260925 16:47:32.165866 18745 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.166633  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260925 16:47:32.167021  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "4de55b75c594486d94ca1518de4b3e6f"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.167316  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:47:32.176823  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:47:32.177976  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:47:32.179425  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:47:32.181717  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:47:32.181939  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.182166  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:47:32.182360  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.225601  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:36337
I20260925 16:47:32.225704 18807 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:36337 every 8 connection(s)
I20260925 16:47:32.231072  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:47:32.238687 18812 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.240146 18813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.244297 18816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:47:32.244395  7803 server_base.cc:1034] running on GCE node
I20260925 16:47:32.247596  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:47:32.247898  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:47:32.248083  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354852248066 us; error 0 us; skew 500 ppm
I20260925 16:47:32.248703  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:47:32.249328 18808 heartbeater.cc:347] Connected to a master server at 127.7.158.254:38107
I20260925 16:47:32.249790 18808 heartbeater.cc:464] Registering TS with master...
I20260925 16:47:32.250602 18808 heartbeater.cc:511] Master 127.7.158.254:38107 requested a full tablet report, sending...
I20260925 16:47:32.251775  7803 webserver.cc:460] Webserver started at http://127.7.158.194:43081/ using document root <none> and password file <none>
I20260925 16:47:32.252449  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:47:32.252701  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:47:32.253063  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:47:32.252964 18681 ts_manager.cc:194] Registered new tserver with Master: 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:32.255045  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/instance:
uuid: "95ce93f423f7436fa4863f1c688c9dc5"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.255929 18681 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55174
I20260925 16:47:32.260293  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.004s	sys 0.000s
I20260925 16:47:32.264518 18820 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.265295  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.000s
I20260925 16:47:32.265586  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-1-root
uuid: "95ce93f423f7436fa4863f1c688c9dc5"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.265901  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:47:32.297271  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:47:32.298507  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:47:32.300129  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:47:32.302253  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:47:32.302470  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.302711  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:47:32.302871  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.343964  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.194:44819
I20260925 16:47:32.344091 18882 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.194:44819 every 8 connection(s)
I20260925 16:47:32.348750  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:47:32.356679 18886 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.357657 18887 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.360850 18890 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:47:32.361363  7803 server_base.cc:1034] running on GCE node
I20260925 16:47:32.362509  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:47:32.362731  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:47:32.362913  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354852362897 us; error 0 us; skew 500 ppm
I20260925 16:47:32.363497  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:47:32.363545 18883 heartbeater.cc:347] Connected to a master server at 127.7.158.254:38107
I20260925 16:47:32.364053 18883 heartbeater.cc:464] Registering TS with master...
I20260925 16:47:32.365023 18883 heartbeater.cc:511] Master 127.7.158.254:38107 requested a full tablet report, sending...
I20260925 16:47:32.366518  7803 webserver.cc:460] Webserver started at http://127.7.158.195:33795/ using document root <none> and password file <none>
I20260925 16:47:32.367213  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:47:32.367274 18681 ts_manager.cc:194] Registered new tserver with Master: 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:32.367556  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:47:32.367969  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:47:32.369597 18681 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55186
I20260925 16:47:32.369642  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/instance:
uuid: "2214de1d38f74b668aa3139202318338"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.375309  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260925 16:47:32.378716 18894 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.379515  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260925 16:47:32.379818  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-2-root
uuid: "2214de1d38f74b668aa3139202318338"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.380086  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:47:32.391791  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:47:32.392875  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:47:32.394243  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:47:32.396400  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:47:32.396606  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.396835  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:47:32.396997  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.442673  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.195:33127
I20260925 16:47:32.442739 18956 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.195:33127 every 8 connection(s)
I20260925 16:47:32.448031  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:47:32.456054 18960 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.459264 18961 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:32.461302 18963 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:47:32.461738  7803 server_base.cc:1034] running on GCE node
I20260925 16:47:32.463066  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:47:32.463287  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:47:32.463441 18957 heartbeater.cc:347] Connected to a master server at 127.7.158.254:38107
I20260925 16:47:32.463479  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354852463462 us; error 0 us; skew 500 ppm
I20260925 16:47:32.464099 18957 heartbeater.cc:464] Registering TS with master...
I20260925 16:47:32.464468  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:47:32.465042 18957 heartbeater.cc:511] Master 127.7.158.254:38107 requested a full tablet report, sending...
I20260925 16:47:32.467459  7803 webserver.cc:460] Webserver started at http://127.7.158.196:39261/ using document root <none> and password file <none>
I20260925 16:47:32.467593 18681 ts_manager.cc:194] Registered new tserver with Master: 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:32.468152  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:47:32.468360  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:47:32.468556  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:47:32.469794  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-3-root/instance:
uuid: "45f690dc20794b529fdeabff43202cf4"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.469841 18681 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55202
I20260925 16:47:32.474414  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260925 16:47:32.477947 18968 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.478766  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260925 16:47:32.479053  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-3-root
uuid: "45f690dc20794b529fdeabff43202cf4"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:32.479346  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:47:32.510159  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:47:32.511391  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:47:32.512887  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:47:32.515175  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:47:32.515554  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.515838  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:47:32.516013  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:32.563378  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.196:45765
I20260925 16:47:32.563503 19030 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.196:45765 every 8 connection(s)
I20260925 16:47:32.579475 19031 heartbeater.cc:347] Connected to a master server at 127.7.158.254:38107
I20260925 16:47:32.580003 19031 heartbeater.cc:464] Registering TS with master...
I20260925 16:47:32.580847 19031 heartbeater.cc:511] Master 127.7.158.254:38107 requested a full tablet report, sending...
I20260925 16:47:32.582746 18681 ts_manager.cc:194] Registered new tserver with Master: 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:32.583145  7803 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.016123502s
I20260925 16:47:32.584378 18681 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:55206
I20260925 16:47:32.585395  7803 test_util.cc:268] Using random seed: 2030215071
I20260925 16:47:32.610646 18681 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:55218:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260925 16:47:32.878607 18921 tablet_service.cc:1467] Processing CreateTablet for tablet c76592461bbe4904ac4715bc51953d7f (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260925 16:47:32.880239 18921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c76592461bbe4904ac4715bc51953d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.880565 18919 tablet_service.cc:1467] Processing CreateTablet for tablet b4232305d9da417abeca7e94118abe8e (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260925 16:47:32.880959 18922 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa425847ff64d34a5137a5224513e75 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260925 16:47:32.881959 18919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4232305d9da417abeca7e94118abe8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.882560 18922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa425847ff64d34a5137a5224513e75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.884267 18918 tablet_service.cc:1467] Processing CreateTablet for tablet 0ef360c253d749e49df7441283aa6f50 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260925 16:47:32.886752 18917 tablet_service.cc:1467] Processing CreateTablet for tablet 61c81981a43a4ea180b0ac988ba75519 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260925 16:47:32.888063 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61c81981a43a4ea180b0ac988ba75519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.892937 18916 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6afc805c294e3497a293a015f886c2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260925 16:47:32.893378 18915 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4452fe3a6e47749633e00bb65aeb8b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260925 16:47:32.894335 18916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6afc805c294e3497a293a015f886c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.878773 18920 tablet_service.cc:1467] Processing CreateTablet for tablet 179c5529bce9433e91b98e095c37f5ba (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260925 16:47:32.896941 18920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 179c5529bce9433e91b98e095c37f5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.897341 18913 tablet_service.cc:1467] Processing CreateTablet for tablet 49fbefc46cf84318a696efb38b7f44ff (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260925 16:47:32.898872 18913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49fbefc46cf84318a696efb38b7f44ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.895598 18914 tablet_service.cc:1467] Processing CreateTablet for tablet 9db46060b3a2424ba8e4a67debeeda7a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260925 16:47:32.900671 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db46060b3a2424ba8e4a67debeeda7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.904105 18915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4452fe3a6e47749633e00bb65aeb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.908057 18918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ef360c253d749e49df7441283aa6f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.944950 18992 tablet_service.cc:1467] Processing CreateTablet for tablet 0ef360c253d749e49df7441283aa6f50 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260925 16:47:32.946450 18992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ef360c253d749e49df7441283aa6f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.949016 18993 tablet_service.cc:1467] Processing CreateTablet for tablet e68a2deed8c14bf4bdfe7deb5417cc56 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260925 16:47:32.950361 18993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68a2deed8c14bf4bdfe7deb5417cc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.952777 18922 tablet_service.cc:1467] Processing CreateTablet for tablet c3fea8b7be6841d6a16f563afcf1916e (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260925 16:47:32.953976 18991 tablet_service.cc:1467] Processing CreateTablet for tablet 61c81981a43a4ea180b0ac988ba75519 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260925 16:47:32.954473 18922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3fea8b7be6841d6a16f563afcf1916e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.955338 18991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61c81981a43a4ea180b0ac988ba75519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.956838 18995 tablet_service.cc:1467] Processing CreateTablet for tablet b9f1f43de2364a66ae54b5b6eba041d2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260925 16:47:32.958159 18995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f1f43de2364a66ae54b5b6eba041d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.960642 18994 tablet_service.cc:1467] Processing CreateTablet for tablet 179c5529bce9433e91b98e095c37f5ba (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260925 16:47:32.961015 18848 tablet_service.cc:1467] Processing CreateTablet for tablet c76592461bbe4904ac4715bc51953d7f (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260925 16:47:32.961948 18994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 179c5529bce9433e91b98e095c37f5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.962580 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c76592461bbe4904ac4715bc51953d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.967026 18921 tablet_service.cc:1467] Processing CreateTablet for tablet 39936f93e1a64ff290f8bcb31e35b2ee (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260925 16:47:32.973340 18915 tablet_service.cc:1467] Processing CreateTablet for tablet a5c4d8141b90433fbf058da0d0641809 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260925 16:47:32.975013 18843 tablet_service.cc:1467] Processing CreateTablet for tablet 61c81981a43a4ea180b0ac988ba75519 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260925 16:47:32.976749 18847 tablet_service.cc:1467] Processing CreateTablet for tablet b9f1f43de2364a66ae54b5b6eba041d2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260925 16:47:32.977914 18841 tablet_service.cc:1467] Processing CreateTablet for tablet a8d68e12cdea4099aa6d278a53a7af17 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260925 16:47:32.978487 18846 tablet_service.cc:1467] Processing CreateTablet for tablet 179c5529bce9433e91b98e095c37f5ba (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260925 16:47:32.984541 18844 tablet_service.cc:1467] Processing CreateTablet for tablet e68a2deed8c14bf4bdfe7deb5417cc56 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260925 16:47:32.987088 18839 tablet_service.cc:1467] Processing CreateTablet for tablet 49fbefc46cf84318a696efb38b7f44ff (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260925 16:47:32.988667 18845 tablet_service.cc:1467] Processing CreateTablet for tablet b4232305d9da417abeca7e94118abe8e (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260925 16:47:32.952843 18996 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa425847ff64d34a5137a5224513e75 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260925 16:47:32.990604 18996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa425847ff64d34a5137a5224513e75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:32.979628 18840 tablet_service.cc:1467] Processing CreateTablet for tablet 9db46060b3a2424ba8e4a67debeeda7a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260925 16:47:32.976756 18842 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6afc805c294e3497a293a015f886c2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260925 16:47:32.997670 18843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 61c81981a43a4ea180b0ac988ba75519. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.002575 18844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68a2deed8c14bf4bdfe7deb5417cc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.003568 18772 tablet_service.cc:1467] Processing CreateTablet for tablet c76592461bbe4904ac4715bc51953d7f (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260925 16:47:33.005107 18770 tablet_service.cc:1467] Processing CreateTablet for tablet b4232305d9da417abeca7e94118abe8e (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260925 16:47:33.005805 18773 tablet_service.cc:1467] Processing CreateTablet for tablet 5aa425847ff64d34a5137a5224513e75 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260925 16:47:33.002072 18769 tablet_service.cc:1467] Processing CreateTablet for tablet e68a2deed8c14bf4bdfe7deb5417cc56 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260925 16:47:33.006083 18771 tablet_service.cc:1467] Processing CreateTablet for tablet b9f1f43de2364a66ae54b5b6eba041d2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260925 16:47:33.008282 18772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c76592461bbe4904ac4715bc51953d7f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.010131 18921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39936f93e1a64ff290f8bcb31e35b2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.011638 18767 tablet_service.cc:1467] Processing CreateTablet for tablet 5e6afc805c294e3497a293a015f886c2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260925 16:47:33.012930 18915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c4d8141b90433fbf058da0d0641809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.014791 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f1f43de2364a66ae54b5b6eba041d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.017256 18990 tablet_service.cc:1467] Processing CreateTablet for tablet a8d68e12cdea4099aa6d278a53a7af17 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260925 16:47:33.018592 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d68e12cdea4099aa6d278a53a7af17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.020126 18847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b9f1f43de2364a66ae54b5b6eba041d2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.020977 18988 tablet_service.cc:1467] Processing CreateTablet for tablet 9db46060b3a2424ba8e4a67debeeda7a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260925 16:47:33.021617 18841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d68e12cdea4099aa6d278a53a7af17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.023062 18846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 179c5529bce9433e91b98e095c37f5ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.024580 18839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49fbefc46cf84318a696efb38b7f44ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.024765 18987 tablet_service.cc:1467] Processing CreateTablet for tablet d8b11e95748c4f57ace6efc0aa7344c4 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260925 16:47:33.026023 18840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db46060b3a2424ba8e4a67debeeda7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.023488 18989 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4452fe3a6e47749633e00bb65aeb8b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260925 16:47:33.029701 18989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4452fe3a6e47749633e00bb65aeb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.032407 18988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9db46060b3a2424ba8e4a67debeeda7a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.036211 18987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b11e95748c4f57ace6efc0aa7344c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.037539 18842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6afc805c294e3497a293a015f886c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.043481 18766 tablet_service.cc:1467] Processing CreateTablet for tablet a8d68e12cdea4099aa6d278a53a7af17 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260925 16:47:33.046342 18765 tablet_service.cc:1467] Processing CreateTablet for tablet 9c4452fe3a6e47749633e00bb65aeb8b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260925 16:47:33.051467 18845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4232305d9da417abeca7e94118abe8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.013099 18768 tablet_service.cc:1467] Processing CreateTablet for tablet 0ef360c253d749e49df7441283aa6f50 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260925 16:47:33.060715 18916 tablet_service.cc:1467] Processing CreateTablet for tablet fb9e866f82fd42c7a217585eda8e7354 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
W20260925 16:47:33.065064 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:33.067217 18770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b4232305d9da417abeca7e94118abe8e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.082490 18768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0ef360c253d749e49df7441283aa6f50. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.086373 18766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a8d68e12cdea4099aa6d278a53a7af17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.092031 18765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9c4452fe3a6e47749633e00bb65aeb8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.096022 18769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e68a2deed8c14bf4bdfe7deb5417cc56. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.100006 18773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5aa425847ff64d34a5137a5224513e75. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.106457 18764 tablet_service.cc:1467] Processing CreateTablet for tablet 49fbefc46cf84318a696efb38b7f44ff (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260925 16:47:33.106849 18914 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb80fbc80ab4acc921f87c842434d44 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260925 16:47:33.116094 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb80fbc80ab4acc921f87c842434d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.113503 18919 tablet_service.cc:1467] Processing CreateTablet for tablet 17301ed72d3d4a7abaebb081f70f39c9 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260925 16:47:33.109385 18915 tablet_service.cc:1467] Processing CreateTablet for tablet 4267fb73e9d54bbbb335e2137af161b4 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260925 16:47:33.124253 18916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb9e866f82fd42c7a217585eda8e7354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.128562 18920 tablet_service.cc:1467] Processing CreateTablet for tablet eaf54561cd6d421890074238dbb8a57a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260925 16:47:33.129593 18915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4267fb73e9d54bbbb335e2137af161b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.124495 18767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5e6afc805c294e3497a293a015f886c2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.140025 18764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49fbefc46cf84318a696efb38b7f44ff. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.140671 18919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17301ed72d3d4a7abaebb081f70f39c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.144219 18913 tablet_service.cc:1467] Processing CreateTablet for tablet 70ad3553e755461c9a8e998b4f54a138 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260925 16:47:33.145448 18913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ad3553e755461c9a8e998b4f54a138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.176262 18848 tablet_service.cc:1467] Processing CreateTablet for tablet d8b11e95748c4f57ace6efc0aa7344c4 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260925 16:47:33.196533 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b11e95748c4f57ace6efc0aa7344c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.177385 18918 tablet_service.cc:1467] Processing CreateTablet for tablet 37ccdcd526ba47b2b415825e4b37e361 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260925 16:47:33.202225 19052 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:33.205564 18917 tablet_service.cc:1467] Processing CreateTablet for tablet b7081600b02b48fb83f2b33eae404adf (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260925 16:47:33.173094 18920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaf54561cd6d421890074238dbb8a57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.240192 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7081600b02b48fb83f2b33eae404adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.250212 19052 tablet_bootstrap.cc:654] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:33.253640 19051 tablet_bootstrap.cc:492] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:33.254278 18918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ccdcd526ba47b2b415825e4b37e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.259532 18808 heartbeater.cc:503] Master 127.7.158.254:38107 was elected leader, sending a full tablet report...
I20260925 16:47:33.267215 18840 tablet_service.cc:1467] Processing CreateTablet for tablet 2570db54563a404ba0205e9af2d7cc1a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260925 16:47:33.270942 18921 tablet_service.cc:1467] Processing CreateTablet for tablet 39c4fd5349684aa580c163b167f15aa0 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260925 16:47:33.272562 18767 tablet_service.cc:1467] Processing CreateTablet for tablet d8b11e95748c4f57ace6efc0aa7344c4 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260925 16:47:33.292451 18842 tablet_service.cc:1467] Processing CreateTablet for tablet 39936f93e1a64ff290f8bcb31e35b2ee (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260925 16:47:33.294996 18765 tablet_service.cc:1467] Processing CreateTablet for tablet 70ad3553e755461c9a8e998b4f54a138 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260925 16:47:33.292497 18767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8b11e95748c4f57ace6efc0aa7344c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.296908 18994 tablet_service.cc:1467] Processing CreateTablet for tablet c3fea8b7be6841d6a16f563afcf1916e (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260925 16:47:33.296909 18989 tablet_service.cc:1467] Processing CreateTablet for tablet 39936f93e1a64ff290f8bcb31e35b2ee (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260925 16:47:33.304785 18992 tablet_service.cc:1467] Processing CreateTablet for tablet a5c4d8141b90433fbf058da0d0641809 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260925 16:47:33.305382 18913 tablet_service.cc:1467] Processing CreateTablet for tablet e068820a06364f1cb92b7b4701f9d8e2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260925 16:47:33.306210 18916 tablet_service.cc:1467] Processing CreateTablet for tablet 22bc127e42794a80991754fc732a2f60 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260925 16:47:33.252336 18847 tablet_service.cc:1467] Processing CreateTablet for tablet 70ad3553e755461c9a8e998b4f54a138 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260925 16:47:33.287663 18769 tablet_service.cc:1467] Processing CreateTablet for tablet c3fea8b7be6841d6a16f563afcf1916e (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260925 16:47:33.312518 19053 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:33.312734 18765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ad3553e755461c9a8e998b4f54a138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.315431 18994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3fea8b7be6841d6a16f563afcf1916e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.323781 18840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2570db54563a404ba0205e9af2d7cc1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.330674 18844 tablet_service.cc:1467] Processing CreateTablet for tablet 877d01ad1b7146388b608954cbc4574d (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260925 16:47:33.333444 18917 tablet_service.cc:1467] Processing CreateTablet for tablet df1e87cab2c64f9f870050016e4677f3 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260925 16:47:33.341181 19054 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:33.338047 18847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 70ad3553e755461c9a8e998b4f54a138. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.297501 18991 tablet_service.cc:1467] Processing CreateTablet for tablet 2570db54563a404ba0205e9af2d7cc1a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260925 16:47:33.328801 18921 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39c4fd5349684aa580c163b167f15aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.317991 18993 tablet_service.cc:1467] Processing CreateTablet for tablet 877d01ad1b7146388b608954cbc4574d (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260925 16:47:33.339432 18995 tablet_service.cc:1467] Processing CreateTablet for tablet 4267fb73e9d54bbbb335e2137af161b4 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260925 16:47:33.348610 18769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c3fea8b7be6841d6a16f563afcf1916e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.354331 18914 tablet_service.cc:1467] Processing CreateTablet for tablet 7293be9e009d40c88899bbef09077e1c (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260925 16:47:33.348258 18918 tablet_service.cc:1467] Processing CreateTablet for tablet 284fe7e2abae4c75999bec672a911342 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260925 16:47:33.357609 18771 tablet_service.cc:1467] Processing CreateTablet for tablet a5c4d8141b90433fbf058da0d0641809 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260925 16:47:33.357936 18846 tablet_service.cc:1467] Processing CreateTablet for tablet 17301ed72d3d4a7abaebb081f70f39c9 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260925 16:47:33.359086 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c4d8141b90433fbf058da0d0641809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.360064 18841 tablet_service.cc:1467] Processing CreateTablet for tablet eaf54561cd6d421890074238dbb8a57a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260925 16:47:33.360769 18843 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb80fbc80ab4acc921f87c842434d44 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260925 16:47:33.364094 18989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39936f93e1a64ff290f8bcb31e35b2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.365758 18988 tablet_service.cc:1467] Processing CreateTablet for tablet 17301ed72d3d4a7abaebb081f70f39c9 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260925 16:47:33.367285 18988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17301ed72d3d4a7abaebb081f70f39c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.350114 18920 tablet_service.cc:1467] Processing CreateTablet for tablet dd5c1c958e2143a6972ab64a912fa7d5 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260925 16:47:33.368414 18991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2570db54563a404ba0205e9af2d7cc1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.354094 19053 tablet_bootstrap.cc:654] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:33.368767 18996 tablet_service.cc:1467] Processing CreateTablet for tablet 19e0d07bb13a4413983a58ea3449cc0c (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260925 16:47:33.370462 18996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e0d07bb13a4413983a58ea3449cc0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.352901 18922 tablet_service.cc:1467] Processing CreateTablet for tablet f55e0c43cee44971a3a7483c91ead27b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260925 16:47:33.373687 18883 heartbeater.cc:503] Master 127.7.158.254:38107 was elected leader, sending a full tablet report...
I20260925 16:47:33.374078 18839 tablet_service.cc:1467] Processing CreateTablet for tablet fb9e866f82fd42c7a217585eda8e7354 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260925 16:47:33.354769 19051 tablet_bootstrap.cc:654] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:33.343183 18990 tablet_service.cc:1467] Processing CreateTablet for tablet fb9e866f82fd42c7a217585eda8e7354 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260925 16:47:33.349889 18913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e068820a06364f1cb92b7b4701f9d8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.381928 18915 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2847dc34a04a54912396f67a4d07b2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260925 16:47:33.383394 18915 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2847dc34a04a54912396f67a4d07b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.348922 18842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39936f93e1a64ff290f8bcb31e35b2ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.388182 18993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877d01ad1b7146388b608954cbc4574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.390821 18995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4267fb73e9d54bbbb335e2137af161b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.391937 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df1e87cab2c64f9f870050016e4677f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.393383 18841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaf54561cd6d421890074238dbb8a57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.395597 19054 tablet_bootstrap.cc:654] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:33.398092 18845 tablet_service.cc:1467] Processing CreateTablet for tablet 19e0d07bb13a4413983a58ea3449cc0c (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260925 16:47:33.400543 18918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 284fe7e2abae4c75999bec672a911342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.401039 18919 tablet_service.cc:1467] Processing CreateTablet for tablet d871558c98cc4c489854c783d1585d95 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260925 16:47:33.402462 18919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d871558c98cc4c489854c783d1585d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.404940 18772 tablet_service.cc:1467] Processing CreateTablet for tablet 7fb80fbc80ab4acc921f87c842434d44 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260925 16:47:33.406266 18772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb80fbc80ab4acc921f87c842434d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.410091 18770 tablet_service.cc:1467] Processing CreateTablet for tablet 4267fb73e9d54bbbb335e2137af161b4 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260925 16:47:33.411310 18770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4267fb73e9d54bbbb335e2137af161b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.353376 18773 tablet_service.cc:1467] Processing CreateTablet for tablet 2570db54563a404ba0205e9af2d7cc1a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260925 16:47:33.412038 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7293be9e009d40c88899bbef09077e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.412834 18773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2570db54563a404ba0205e9af2d7cc1a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.414095 18767 tablet_service.cc:1467] Processing CreateTablet for tablet eaf54561cd6d421890074238dbb8a57a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260925 16:47:33.418322 18764 tablet_service.cc:1467] Processing CreateTablet for tablet 19e0d07bb13a4413983a58ea3449cc0c (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260925 16:47:33.399639 18845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e0d07bb13a4413983a58ea3449cc0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.425832 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb9e866f82fd42c7a217585eda8e7354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.425904 18846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 17301ed72d3d4a7abaebb081f70f39c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.427803 18992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a5c4d8141b90433fbf058da0d0641809. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.427945 18843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7fb80fbc80ab4acc921f87c842434d44. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.431968 18844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877d01ad1b7146388b608954cbc4574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.431885 18848 tablet_service.cc:1467] Processing CreateTablet for tablet dd5c1c958e2143a6972ab64a912fa7d5 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260925 16:47:33.433324 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd5c1c958e2143a6972ab64a912fa7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.433456 18766 tablet_service.cc:1467] Processing CreateTablet for tablet 37ccdcd526ba47b2b415825e4b37e361 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260925 16:47:33.433949 19052 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:33.434330 18920 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd5c1c958e2143a6972ab64a912fa7d5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.434459 19052 ts_tablet_manager.cc:1397] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.233s	user 0.009s	sys 0.003s
I20260925 16:47:33.436136 18922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f55e0c43cee44971a3a7483c91ead27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.447924 18913 tablet_service.cc:1467] Processing CreateTablet for tablet 80f37dab820e4459b45ad556ef1dcc09 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260925 16:47:33.460500 18768 tablet_service.cc:1467] Processing CreateTablet for tablet 877d01ad1b7146388b608954cbc4574d (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260925 16:47:33.462044 18768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 877d01ad1b7146388b608954cbc4574d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.468504 18916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22bc127e42794a80991754fc732a2f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.471391 18848 tablet_service.cc:1467] Processing CreateTablet for tablet bfc7929e7dd84f6fba5909bdcab84721 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260925 16:47:33.472656 18987 tablet_service.cc:1467] Processing CreateTablet for tablet 37ccdcd526ba47b2b415825e4b37e361 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260925 16:47:33.473151 18957 heartbeater.cc:503] Master 127.7.158.254:38107 was elected leader, sending a full tablet report...
I20260925 16:47:33.473873 18987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ccdcd526ba47b2b415825e4b37e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.476414 18840 tablet_service.cc:1467] Processing CreateTablet for tablet b7081600b02b48fb83f2b33eae404adf (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260925 16:47:33.491091 18918 tablet_service.cc:1467] Processing CreateTablet for tablet 49eeeb50567d415782d85c029c855ef6 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260925 16:47:33.439474 19052 raft_consensus.cc:348] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:33.506361 19052 raft_consensus.cc:374] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:33.506736 19052 raft_consensus.cc:729] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:33.496568 18764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 19e0d07bb13a4413983a58ea3449cc0c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.507632 19052 consensus_queue.cc:260] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:33.508816 18989 tablet_service.cc:1467] Processing CreateTablet for tablet bfc7929e7dd84f6fba5909bdcab84721 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260925 16:47:33.510607 18989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfc7929e7dd84f6fba5909bdcab84721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.510900 18766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 37ccdcd526ba47b2b415825e4b37e361. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.513115 18767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eaf54561cd6d421890074238dbb8a57a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.534940 18839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet fb9e866f82fd42c7a217585eda8e7354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.569854 18913 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f37dab820e4459b45ad556ef1dcc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.570330 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfc7929e7dd84f6fba5909bdcab84721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.583417 18840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7081600b02b48fb83f2b33eae404adf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.588075 19031 heartbeater.cc:503] Master 127.7.158.254:38107 was elected leader, sending a full tablet report...
I20260925 16:47:33.587038 18918 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49eeeb50567d415782d85c029c855ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.589388 19052 ts_tablet_manager.cc:1428] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.155s	user 0.009s	sys 0.006s
I20260925 16:47:33.590405 19052 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:33.590893 18917 tablet_service.cc:1467] Processing CreateTablet for tablet ca3a94319c924815ac7fb94f095c36ed (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260925 16:47:33.592157 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca3a94319c924815ac7fb94f095c36ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.595856 18988 tablet_service.cc:1467] Processing CreateTablet for tablet b7081600b02b48fb83f2b33eae404adf (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260925 16:47:33.597185 18988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b7081600b02b48fb83f2b33eae404adf. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:47:33.598762 18884 tablet.cc:2369] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 16:47:33.613181 19053 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:33.613729 19053 ts_tablet_manager.cc:1397] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.302s	user 0.009s	sys 0.019s
I20260925 16:47:33.620347 18994 tablet_service.cc:1467] Processing CreateTablet for tablet 7293be9e009d40c88899bbef09077e1c (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260925 16:47:33.621626 18994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7293be9e009d40c88899bbef09077e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.626523 18769 tablet_service.cc:1467] Processing CreateTablet for tablet 39c4fd5349684aa580c163b167f15aa0 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260925 16:47:33.637259 19054 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:33.637789 19054 ts_tablet_manager.cc:1397] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.297s	user 0.012s	sys 0.009s
I20260925 16:47:33.640054 18990 tablet_service.cc:1467] Processing CreateTablet for tablet e068820a06364f1cb92b7b4701f9d8e2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260925 16:47:33.641398 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e068820a06364f1cb92b7b4701f9d8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.646370 18770 tablet_service.cc:1467] Processing CreateTablet for tablet bfc7929e7dd84f6fba5909bdcab84721 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260925 16:47:33.650637 19051 tablet_bootstrap.cc:492] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:33.651160 19051 ts_tablet_manager.cc:1397] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.398s	user 0.056s	sys 0.058s
I20260925 16:47:33.651865 18769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39c4fd5349684aa580c163b167f15aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.656487 18922 tablet_service.cc:1467] Processing CreateTablet for tablet acdc1cf1c6854ba3a3f9819d8afccccc (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260925 16:47:33.657781 18922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acdc1cf1c6854ba3a3f9819d8afccccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.663076 18914 tablet_service.cc:1467] Processing CreateTablet for tablet eeb6462147004a588cfd7aa36658ae4a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260925 16:47:33.664359 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb6462147004a588cfd7aa36658ae4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.664474 19054 raft_consensus.cc:348] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:33.665329 19054 raft_consensus.cc:374] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:33.665643 19054 raft_consensus.cc:729] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:33.666702 19054 consensus_queue.cc:260] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:33.668721 19053 raft_consensus.cc:348] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:33.669486 19053 raft_consensus.cc:374] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:33.669764 19053 raft_consensus.cc:729] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:33.670452 19053 consensus_queue.cc:260] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:33.680171 18770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bfc7929e7dd84f6fba5909bdcab84721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.681674 18843 tablet_service.cc:1467] Processing CreateTablet for tablet 39c4fd5349684aa580c163b167f15aa0 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260925 16:47:33.683061 18843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 39c4fd5349684aa580c163b167f15aa0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.686313 18772 tablet_service.cc:1467] Processing CreateTablet for tablet 7293be9e009d40c88899bbef09077e1c (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260925 16:47:33.687932 18765 tablet_service.cc:1467] Processing CreateTablet for tablet 22bc127e42794a80991754fc732a2f60 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260925 16:47:33.689242 18772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7293be9e009d40c88899bbef09077e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.689165 18847 tablet_service.cc:1467] Processing CreateTablet for tablet e068820a06364f1cb92b7b4701f9d8e2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260925 16:47:33.692466 18991 tablet_service.cc:1467] Processing CreateTablet for tablet e6b8d8271b4e4be4b59fc66ebd6a6938 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260925 16:47:33.693077 18765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22bc127e42794a80991754fc732a2f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.694155 18991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b8d8271b4e4be4b59fc66ebd6a6938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.715123 19052 tablet_bootstrap.cc:654] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:33.700661 18988 tablet_service.cc:1467] Processing CreateTablet for tablet df1e87cab2c64f9f870050016e4677f3 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260925 16:47:33.734175 18992 tablet_service.cc:1467] Processing CreateTablet for tablet a21dbc5af1e44992abcf69b0d4a3d238 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260925 16:47:33.718379 18839 tablet_service.cc:1467] Processing CreateTablet for tablet 284fe7e2abae4c75999bec672a911342 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260925 16:47:33.733743 18987 tablet_service.cc:1467] Processing CreateTablet for tablet dd5c1c958e2143a6972ab64a912fa7d5 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260925 16:47:33.703471 18846 tablet_service.cc:1467] Processing CreateTablet for tablet 22bc127e42794a80991754fc732a2f60 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260925 16:47:33.708001 18840 tablet_service.cc:1467] Processing CreateTablet for tablet e6b8d8271b4e4be4b59fc66ebd6a6938 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260925 16:47:33.709204 18847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e068820a06364f1cb92b7b4701f9d8e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.776757 18840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b8d8271b4e4be4b59fc66ebd6a6938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.779577 18995 tablet_service.cc:1467] Processing CreateTablet for tablet d871558c98cc4c489854c783d1585d95 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260925 16:47:33.779896 18668 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.158.196:45765, user_credentials={real_user=slave}} blocked reactor thread for 84687.4us
I20260925 16:47:33.781591 18993 tablet_service.cc:1467] Processing CreateTablet for tablet 80f37dab820e4459b45ad556ef1dcc09 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260925 16:47:33.743748 18844 tablet_service.cc:1467] Processing CreateTablet for tablet d871558c98cc4c489854c783d1585d95 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260925 16:47:33.747251 19060 raft_consensus.cc:482] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:33.789650 19060 raft_consensus.cc:504] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:33.790496 18773 tablet_service.cc:1467] Processing CreateTablet for tablet f55e0c43cee44971a3a7483c91ead27b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260925 16:47:33.749080 18994 tablet_service.cc:1467] Processing CreateTablet for tablet a50eab07c6334fde8ca0537cf60c9928 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260925 16:47:33.750463 18988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df1e87cab2c64f9f870050016e4677f3. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:47:33.756033 18666 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.158.193:36337, user_credentials={real_user=slave}} blocked reactor thread for 68618.1us
I20260925 16:47:33.756827 18848 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2847dc34a04a54912396f67a4d07b2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260925 16:47:33.763955 18989 tablet_service.cc:1467] Processing CreateTablet for tablet f55e0c43cee44971a3a7483c91ead27b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260925 16:47:33.769834 18767 tablet_service.cc:1467] Processing CreateTablet for tablet 284fe7e2abae4c75999bec672a911342 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260925 16:47:33.771481 18768 tablet_service.cc:1467] Processing CreateTablet for tablet a21dbc5af1e44992abcf69b0d4a3d238 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260925 16:47:33.772763 19054 ts_tablet_manager.cc:1428] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.134s	user 0.012s	sys 0.022s
I20260925 16:47:33.705533 18771 tablet_service.cc:1467] Processing CreateTablet for tablet e6b8d8271b4e4be4b59fc66ebd6a6938 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260925 16:47:33.713713 19051 raft_consensus.cc:348] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:33.772177 18766 tablet_service.cc:1467] Processing CreateTablet for tablet df1e87cab2c64f9f870050016e4677f3 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260925 16:47:33.789076 18839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 284fe7e2abae4c75999bec672a911342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.796542 19060 leader_election.cc:288] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:33.792878 18773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f55e0c43cee44971a3a7483c91ead27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.809031 18996 tablet_service.cc:1467] Processing CreateTablet for tablet 49eeeb50567d415782d85c029c855ef6 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260925 16:47:33.813324 19051 raft_consensus.cc:374] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:33.826666 19051 raft_consensus.cc:729] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:33.821791 18841 tablet_service.cc:1467] Processing CreateTablet for tablet 49eeeb50567d415782d85c029c855ef6 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260925 16:47:33.737233 18842 tablet_service.cc:1467] Processing CreateTablet for tablet a21dbc5af1e44992abcf69b0d4a3d238 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260925 16:47:33.825507 19052 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:33.825244 18769 tablet_service.cc:1467] Processing CreateTablet for tablet 7f2847dc34a04a54912396f67a4d07b2 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260925 16:47:33.816334 18768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21dbc5af1e44992abcf69b0d4a3d238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.836678 19052 ts_tablet_manager.cc:1397] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.246s	user 0.010s	sys 0.002s
I20260925 16:47:33.827173 18987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet dd5c1c958e2143a6972ab64a912fa7d5. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:47:33.834066 18665 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.7.158.195:33127, user_credentials={real_user=slave}} blocked reactor thread for 76303.2us
I20260925 16:47:33.841902 18842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21dbc5af1e44992abcf69b0d4a3d238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.843662 18996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49eeeb50567d415782d85c029c855ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.834326 19051 consensus_queue.cc:260] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:33.843947 19052 raft_consensus.cc:348] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:33.845305 18766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df1e87cab2c64f9f870050016e4677f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.846089 18841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 49eeeb50567d415782d85c029c855ef6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.846150 18840 tablet_service.cc:1467] Processing CreateTablet for tablet ca3a94319c924815ac7fb94f095c36ed (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260925 16:47:33.847102 18990 tablet_service.cc:1467] Processing CreateTablet for tablet 10b8d7fdd5d24fdf82b70406d9cd5a37 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260925 16:47:33.834393 19053 ts_tablet_manager.cc:1428] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.220s	user 0.006s	sys 0.003s
I20260925 16:47:33.861624 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2847dc34a04a54912396f67a4d07b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.861975 18764 tablet_service.cc:1467] Processing CreateTablet for tablet a50eab07c6334fde8ca0537cf60c9928 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260925 16:47:33.864316 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6b8d8271b4e4be4b59fc66ebd6a6938. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.855947 19052 raft_consensus.cc:374] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:33.868520 18844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d871558c98cc4c489854c783d1585d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.869462 18846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 22bc127e42794a80991754fc732a2f60. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.870800 18845 tablet_service.cc:1467] Processing CreateTablet for tablet a50eab07c6334fde8ca0537cf60c9928 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260925 16:47:33.871552 19052 raft_consensus.cc:729] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:33.872624 19052 consensus_queue.cc:260] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:33.874148 18767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 284fe7e2abae4c75999bec672a911342. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.876231 18840 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca3a94319c924815ac7fb94f095c36ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.880573 18845 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50eab07c6334fde8ca0537cf60c9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.890558 19052 ts_tablet_manager.cc:1428] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.054s	user 0.008s	sys 0.000s
I20260925 16:47:33.891624 19052 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:33.894732 19059 raft_consensus.cc:482] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:33.895226 19059 raft_consensus.cc:504] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:33.866214 19054 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:33.897671 18770 tablet_service.cc:1467] Processing CreateTablet for tablet 80f37dab820e4459b45ad556ef1dcc09 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260925 16:47:33.899508 19059 leader_election.cc:288] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:33.908491 19053 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:33.908676 18988 tablet_service.cc:1467] Processing CreateTablet for tablet acdc1cf1c6854ba3a3f9819d8afccccc (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260925 16:47:33.909762 18919 tablet_service.cc:1467] Processing CreateTablet for tablet 8fdff79a8c884e798cefb59b1884b37b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260925 16:47:33.922020 18919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fdff79a8c884e798cefb59b1884b37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.924429 19061 raft_consensus.cc:482] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:33.924921 19061 raft_consensus.cc:504] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:33.926949 18847 tablet_service.cc:1467] Processing CreateTablet for tablet 10b8d7fdd5d24fdf82b70406d9cd5a37 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260925 16:47:33.906301 18992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a21dbc5af1e44992abcf69b0d4a3d238. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.945971 18848 tablet_service.cc:1467] Processing CreateTablet for tablet eeb6462147004a588cfd7aa36658ae4a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260925 16:47:33.940390 18769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7f2847dc34a04a54912396f67a4d07b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.929018 19061 leader_election.cc:288] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:33.946993 19052 tablet_bootstrap.cc:654] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:33.953092 18988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acdc1cf1c6854ba3a3f9819d8afccccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.953768 18764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50eab07c6334fde8ca0537cf60c9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.947582 18847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b8d7fdd5d24fdf82b70406d9cd5a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.958446 18765 tablet_service.cc:1467] Processing CreateTablet for tablet ca3a94319c924815ac7fb94f095c36ed (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260925 16:47:33.960516 18914 tablet_service.cc:1467] Processing CreateTablet for tablet 79157399a8fb41009d17ca277792780b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260925 16:47:33.961942 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79157399a8fb41009d17ca277792780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.971886 18989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f55e0c43cee44971a3a7483c91ead27b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.987982 18848 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb6462147004a588cfd7aa36658ae4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:33.994485 18987 tablet_service.cc:1467] Processing CreateTablet for tablet eeb6462147004a588cfd7aa36658ae4a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260925 16:47:34.017810 18846 tablet_service.cc:1467] Processing CreateTablet for tablet 8fdff79a8c884e798cefb59b1884b37b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260925 16:47:34.019137 18846 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fdff79a8c884e798cefb59b1884b37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.024889 18772 tablet_service.cc:1467] Processing CreateTablet for tablet 10b8d7fdd5d24fdf82b70406d9cd5a37 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260925 16:47:34.025751 18995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d871558c98cc4c489854c783d1585d95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.026543 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:34.028334 18749 leader_election.cc:341] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.034888 18770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f37dab820e4459b45ad556ef1dcc09. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.041837 18768 tablet_service.cc:1467] Processing CreateTablet for tablet acdc1cf1c6854ba3a3f9819d8afccccc (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260925 16:47:34.044054 19059 raft_consensus.cc:482] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.044832 19053 tablet_bootstrap.cc:654] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.044538 19059 raft_consensus.cc:504] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.046614 19059 leader_election.cc:288] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:34.047343 18917 tablet_service.cc:1467] Processing CreateTablet for tablet 59dd7657b032497789d2fc68f2f969b7 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260925 16:47:34.053964 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59dd7657b032497789d2fc68f2f969b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.066998 18843 tablet_service.cc:1467] Processing CreateTablet for tablet cd74375a5e1c4503b89b69b20e68de30 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260925 16:47:34.067376 18922 tablet_service.cc:1467] Processing CreateTablet for tablet cd74375a5e1c4503b89b69b20e68de30 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260925 16:47:34.068722 18843 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd74375a5e1c4503b89b69b20e68de30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.070001 18922 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd74375a5e1c4503b89b69b20e68de30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.049063 18768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet acdc1cf1c6854ba3a3f9819d8afccccc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.073623 18765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ca3a94319c924815ac7fb94f095c36ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.075156 19051 ts_tablet_manager.cc:1428] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.424s	user 0.026s	sys 0.018s
I20260925 16:47:34.076244 19051 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.077383 18841 tablet_service.cc:1467] Processing CreateTablet for tablet 88a1af2c233844768c8ba7778f5a58ae (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260925 16:47:34.078722 18772 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b8d7fdd5d24fdf82b70406d9cd5a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.089959 18993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80f37dab820e4459b45ad556ef1dcc09. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:47:34.093204 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:34.104903 19054 tablet_bootstrap.cc:654] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.115602 19051 tablet_bootstrap.cc:654] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.128903 18916 tablet_service.cc:1467] Processing CreateTablet for tablet 541076ccaed74b828fdaa39a9e33a1c0 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260925 16:47:34.131995 18844 tablet_service.cc:1467] Processing CreateTablet for tablet 59dd7657b032497789d2fc68f2f969b7 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260925 16:47:34.135818 18841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a1af2c233844768c8ba7778f5a58ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.136152 18987 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet eeb6462147004a588cfd7aa36658ae4a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.151736 18844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59dd7657b032497789d2fc68f2f969b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.151577 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:34.153147 18822 leader_election.cc:341] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.153437 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.154906 18916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 541076ccaed74b828fdaa39a9e33a1c0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260925 16:47:34.156134 18822 leader_election.cc:341] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.159920 18766 tablet_service.cc:1467] Processing CreateTablet for tablet 88a1af2c233844768c8ba7778f5a58ae (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260925 16:47:34.161232 18766 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a1af2c233844768c8ba7778f5a58ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.164986 18773 tablet_service.cc:1467] Processing CreateTablet for tablet 8fdff79a8c884e798cefb59b1884b37b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260925 16:47:34.165772 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.167434 19053 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:34.168040 19053 ts_tablet_manager.cc:1397] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.260s	user 0.010s	sys 0.017s
I20260925 16:47:34.169013 18839 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38132 (request call id 27) took 1004 ms. Trace:
W20260925 16:47:34.169931 18746 leader_election.cc:341] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.169968 19067 raft_consensus.cc:482] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.169415 18839 rpcz_store.cc:276] 0925 16:47:33.164532 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.717585 (+553053us) service_pool.cc:227] Handling call
0925 16:47:33.735688 (+ 18103us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.735820 (+   132us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:33.948492 (+212672us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.168467 (+219975us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.168957 (+   490us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.175606 19067 raft_consensus.cc:504] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.175411 18746 leader_election.cc:302] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:34.177376 19060 raft_consensus.cc:2726] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:34.172264 18771 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40682 (request call id 25) took 1005 ms. Trace:
I20260925 16:47:34.172966 18773 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8fdff79a8c884e798cefb59b1884b37b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.179663 18771 rpcz_store.cc:276] 0925 16:47:33.167157 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.704745 (+537588us) service_pool.cc:227] Handling call
0925 16:47:33.834445 (+129700us) spinlock_profiling.cc:243] Waited 1.1 ms on lock 0x7b58002d1898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ed8d21 00007f71a0eb61e3 00007f71a0e67869 00007f719a469c44 00007f719a469bd2 00007f719a469b01
0925 16:47:33.863788 (+ 29343us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b58002d1898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fcaf98 00007f7198fcaebb 00007f71a1ee38b9 00007f71a0df65d8 00007f71a0eb62a0 00007f71a0e67869 00007f719a469c44 00007f719a469bd2 00007f719a469b01 00007f719a469a7c
0925 16:47:33.863835 (+    47us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.863968 (+   133us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.022388 (+158420us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.127425 (+105037us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.172207 (+ 44782us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":6118016}
I20260925 16:47:34.182605 18839 tablet_service.cc:1467] Processing CreateTablet for tablet 172d70ae40f44cbd8d1f59c037fb2e04 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260925 16:47:34.186069 18771 tablet_service.cc:1467] Processing CreateTablet for tablet 79157399a8fb41009d17ca277792780b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260925 16:47:34.186923 18839 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 172d70ae40f44cbd8d1f59c037fb2e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.189051 18994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a50eab07c6334fde8ca0537cf60c9928. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.196997 19052 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.226096 19054 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:34.226650 19054 ts_tablet_manager.cc:1397] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.369s	user 0.023s	sys 0.015s
I20260925 16:47:34.229216 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.231986 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.232394 19067 leader_election.cc:288] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
W20260925 16:47:34.233290 18821 leader_election.cc:341] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.234961 18821 leader_election.cc:302] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:34.245347 19059 raft_consensus.cc:2726] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:47:34.245810 18821 leader_election.cc:341] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.246286 18821 leader_election.cc:302] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:34.247077 19059 raft_consensus.cc:2726] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:34.239245 19052 ts_tablet_manager.cc:1397] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.348s	user 0.020s	sys 0.016s
I20260925 16:47:34.252122 18770 tablet_service.cc:1467] Processing CreateTablet for tablet 59dd7657b032497789d2fc68f2f969b7 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260925 16:47:34.254920 18767 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40682 (request call id 27) took 1082 ms. Trace:
I20260925 16:47:34.255326 19052 raft_consensus.cc:348] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.256500 19052 raft_consensus.cc:374] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.256835 19052 raft_consensus.cc:729] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.257639 19052 consensus_queue.cc:260] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.258481 18847 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb250f028fa4a75a53db16d27a92efa (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260925 16:47:34.262005 18992 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 27) took 1129 ms. Trace:
I20260925 16:47:34.255277 18767 rpcz_store.cc:276] 0925 16:47:33.186088 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.768989 (+582901us) service_pool.cc:227] Handling call
0925 16:47:33.816212 (+ 47223us) spinlock_profiling.cc:243] Waited 2.14 ms on lock 0x7b58002d1898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ed8d21 00007f71a0eb61e3 00007f71a0e67869 00007f719a469c44 00007f719a469bd2 00007f719a469b01
0925 16:47:33.816338 (+   126us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.816417 (+    79us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:33.977301 (+160884us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.254295 (+276994us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.254850 (+   555us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4931840}
I20260925 16:47:34.262873 18992 rpcz_store.cc:276] 0925 16:47:33.132259 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.733315 (+601056us) service_pool.cc:227] Handling call
0925 16:47:33.735074 (+  1759us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.735167 (+    93us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.065594 (+330427us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.261185 (+195591us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.261906 (+   721us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.290725 18992 tablet_service.cc:1467] Processing CreateTablet for tablet 88a1af2c233844768c8ba7778f5a58ae (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260925 16:47:34.291205 18995 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 29) took 1037 ms. Trace:
I20260925 16:47:34.264599 18767 tablet_service.cc:1467] Processing CreateTablet for tablet 172d70ae40f44cbd8d1f59c037fb2e04 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260925 16:47:34.267215 19053 raft_consensus.cc:348] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.270290 18847 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb250f028fa4a75a53db16d27a92efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.291618 18995 rpcz_store.cc:276] 0925 16:47:33.253490 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.778500 (+525010us) service_pool.cc:227] Handling call
0925 16:47:33.780470 (+  1970us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.780619 (+   149us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.228827 (+448208us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.290734 (+ 61907us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.291147 (+   413us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.295276 18995 tablet_service.cc:1467] Processing CreateTablet for tablet 79157399a8fb41009d17ca277792780b (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260925 16:47:34.295562 18989 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 28) took 1042 ms. Trace:
I20260925 16:47:34.277647 19051 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.296204 18989 rpcz_store.cc:276] 0925 16:47:33.252935 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.763079 (+510144us) service_pool.cc:227] Handling call
0925 16:47:33.830592 (+ 67513us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.833471 (+  2879us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.138664 (+305193us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.294991 (+156327us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.295498 (+   507us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.292778 19053 raft_consensus.cc:374] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.293853 18991 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 24) took 1162 ms. Trace:
I20260925 16:47:34.298024 18989 tablet_service.cc:1467] Processing CreateTablet for tablet cd74375a5e1c4503b89b69b20e68de30 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260925 16:47:34.296753 19051 ts_tablet_manager.cc:1397] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.221s	user 0.013s	sys 0.010s
I20260925 16:47:34.297933 18991 rpcz_store.cc:276] 0925 16:47:33.131284 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.690931 (+559647us) service_pool.cc:227] Handling call
0925 16:47:33.693559 (+  2628us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.693677 (+   118us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.059004 (+365327us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.293402 (+234398us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.293799 (+   397us) inbound_call.cc:173] Queueing success response
Metrics: {"mutex_wait_us":7475}
I20260925 16:47:34.300275 18991 tablet_service.cc:1467] Processing CreateTablet for tablet 172d70ae40f44cbd8d1f59c037fb2e04 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260925 16:47:34.301167 18990 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 10b8d7fdd5d24fdf82b70406d9cd5a37. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.301990 18991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 172d70ae40f44cbd8d1f59c037fb2e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.297773 19053 raft_consensus.cc:729] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.302948 18995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79157399a8fb41009d17ca277792780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.303223 19053 consensus_queue.cc:260] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.293690 19054 raft_consensus.cc:348] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.316535 19054 raft_consensus.cc:374] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.316954 19054 raft_consensus.cc:729] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.317888 19054 consensus_queue.cc:260] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.323463 18992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88a1af2c233844768c8ba7778f5a58ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.324126 19054 ts_tablet_manager.cc:1428] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.097s	user 0.007s	sys 0.002s
I20260925 16:47:34.325151 19054 tablet_bootstrap.cc:492] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:34.326453 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9f1f43de2364a66ae54b5b6eba041d2" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:34.327147 18858 raft_consensus.cc:2454] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:34.329041 19061 raft_consensus.cc:482] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.329514 19061 raft_consensus.cc:504] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.331605 19061 leader_election.cc:288] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:34.332587 18970 leader_election.cc:302] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:34.316231 19053 ts_tablet_manager.cc:1428] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.148s	user 0.006s	sys 0.006s
I20260925 16:47:34.301528 19051 raft_consensus.cc:348] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.336556 19061 raft_consensus.cc:2781] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.338730 19051 raft_consensus.cc:374] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.338973 19061 raft_consensus.cc:482] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.343928 19061 raft_consensus.cc:3037] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.354152 18842 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38132 (request call id 28) took 1178 ms. Trace:
I20260925 16:47:34.354617 18842 rpcz_store.cc:276] 0925 16:47:33.164840 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.736414 (+571574us) service_pool.cc:227] Handling call
0925 16:47:33.840195 (+103781us) spinlock_profiling.cc:243] Waited 5.79 ms on lock 0x7b5800005498. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ed8d21 00007f71a0eb61e3 00007f71a0e67869 00007f719a469c44 00007f719a469bd2 00007f719a469b01
0925 16:47:33.840334 (+   139us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.840438 (+   104us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:33.984917 (+144479us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.299518 (+314601us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.342975 (+ 43457us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":13326080}
I20260925 16:47:34.358865 19052 ts_tablet_manager.cc:1428] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.107s	user 0.007s	sys 0.001s
I20260925 16:47:34.360098 19052 tablet_bootstrap.cc:492] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.339105 19051 raft_consensus.cc:729] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.370379 18844 tablet_service.cc:1467] Processing CreateTablet for tablet cd0fa06962e2429484873fcd69d3591d (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260925 16:47:34.367173 18771 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 79157399a8fb41009d17ca277792780b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.365991 18845 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:38132 (request call id 31) took 1034 ms. Trace:
I20260925 16:47:34.378026 18989 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd74375a5e1c4503b89b69b20e68de30. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.383949 18842 tablet_service.cc:1467] Processing CreateTablet for tablet 8108992d4cfa4399a5c0c6efd1291f6a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260925 16:47:34.387478 18844 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0fa06962e2429484873fcd69d3591d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.387812 19051 consensus_queue.cc:260] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.388729 18842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8108992d4cfa4399a5c0c6efd1291f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.390098 19051 ts_tablet_manager.cc:1428] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.091s	user 0.002s	sys 0.003s
I20260925 16:47:34.390580 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:34.392088 18969 leader_election.cc:341] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.392875 18988 tablet_service.cc:1467] Processing CreateTablet for tablet 541076ccaed74b828fdaa39a9e33a1c0 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260925 16:47:34.396364 19051 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.397588 18994 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 30) took 1077 ms. Trace:
I20260925 16:47:34.398029 18994 rpcz_store.cc:276] 0925 16:47:33.320576 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.748503 (+427927us) service_pool.cc:227] Handling call
0925 16:47:33.806089 (+ 57586us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.813664 (+  7575us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.366012 (+552348us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.397121 (+ 31109us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.397531 (+   410us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.402515 19051 tablet_bootstrap.cc:654] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.404373 19052 tablet_bootstrap.cc:654] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.405799 18993 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 31) took 1057 ms. Trace:
I20260925 16:47:34.406306 18993 rpcz_store.cc:276] 0925 16:47:33.348611 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.778890 (+430279us) service_pool.cc:227] Handling call
0925 16:47:33.782516 (+  3626us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.782607 (+    91us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.398830 (+616223us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.405305 (+  6475us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.405744 (+   439us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.412122 18988 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 541076ccaed74b828fdaa39a9e33a1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.412520 18917 tablet_service.cc:1467] Processing CreateTablet for tablet cd0fa06962e2429484873fcd69d3591d (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260925 16:47:34.412639 18916 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb250f028fa4a75a53db16d27a92efa (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260925 16:47:34.413828 18917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0fa06962e2429484873fcd69d3591d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.382613 18845 rpcz_store.cc:276] 0925 16:47:33.331347 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.806716 (+475369us) service_pool.cc:227] Handling call
0925 16:47:33.880134 (+ 73418us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.880238 (+   104us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.137771 (+257533us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.365481 (+227710us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.365936 (+   455us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.418238 18914 tablet_service.cc:1467] Processing CreateTablet for tablet cfaca9c07b0a4e0e8859c15c7f0e43d1 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260925 16:47:34.426141 19061 raft_consensus.cc:504] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.432065 18914 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfaca9c07b0a4e0e8859c15c7f0e43d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.439896 19054 tablet_bootstrap.cc:654] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.440474 18770 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59dd7657b032497789d2fc68f2f969b7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.441607 18916 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb250f028fa4a75a53db16d27a92efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.452699 18990 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 33) took 1068 ms. Trace:
I20260925 16:47:34.454262 18764 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40682 (request call id 31) took 1136 ms. Trace:
I20260925 16:47:34.454711 18764 rpcz_store.cc:276] 0925 16:47:33.317694 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.853758 (+536064us) service_pool.cc:227] Handling call
0925 16:47:33.904762 (+ 51004us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.916913 (+ 12151us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.035166 (+118253us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.295966 (+260800us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.352390 (+ 56424us) spinlock_profiling.cc:243] Waited 15.8 ms on lock 0x7b58002d1898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fcae82 00007f71a1ee38b9 00007f71a0df65d8 00007f71a0eba063 00007f71a0eb5e2f 00007f71a0eb65ed 00007f71a0e67869 00007f719a469c44 00007f719a469bd2
0925 16:47:34.454203 (+101813us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":36334464}
I20260925 16:47:34.455646 18991 tablet_service.cc:1467] Processing CreateTablet for tablet cfaca9c07b0a4e0e8859c15c7f0e43d1 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260925 16:47:34.456912 18991 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfaca9c07b0a4e0e8859c15c7f0e43d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.457428 18765 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40682 (request call id 33) took 1104 ms. Trace:
I20260925 16:47:34.457806 18765 rpcz_store.cc:276] 0925 16:47:33.353468 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.907289 (+553821us) service_pool.cc:227] Handling call
0925 16:47:34.066413 (+159124us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:34.066536 (+   123us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.357067 (+290531us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.370738 (+ 13671us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.457363 (+ 86625us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.434930 18996 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:52804 (request call id 32) took 1086 ms. Trace:
I20260925 16:47:34.460053 18996 rpcz_store.cc:276] 0925 16:47:33.349044 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.805075 (+456031us) service_pool.cc:227] Handling call
0925 16:47:33.842872 (+ 37797us) spinlock_profiling.cc:243] Waited 1.87 ms on lock 0x7b5800cd1a98. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fca851 00007f7198fca702 00007f71a1ebab09 00007f71a0df6730 00007f71a0ed8d21 00007f71a0eb61e3 00007f71a0e67869 00007f719a469c44 00007f719a469bd2 00007f719a469b01
0925 16:47:33.843058 (+   186us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.843183 (+   125us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.130546 (+287363us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.377759 (+247213us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.433568 (+ 55809us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":4305280}
I20260925 16:47:34.459519 18765 tablet_service.cc:1467] Processing CreateTablet for tablet cd0fa06962e2429484873fcd69d3591d (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260925 16:47:34.462307 18765 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cd0fa06962e2429484873fcd69d3591d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.455711 18995 tablet_service.cc:1467] Processing CreateTablet for tablet 8108992d4cfa4399a5c0c6efd1291f6a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260925 16:47:34.462091 18993 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb250f028fa4a75a53db16d27a92efa (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260925 16:47:34.463333 18995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8108992d4cfa4399a5c0c6efd1291f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.456593 18764 tablet_service.cc:1467] Processing CreateTablet for tablet 541076ccaed74b828fdaa39a9e33a1c0 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260925 16:47:34.464371 18764 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 541076ccaed74b828fdaa39a9e33a1c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.464740 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9f1f43de2364a66ae54b5b6eba041d2" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.454156 18769 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40682 (request call id 30) took 1254 ms. Trace:
I20260925 16:47:34.466066 18769 rpcz_store.cc:276] 0925 16:47:33.200223 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.824454 (+624231us) service_pool.cc:227] Handling call
0925 16:47:33.898302 (+ 73848us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.902946 (+  4644us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:33.988889 (+ 85943us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.266062 (+277173us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.451832 (+185770us) spinlock_profiling.cc:243] Waited 3.67 ms on lock 0x7b58002d1898. stack: 00007f7198fd0033 00007f7198fcff30 00007f719892e534 00007f71a263a8b4 00007f71a263a849 00007f7198e46f11 00007f7198fcaf98 00007f7198fcaebb 00007f71a1ee38b9 00007f71a0df65d8 00007f71a0eba063 00007f71a0eb5e2f 00007f71a0eb65ed 00007f71a0e67869 00007f719a469c44 00007f719a469bd2
0925 16:47:34.454096 (+  2264us) inbound_call.cc:173] Queueing success response
Metrics: {"spinlock_wait_cycles":8431488}
I20260925 16:47:34.466698 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.467327 18782 raft_consensus.cc:2454] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:34.468261 18772 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:40682 (request call id 34) took 1077 ms. Trace:
I20260925 16:47:34.468219 18769 tablet_service.cc:1467] Processing CreateTablet for tablet 8108992d4cfa4399a5c0c6efd1291f6a (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260925 16:47:34.468793 18767 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 172d70ae40f44cbd8d1f59c037fb2e04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.469409 19053 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:34.473212 18768 tablet_service.cc:1467] Processing CreateTablet for tablet cfaca9c07b0a4e0e8859c15c7f0e43d1 (DEFAULT_TABLE table=test-workload [id=388bb4e72bd54eb493e934baea792808]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260925 16:47:34.474381 18768 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet cfaca9c07b0a4e0e8859c15c7f0e43d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.476068 18993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5bb250f028fa4a75a53db16d27a92efa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.468801 18772 rpcz_store.cc:276] 0925 16:47:33.391343 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:34.023189 (+631846us) service_pool.cc:227] Handling call
0925 16:47:34.049200 (+ 26011us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:34.062121 (+ 12921us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.249404 (+187283us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.381581 (+132177us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.468207 (+ 86626us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.481020 19053 tablet_bootstrap.cc:654] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:34.483619 18970 leader_election.cc:341] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.488409 18769 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8108992d4cfa4399a5c0c6efd1291f6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:47:34.505681 19061 leader_election.cc:288] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:34.506690 18970 leader_election.cc:302] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:34.508745 19052 tablet_bootstrap.cc:492] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.508936 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9f1f43de2364a66ae54b5b6eba041d2" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:34.509378 19052 ts_tablet_manager.cc:1397] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.150s	user 0.017s	sys 0.016s
I20260925 16:47:34.509553 18858 raft_consensus.cc:3037] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.512598 19052 raft_consensus.cc:348] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.513340 19052 raft_consensus.cc:374] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.513620 19052 raft_consensus.cc:729] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.516968 18858 raft_consensus.cc:2454] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:34.517460 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c81981a43a4ea180b0ac988ba75519" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:34.518949 18896 leader_election.cc:341] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.519682 19061 raft_consensus.cc:2781] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.525223 19061 raft_consensus.cc:482] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.453146 18990 rpcz_store.cc:276] 0925 16:47:33.384185 (+     0us) service_pool.cc:170] Inserting onto call queue
0925 16:47:33.846312 (+462127us) service_pool.cc:227] Handling call
0925 16:47:33.865367 (+ 19055us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0925 16:47:33.887520 (+ 22153us) ts_tablet_manager.cc:676] Creating new metadata...
0925 16:47:34.358293 (+470773us) tablet_metadata.cc:641] Metadata flushed
0925 16:47:34.452198 (+ 93905us) tablet_replica.cc:205] Creating consensus instance
0925 16:47:34.452636 (+   438us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20260925 16:47:34.533293 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b9f1f43de2364a66ae54b5b6eba041d2" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:34.530057 19061 raft_consensus.cc:3037] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.543181 19054 tablet_bootstrap.cc:492] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:34.543685 19054 ts_tablet_manager.cc:1397] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.219s	user 0.004s	sys 0.010s
I20260925 16:47:34.545718 19051 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.546224 19051 ts_tablet_manager.cc:1397] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.150s	user 0.007s	sys 0.011s
I20260925 16:47:34.546500 19054 raft_consensus.cc:348] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.547223 19054 raft_consensus.cc:374] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.541033 18970 leader_election.cc:302] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:34.548784 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c81981a43a4ea180b0ac988ba75519" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:34.550441 18898 leader_election.cc:341] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.550968 18898 leader_election.cc:302] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:34.551856 19067 raft_consensus.cc:2726] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:34.547487 19054 raft_consensus.cc:729] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.553328 19054 consensus_queue.cc:260] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
W20260925 16:47:34.561414 18970 leader_election.cc:341] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.529265 19052 consensus_queue.cc:260] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.567243 19088 raft_consensus.cc:2781] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:34.583105 19088 raft_consensus.cc:686] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:34.569357 19053 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:34.590232 19053 ts_tablet_manager.cc:1397] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.121s	user 0.021s	sys 0.004s
I20260925 16:47:34.590549 19088 consensus_queue.cc:237] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.593108 19053 raft_consensus.cc:348] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.593909 19053 raft_consensus.cc:374] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.594182 19053 raft_consensus.cc:729] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.594923 19053 consensus_queue.cc:260] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.575949 19061 raft_consensus.cc:504] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.582616 19052 ts_tablet_manager.cc:1428] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.073s	user 0.006s	sys 0.001s
I20260925 16:47:34.567818 19051 raft_consensus.cc:348] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.597385 19051 raft_consensus.cc:374] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.597728 19051 raft_consensus.cc:729] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.597942 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:34.585289 19054 ts_tablet_manager.cc:1428] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.001s
W20260925 16:47:34.599164 18969 leader_election.cc:341] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.598464 19051 consensus_queue.cc:260] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.599977 19054 tablet_bootstrap.cc:492] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:34.601786 19051 ts_tablet_manager.cc:1428] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.055s	user 0.008s	sys 0.000s
I20260925 16:47:34.602775 19051 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.606575 19054 tablet_bootstrap.cc:654] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.607153 18679 catalog_manager.cc:5495] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:34.599977 19052 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.615118 19052 tablet_bootstrap.cc:654] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.616802 19061 leader_election.cc:288] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:34.617028 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:34.617642 18782 raft_consensus.cc:3037] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.618848 19053 ts_tablet_manager.cc:1428] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260925 16:47:34.620291 19054 tablet_bootstrap.cc:492] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:34.620960 19054 ts_tablet_manager.cc:1397] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260925 16:47:34.621320 19053 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:34.623852 19054 raft_consensus.cc:348] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.624709 19054 raft_consensus.cc:374] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.625072 19054 raft_consensus.cc:729] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.620312 19051 tablet_bootstrap.cc:654] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.627671 18782 raft_consensus.cc:2454] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:34.628914 18970 leader_election.cc:302] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:34.630177 19061 raft_consensus.cc:2781] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:34.629839 19054 consensus_queue.cc:260] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.630839 19061 raft_consensus.cc:686] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:34.632274 19061 consensus_queue.cc:237] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.633849 19054 ts_tablet_manager.cc:1428] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260925 16:47:34.634910 19054 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:34.637523 19053 tablet_bootstrap.cc:654] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.641809 19051 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.642364 19051 ts_tablet_manager.cc:1397] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.040s	user 0.010s	sys 0.000s
I20260925 16:47:34.645356 19051 raft_consensus.cc:348] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.645807 19054 tablet_bootstrap.cc:654] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.646157 19051 raft_consensus.cc:374] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.646436 19052 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.646551 19051 raft_consensus.cc:729] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.647027 19052 ts_tablet_manager.cc:1397] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.010s
I20260925 16:47:34.647482 19051 consensus_queue.cc:260] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.650202 19051 ts_tablet_manager.cc:1428] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:47:34.650012 19052 raft_consensus.cc:348] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.650799 19052 raft_consensus.cc:374] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.651093 19052 raft_consensus.cc:729] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.651358 19051 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.651945 19052 consensus_queue.cc:260] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.654466 19052 ts_tablet_manager.cc:1428] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.004s
I20260925 16:47:34.655483 19052 tablet_bootstrap.cc:492] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.658239 19051 tablet_bootstrap.cc:654] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.661669 19052 tablet_bootstrap.cc:654] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.670629 19051 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.671288 19051 ts_tablet_manager.cc:1397] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260925 16:47:34.674857 19051 raft_consensus.cc:348] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.675976 19051 raft_consensus.cc:374] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.676342 19051 raft_consensus.cc:729] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.678313 19051 consensus_queue.cc:260] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.679472 19052 tablet_bootstrap.cc:492] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.679999 19052 ts_tablet_manager.cc:1397] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.011s
I20260925 16:47:34.680879 19051 ts_tablet_manager.cc:1428] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260925 16:47:34.681978 19051 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.682906 19052 raft_consensus.cc:348] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.683636 19052 raft_consensus.cc:374] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.683943 19052 raft_consensus.cc:729] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.678478 18679 catalog_manager.cc:5495] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:34.684764 19052 consensus_queue.cc:260] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.690747 19052 ts_tablet_manager.cc:1428] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260925 16:47:34.688009 19051 tablet_bootstrap.cc:654] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.691844 19052 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.699290 19052 tablet_bootstrap.cc:654] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.707614 19053 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:34.708103 19053 ts_tablet_manager.cc:1397] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.087s	user 0.014s	sys 0.003s
I20260925 16:47:34.710899 19053 raft_consensus.cc:348] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.711638 19053 raft_consensus.cc:374] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.711967 19053 raft_consensus.cc:729] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.714059 19054 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:34.714578 19054 ts_tablet_manager.cc:1397] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.080s	user 0.026s	sys 0.033s
I20260925 16:47:34.717797 19054 raft_consensus.cc:348] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.718387 19051 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.719946 19051 ts_tablet_manager.cc:1397] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.003s
I20260925 16:47:34.718571 19053 consensus_queue.cc:260] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.721068 19052 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.721545 19052 ts_tablet_manager.cc:1397] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.012s
I20260925 16:47:34.722529 19053 ts_tablet_manager.cc:1428] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260925 16:47:34.718539 19054 raft_consensus.cc:374] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.723654 19054 raft_consensus.cc:729] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.724136 19052 raft_consensus.cc:348] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.725013 19052 raft_consensus.cc:374] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.725416 19052 raft_consensus.cc:729] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.725067 19054 consensus_queue.cc:260] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.724130 19053 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:34.725577 19051 raft_consensus.cc:348] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.726465 19051 raft_consensus.cc:374] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.726776 19051 raft_consensus.cc:729] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.731170 19051 consensus_queue.cc:260] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.732492 19053 tablet_bootstrap.cc:654] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.728005 19052 consensus_queue.cc:260] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.734578 19052 ts_tablet_manager.cc:1428] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.013s	user 0.002s	sys 0.004s
I20260925 16:47:34.730253 19054 ts_tablet_manager.cc:1428] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260925 16:47:34.735739 19054 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:34.736200 19051 ts_tablet_manager.cc:1428] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260925 16:47:34.737195 19051 tablet_bootstrap.cc:492] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.740613 19052 tablet_bootstrap.cc:492] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.742082 19054 tablet_bootstrap.cc:654] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.746977 19051 tablet_bootstrap.cc:654] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.755033 19052 tablet_bootstrap.cc:654] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.764413 19052 tablet_bootstrap.cc:492] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.764897 19052 ts_tablet_manager.cc:1397] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.006s
I20260925 16:47:34.768967 19052 raft_consensus.cc:348] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.769690 19052 raft_consensus.cc:374] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.769960 19052 raft_consensus.cc:729] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.770058 19051 tablet_bootstrap.cc:492] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.770669 19051 ts_tablet_manager.cc:1397] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.034s	user 0.010s	sys 0.008s
I20260925 16:47:34.770726 19052 consensus_queue.cc:260] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.771257 19053 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:34.771997 19053 ts_tablet_manager.cc:1397] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.010s
I20260925 16:47:34.772933 19052 ts_tablet_manager.cc:1428] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260925 16:47:34.771320 19054 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:34.773550 19054 ts_tablet_manager.cc:1397] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.038s	user 0.019s	sys 0.011s
I20260925 16:47:34.774035 19051 raft_consensus.cc:348] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.774435 19053 raft_consensus.cc:348] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.774822 19051 raft_consensus.cc:374] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.775118 19053 raft_consensus.cc:374] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.775174 19051 raft_consensus.cc:729] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.775475 19053 raft_consensus.cc:729] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.776038 19051 consensus_queue.cc:260] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.776300 19054 raft_consensus.cc:348] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.776322 19053 consensus_queue.cc:260] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.777149 19054 raft_consensus.cc:374] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.778380 19051 ts_tablet_manager.cc:1428] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260925 16:47:34.779069 19053 ts_tablet_manager.cc:1428] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:47:34.779170 19060 raft_consensus.cc:482] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.779390 19051 tablet_bootstrap.cc:492] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.780130 19053 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:34.777491 19054 raft_consensus.cc:729] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.780727 19052 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.779656 19060 raft_consensus.cc:504] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.786542 19051 tablet_bootstrap.cc:654] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.779877 19067 raft_consensus.cc:482] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.789472 19067 raft_consensus.cc:504] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.791422 19053 tablet_bootstrap.cc:654] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.791740 19052 tablet_bootstrap.cc:654] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.795506 19054 consensus_queue.cc:260] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.798437 19054 ts_tablet_manager.cc:1428] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260925 16:47:34.798501 19051 tablet_bootstrap.cc:492] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.799041 19051 ts_tablet_manager.cc:1397] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.020s	user 0.004s	sys 0.012s
I20260925 16:47:34.799594 19054 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:34.800102 19061 raft_consensus.cc:482] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.800786 19061 raft_consensus.cc:504] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.801577 19051 raft_consensus.cc:348] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.802341 19051 raft_consensus.cc:374] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.802608 19051 raft_consensus.cc:729] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.804129 19051 consensus_queue.cc:260] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.804870 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c81981a43a4ea180b0ac988ba75519" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:34.805562 19054 tablet_bootstrap.cc:654] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.805816 18857 raft_consensus.cc:2454] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:34.809091 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c81981a43a4ea180b0ac988ba75519" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.810012 18931 raft_consensus.cc:2454] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:34.812073 19052 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.812575 19052 ts_tablet_manager.cc:1397] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.004s
I20260925 16:47:34.812381 18970 leader_election.cc:302] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:34.813561 19088 raft_consensus.cc:2781] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.813593 19061 leader_election.cc:288] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:34.814074 19051 ts_tablet_manager.cc:1428] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.007s
I20260925 16:47:34.814118 19088 raft_consensus.cc:482] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.814661 19088 raft_consensus.cc:3037] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.815308 19051 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:34.821588 19052 raft_consensus.cc:348] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.822276 19052 raft_consensus.cc:374] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.822556 19052 raft_consensus.cc:729] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.822580 19112 raft_consensus.cc:482] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.823182 19052 consensus_queue.cc:260] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.823771 19112 raft_consensus.cc:504] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.826622 19088 raft_consensus.cc:504] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.827466 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa425847ff64d34a5137a5224513e75" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:34.828485 19051 tablet_bootstrap.cc:654] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.828555 19088 leader_election.cc:288] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:34.830586 19052 ts_tablet_manager.cc:1428] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260925 16:47:34.831370 19112 leader_election.cc:288] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:34.831605 19052 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
W20260925 16:47:34.832140 18898 leader_election.cc:341] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.834300 19051 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:34.844585 19051 ts_tablet_manager.cc:1397] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260925 16:47:34.844008 19054 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:34.845142 19054 ts_tablet_manager.cc:1397] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.046s	user 0.013s	sys 0.000s
I20260925 16:47:34.845655 19060 leader_election.cc:288] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:34.846928 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.847569 18932 raft_consensus.cc:2454] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:34.841851 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c81981a43a4ea180b0ac988ba75519" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:34.848793 18746 leader_election.cc:302] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:34.847986 19054 raft_consensus.cc:348] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.844424 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61c81981a43a4ea180b0ac988ba75519" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:34.849443 19054 raft_consensus.cc:374] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.837422 19052 tablet_bootstrap.cc:654] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.849792 18931 raft_consensus.cc:3037] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.849813 19054 raft_consensus.cc:729] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.848889 18857 raft_consensus.cc:3037] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.853325 19054 consensus_queue.cc:260] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.854521 19067 leader_election.cc:288] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:34.855911 19054 ts_tablet_manager.cc:1428] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.001s
I20260925 16:47:34.856884 19054 tablet_bootstrap.cc:492] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:34.858610 19060 raft_consensus.cc:2781] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.859015 19060 raft_consensus.cc:482] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.859354 19060 raft_consensus.cc:3037] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.863373 19051 raft_consensus.cc:348] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.864008 19059 raft_consensus.cc:482] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.864591 19059 raft_consensus.cc:504] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.867133 19059 leader_election.cc:288] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:34.868369 19054 tablet_bootstrap.cc:654] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:34.870064 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db46060b3a2424ba8e4a67debeeda7a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.870781 18932 raft_consensus.cc:2454] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:34.872512 18821 leader_election.cc:302] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:34.878991 19059 raft_consensus.cc:2781] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.879469 19059 raft_consensus.cc:482] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.879869 19059 raft_consensus.cc:3037] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.890205 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:34.891307 18858 raft_consensus.cc:2454] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:34.893414 19067 raft_consensus.cc:482] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.904254 19067 raft_consensus.cc:504] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.907109 19067 leader_election.cc:288] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:34.864156 19051 raft_consensus.cc:374] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.911712 19052 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:34.896421 18931 raft_consensus.cc:2454] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:34.944270 19052 ts_tablet_manager.cc:1397] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.113s	user 0.027s	sys 0.022s
I20260925 16:47:34.910969 18896 leader_election.cc:302] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:34.945093 18969 leader_election.cc:302] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:34.946273 19088 raft_consensus.cc:2781] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:34.946736 19088 raft_consensus.cc:686] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:34.947139 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.947559 19088 consensus_queue.cc:237] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.948326 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.948496 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa425847ff64d34a5137a5224513e75" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.949386 18783 raft_consensus.cc:2454] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:34.945473 19112 raft_consensus.cc:2781] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.950156 19052 raft_consensus.cc:348] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.950917 19052 raft_consensus.cc:374] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:34.950803 19112 raft_consensus.cc:482] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.951495 19112 raft_consensus.cc:3037] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.911962 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:34.958721 18858 raft_consensus.cc:2454] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:34.960033 19112 raft_consensus.cc:504] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:34.961716 19052 raft_consensus.cc:729] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.910943 18857 raft_consensus.cc:2454] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:34.962774 19051 raft_consensus.cc:729] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:34.963045 19052 consensus_queue.cc:260] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.963440 19051 consensus_queue.cc:260] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.966898 19120 raft_consensus.cc:482] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.918498 19059 raft_consensus.cc:504] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:34.968039 19120 raft_consensus.cc:504] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
W20260925 16:47:34.952766 18896 leader_election.cc:341] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.970077 19112 leader_election.cc:288] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:34.970507 18896 leader_election.cc:302] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:34.971686 19052 ts_tablet_manager.cc:1428] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260925 16:47:34.961318 18680 catalog_manager.cc:5495] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:34.972716 19052 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:34.975859 19088 raft_consensus.cc:482] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.976384 19088 raft_consensus.cc:504] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.978308 19088 leader_election.cc:288] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:34.979125 19121 raft_consensus.cc:482] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.979621 19121 raft_consensus.cc:504] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:34.980638 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.982131 19121 leader_election.cc:288] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:34.981948 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:34.984360 18970 leader_election.cc:341] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.984467 19088 raft_consensus.cc:482] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.983415 18856 raft_consensus.cc:2454] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:34.985173 19088 raft_consensus.cc:504] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:34.986004 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:34.986483 18970 leader_election.cc:302] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
W20260925 16:47:34.987411 18822 leader_election.cc:341] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.987532 19061 raft_consensus.cc:2781] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:34.988108 19061 raft_consensus.cc:482] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:34.988435 19088 leader_election.cc:288] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:34.988520 19061 raft_consensus.cc:3037] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.955837 19119 raft_consensus.cc:482] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:34.991667 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:34.996050 18970 leader_election.cc:341] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.996227 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:34.998008 19052 tablet_bootstrap.cc:654] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:34.998724 18969 leader_election.cc:341] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:34.999217 18969 leader_election.cc:302] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.000231 19087 raft_consensus.cc:2726] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.002256 18783 raft_consensus.cc:3037] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.995641 19119 raft_consensus.cc:504] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.007361 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49fbefc46cf84318a696efb38b7f44ff" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.007447 19061 raft_consensus.cc:504] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
W20260925 16:47:35.009305 18822 leader_election.cc:341] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.011811 19119 leader_election.cc:288] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.012115 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49fbefc46cf84318a696efb38b7f44ff" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.013963 18932 raft_consensus.cc:2454] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:35.015967 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db46060b3a2424ba8e4a67debeeda7a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.016422 19112 raft_consensus.cc:2781] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.016829 18931 raft_consensus.cc:3037] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.016894 19112 raft_consensus.cc:482] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.017129 18821 leader_election.cc:302] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.016403 19059 leader_election.cc:288] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:35.017601 19112 raft_consensus.cc:3037] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.018501 19059 raft_consensus.cc:2781] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.018867 19059 raft_consensus.cc:482] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.019162 19059 raft_consensus.cc:3037] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:34.922956 19060 raft_consensus.cc:504] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.029409 19051 ts_tablet_manager.cc:1428] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.181s	user 0.008s	sys 0.000s
I20260925 16:47:35.030205 19051 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:35.022006 19088 consensus_queue.cc:1035] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260925 16:47:35.034475 19053 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:35.034448 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.035159 19053 ts_tablet_manager.cc:1397] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.255s	user 0.089s	sys 0.138s
I20260925 16:47:35.035959 19119 raft_consensus.cc:482] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.036608 19067 raft_consensus.cc:482] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.036490 19119 raft_consensus.cc:504] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.037078 19067 raft_consensus.cc:504] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.043341 18782 raft_consensus.cc:2379] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 4de55b75c594486d94ca1518de4b3e6f in this term.
I20260925 16:47:35.043798 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db46060b3a2424ba8e4a67debeeda7a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.043962 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.038582 19120 leader_election.cc:288] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:35.052160 19088 raft_consensus.cc:482] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.052542 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.052871 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.052666 19088 raft_consensus.cc:504] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.053612 18932 raft_consensus.cc:2454] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:35.053821 19003 raft_consensus.cc:2379] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95ce93f423f7436fa4863f1c688c9dc5 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:35.054951 19088 leader_election.cc:288] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.051885 19059 raft_consensus.cc:504] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:35.055088 18824 leader_election.cc:341] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.057108 19088 raft_consensus.cc:482] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.057310 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.057533 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.057591 19088 raft_consensus.cc:504] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.058144 18857 raft_consensus.cc:3037] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.058331 18932 raft_consensus.cc:2454] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.059593 19088 leader_election.cc:288] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:35.059604 18969 leader_election.cc:302] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:35.045198 19061 leader_election.cc:288] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
W20260925 16:47:35.045959 18822 leader_election.cc:341] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.068385 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.068594 19112 raft_consensus.cc:504] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.070039 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49fbefc46cf84318a696efb38b7f44ff" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.071094 19112 leader_election.cc:288] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
W20260925 16:47:35.071457 18822 leader_election.cc:341] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.071587 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa425847ff64d34a5137a5224513e75" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:35.068217 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db46060b3a2424ba8e4a67debeeda7a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:35.071913 19087 consensus_queue.cc:1035] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.073412 19051 tablet_bootstrap.cc:654] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:35.073009 18898 leader_election.cc:341] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.065850 19088 raft_consensus.cc:2781] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.075707 19088 raft_consensus.cc:482] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.076119 19088 raft_consensus.cc:3037] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.077060 18821 leader_election.cc:302] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:35.077767 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.078305 19120 raft_consensus.cc:2781] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.078739 19120 raft_consensus.cc:482] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.078858 18932 raft_consensus.cc:2379] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 2214de1d38f74b668aa3139202318338 in this term.
I20260925 16:47:35.079069 19120 raft_consensus.cc:3037] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.081142 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49fbefc46cf84318a696efb38b7f44ff" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.081964 18930 raft_consensus.cc:3037] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.082690 19054 tablet_bootstrap.cc:492] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:35.083226 19054 ts_tablet_manager.cc:1397] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.227s	user 0.040s	sys 0.031s
I20260925 16:47:35.083045 18824 leader_election.cc:302] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.084264 19060 leader_election.cc:288] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
W20260925 16:47:35.084702 18824 leader_election.cc:341] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.085186 18824 leader_election.cc:302] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.085857 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:35.087338 18898 leader_election.cc:341] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.088480 19054 raft_consensus.cc:348] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.089146 19054 raft_consensus.cc:374] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.089389 19054 raft_consensus.cc:729] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.089686 19119 leader_election.cc:288] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:35.090199 19119 raft_consensus.cc:2726] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.090013 19054 consensus_queue.cc:260] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.074091 19053 raft_consensus.cc:348] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.091336 19053 raft_consensus.cc:374] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.091636 19053 raft_consensus.cc:729] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.084654 19067 leader_election.cc:288] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:35.093492 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:35.093665 18970 leader_election.cc:341] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.095731 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.108902 18857 raft_consensus.cc:2454] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:35.109691 19121 raft_consensus.cc:2726] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.108999 19088 raft_consensus.cc:504] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
W20260925 16:47:35.109885 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:35.110711 18930 raft_consensus.cc:2454] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:35.111934 18821 leader_election.cc:302] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.112460 18855 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.112769 19121 raft_consensus.cc:2781] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.113245 19121 raft_consensus.cc:686] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:35.114035 19121 consensus_queue.cc:237] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.115928 19120 raft_consensus.cc:504] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.094707 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.118283 18858 raft_consensus.cc:2454] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.119243 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.067437 19059 leader_election.cc:288] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.120851 18932 raft_consensus.cc:3037] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.122227 18856 raft_consensus.cc:2379] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45f690dc20794b529fdeabff43202cf4 in current term 1: Already voted for candidate 95ce93f423f7436fa4863f1c688c9dc5 in this term.
I20260925 16:47:35.123927 19054 ts_tablet_manager.cc:1428] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.040s	user 0.006s	sys 0.000s
I20260925 16:47:35.124807 19054 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:35.107565 19060 raft_consensus.cc:482] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.126374 19120 leader_election.cc:288] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:35.128389 18970 leader_election.cc:302] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
W20260925 16:47:35.131456 18824 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.196:45765, user_credentials={real_user=slave}} blocked reactor thread for 46009.8us
I20260925 16:47:35.130774 19087 raft_consensus.cc:2781] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.132839 19087 raft_consensus.cc:482] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:47:35.133044 18824 leader_election.cc:341] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.133159 19087 raft_consensus.cc:3037] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.133270 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.134703 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.129350 18970 leader_election.cc:302] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.135937 19004 raft_consensus.cc:2379] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95ce93f423f7436fa4863f1c688c9dc5 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:35.134734 18969 leader_election.cc:302] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:35.136710 19054 tablet_bootstrap.cc:654] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.138329 19061 raft_consensus.cc:2781] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.144809 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.145046 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.145490 18856 raft_consensus.cc:2454] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:35.142571 19052 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:35.146605 19052 ts_tablet_manager.cc:1397] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.018s
I20260925 16:47:35.146940 18747 leader_election.cc:302] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:35.149888 19052 raft_consensus.cc:348] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.150725 19052 raft_consensus.cc:374] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.151050 19052 raft_consensus.cc:729] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.152570 19124 raft_consensus.cc:2726] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.137480 19088 leader_election.cc:288] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.130199 19060 raft_consensus.cc:504] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.159391 19087 raft_consensus.cc:504] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.160441 18782 raft_consensus.cc:2454] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.162276 19060 leader_election.cc:288] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:35.123202 19053 consensus_queue.cc:260] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.166301 19052 consensus_queue.cc:260] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.162472 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.169866 19004 raft_consensus.cc:2379] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:35.169979 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.170811 18856 raft_consensus.cc:2454] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:35.172287 18747 leader_election.cc:302] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:35.172540 18931 raft_consensus.cc:2454] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:35.173892 18821 leader_election.cc:302] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:35.175168 19124 raft_consensus.cc:2781] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.175637 19053 ts_tablet_manager.cc:1428] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.140s	user 0.007s	sys 0.000s
I20260925 16:47:35.175724 19124 raft_consensus.cc:482] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.176690 19124 raft_consensus.cc:3037] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.177060 19053 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:35.165902 19087 leader_election.cc:288] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:35.180210 19088 raft_consensus.cc:2726] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.191534 19120 raft_consensus.cc:2781] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.193060 19120 raft_consensus.cc:686] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:35.193172 19052 ts_tablet_manager.cc:1428] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.046s	user 0.006s	sys 0.002s
W20260925 16:47:35.104220 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:36337, user_credentials={real_user=slave}} blocked reactor thread for 133907us
I20260925 16:47:35.194023 19120 consensus_queue.cc:237] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.195731 19067 raft_consensus.cc:482] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.196197 19067 raft_consensus.cc:504] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.198134 19067 leader_election.cc:288] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:35.198860 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.201079 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa425847ff64d34a5137a5224513e75" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.201705 18782 raft_consensus.cc:3037] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.203933 19088 raft_consensus.cc:482] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.204439 19088 raft_consensus.cc:504] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.204766 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.205688 18783 raft_consensus.cc:2379] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 4de55b75c594486d94ca1518de4b3e6f in this term.
I20260925 16:47:35.207877 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.207984 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.208738 18856 raft_consensus.cc:3037] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.209062 19088 leader_election.cc:288] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.209726 19052 tablet_bootstrap.cc:492] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:35.210068 18782 raft_consensus.cc:2454] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:35.214763 18896 leader_election.cc:302] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.210557 18932 raft_consensus.cc:2454] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:35.211822 19053 tablet_bootstrap.cc:654] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.218647 19052 tablet_bootstrap.cc:654] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.216166 19067 raft_consensus.cc:2781] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 16:47:35.215847 18969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:33127, user_credentials={real_user=slave}} blocked reactor thread for 81195.4us
I20260925 16:47:35.216244 19061 raft_consensus.cc:686] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:35.221436 19067 raft_consensus.cc:482] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.227684 19067 raft_consensus.cc:3037] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.223181 18821 leader_election.cc:302] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
W20260925 16:47:35.235194 18896 leader_election.cc:341] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.235668 18896 leader_election.cc:302] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.236001 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:35.236793 18896 leader_election.cc:302] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:35.236815 19004 raft_consensus.cc:2379] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 95ce93f423f7436fa4863f1c688c9dc5 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:35.237949 19112 raft_consensus.cc:2726] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.238546 19112 raft_consensus.cc:2781] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.238852 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db46060b3a2424ba8e4a67debeeda7a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.239382 18931 raft_consensus.cc:3037] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.239241 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9c4452fe3a6e47749633e00bb65aeb8b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.239748 18932 raft_consensus.cc:2379] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45f690dc20794b529fdeabff43202cf4 in current term 1: Already voted for candidate 95ce93f423f7436fa4863f1c688c9dc5 in this term.
I20260925 16:47:35.238961 19112 raft_consensus.cc:686] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:35.241804 19112 consensus_queue.cc:237] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.242980 18896 leader_election.cc:302] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.246515 18680 catalog_manager.cc:5495] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.240875 19061 consensus_queue.cc:237] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.248648 19051 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:35.231813 19121 raft_consensus.cc:2781] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.252432 19051 ts_tablet_manager.cc:1397] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.222s	user 0.013s	sys 0.005s
I20260925 16:47:35.253841 19121 raft_consensus.cc:686] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:35.254782 19121 consensus_queue.cc:237] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.256027 18856 raft_consensus.cc:2454] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:35.256211 19051 raft_consensus.cc:348] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.256875 19051 raft_consensus.cc:374] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.257285 19051 raft_consensus.cc:729] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.257552 18896 leader_election.cc:302] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.257926 19051 consensus_queue.cc:260] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.263033 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.272760 19052 tablet_bootstrap.cc:492] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:35.273283 19052 ts_tablet_manager.cc:1397] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.064s	user 0.018s	sys 0.007s
I20260925 16:47:35.273326 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.274253 18856 raft_consensus.cc:3037] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.277719 19054 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:35.277786 19122 raft_consensus.cc:2726] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.278342 19054 ts_tablet_manager.cc:1397] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.154s	user 0.013s	sys 0.001s
I20260925 16:47:35.279314 19122 raft_consensus.cc:2781] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.280890 19130 consensus_queue.cc:1035] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:35.281019 19054 raft_consensus.cc:348] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.281831 19054 raft_consensus.cc:374] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.282138 19054 raft_consensus.cc:729] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.282740 19054 consensus_queue.cc:260] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.285002 19054 ts_tablet_manager.cc:1428] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260925 16:47:35.285864 19054 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:35.286631 19052 raft_consensus.cc:348] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.287572 19052 raft_consensus.cc:374] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.287866 19052 raft_consensus.cc:729] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.279847 19122 raft_consensus.cc:686] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:35.288502 19052 consensus_queue.cc:260] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.296146 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9db46060b3a2424ba8e4a67debeeda7a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.311250 19122 consensus_queue.cc:237] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.313575 18680 catalog_manager.cc:5495] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.314914 19124 raft_consensus.cc:504] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.316174 18782 raft_consensus.cc:2379] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 45f690dc20794b529fdeabff43202cf4 in current term 1: Already voted for candidate 4de55b75c594486d94ca1518de4b3e6f in this term.
I20260925 16:47:35.316308 18970 leader_election.cc:302] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:35.316677 18856 raft_consensus.cc:2454] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:35.287021 19067 raft_consensus.cc:504] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.318847 19052 ts_tablet_manager.cc:1428] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.001s
I20260925 16:47:35.318913 19130 raft_consensus.cc:3037] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.319828 19129 consensus_queue.cc:1035] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:47:35.320745 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:35.322278 18970 leader_election.cc:302] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.323071 19124 leader_election.cc:288] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:35.325169 18679 catalog_manager.cc:5495] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.328321 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e68a2deed8c14bf4bdfe7deb5417cc56" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.334311 19052 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:35.335615 19054 tablet_bootstrap.cc:654] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.348330 18680 catalog_manager.cc:5495] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.349381 19004 raft_consensus.cc:2379] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
W20260925 16:47:35.339941 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:44819, user_credentials={real_user=slave}} blocked reactor thread for 82508.8us
I20260925 16:47:35.360726 18856 raft_consensus.cc:2379] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:35.373854 19053 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:35.374393 19053 ts_tablet_manager.cc:1397] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.198s	user 0.016s	sys 0.011s
I20260925 16:47:35.375061 19052 tablet_bootstrap.cc:654] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.375876 19131 raft_consensus.cc:2781] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.376382 19131 raft_consensus.cc:686] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:35.376848 19067 leader_election.cc:288] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:35.377185 19131 consensus_queue.cc:237] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.379194 19053 raft_consensus.cc:348] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.383024 19061 consensus_queue.cc:1035] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.379968 19053 raft_consensus.cc:374] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.386592 19053 raft_consensus.cc:729] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.387291 18747 leader_election.cc:302] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:35.389183 19054 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:35.389460 19060 raft_consensus.cc:2726] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.389631 19054 ts_tablet_manager.cc:1397] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.104s	user 0.015s	sys 0.000s
I20260925 16:47:35.385257 18678 catalog_manager.cc:5495] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.392516 19051 ts_tablet_manager.cc:1428] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.140s	user 0.018s	sys 0.012s
I20260925 16:47:35.397881 19053 consensus_queue.cc:260] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.400588 19051 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:35.400679 19053 ts_tablet_manager.cc:1428] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.026s	user 0.008s	sys 0.000s
I20260925 16:47:35.401762 19053 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:35.403311 19130 raft_consensus.cc:2726] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.405619 19054 raft_consensus.cc:348] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.409071 19054 raft_consensus.cc:374] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.409418 19054 raft_consensus.cc:729] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.411437 19054 consensus_queue.cc:260] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.414074 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.414615 19054 ts_tablet_manager.cc:1428] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.025s	user 0.007s	sys 0.000s
I20260925 16:47:35.414921 18857 raft_consensus.cc:3037] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.415652 19054 tablet_bootstrap.cc:492] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:35.417433 19053 tablet_bootstrap.cc:654] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.426887 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.427520 18782 raft_consensus.cc:3037] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.434387 18782 raft_consensus.cc:2454] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:35.446929 19130 consensus_queue.cc:1035] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.454890 19051 tablet_bootstrap.cc:654] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.437631 18896 leader_election.cc:302] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:35.456804 19148 raft_consensus.cc:2781] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.457278 19148 raft_consensus.cc:686] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:35.458036 19148 consensus_queue.cc:237] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.459043 18857 raft_consensus.cc:2454] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:35.472590 19054 tablet_bootstrap.cc:654] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.492522 19121 raft_consensus.cc:482] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.500846 19052 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:35.504691 19052 ts_tablet_manager.cc:1397] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.172s	user 0.008s	sys 0.021s
I20260925 16:47:35.500227 19121 raft_consensus.cc:504] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.509666 18679 catalog_manager.cc:5495] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:35.512657 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4232305d9da417abeca7e94118abe8e" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.513275 19052 raft_consensus.cc:348] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.513505 18782 raft_consensus.cc:2454] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:35.513991 19052 raft_consensus.cc:374] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.514317 19052 raft_consensus.cc:729] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.514910 19052 consensus_queue.cc:260] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.518006 19052 ts_tablet_manager.cc:1428] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260925 16:47:35.518836 19052 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:35.522778 19121 leader_election.cc:288] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.529739 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4232305d9da417abeca7e94118abe8e" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.530416 18931 raft_consensus.cc:2454] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:35.527721 18822 leader_election.cc:302] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:35.535199 19120 raft_consensus.cc:2781] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.535563 19120 raft_consensus.cc:482] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.535887 19120 raft_consensus.cc:3037] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.541958 19054 tablet_bootstrap.cc:492] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:35.542496 19054 ts_tablet_manager.cc:1397] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.000s
I20260925 16:47:35.546671 19054 raft_consensus.cc:348] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.547814 19054 raft_consensus.cc:374] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.548218 19054 raft_consensus.cc:729] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.552925 19054 consensus_queue.cc:260] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.551235 18679 catalog_manager.cc:5495] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.556941 19054 ts_tablet_manager.cc:1428] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260925 16:47:35.558312 19054 tablet_bootstrap.cc:492] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:35.551537 19120 raft_consensus.cc:504] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.560096 19053 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:35.560652 19053 ts_tablet_manager.cc:1397] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.159s	user 0.022s	sys 0.016s
I20260925 16:47:35.561287 19152 raft_consensus.cc:482] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.561784 19152 raft_consensus.cc:504] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.562321 19051 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:35.562781 19051 ts_tablet_manager.cc:1397] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.162s	user 0.016s	sys 0.028s
I20260925 16:47:35.564186 19052 tablet_bootstrap.cc:654] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.564972 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4232305d9da417abeca7e94118abe8e" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:35.565569 18782 raft_consensus.cc:3037] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.565820 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17301ed72d3d4a7abaebb081f70f39c9" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:35.567270 18969 leader_election.cc:341] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.567842 19152 leader_election.cc:288] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.568602 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17301ed72d3d4a7abaebb081f70f39c9" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.569029 19051 raft_consensus.cc:348] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.569715 19051 raft_consensus.cc:374] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 16:47:35.569988 18970 leader_election.cc:341] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.570592 18970 leader_election.cc:302] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:35.563506 19053 raft_consensus.cc:348] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.571657 19152 raft_consensus.cc:2726] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.574966 19052 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:35.571787 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4232305d9da417abeca7e94118abe8e" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.575554 19052 ts_tablet_manager.cc:1397] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.057s	user 0.011s	sys 0.000s
I20260925 16:47:35.575670 18932 raft_consensus.cc:3037] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.577343 19054 tablet_bootstrap.cc:654] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.578052 19052 raft_consensus.cc:348] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.578779 19052 raft_consensus.cc:374] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.578847 19053 raft_consensus.cc:374] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.579172 19052 raft_consensus.cc:729] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.569988 19051 raft_consensus.cc:729] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.575786 19120 leader_election.cc:288] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.579442 19053 raft_consensus.cc:729] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.580843 19051 consensus_queue.cc:260] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.581506 19053 consensus_queue.cc:260] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.584533 19051 ts_tablet_manager.cc:1428] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.002s
I20260925 16:47:35.574455 18782 raft_consensus.cc:2454] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:35.586395 19052 consensus_queue.cc:260] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.586964 18822 leader_election.cc:302] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:35.585937 19051 tablet_bootstrap.cc:492] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:35.591128 18932 raft_consensus.cc:2454] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:35.593267 19053 ts_tablet_manager.cc:1428] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.000s
I20260925 16:47:35.594048 19051 tablet_bootstrap.cc:654] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.594743 19053 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:35.596282 19120 raft_consensus.cc:2781] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.596791 19120 raft_consensus.cc:686] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:35.597587 19120 consensus_queue.cc:237] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.600710 19053 tablet_bootstrap.cc:654] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.603322 19052 ts_tablet_manager.cc:1428] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260925 16:47:35.605846 19052 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:35.612874 18678 catalog_manager.cc:5495] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:35.620117 19052 tablet_bootstrap.cc:654] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.626935 19053 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:35.627449 19053 ts_tablet_manager.cc:1397] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.005s
I20260925 16:47:35.629966 19053 raft_consensus.cc:348] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.632769 19121 consensus_queue.cc:1035] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.630656 19053 raft_consensus.cc:374] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.640190 19053 raft_consensus.cc:729] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.640978 19053 consensus_queue.cc:260] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.644418 19052 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:35.644937 19052 ts_tablet_manager.cc:1397] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.039s	user 0.010s	sys 0.003s
I20260925 16:47:35.646519 19053 ts_tablet_manager.cc:1428] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.002s
I20260925 16:47:35.647605 19052 raft_consensus.cc:348] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.648371 19052 raft_consensus.cc:374] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.648636 19052 raft_consensus.cc:729] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.658077 19054 tablet_bootstrap.cc:492] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:35.658639 19054 ts_tablet_manager.cc:1397] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.100s	user 0.018s	sys 0.000s
W20260925 16:47:35.658718 18822 consensus_peers.cc:487] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:35.647558 19053 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:35.666077 19053 tablet_bootstrap.cc:654] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.666042 19052 consensus_queue.cc:260] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.671388 19052 ts_tablet_manager.cc:1428] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260925 16:47:35.674188 19054 raft_consensus.cc:348] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.674973 19054 raft_consensus.cc:374] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.675302 19054 raft_consensus.cc:729] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.676365 19152 raft_consensus.cc:482] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.676702 19052 tablet_bootstrap.cc:492] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:35.676929 19152 raft_consensus.cc:504] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.678985 19152 leader_election.cc:288] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:35.679371 19054 consensus_queue.cc:260] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.680563 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa425847ff64d34a5137a5224513e75" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.683856 19054 ts_tablet_manager.cc:1428] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260925 16:47:35.683988 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5aa425847ff64d34a5137a5224513e75" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.684783 19054 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:35.684878 18782 raft_consensus.cc:2379] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45f690dc20794b529fdeabff43202cf4 in current term 1: Already voted for candidate 2214de1d38f74b668aa3139202318338 in this term.
I20260925 16:47:35.692433 19121 consensus_queue.cc:1035] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.693166 18970 leader_election.cc:302] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.680589 19126 raft_consensus.cc:482] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.694794 19126 raft_consensus.cc:504] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.695441 19052 tablet_bootstrap.cc:654] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.695537 19087 raft_consensus.cc:3037] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.696614 19148 consensus_queue.cc:1035] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.697541 19126 leader_election.cc:288] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:35.700304 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.700824 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:35.702111 18822 leader_election.cc:341] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:35.702584 18824 leader_election.cc:341] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.703161 18824 leader_election.cc:302] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.704174 19121 consensus_queue.cc:1035] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:35.705737 19121 raft_consensus.cc:2726] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.707978 19053 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:35.709187 19053 ts_tablet_manager.cc:1397] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.003s
I20260925 16:47:35.718389 19121 consensus_queue.cc:1035] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:35.719281 19087 raft_consensus.cc:2726] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:47:35.732157 18970 consensus_peers.cc:487] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:35.732944 19051 tablet_bootstrap.cc:492] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:35.733467 19051 ts_tablet_manager.cc:1397] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.148s	user 0.026s	sys 0.011s
I20260925 16:47:35.736048 19121 raft_consensus.cc:482] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.736567 19121 raft_consensus.cc:504] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.738138 19051 raft_consensus.cc:348] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.741202 19121 leader_election.cc:288] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:35.738801 19053 raft_consensus.cc:348] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.739223 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.741783 19053 raft_consensus.cc:374] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.742072 19053 raft_consensus.cc:729] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.741433 19051 raft_consensus.cc:374] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.742863 19051 raft_consensus.cc:729] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
W20260925 16:47:35.742815 18821 leader_election.cc:341] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.744704 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:35.746284 18824 leader_election.cc:341] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.746011 19053 consensus_queue.cc:260] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.751977 18824 leader_election.cc:302] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:35.743548 19051 consensus_queue.cc:260] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.758460 18678 catalog_manager.cc:5495] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:35.766737 19053 ts_tablet_manager.cc:1428] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.057s	user 0.004s	sys 0.003s
I20260925 16:47:35.767684 19051 ts_tablet_manager.cc:1428] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260925 16:47:35.768847 19051 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:35.768966 19124 raft_consensus.cc:482] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.769675 19124 raft_consensus.cc:504] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.771633 19052 tablet_bootstrap.cc:492] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:35.772171 19052 ts_tablet_manager.cc:1397] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.096s	user 0.015s	sys 0.005s
I20260925 16:47:35.771590 19124 leader_election.cc:288] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.777069 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49fbefc46cf84318a696efb38b7f44ff" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.777251 19052 raft_consensus.cc:348] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.780326 19052 raft_consensus.cc:374] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.780670 19052 raft_consensus.cc:729] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.780826 19053 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:35.778327 19120 raft_consensus.cc:2726] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.779461 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49fbefc46cf84318a696efb38b7f44ff" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.781337 19052 consensus_queue.cc:260] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.782238 19121 raft_consensus.cc:482] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.789013 18746 leader_election.cc:302] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:35.790136 19124 raft_consensus.cc:2726] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.793802 19054 tablet_bootstrap.cc:654] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.796031 19051 tablet_bootstrap.cc:654] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.786466 19121 raft_consensus.cc:504] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.799986 19148 consensus_queue.cc:1035] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.800880 19121 leader_election.cc:288] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.801107 19087 consensus_queue.cc:1035] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.803061 19124 raft_consensus.cc:482] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.803553 19124 raft_consensus.cc:504] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.806385 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.807040 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:35.807682 19003 raft_consensus.cc:2454] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:35.807036 18932 raft_consensus.cc:2454] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:35.808534 19053 tablet_bootstrap.cc:654] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.809856 18746 leader_election.cc:302] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:35.810194 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.810642 19060 raft_consensus.cc:2781] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.811031 19060 raft_consensus.cc:482] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.811345 19060 raft_consensus.cc:3037] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.813517 19087 raft_consensus.cc:482] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.813970 19087 raft_consensus.cc:504] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.818109 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.818164 19148 consensus_queue.cc:1035] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.818820 18856 raft_consensus.cc:2454] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.818511 19060 raft_consensus.cc:504] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.819533 19087 leader_election.cc:288] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:35.820523 18970 leader_election.cc:302] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:35.821242 19060 leader_election.cc:288] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:35.821538 19130 raft_consensus.cc:2781] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.821944 19130 raft_consensus.cc:482] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.822877 19124 leader_election.cc:288] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:35.829845 19130 raft_consensus.cc:3037] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.840276 19052 ts_tablet_manager.cc:1428] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.008s
I20260925 16:47:35.841427 19052 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
W20260925 16:47:35.842782 18821 leader_election.cc:341] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.846444 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.846638 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.847167 18930 raft_consensus.cc:3037] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:47:35.847922 18822 leader_election.cc:341] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.848372 18822 leader_election.cc:302] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.849452 19120 raft_consensus.cc:2726] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.849464 19122 consensus_queue.cc:1035] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:35.844373 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.856655 19087 consensus_queue.cc:1035] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260925 16:47:35.857419 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:35.869004 19004 raft_consensus.cc:3037] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.857064 18783 raft_consensus.cc:2454] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.869841 19120 consensus_queue.cc:1035] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.875420 18930 raft_consensus.cc:2454] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:35.851688 19130 raft_consensus.cc:504] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.889642 19052 tablet_bootstrap.cc:654] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.891567 18746 leader_election.cc:302] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:35.893391 19124 raft_consensus.cc:2781] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.893864 19124 raft_consensus.cc:686] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:35.894699 19124 consensus_queue.cc:237] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.898553 19087 raft_consensus.cc:482] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.899085 19087 raft_consensus.cc:504] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.901373 19054 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:35.901347 19087 leader_election.cc:288] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.902021 19054 ts_tablet_manager.cc:1397] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.217s	user 0.021s	sys 0.008s
I20260925 16:47:35.917876 19054 raft_consensus.cc:348] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.918598 19054 raft_consensus.cc:374] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.918895 19054 raft_consensus.cc:729] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.918699 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39936f93e1a64ff290f8bcb31e35b2ee" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:35.919864 18930 raft_consensus.cc:2454] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.920873 18969 leader_election.cc:302] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:35.922402 19088 raft_consensus.cc:2781] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:35.923313 19054 consensus_queue.cc:260] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:35.922768 19088 raft_consensus.cc:482] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:35.928782 19088 raft_consensus.cc:3037] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.941663 19087 consensus_queue.cc:1035] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:35.942206 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39936f93e1a64ff290f8bcb31e35b2ee" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:35.942917 18857 raft_consensus.cc:2454] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:35.954151 19004 raft_consensus.cc:2454] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:35.958446 19053 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:35.958963 19053 ts_tablet_manager.cc:1397] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.178s	user 0.021s	sys 0.021s
I20260925 16:47:35.960052 19054 ts_tablet_manager.cc:1428] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.055s	user 0.006s	sys 0.000s
I20260925 16:47:35.961710 19054 tablet_bootstrap.cc:492] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:35.962882 19088 raft_consensus.cc:504] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.967332 19051 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:35.967916 19051 ts_tablet_manager.cc:1397] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.199s	user 0.025s	sys 0.020s
I20260925 16:47:35.967938 19088 leader_election.cc:288] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.970598 19051 raft_consensus.cc:348] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.971311 19051 raft_consensus.cc:374] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:35.971561 19051 raft_consensus.cc:729] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:35.972174 19130 leader_election.cc:288] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:35.970618 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39936f93e1a64ff290f8bcb31e35b2ee" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:35.972187 19051 consensus_queue.cc:260] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.976372 18930 raft_consensus.cc:3037] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.975333 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:35.977994 18858 raft_consensus.cc:3037] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:35.978152 19051 ts_tablet_manager.cc:1428] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260925 16:47:35.979127 19051 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:35.980729 19120 raft_consensus.cc:482] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:35.981213 19120 raft_consensus.cc:504] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:35.982404 19054 tablet_bootstrap.cc:654] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.983110 19120 leader_election.cc:288] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:35.983923 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:35.984586 18930 raft_consensus.cc:2454] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:35.984683 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:35.985481 18822 leader_election.cc:341] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.985984 18969 leader_election.cc:302] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:35.986838 19130 raft_consensus.cc:2781] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
W20260925 16:47:35.986994 18821 leader_election.cc:341] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:35.987365 19130 raft_consensus.cc:686] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:35.987537 18821 leader_election.cc:302] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:35.989355 19120 raft_consensus.cc:2726] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:35.988984 19130 consensus_queue.cc:237] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:35.991601 18858 raft_consensus.cc:2454] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:35.992802 19051 tablet_bootstrap.cc:654] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:35.993228 18970 leader_election.cc:302] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:35.994076 19088 raft_consensus.cc:2781] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:35.994553 19088 raft_consensus.cc:686] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:35.995311 19088 consensus_queue.cc:237] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.001128 19053 raft_consensus.cc:348] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.002014 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39936f93e1a64ff290f8bcb31e35b2ee" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:36.003017 18857 raft_consensus.cc:3037] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.011869 19067 consensus_queue.cc:1035] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.011660 18857 raft_consensus.cc:2454] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:36.002048 19053 raft_consensus.cc:374] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.014201 19053 raft_consensus.cc:729] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.014830 19053 consensus_queue.cc:260] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:35.992072 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:36.016345 18782 raft_consensus.cc:3037] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.016533 19053 ts_tablet_manager.cc:1428] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.057s	user 0.007s	sys 0.000s
I20260925 16:47:36.017597 19053 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.022841 19053 tablet_bootstrap.cc:654] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.030565 19067 consensus_queue.cc:1035] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:36.036057 18782 raft_consensus.cc:2454] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:36.045861 18678 catalog_manager.cc:5495] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:36.055540 18783 raft_consensus.cc:3037] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.063413 19053 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.064236 19053 ts_tablet_manager.cc:1397] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.047s	user 0.014s	sys 0.001s
I20260925 16:47:36.067842 19053 raft_consensus.cc:348] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.068605 19053 raft_consensus.cc:374] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.068914 19053 raft_consensus.cc:729] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.069744 19124 raft_consensus.cc:482] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.069629 19053 consensus_queue.cc:260] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.070652 19087 raft_consensus.cc:482] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.070428 19124 raft_consensus.cc:504] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.071152 19087 raft_consensus.cc:504] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.072597 19053 ts_tablet_manager.cc:1428] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:47:36.073575 19053 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.073676 19124 leader_election.cc:288] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.074033 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:36.075589 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.076262 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:36.083770 19051 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.084306 19051 ts_tablet_manager.cc:1397] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.105s	user 0.014s	sys 0.000s
I20260925 16:47:36.078812 18747 leader_election.cc:302] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
W20260925 16:47:36.082185 18969 leader_election.cc:341] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.089213 19087 leader_election.cc:288] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:36.097318 19052 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.097853 19052 ts_tablet_manager.cc:1397] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.257s	user 0.014s	sys 0.002s
I20260925 16:47:36.088065 19124 raft_consensus.cc:2726] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:36.100394 19178 consensus_queue.cc:1035] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.100759 19051 raft_consensus.cc:348] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.101500 19051 raft_consensus.cc:374] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.101739 19051 raft_consensus.cc:729] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.102337 19051 consensus_queue.cc:260] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.102814 19053 tablet_bootstrap.cc:654] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.103456 19054 tablet_bootstrap.cc:492] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.103947 19054 ts_tablet_manager.cc:1397] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.143s	user 0.029s	sys 0.025s
I20260925 16:47:36.104983 18680 catalog_manager.cc:5495] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:36.106387 19054 raft_consensus.cc:348] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.107139 19054 raft_consensus.cc:374] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.107434 19054 raft_consensus.cc:729] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.106487 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:36.108240 19054 consensus_queue.cc:260] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.113615 19051 ts_tablet_manager.cc:1428] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.029s	user 0.005s	sys 0.000s
I20260925 16:47:36.109117 19052 raft_consensus.cc:348] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.116000 19052 raft_consensus.cc:374] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.116340 19052 raft_consensus.cc:729] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.116695 19051 tablet_bootstrap.cc:492] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.117134 19052 consensus_queue.cc:260] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.114308 18680 catalog_manager.cc:5495] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:36.122622 19054 ts_tablet_manager.cc:1428] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260925 16:47:36.125814 18782 raft_consensus.cc:2454] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:36.139544 19054 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.139974 18970 leader_election.cc:302] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:36.141593 19087 raft_consensus.cc:2781] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.142040 19087 raft_consensus.cc:482] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.142423 19087 raft_consensus.cc:3037] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.144163 19178 consensus_queue.cc:1035] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:36.145453 19054 tablet_bootstrap.cc:654] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.128021 19052 ts_tablet_manager.cc:1428] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260925 16:47:36.129173 19051 tablet_bootstrap.cc:654] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.162014 19052 tablet_bootstrap.cc:492] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
W20260925 16:47:36.168094 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:36.178918 19087 raft_consensus.cc:504] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.186336 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:36.186619 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:36.187006 18783 raft_consensus.cc:3037] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.188371 19052 tablet_bootstrap.cc:654] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.192078 19053 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.192580 19053 ts_tablet_manager.cc:1397] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.119s	user 0.030s	sys 0.014s
W20260925 16:47:36.194862 18969 leader_election.cc:341] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.195190 19053 raft_consensus.cc:348] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.195989 19053 raft_consensus.cc:374] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.196264 19053 raft_consensus.cc:729] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.196957 19053 consensus_queue.cc:260] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.188195 19087 leader_election.cc:288] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:36.202664 19053 ts_tablet_manager.cc:1428] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260925 16:47:36.203588 19053 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.208902 19053 tablet_bootstrap.cc:654] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.195568 18783 raft_consensus.cc:2454] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:36.214568 18970 leader_election.cc:302] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:36.217216 19087 raft_consensus.cc:2781] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.217835 19087 raft_consensus.cc:686] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:36.219048 19087 consensus_queue.cc:237] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.219971 19053 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.224109 19053 ts_tablet_manager.cc:1397] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.003s
I20260925 16:47:36.227079 19053 raft_consensus.cc:348] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.234022 19053 raft_consensus.cc:374] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.235263 19053 raft_consensus.cc:729] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.236919 19053 consensus_queue.cc:260] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.239432 19060 raft_consensus.cc:482] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.241020 19060 raft_consensus.cc:504] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.243563 19060 leader_election.cc:288] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.244592 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4267fb73e9d54bbbb335e2137af161b4" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:36.247076 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4267fb73e9d54bbbb335e2137af161b4" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.247856 19053 ts_tablet_manager.cc:1428] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260925 16:47:36.249130 19053 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
W20260925 16:47:36.249532 18746 leader_election.cc:341] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:36.250785 18749 leader_election.cc:341] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.251547 18749 leader_election.cc:302] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:36.253186 19060 raft_consensus.cc:2726] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:36.254734 18781 raft_consensus.cc:3037] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.259529 19052 tablet_bootstrap.cc:492] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.260048 19052 ts_tablet_manager.cc:1397] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.101s	user 0.018s	sys 0.000s
I20260925 16:47:36.267288 19054 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.267848 19054 ts_tablet_manager.cc:1397] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.129s	user 0.013s	sys 0.002s
I20260925 16:47:36.270628 19054 raft_consensus.cc:348] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.271407 19054 raft_consensus.cc:374] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.271579 19051 tablet_bootstrap.cc:492] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.271725 19054 raft_consensus.cc:729] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.272406 19051 ts_tablet_manager.cc:1397] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.156s	user 0.021s	sys 0.067s
I20260925 16:47:36.272976 19054 consensus_queue.cc:260] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.275210 19053 tablet_bootstrap.cc:654] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.275395 19054 ts_tablet_manager.cc:1428] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:47:36.276753 19054 tablet_bootstrap.cc:492] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.276656 19051 raft_consensus.cc:348] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.278652 19051 raft_consensus.cc:374] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.267848 19052 raft_consensus.cc:348] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.279522 19051 raft_consensus.cc:729] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.279683 19052 raft_consensus.cc:374] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.287853 19052 raft_consensus.cc:729] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.288285 19051 consensus_queue.cc:260] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.288697 19052 consensus_queue.cc:260] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.291261 19051 ts_tablet_manager.cc:1428] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260925 16:47:36.291251 19052 ts_tablet_manager.cc:1428] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260925 16:47:36.292877 19051 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.294004 19052 tablet_bootstrap.cc:492] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:36.299080 19051 tablet_bootstrap.cc:654] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.300307 19054 tablet_bootstrap.cc:654] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.305218 19052 tablet_bootstrap.cc:654] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.310961 19053 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.311268 19054 tablet_bootstrap.cc:492] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.311561 19053 ts_tablet_manager.cc:1397] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.063s	user 0.013s	sys 0.004s
I20260925 16:47:36.311784 19054 ts_tablet_manager.cc:1397] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.035s	user 0.006s	sys 0.006s
I20260925 16:47:36.314476 19054 raft_consensus.cc:348] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.315357 19054 raft_consensus.cc:374] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.314987 19053 raft_consensus.cc:348] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.316072 19053 raft_consensus.cc:374] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.316427 19053 raft_consensus.cc:729] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.317222 19053 consensus_queue.cc:260] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.315771 19054 raft_consensus.cc:729] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.320461 19054 consensus_queue.cc:260] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.322870 19051 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.324002 19051 ts_tablet_manager.cc:1397] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.031s	user 0.009s	sys 0.008s
I20260925 16:47:36.325525 19053 ts_tablet_manager.cc:1428] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260925 16:47:36.326553 19051 raft_consensus.cc:348] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.327045 19053 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.329145 19051 raft_consensus.cc:374] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.328639 18681 catalog_manager.cc:5495] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:36.329527 19051 raft_consensus.cc:729] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.328794 19054 ts_tablet_manager.cc:1428] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260925 16:47:36.331084 19130 raft_consensus.cc:482] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.331542 19130 raft_consensus.cc:504] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.333459 19130 leader_election.cc:288] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.335145 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:36.335867 18858 raft_consensus.cc:2454] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:36.337082 18970 leader_election.cc:302] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.337596 19148 raft_consensus.cc:482] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.337879 19130 raft_consensus.cc:2781] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.330199 19051 consensus_queue.cc:260] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.342788 19051 ts_tablet_manager.cc:1428] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260925 16:47:36.338191 19053 tablet_bootstrap.cc:654] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.338063 19148 raft_consensus.cc:504] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.338337 19130 raft_consensus.cc:482] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.356645 19130 raft_consensus.cc:3037] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.356923 19051 tablet_bootstrap.cc:492] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.351918 19054 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.353623 19052 tablet_bootstrap.cc:492] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.342255 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:36.358943 19052 ts_tablet_manager.cc:1397] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.065s	user 0.019s	sys 0.008s
W20260925 16:47:36.359935 18970 leader_election.cc:341] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.360936 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:36.361649 18782 raft_consensus.cc:2454] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:36.362569 19051 tablet_bootstrap.cc:654] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.362821 18896 leader_election.cc:302] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:36.362957 19052 raft_consensus.cc:348] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.363638 19067 raft_consensus.cc:2781] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.364169 19067 raft_consensus.cc:482] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.364516 19067 raft_consensus.cc:3037] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.365278 19148 leader_election.cc:288] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.365540 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:36.366478 18858 raft_consensus.cc:2454] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:36.363766 19052 raft_consensus.cc:374] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.368958 19052 raft_consensus.cc:729] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.371228 19054 tablet_bootstrap.cc:654] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.371546 19052 consensus_queue.cc:260] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.374146 19067 raft_consensus.cc:504] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.376541 19067 leader_election.cc:288] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.380605 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:36.381438 18858 raft_consensus.cc:3037] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.384671 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:36.385545 18782 raft_consensus.cc:3037] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.387676 19053 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.388337 19053 ts_tablet_manager.cc:1397] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.062s	user 0.006s	sys 0.006s
I20260925 16:47:36.391605 19053 raft_consensus.cc:348] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.392450 19053 raft_consensus.cc:374] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.392777 19053 raft_consensus.cc:729] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.393651 19053 consensus_queue.cc:260] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.397782 19051 tablet_bootstrap.cc:492] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.398401 19051 ts_tablet_manager.cc:1397] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.018s
I20260925 16:47:36.398756 18858 raft_consensus.cc:2454] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:36.399673 18896 leader_election.cc:302] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.400630 19067 raft_consensus.cc:2781] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.400768 19052 ts_tablet_manager.cc:1428] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260925 16:47:36.401127 19067 raft_consensus.cc:686] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:36.401811 19052 tablet_bootstrap.cc:492] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:36.402009 18782 raft_consensus.cc:2454] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:36.401944 19067 consensus_queue.cc:237] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.404597 19130 raft_consensus.cc:504] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.405239 19053 ts_tablet_manager.cc:1428] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260925 16:47:36.406179 19053 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.400811 19051 raft_consensus.cc:348] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.408756 19051 raft_consensus.cc:374] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.409013 19051 raft_consensus.cc:729] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.409063 19087 consensus_queue.cc:1035] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.409714 19051 consensus_queue.cc:260] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.411759 19051 ts_tablet_manager.cc:1428] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260925 16:47:36.412497 19053 tablet_bootstrap.cc:654] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.412709 19060 consensus_queue.cc:1035] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.417368 19052 tablet_bootstrap.cc:654] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.420449 19051 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.431588 19178 raft_consensus.cc:482] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.432180 19178 raft_consensus.cc:504] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.434293 19178 leader_election.cc:288] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.437083 19051 tablet_bootstrap.cc:654] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.438114 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17301ed72d3d4a7abaebb081f70f39c9" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:36.439711 18821 leader_election.cc:341] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.441284 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17301ed72d3d4a7abaebb081f70f39c9" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.441956 19004 raft_consensus.cc:2454] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:36.443555 18824 leader_election.cc:302] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:36.443918 19148 raft_consensus.cc:482] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.444344 19130 leader_election.cc:288] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.444609 19148 raft_consensus.cc:504] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.446949 19178 raft_consensus.cc:2781] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.447389 19178 raft_consensus.cc:482] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.447813 19178 raft_consensus.cc:3037] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.449298 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:36.450150 18856 raft_consensus.cc:3037] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.454125 19052 tablet_bootstrap.cc:492] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.454629 19052 ts_tablet_manager.cc:1397] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.053s	user 0.010s	sys 0.001s
I20260925 16:47:36.457271 19052 raft_consensus.cc:348] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.457962 19052 raft_consensus.cc:374] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.458206 19052 raft_consensus.cc:729] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.458989 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:36.461153 18970 leader_election.cc:341] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.463570 19148 leader_election.cc:288] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.464556 19148 raft_consensus.cc:482] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.465138 19178 raft_consensus.cc:504] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.466084 19121 raft_consensus.cc:482] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.466702 19052 consensus_queue.cc:260] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.479251 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:36.480048 19052 ts_tablet_manager.cc:1428] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.001s
I20260925 16:47:36.479961 18857 raft_consensus.cc:2454] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:36.480695 19121 raft_consensus.cc:504] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.481717 19130 consensus_queue.cc:1035] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.468541 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:36.487015 19121 leader_election.cc:288] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.488071 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7081600b02b48fb83f2b33eae404adf" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:36.488950 18931 raft_consensus.cc:2454] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:36.489220 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7081600b02b48fb83f2b33eae404adf" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.489919 19003 raft_consensus.cc:2454] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:36.490221 18821 leader_election.cc:302] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.491050 19177 raft_consensus.cc:2781] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.491434 19177 raft_consensus.cc:482] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.491875 19177 raft_consensus.cc:3037] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.492822 19178 leader_election.cc:288] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.493330 18782 raft_consensus.cc:2454] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:36.491310 18896 leader_election.cc:302] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.502336 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17301ed72d3d4a7abaebb081f70f39c9" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:36.503034 19003 raft_consensus.cc:3037] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.505173 18856 raft_consensus.cc:2454] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:36.505450 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "17301ed72d3d4a7abaebb081f70f39c9" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:36.506345 18970 leader_election.cc:302] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:36.507469 19122 raft_consensus.cc:2781] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.507880 19122 raft_consensus.cc:482] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.508157 19054 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.508781 19054 ts_tablet_manager.cc:1397] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.178s	user 0.020s	sys 0.010s
I20260925 16:47:36.508260 19177 raft_consensus.cc:504] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
W20260925 16:47:36.509444 18821 leader_election.cc:341] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.510815 19131 raft_consensus.cc:2781] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.511366 19131 raft_consensus.cc:686] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:36.511417 19054 raft_consensus.cc:348] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.511767 19060 consensus_queue.cc:1035] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.512265 19054 raft_consensus.cc:374] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.512576 19054 raft_consensus.cc:729] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.512499 19131 consensus_queue.cc:237] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.513351 19054 consensus_queue.cc:260] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.514454 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7081600b02b48fb83f2b33eae404adf" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:36.515080 18931 raft_consensus.cc:3037] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.493764 18681 catalog_manager.cc:5495] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:36.483589 19148 raft_consensus.cc:504] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.517271 19054 ts_tablet_manager.cc:1428] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:47:36.519987 19054 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.522822 19148 leader_election.cc:288] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:36.508229 19122 raft_consensus.cc:3037] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.524513 19052 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:36.529479 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.531615 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b7081600b02b48fb83f2b33eae404adf" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:36.532233 19005 raft_consensus.cc:3037] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.536530 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:36.529942 19177 leader_election.cc:288] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.537334 18782 raft_consensus.cc:2379] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:36.539112 18896 leader_election.cc:302] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:36.548913 19067 raft_consensus.cc:3037] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.553599 19051 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.554183 19051 ts_tablet_manager.cc:1397] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.142s	user 0.016s	sys 0.016s
I20260925 16:47:36.555436 19052 tablet_bootstrap.cc:654] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.559386 19087 consensus_queue.cc:1035] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:36.566417 19053 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.566980 19053 ts_tablet_manager.cc:1397] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.161s	user 0.041s	sys 0.028s
I20260925 16:47:36.567900 19051 raft_consensus.cc:348] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.568979 19051 raft_consensus.cc:374] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.569315 19051 raft_consensus.cc:729] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.570416 19051 consensus_queue.cc:260] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.545470 18931 raft_consensus.cc:2454] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:36.570319 19178 raft_consensus.cc:482] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.577885 19178 raft_consensus.cc:504] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.578229 19053 raft_consensus.cc:348] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.578981 19053 raft_consensus.cc:374] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.579272 19053 raft_consensus.cc:729] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.580384 19178 leader_election.cc:288] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.581311 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:36.581987 18932 raft_consensus.cc:2454] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:36.582728 19054 tablet_bootstrap.cc:654] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.584774 18821 leader_election.cc:302] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.585812 19178 raft_consensus.cc:2781] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.586254 19178 raft_consensus.cc:482] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.586625 19087 consensus_queue.cc:1035] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.586969 19178 raft_consensus.cc:3037] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.592046 19005 raft_consensus.cc:2454] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:36.586247 19130 raft_consensus.cc:482] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.593186 19130 raft_consensus.cc:504] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.593698 18824 leader_election.cc:302] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.594079 19178 raft_consensus.cc:504] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.594957 19177 raft_consensus.cc:2781] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.595149 19130 leader_election.cc:288] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:36.595804 19177 raft_consensus.cc:686] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:36.596771 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:36.597877 18856 raft_consensus.cc:2379] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45f690dc20794b529fdeabff43202cf4 in current term 1: Already voted for candidate 95ce93f423f7436fa4863f1c688c9dc5 in this term.
I20260925 16:47:36.597364 19177 consensus_queue.cc:237] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.596755 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:36.598851 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:36.599393 18932 raft_consensus.cc:3037] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.563143 19003 raft_consensus.cc:2454] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:36.604580 19053 consensus_queue.cc:260] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.623346 19126 raft_consensus.cc:482] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.624089 19126 raft_consensus.cc:504] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.632346 19051 ts_tablet_manager.cc:1428] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.078s	user 0.009s	sys 0.001s
I20260925 16:47:36.634907 19051 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.620297 19067 raft_consensus.cc:2726] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:36.637715 19053 ts_tablet_manager.cc:1428] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.070s	user 0.006s	sys 0.001s
I20260925 16:47:36.638473 19053 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.600833 18969 leader_election.cc:302] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
W20260925 16:47:36.645623 18969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:33127, user_credentials={real_user=slave}} blocked reactor thread for 44901.6us
I20260925 16:47:36.646752 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.647032 19087 raft_consensus.cc:3037] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.636323 19178 leader_election.cc:288] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.644014 19126 leader_election.cc:288] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:36.668468 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc7929e7dd84f6fba5909bdcab84721" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:36.670284 19051 tablet_bootstrap.cc:654] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:36.670200 18822 leader_election.cc:341] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.675240 19054 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.675798 19054 ts_tablet_manager.cc:1397] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.157s	user 0.021s	sys 0.018s
W20260925 16:47:36.651119 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:36337, user_credentials={real_user=slave}} blocked reactor thread for 110418us
I20260925 16:47:36.678859 19052 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.679505 19052 ts_tablet_manager.cc:1397] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.155s	user 0.015s	sys 0.017s
I20260925 16:47:36.684700 18824 leader_election.cc:302] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:36.686807 19177 raft_consensus.cc:2781] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.687287 19177 raft_consensus.cc:686] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:36.688088 19177 consensus_queue.cc:237] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.692441 19053 tablet_bootstrap.cc:654] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.693516 19054 raft_consensus.cc:348] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.694337 19054 raft_consensus.cc:374] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.694636 19054 raft_consensus.cc:729] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.702518 19054 consensus_queue.cc:260] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.715441 19052 raft_consensus.cc:348] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.718259 19052 raft_consensus.cc:374] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.718684 19052 raft_consensus.cc:729] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.708073 19124 raft_consensus.cc:482] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.720884 19052 consensus_queue.cc:260] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.710494 19087 raft_consensus.cc:2726] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:36.708880 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc7929e7dd84f6fba5909bdcab84721" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.693521 19122 raft_consensus.cc:504] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.730330 19122 leader_election.cc:288] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:36.731379 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:36.732028 18856 raft_consensus.cc:3037] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.722394 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:36.736816 18678 catalog_manager.cc:5495] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:36.740275 19052 ts_tablet_manager.cc:1428] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.060s	user 0.007s	sys 0.000s
I20260925 16:47:36.741410 19052 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:36.728709 19006 raft_consensus.cc:2454] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:36.724997 19124 raft_consensus.cc:504] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.727458 18932 raft_consensus.cc:2454] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:36.744197 18821 leader_election.cc:302] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.744524 19124 leader_election.cc:288] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.745405 19126 raft_consensus.cc:2781] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.745851 19126 raft_consensus.cc:686] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:36.746454 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:36.746687 19126 consensus_queue.cc:237] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.747247 18783 raft_consensus.cc:3037] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.751431 19054 ts_tablet_manager.cc:1428] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.075s	user 0.008s	sys 0.009s
I20260925 16:47:36.752422 19054 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.756502 18856 raft_consensus.cc:2454] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:36.757769 18896 leader_election.cc:302] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:36.758661 19122 raft_consensus.cc:2781] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.758718 19054 tablet_bootstrap.cc:654] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.764268 18679 catalog_manager.cc:5495] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:36.761919 19122 raft_consensus.cc:686] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:36.762032 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.766554 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:36.776269 18824 leader_election.cc:341] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:36.778384 18824 leader_election.cc:302] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:36.780236 19120 raft_consensus.cc:2726] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:36.787822 19052 tablet_bootstrap.cc:654] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.773492 19006 raft_consensus.cc:2454] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:36.777062 18932 raft_consensus.cc:2454] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:36.792238 19122 consensus_queue.cc:237] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.792752 18749 leader_election.cc:302] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:36.793663 19124 raft_consensus.cc:2781] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.794036 19124 raft_consensus.cc:482] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.794349 19124 raft_consensus.cc:3037] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.799608 19051 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.800282 19051 ts_tablet_manager.cc:1397] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.167s	user 0.018s	sys 0.000s
I20260925 16:47:36.802845 19051 raft_consensus.cc:348] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.803503 19051 raft_consensus.cc:374] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.803791 19051 raft_consensus.cc:729] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.806346 18680 catalog_manager.cc:5495] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:36.808746 18680 catalog_manager.cc:5495] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:36.813160 19222 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:36.813644 19222 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.808986 19124 raft_consensus.cc:504] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.798199 18783 raft_consensus.cc:2454] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:36.819521 19051 consensus_queue.cc:260] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.823212 19051 ts_tablet_manager.cc:1428] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.023s	user 0.004s	sys 0.000s
I20260925 16:47:36.824852 19051 tablet_bootstrap.cc:492] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.825423 19053 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:36.825843 19053 ts_tablet_manager.cc:1397] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.188s	user 0.015s	sys 0.002s
I20260925 16:47:36.827759 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:36.828513 19054 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.798302 19237 consensus_queue.cc:1035] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.040s
I20260925 16:47:36.833928 19222 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.833691 18932 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:36.837967 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:36.839054 19006 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:36.841112 19124 leader_election.cc:288] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.841729 19054 ts_tablet_manager.cc:1397] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.089s	user 0.014s	sys 0.000s
I20260925 16:47:36.843283 18746 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:36.843999 19130 consensus_queue.cc:1035] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:36.844234 19054 raft_consensus.cc:348] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.845008 19054 raft_consensus.cc:374] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.845278 19054 raft_consensus.cc:729] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.845896 19054 consensus_queue.cc:260] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.847286 19051 tablet_bootstrap.cc:654] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.847892 19054 ts_tablet_manager.cc:1428] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:47:36.848342 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:36.848814 19054 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.848942 19006 raft_consensus.cc:3037] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.849485 19222 raft_consensus.cc:2781] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:36.849891 19222 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:36.850222 19222 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.852226 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:36.854835 18932 raft_consensus.cc:3037] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.865013 18679 catalog_manager.cc:5495] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:36.864842 19006 raft_consensus.cc:2454] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:36.867638 18749 leader_election.cc:302] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:36.869190 19124 raft_consensus.cc:2781] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.872836 19124 raft_consensus.cc:686] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:36.877450 19052 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.878847 19052 ts_tablet_manager.cc:1397] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.138s	user 0.023s	sys 0.009s
I20260925 16:47:36.879196 19124 consensus_queue.cc:237] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.881491 19053 raft_consensus.cc:348] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.882529 19053 raft_consensus.cc:374] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.882824 19053 raft_consensus.cc:729] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.884486 19053 consensus_queue.cc:260] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.891515 19053 ts_tablet_manager.cc:1428] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.065s	user 0.006s	sys 0.001s
I20260925 16:47:36.894133 19053 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:36.895393 18932 raft_consensus.cc:2454] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:36.897733 19054 tablet_bootstrap.cc:654] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.887578 19222 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:36.900509 18970 consensus_peers.cc:487] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:36.901702 19222 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:36.903165 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:36.903898 19006 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.907621 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:36.908274 18932 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:36.911976 19052 raft_consensus.cc:348] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.912708 19052 raft_consensus.cc:374] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.912969 19052 raft_consensus.cc:729] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.913560 19052 consensus_queue.cc:260] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.924866 19052 ts_tablet_manager.cc:1428] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260925 16:47:36.924732 19006 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:36.931861 19054 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:36.932365 19054 ts_tablet_manager.cc:1397] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.084s	user 0.009s	sys 0.005s
I20260925 16:47:36.933043 19051 tablet_bootstrap.cc:492] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:36.932911 18749 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:36.933553 19051 ts_tablet_manager.cc:1397] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.109s	user 0.013s	sys 0.000s
I20260925 16:47:36.929673 18932 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:36.933799 19222 raft_consensus.cc:2781] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:36.936100 19222 raft_consensus.cc:686] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:36.936877 19222 consensus_queue.cc:237] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:36.929632 19053 tablet_bootstrap.cc:654] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.940426 19051 raft_consensus.cc:348] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.941421 19051 raft_consensus.cc:374] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.941753 19051 raft_consensus.cc:729] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.935050 19052 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:36.943379 19051 consensus_queue.cc:260] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:36.947259 19051 ts_tablet_manager.cc:1428] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260925 16:47:36.935664 19054 raft_consensus.cc:348] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.948633 19051 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:36.948668 19054 raft_consensus.cc:374] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.953833 19052 tablet_bootstrap.cc:654] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.959077 19051 tablet_bootstrap.cc:654] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.951828 19054 raft_consensus.cc:729] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.960280 19054 consensus_queue.cc:260] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:36.964100 19054 ts_tablet_manager.cc:1428] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.000s
I20260925 16:47:36.965004 19054 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:36.966321 19052 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:36.966902 19052 ts_tablet_manager.cc:1397] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.032s	user 0.010s	sys 0.004s
I20260925 16:47:36.969090 19052 raft_consensus.cc:348] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.969751 19052 raft_consensus.cc:374] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:36.970018 19052 raft_consensus.cc:729] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:36.970585 19054 tablet_bootstrap.cc:654] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.970638 19052 consensus_queue.cc:260] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:36.971508 18679 catalog_manager.cc:5495] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:36.973057 19052 ts_tablet_manager.cc:1428] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:47:36.974215 19052 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:36.979365 19052 tablet_bootstrap.cc:654] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:36.982913 19122 consensus_queue.cc:1035] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:36.992483 19122 consensus_queue.cc:1035] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.010113 19126 raft_consensus.cc:482] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.010564 19051 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:37.011267 19051 ts_tablet_manager.cc:1397] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.063s	user 0.017s	sys 0.011s
I20260925 16:47:37.010591 19126 raft_consensus.cc:504] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.013042 19126 leader_election.cc:288] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.013278 19052 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:37.013899 19052 ts_tablet_manager.cc:1397] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.018s
I20260925 16:47:37.014516 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.015033 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:37.015889 18822 leader_election.cc:341] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.015609 19051 raft_consensus.cc:348] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.016360 19051 raft_consensus.cc:374] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.016641 19051 raft_consensus.cc:729] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
W20260925 16:47:37.016700 18824 leader_election.cc:341] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.017185 18824 leader_election.cc:302] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.017318 19051 consensus_queue.cc:260] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.017978 19126 raft_consensus.cc:2726] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.019750 19051 ts_tablet_manager.cc:1428] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.004s
I20260925 16:47:37.019841 19052 raft_consensus.cc:348] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.020591 19052 raft_consensus.cc:374] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.020735 19051 tablet_bootstrap.cc:492] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:37.020843 19052 raft_consensus.cc:729] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.021759 19052 consensus_queue.cc:260] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.024107 19052 ts_tablet_manager.cc:1428] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.010s	user 0.002s	sys 0.004s
I20260925 16:47:37.024838 19053 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:37.024999 19052 tablet_bootstrap.cc:492] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:37.025331 19053 ts_tablet_manager.cc:1397] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.132s	user 0.019s	sys 0.009s
I20260925 16:47:37.027863 19051 tablet_bootstrap.cc:654] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.023219 18678 catalog_manager.cc:5495] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:37.030658 19052 tablet_bootstrap.cc:654] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.028228 19053 raft_consensus.cc:348] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.031145 19053 raft_consensus.cc:374] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.032522 19053 raft_consensus.cc:729] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.036042 19052 tablet_bootstrap.cc:492] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:37.038272 19052 ts_tablet_manager.cc:1397] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.013s	user 0.009s	sys 0.001s
I20260925 16:47:37.038427 19054 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:37.038913 19054 ts_tablet_manager.cc:1397] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.015s
I20260925 16:47:37.038139 19053 consensus_queue.cc:260] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.041410 19054 raft_consensus.cc:348] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.042068 19054 raft_consensus.cc:374] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.042306 19054 raft_consensus.cc:729] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.042871 19054 consensus_queue.cc:260] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.043483 19052 raft_consensus.cc:348] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.044198 19052 raft_consensus.cc:374] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.044454 19052 raft_consensus.cc:729] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.045122 19054 ts_tablet_manager.cc:1428] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260925 16:47:37.045104 19052 consensus_queue.cc:260] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.047395 19054 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:37.047602 19052 ts_tablet_manager.cc:1428] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260925 16:47:37.048542 19052 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:37.053386 19052 tablet_bootstrap.cc:654] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.058656 19051 tablet_bootstrap.cc:492] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:37.059140 19051 ts_tablet_manager.cc:1397] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.039s	user 0.013s	sys 0.003s
I20260925 16:47:37.061512 19051 raft_consensus.cc:348] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.062191 19051 raft_consensus.cc:374] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.062453 19051 raft_consensus.cc:729] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.064091 19054 tablet_bootstrap.cc:654] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.066746 19051 consensus_queue.cc:260] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.068862 19051 ts_tablet_manager.cc:1428] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.009s	user 0.002s	sys 0.003s
I20260925 16:47:37.072381 19051 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:37.076458 19053 ts_tablet_manager.cc:1428] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.051s	user 0.007s	sys 0.000s
I20260925 16:47:37.080389 19051 tablet_bootstrap.cc:654] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.081224 19053 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:37.086540 19054 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:37.087078 19054 ts_tablet_manager.cc:1397] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.040s	user 0.012s	sys 0.004s
I20260925 16:47:37.089704 19054 raft_consensus.cc:348] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.090363 19054 raft_consensus.cc:374] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.090626 19054 raft_consensus.cc:729] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.091358 19054 consensus_queue.cc:260] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.093540 19054 ts_tablet_manager.cc:1428] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.003s
I20260925 16:47:37.094496 19120 raft_consensus.cc:482] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.095031 19120 raft_consensus.cc:504] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.094597 19054 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:37.096935 19120 leader_election.cc:288] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:37.098354 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e068820a06364f1cb92b7b4701f9d8e2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:37.099031 18932 raft_consensus.cc:2454] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:37.100195 18821 leader_election.cc:302] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:37.101114 19120 raft_consensus.cc:2781] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.101516 19120 raft_consensus.cc:482] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.101893 19120 raft_consensus.cc:3037] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.102746 19053 tablet_bootstrap.cc:654] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.103813 19234 consensus_queue.cc:1035] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.104136 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e068820a06364f1cb92b7b4701f9d8e2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:37.105757 18824 leader_election.cc:341] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.111104 19120 raft_consensus.cc:504] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.114125 19052 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:37.113935 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e068820a06364f1cb92b7b4701f9d8e2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:37.114609 19052 ts_tablet_manager.cc:1397] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.066s	user 0.012s	sys 0.011s
I20260925 16:47:37.114692 18932 raft_consensus.cc:3037] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.117614 19052 raft_consensus.cc:348] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.118546 19052 raft_consensus.cc:374] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.118801 19052 raft_consensus.cc:729] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.119740 19051 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:37.120231 19051 ts_tablet_manager.cc:1397] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.003s
I20260925 16:47:37.122900 19051 raft_consensus.cc:348] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.123967 19053 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:37.124423 19053 ts_tablet_manager.cc:1397] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.000s
I20260925 16:47:37.127209 19053 raft_consensus.cc:348] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.127897 19053 raft_consensus.cc:374] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.128136 19053 raft_consensus.cc:729] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.128756 19053 consensus_queue.cc:260] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.131168 19053 ts_tablet_manager.cc:1428] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:47:37.132155 19053 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:37.133775 19054 tablet_bootstrap.cc:654] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.123541 19051 raft_consensus.cc:374] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.136494 19051 raft_consensus.cc:729] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.137318 19053 tablet_bootstrap.cc:654] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.137353 19051 consensus_queue.cc:260] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.119392 19052 consensus_queue.cc:260] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.141423 19052 ts_tablet_manager.cc:1428] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260925 16:47:37.142241 19052 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:37.146116 19051 ts_tablet_manager.cc:1428] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260925 16:47:37.147055 19051 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:37.147778 19052 tablet_bootstrap.cc:654] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.151758 19126 consensus_queue.cc:1035] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:47:37.155053 19051 tablet_bootstrap.cc:654] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.161096 19120 leader_election.cc:288] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:37.154419 18932 raft_consensus.cc:2454] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:37.162999 18821 leader_election.cc:302] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:37.167164 19054 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:37.167832 19054 ts_tablet_manager.cc:1397] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.073s	user 0.008s	sys 0.005s
I20260925 16:47:37.172992 19126 raft_consensus.cc:2781] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:37.173676 19126 raft_consensus.cc:686] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:37.174726 19126 consensus_queue.cc:237] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.175925 19177 consensus_queue.cc:1035] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.181785 19054 raft_consensus.cc:348] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.177435 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e068820a06364f1cb92b7b4701f9d8e2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:37.187549 19122 raft_consensus.cc:482] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.188154 19122 raft_consensus.cc:504] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:37.188684 18824 leader_election.cc:341] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.190045 19122 leader_election.cc:288] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.191836 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaf54561cd6d421890074238dbb8a57a" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.192508 18783 raft_consensus.cc:2454] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:37.194586 18896 leader_election.cc:302] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:37.196527 19067 raft_consensus.cc:2781] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.196974 19067 raft_consensus.cc:482] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.197297 19067 raft_consensus.cc:3037] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.182502 19054 raft_consensus.cc:374] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.200999 19054 raft_consensus.cc:729] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.203723 19054 consensus_queue.cc:260] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.196300 19177 consensus_queue.cc:1035] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.209136 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaf54561cd6d421890074238dbb8a57a" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:37.209805 18857 raft_consensus.cc:2454] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:37.214403 19054 ts_tablet_manager.cc:1428] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260925 16:47:37.219354 19054 tablet_bootstrap.cc:492] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:37.221314 19222 raft_consensus.cc:482] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.222003 19122 raft_consensus.cc:482] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.221807 19222 raft_consensus.cc:504] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.222638 19122 raft_consensus.cc:504] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.224053 19222 leader_election.cc:288] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.225234 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:37.225768 19122 leader_election.cc:288] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.225894 18857 raft_consensus.cc:2454] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:37.226058 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4267fb73e9d54bbbb335e2137af161b4" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:37.226702 19004 raft_consensus.cc:2454] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:37.227223 18747 leader_election.cc:302] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:37.227947 18898 leader_election.cc:302] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:37.229197 19222 raft_consensus.cc:2781] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.229568 19222 raft_consensus.cc:482] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.229882 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4267fb73e9d54bbbb335e2137af161b4" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.229882 19222 raft_consensus.cc:3037] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.231807 19120 consensus_queue.cc:1035] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.230603 18783 raft_consensus.cc:2454] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:37.240144 19053 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:37.240634 19053 ts_tablet_manager.cc:1397] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.109s	user 0.024s	sys 0.002s
I20260925 16:47:37.230031 19122 raft_consensus.cc:2781] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.241544 19122 raft_consensus.cc:482] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.241915 19122 raft_consensus.cc:3037] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.243289 19053 raft_consensus.cc:348] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.244043 19053 raft_consensus.cc:374] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.244307 19053 raft_consensus.cc:729] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.223651 19067 raft_consensus.cc:504] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.247661 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:37.248097 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaf54561cd6d421890074238dbb8a57a" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:37.248404 19005 raft_consensus.cc:2454] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:37.248704 18783 raft_consensus.cc:3037] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.249593 19130 raft_consensus.cc:482] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.250119 18930 raft_consensus.cc:3037] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.250025 19130 raft_consensus.cc:504] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.254278 19130 leader_election.cc:288] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.255968 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc7929e7dd84f6fba5909bdcab84721" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.256286 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc7929e7dd84f6fba5909bdcab84721" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:37.256916 18857 raft_consensus.cc:2454] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
W20260925 16:47:37.257416 18970 leader_election.cc:341] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.258282 18970 leader_election.cc:302] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.259806 19131 raft_consensus.cc:2781] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.260214 19131 raft_consensus.cc:482] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.260525 19131 raft_consensus.cc:3037] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.260771 19234 raft_consensus.cc:482] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.261236 19234 raft_consensus.cc:504] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.261200 19120 raft_consensus.cc:482] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.267381 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:37.268146 19131 raft_consensus.cc:504] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
W20260925 16:47:37.269205 18969 leader_election.cc:341] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.270696 19234 leader_election.cc:288] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.271078 19131 leader_election.cc:288] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.271512 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc7929e7dd84f6fba5909bdcab84721" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:37.272541 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bfc7929e7dd84f6fba5909bdcab84721" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
W20260925 16:47:37.272925 18970 leader_election.cc:341] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.273129 18857 raft_consensus.cc:3037] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.264816 19120 raft_consensus.cc:504] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.275506 19120 leader_election.cc:288] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.276048 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.276604 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b8d8271b4e4be4b59fc66ebd6a6938" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:37.277405 18970 leader_election.cc:341] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:37.277910 18822 leader_election.cc:341] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.277987 18970 leader_election.cc:302] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.280799 19131 raft_consensus.cc:2726] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.255900 18783 raft_consensus.cc:2454] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:37.282687 19051 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:37.245131 19053 consensus_queue.cc:260] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.259788 19067 leader_election.cc:288] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.281996 19224 raft_consensus.cc:482] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.281474 19177 consensus_queue.cc:1035] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260925 16:47:37.283457 18857 raft_consensus.cc:2454] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:37.289582 19052 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:37.288419 19222 raft_consensus.cc:504] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.302497 19051 ts_tablet_manager.cc:1397] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.156s	user 0.012s	sys 0.000s
I20260925 16:47:37.304184 19053 ts_tablet_manager.cc:1428] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.000s
I20260925 16:47:37.306520 19052 ts_tablet_manager.cc:1397] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.164s	user 0.037s	sys 0.050s
I20260925 16:47:37.308820 19053 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:37.304788 19224 raft_consensus.cc:504] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.312896 19052 raft_consensus.cc:348] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.314514 19052 raft_consensus.cc:374] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.314761 19052 raft_consensus.cc:729] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.315251 19052 consensus_queue.cc:260] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.323293 19052 ts_tablet_manager.cc:1428] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.003s
I20260925 16:47:37.324129 19052 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:37.325901 18970 leader_election.cc:302] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.330323 19131 raft_consensus.cc:2781] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:37.330821 19131 raft_consensus.cc:686] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:37.331741 19131 consensus_queue.cc:237] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.335098 19224 leader_election.cc:288] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.335987 19177 consensus_queue.cc:1035] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.336699 19222 leader_election.cc:288] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.314149 18896 leader_election.cc:302] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:37.337095 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b8d8271b4e4be4b59fc66ebd6a6938" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:37.338208 19224 raft_consensus.cc:2781] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:37.339922 19122 raft_consensus.cc:504] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.340766 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.342712 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4267fb73e9d54bbbb335e2137af161b4" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:37.343328 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4267fb73e9d54bbbb335e2137af161b4" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:37.343456 19005 raft_consensus.cc:3037] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.343961 18783 raft_consensus.cc:3037] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.346014 19122 leader_election.cc:288] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.346853 19054 tablet_bootstrap.cc:654] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.348132 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:37.342023 18679 catalog_manager.cc:5495] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:37.348749 19006 raft_consensus.cc:3037] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.343480 19051 raft_consensus.cc:348] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.388599 19051 raft_consensus.cc:374] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.388928 19051 raft_consensus.cc:729] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.391259 19053 tablet_bootstrap.cc:654] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:37.394351 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:37.394888 19005 raft_consensus.cc:2454] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:37.385723 19052 tablet_bootstrap.cc:654] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.395746 19051 consensus_queue.cc:260] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.397434 19006 raft_consensus.cc:2454] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:37.400966 19126 raft_consensus.cc:482] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.401183 18783 raft_consensus.cc:2454] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:37.406153 19126 raft_consensus.cc:504] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.406839 18898 leader_election.cc:302] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:37.408154 19126 leader_election.cc:288] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.408329 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eaf54561cd6d421890074238dbb8a57a" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:37.408954 18857 raft_consensus.cc:3037] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:47:37.409394 18824 leader_election.cc:341] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.409435 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:37.410028 18824 leader_election.cc:302] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.410789 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e0d07bb13a4413983a58ea3449cc0c" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.411893 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:37.412249 18782 raft_consensus.cc:2454] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:37.412408 19067 raft_consensus.cc:2781] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:37.412520 18858 raft_consensus.cc:3037] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.413009 19067 raft_consensus.cc:686] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:37.413441 18822 leader_election.cc:302] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
W20260925 16:47:37.414151 18896 leader_election.cc:341] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.414255 19275 raft_consensus.cc:2781] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.414697 19275 raft_consensus.cc:482] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.415071 19275 raft_consensus.cc:3037] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.405948 19224 raft_consensus.cc:686] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:37.416081 19224 consensus_queue.cc:237] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.415833 18679 catalog_manager.cc:5495] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:37.417377 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e0d07bb13a4413983a58ea3449cc0c" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:37.417992 19004 raft_consensus.cc:2454] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:37.411334 19126 raft_consensus.cc:2726] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.413846 19067 consensus_queue.cc:237] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.428498 19060 consensus_queue.cc:1035] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.431668 19126 raft_consensus.cc:482] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.436134 19051 ts_tablet_manager.cc:1428] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.130s	user 0.008s	sys 0.003s
I20260925 16:47:37.437037 19051 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:37.423117 19275 raft_consensus.cc:504] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.432192 19126 raft_consensus.cc:504] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.405119 19222 consensus_queue.cc:1035] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.037s
I20260925 16:47:37.456288 19274 raft_consensus.cc:482] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.456852 19274 raft_consensus.cc:504] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.458989 19274 leader_election.cc:288] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:37.459432 18858 raft_consensus.cc:2454] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:37.460157 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:37.461649 18821 leader_election.cc:341] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.448962 19122 consensus_queue.cc:1035] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.013s
I20260925 16:47:37.451036 18749 leader_election.cc:302] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:37.475355 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.476619 19124 raft_consensus.cc:2781] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
W20260925 16:47:37.476941 18822 leader_election.cc:341] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.477159 19124 raft_consensus.cc:686] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:37.477429 18822 leader_election.cc:302] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.478140 19124 consensus_queue.cc:237] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.479926 19120 raft_consensus.cc:2726] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.481868 19054 tablet_bootstrap.cc:492] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:37.482335 19054 ts_tablet_manager.cc:1397] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.264s	user 0.009s	sys 0.001s
I20260925 16:47:37.492830 18679 catalog_manager.cc:5495] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
W20260925 16:47:37.509248 19273 log.cc:924] Time spent T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260925 16:47:37.511538 19222 raft_consensus.cc:482] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.511906 19277 consensus_queue.cc:1035] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260925 16:47:37.512077 19222 raft_consensus.cc:504] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.513772 19060 consensus_queue.cc:1035] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.514055 19222 leader_election.cc:288] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:37.515242 19126 leader_election.cc:288] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:37.516130 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:37.516451 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:37.518680 18857 raft_consensus.cc:2454] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
W20260925 16:47:37.520576 18824 leader_election.cc:341] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.521136 18931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:37.522500 19054 raft_consensus.cc:348] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.523164 19054 raft_consensus.cc:374] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.523401 19054 raft_consensus.cc:729] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.524021 19054 consensus_queue.cc:260] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.526014 19054 ts_tablet_manager.cc:1428] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.043s	user 0.005s	sys 0.001s
I20260925 16:47:37.527009 19054 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
W20260925 16:47:37.530134 18821 leader_election.cc:341] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.530877 19053 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:37.547034 19053 ts_tablet_manager.cc:1397] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.240s	user 0.017s	sys 0.006s
I20260925 16:47:37.531534 19222 consensus_queue.cc:1035] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260925 16:47:37.531764 18896 leader_election.cc:341] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.560017 18821 leader_election.cc:302] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:37.583823 18896 leader_election.cc:302] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
W20260925 16:47:37.589972 18749 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.196:45765, user_credentials={real_user=slave}} blocked reactor thread for 76960.6us
I20260925 16:47:37.600030 19275 leader_election.cc:288] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.601764 19177 raft_consensus.cc:2726] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.607180 19277 raft_consensus.cc:2726] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.620087 18783 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e0d07bb13a4413983a58ea3449cc0c" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:37.620486 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19e0d07bb13a4413983a58ea3449cc0c" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:37.620810 18783 raft_consensus.cc:3037] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.621100 19005 raft_consensus.cc:3037] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.625095 19052 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:37.625569 19052 ts_tablet_manager.cc:1397] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.302s	user 0.012s	sys 0.024s
W20260925 16:47:37.608220 18821 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.195:33127, user_credentials={real_user=slave}} blocked reactor thread for 77285.8us
I20260925 16:47:37.610901 19274 raft_consensus.cc:482] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260925 16:47:37.611017 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:44819, user_credentials={real_user=slave}} blocked reactor thread for 79310.4us
I20260925 16:47:37.642792 19053 raft_consensus.cc:348] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.644214 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:37.644230 19283 log.cc:924] Time spent T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260925 16:47:37.649111 18782 raft_consensus.cc:3037] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.647429 19005 raft_consensus.cc:2454] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:37.643555 19053 raft_consensus.cc:374] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.661341 19053 raft_consensus.cc:729] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.661947 19053 consensus_queue.cc:260] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.635828 19052 raft_consensus.cc:348] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.634037 19274 raft_consensus.cc:504] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.666045 19053 ts_tablet_manager.cc:1428] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.119s	user 0.005s	sys 0.001s
I20260925 16:47:37.666057 19274 leader_election.cc:288] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:37.663604 19052 raft_consensus.cc:374] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.679411 19052 raft_consensus.cc:729] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.671376 19053 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:37.667971 18779 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c4fd5349684aa580c163b167f15aa0" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.672600 19054 tablet_bootstrap.cc:654] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.678207 19051 tablet_bootstrap.cc:654] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.687211 18779 raft_consensus.cc:2454] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:37.691128 18822 leader_election.cc:302] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:37.692323 19178 raft_consensus.cc:2781] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.692710 19178 raft_consensus.cc:482] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.693049 19178 raft_consensus.cc:3037] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.694200 18824 leader_election.cc:302] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:37.696028 19126 raft_consensus.cc:2781] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:37.696499 19126 raft_consensus.cc:686] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:37.688074 19052 consensus_queue.cc:260] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.697156 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c4fd5349684aa580c163b167f15aa0" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:37.706473 19052 ts_tablet_manager.cc:1428] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.000s
W20260925 16:47:37.710916 19288 log.cc:924] Time spent T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: Append to log took a long time: real 0.062s	user 0.003s	sys 0.000s
W20260925 16:47:37.716126 18821 leader_election.cc:341] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.717836 18749 leader_election.cc:302] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:37.697345 19126 consensus_queue.cc:237] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:37.724857 18783 raft_consensus.cc:2454] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:37.743439 19054 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:37.744530 19054 ts_tablet_manager.cc:1397] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.218s	user 0.016s	sys 0.011s
I20260925 16:47:37.738119 19178 raft_consensus.cc:504] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.750506 19051 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:37.751029 19051 ts_tablet_manager.cc:1397] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.314s	user 0.013s	sys 0.002s
I20260925 16:47:37.761231 19053 tablet_bootstrap.cc:654] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.754817 19054 raft_consensus.cc:348] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.762017 19054 raft_consensus.cc:374] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.762256 19054 raft_consensus.cc:729] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.763873 19054 consensus_queue.cc:260] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.770656 19052 tablet_bootstrap.cc:492] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:37.760347 19051 raft_consensus.cc:348] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.772502 19051 raft_consensus.cc:374] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.758145 19006 raft_consensus.cc:3037] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.773567 19051 raft_consensus.cc:729] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.780004 19178 leader_election.cc:288] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:37.780870 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c4fd5349684aa580c163b167f15aa0" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:37.782488 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39c4fd5349684aa580c163b167f15aa0" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:37.786690 19051 consensus_queue.cc:260] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.787318 18679 catalog_manager.cc:5495] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:37.795431 18781 raft_consensus.cc:3037] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.790938 18678 catalog_manager.cc:5495] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:37.807390 19054 ts_tablet_manager.cc:1428] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.000s
I20260925 16:47:37.809659 19051 ts_tablet_manager.cc:1428] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.058s	user 0.006s	sys 0.001s
I20260925 16:47:37.810624 19054 tablet_bootstrap.cc:492] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:37.811651 19051 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
W20260925 16:47:37.814250 18970 consensus_peers.cc:487] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:37.806330 19222 raft_consensus.cc:2726] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.825316 19224 consensus_queue.cc:1035] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.826603 18781 raft_consensus.cc:2454] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:37.837450 19052 tablet_bootstrap.cc:654] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:37.810369 18821 leader_election.cc:341] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.841715 18822 leader_election.cc:302] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:37.843729 19131 raft_consensus.cc:482] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.844230 19131 raft_consensus.cc:504] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.845705 19178 raft_consensus.cc:2781] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:37.846230 19178 raft_consensus.cc:686] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:37.846524 19131 leader_election.cc:288] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.848044 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df1e87cab2c64f9f870050016e4677f3" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:37.847024 19178 consensus_queue.cc:237] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.847899 19177 consensus_queue.cc:1035] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.855410 18928 raft_consensus.cc:2454] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:37.856374 19051 tablet_bootstrap.cc:654] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.856609 18969 leader_election.cc:302] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:37.864894 19131 raft_consensus.cc:2781] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:37.865316 19131 raft_consensus.cc:482] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:37.865630 19131 raft_consensus.cc:3037] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:37.905763 19053 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:37.906347 19053 ts_tablet_manager.cc:1397] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.235s	user 0.013s	sys 0.008s
I20260925 16:47:37.910904 19054 tablet_bootstrap.cc:654] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:37.911408 19053 raft_consensus.cc:348] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.913395 19284 consensus_queue.cc:1035] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.916975 19237 raft_consensus.cc:482] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.917073 19053 raft_consensus.cc:374] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:37.917634 19053 raft_consensus.cc:729] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:37.917570 19237 raft_consensus.cc:504] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:37.901383 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df1e87cab2c64f9f870050016e4677f3" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.926637 18679 catalog_manager.cc:5495] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:37.929406 19052 tablet_bootstrap.cc:492] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:37.930114 19052 ts_tablet_manager.cc:1397] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.160s	user 0.011s	sys 0.008s
I20260925 16:47:37.919023 19053 consensus_queue.cc:260] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:37.936812 19126 consensus_queue.cc:1035] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:37.957450 19237 leader_election.cc:288] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
W20260925 16:47:37.958748 18970 leader_election.cc:341] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.959756 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e068820a06364f1cb92b7b4701f9d8e2" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:37.963171 19131 raft_consensus.cc:504] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.965131 19131 leader_election.cc:288] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:37.966948 19284 raft_consensus.cc:482] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:37.967603 19284 raft_consensus.cc:504] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:37.968514 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df1e87cab2c64f9f870050016e4677f3" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:37.969848 19284 leader_election.cc:288] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
W20260925 16:47:37.969863 18970 leader_election.cc:341] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.971807 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:37.972746 19237 consensus_queue.cc:1035] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260925 16:47:37.973568 18896 leader_election.cc:341] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.975265 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:37.981293 18898 leader_election.cc:341] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:37.981724 18898 leader_election.cc:302] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:37.982589 19284 raft_consensus.cc:2726] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:37.984011 19222 consensus_queue.cc:1035] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.988621 19054 tablet_bootstrap.cc:492] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:37.989121 19054 ts_tablet_manager.cc:1397] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.179s	user 0.008s	sys 0.021s
I20260925 16:47:37.990165 19284 consensus_queue.cc:1035] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:37.986708 19053 ts_tablet_manager.cc:1428] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.080s	user 0.004s	sys 0.006s
I20260925 16:47:37.994903 19053 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.000450 19051 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:38.001029 19051 ts_tablet_manager.cc:1397] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.191s	user 0.017s	sys 0.047s
I20260925 16:47:37.994777 19284 consensus_queue.cc:1035] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20260925 16:47:38.012409 19054 raft_consensus.cc:348] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.013206 19054 raft_consensus.cc:374] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.013473 19054 raft_consensus.cc:729] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.014181 19054 consensus_queue.cc:260] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.016359 19054 ts_tablet_manager.cc:1428] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.027s	user 0.003s	sys 0.004s
I20260925 16:47:38.017251 19054 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.017402 19053 tablet_bootstrap.cc:654] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.024871 19054 tablet_bootstrap.cc:654] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.003988 19177 raft_consensus.cc:482] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.033769 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e068820a06364f1cb92b7b4701f9d8e2" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.034263 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df1e87cab2c64f9f870050016e4677f3" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.034871 19053 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.035363 19053 ts_tablet_manager.cc:1397] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.004s
I20260925 16:47:38.032539 19177 raft_consensus.cc:504] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.038003 19053 raft_consensus.cc:348] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.038932 19053 raft_consensus.cc:374] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.039218 19053 raft_consensus.cc:729] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.039835 19053 consensus_queue.cc:260] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.041188 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bc127e42794a80991754fc732a2f60" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.035221 19051 raft_consensus.cc:348] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.042896 19051 raft_consensus.cc:374] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.043256 19051 raft_consensus.cc:729] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.038511 19177 leader_election.cc:288] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.044042 19051 consensus_queue.cc:260] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.049582 19052 raft_consensus.cc:348] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.050478 19052 raft_consensus.cc:374] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.050747 19052 raft_consensus.cc:729] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.051993 19052 consensus_queue.cc:260] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.034914 18929 raft_consensus.cc:3037] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.058296 19053 ts_tablet_manager.cc:1428] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
I20260925 16:47:38.058794 19051 ts_tablet_manager.cc:1428] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.057s	user 0.008s	sys 0.000s
I20260925 16:47:38.059795 19053 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.061220 19052 ts_tablet_manager.cc:1428] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.131s	user 0.003s	sys 0.004s
I20260925 16:47:38.062291 19052 tablet_bootstrap.cc:492] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:38.063217 19051 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:38.068120 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bc127e42794a80991754fc732a2f60" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.068867 18781 raft_consensus.cc:2454] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:38.069710 18969 leader_election.cc:302] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:38.072012 19130 raft_consensus.cc:2726] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 16:47:38.079210 18821 leader_election.cc:341] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.086300 18822 leader_election.cc:302] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:38.091008 19178 raft_consensus.cc:2781] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.091436 19178 raft_consensus.cc:482] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.091806 19178 raft_consensus.cc:3037] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.091912 19305 consensus_queue.cc:1035] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:38.101452 18929 raft_consensus.cc:2454] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:38.108669 19052 tablet_bootstrap.cc:654] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.118360 18678 catalog_manager.cc:5495] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:38.121275 18969 leader_election.cc:302] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:38.123864 19131 raft_consensus.cc:2781] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.124351 19131 raft_consensus.cc:686] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:38.125133 19131 consensus_queue.cc:237] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.133731 19178 raft_consensus.cc:504] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.137517 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bc127e42794a80991754fc732a2f60" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:38.138126 18781 raft_consensus.cc:3037] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.144563 19051 tablet_bootstrap.cc:654] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.170012 19178 leader_election.cc:288] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.175518 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "22bc127e42794a80991754fc732a2f60" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.176947 19126 consensus_queue.cc:1035] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260925 16:47:38.180315 18821 leader_election.cc:341] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.193622 19054 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.194034 19054 ts_tablet_manager.cc:1397] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.177s	user 0.021s	sys 0.028s
I20260925 16:47:38.195879 19054 raft_consensus.cc:348] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.196542 19054 raft_consensus.cc:374] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.196784 19054 raft_consensus.cc:729] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.198187 19053 tablet_bootstrap.cc:654] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.197382 19054 consensus_queue.cc:260] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.205399 18781 raft_consensus.cc:2454] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:38.209942 18822 leader_election.cc:302] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:38.206200 19054 ts_tablet_manager.cc:1428] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260925 16:47:38.202697 18679 catalog_manager.cc:5495] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:38.213192 19054 tablet_bootstrap.cc:492] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.214808 19120 consensus_queue.cc:1035] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:38.215370 19052 tablet_bootstrap.cc:492] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:38.215867 19052 ts_tablet_manager.cc:1397] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.154s	user 0.019s	sys 0.005s
I20260925 16:47:38.219398 19120 raft_consensus.cc:2781] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.219882 19120 raft_consensus.cc:686] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:38.220679 19120 consensus_queue.cc:237] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.220340 19052 raft_consensus.cc:348] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.223913 19052 raft_consensus.cc:374] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.224215 19052 raft_consensus.cc:729] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.225358 19052 consensus_queue.cc:260] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.232846 19052 ts_tablet_manager.cc:1428] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260925 16:47:38.233755 19052 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:38.236599 19051 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:38.238198 19051 ts_tablet_manager.cc:1397] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.179s	user 0.014s	sys 0.007s
I20260925 16:47:38.251171 19053 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.251713 19053 ts_tablet_manager.cc:1397] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.192s	user 0.007s	sys 0.003s
I20260925 16:47:38.253854 19051 raft_consensus.cc:348] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.254752 19051 raft_consensus.cc:374] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.255048 19051 raft_consensus.cc:729] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.255517 19054 tablet_bootstrap.cc:654] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.256028 19051 consensus_queue.cc:260] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.256357 19178 consensus_queue.cc:1035] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:38.259429 19053 raft_consensus.cc:348] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.260143 19053 raft_consensus.cc:374] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.260426 19053 raft_consensus.cc:729] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.266942 18678 catalog_manager.cc:5495] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:38.272720 19054 tablet_bootstrap.cc:492] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.273227 19054 ts_tablet_manager.cc:1397] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.062s	user 0.013s	sys 0.001s
I20260925 16:47:38.275750 19054 raft_consensus.cc:348] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.276418 19054 raft_consensus.cc:374] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.276674 19054 raft_consensus.cc:729] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.277158 19053 consensus_queue.cc:260] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.277431 19054 consensus_queue.cc:260] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.284380 19054 ts_tablet_manager.cc:1428] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260925 16:47:38.285009 18929 raft_consensus.cc:3037] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.285302 19054 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.292958 19054 tablet_bootstrap.cc:654] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.294651 18780 raft_consensus.cc:3037] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.296911 19120 consensus_queue.cc:1035] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:38.305805 19131 raft_consensus.cc:482] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.306032 19054 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.306990 19054 ts_tablet_manager.cc:1397] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.022s	user 0.013s	sys 0.003s
I20260925 16:47:38.306578 19131 raft_consensus.cc:504] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.309600 19051 ts_tablet_manager.cc:1428] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.071s	user 0.007s	sys 0.000s
I20260925 16:47:38.309474 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.309688 19054 raft_consensus.cc:348] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.310425 19131 leader_election.cc:288] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:38.311569 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:38.313328 18970 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.314299 19052 tablet_bootstrap.cc:654] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:38.314920 18970 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.315364 18970 leader_election.cc:302] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:38.315619 19053 ts_tablet_manager.cc:1428] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.064s	user 0.005s	sys 0.000s
I20260925 16:47:38.316425 19130 raft_consensus.cc:2726] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.316582 19053 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.310436 19054 raft_consensus.cc:374] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.320290 19054 raft_consensus.cc:729] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.321009 19051 tablet_bootstrap.cc:492] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:38.320863 19054 consensus_queue.cc:260] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.330147 19054 ts_tablet_manager.cc:1428] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.001s
I20260925 16:47:38.331177 19054 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.336673 19054 tablet_bootstrap.cc:654] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.338153 19051 tablet_bootstrap.cc:654] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.327687 19052 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:38.340750 19052 ts_tablet_manager.cc:1397] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.107s	user 0.009s	sys 0.008s
I20260925 16:47:38.328080 19053 tablet_bootstrap.cc:654] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.343348 19052 raft_consensus.cc:348] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.344074 19052 raft_consensus.cc:374] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.344305 19052 raft_consensus.cc:729] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.344975 19052 consensus_queue.cc:260] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.347126 19052 ts_tablet_manager.cc:1428] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:47:38.354933 19054 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.355444 19054 ts_tablet_manager.cc:1397] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.005s
I20260925 16:47:38.356827 19052 tablet_bootstrap.cc:492] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:38.357767 19053 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.358256 19053 ts_tablet_manager.cc:1397] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.042s	user 0.012s	sys 0.000s
I20260925 16:47:38.358474 19054 raft_consensus.cc:348] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.359177 19054 raft_consensus.cc:374] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.359438 19054 raft_consensus.cc:729] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.360030 19054 consensus_queue.cc:260] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.360773 19053 raft_consensus.cc:348] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.361539 19053 raft_consensus.cc:374] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.361817 19053 raft_consensus.cc:729] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.362713 19054 ts_tablet_manager.cc:1428] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260925 16:47:38.362463 19053 consensus_queue.cc:260] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.364531 19054 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.364995 19053 ts_tablet_manager.cc:1428] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:47:38.366003 19053 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.370774 19054 tablet_bootstrap.cc:654] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.371338 19053 tablet_bootstrap.cc:654] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.375988 19052 tablet_bootstrap.cc:654] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.381728 19054 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.382368 19054 ts_tablet_manager.cc:1397] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.004s
I20260925 16:47:38.390865 19051 tablet_bootstrap.cc:492] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:38.391350 19051 ts_tablet_manager.cc:1397] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.071s	user 0.006s	sys 0.007s
I20260925 16:47:38.393694 19051 raft_consensus.cc:348] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.394366 19051 raft_consensus.cc:374] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.394604 19051 raft_consensus.cc:729] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.385624 19054 raft_consensus.cc:348] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.396989 19054 raft_consensus.cc:374] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.397238 19054 raft_consensus.cc:729] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.397874 19054 consensus_queue.cc:260] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.400020 19054 ts_tablet_manager.cc:1428] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260925 16:47:38.400910 19054 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.395154 19051 consensus_queue.cc:260] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.403287 19051 ts_tablet_manager.cc:1428] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260925 16:47:38.404774 19053 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.405323 19053 ts_tablet_manager.cc:1397] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.040s	user 0.022s	sys 0.013s
I20260925 16:47:38.406291 19054 tablet_bootstrap.cc:654] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.406769 19131 raft_consensus.cc:482] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.407240 19131 raft_consensus.cc:504] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.409155 19131 leader_election.cc:288] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.410642 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.411296 18929 raft_consensus.cc:2454] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.412528 19053 raft_consensus.cc:348] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.413069 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:38.413317 19053 raft_consensus.cc:374] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.413693 19053 raft_consensus.cc:729] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.413727 18857 raft_consensus.cc:2454] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.415206 19053 consensus_queue.cc:260] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.420814 18969 leader_election.cc:302] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:38.422195 19053 ts_tablet_manager.cc:1428] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260925 16:47:38.423458 19053 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.424630 19130 raft_consensus.cc:2781] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.425048 19130 raft_consensus.cc:482] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.425374 19130 raft_consensus.cc:3037] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.427856 19120 raft_consensus.cc:482] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.428390 19120 raft_consensus.cc:504] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.430625 19120 leader_election.cc:288] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.432369 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.437870 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.441643 19053 tablet_bootstrap.cc:654] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:38.443562 18822 leader_election.cc:341] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.444581 18929 raft_consensus.cc:2454] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:38.445874 18821 leader_election.cc:302] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:38.447399 19120 raft_consensus.cc:2781] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.447904 19120 raft_consensus.cc:482] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.448297 19120 raft_consensus.cc:3037] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.456532 19305 raft_consensus.cc:482] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.457229 19305 raft_consensus.cc:504] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.460359 19305 leader_election.cc:288] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:38.461126 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.462522 18929 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:38.464053 18746 leader_election.cc:302] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:38.464991 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.465550 19305 raft_consensus.cc:2781] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.465878 19004 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:38.466290 19305 raft_consensus.cc:482] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.466974 19305 raft_consensus.cc:3037] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.489791 19178 raft_consensus.cc:482] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.490721 19305 raft_consensus.cc:504] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.490322 19178 raft_consensus.cc:504] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.493108 19053 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.496562 19053 ts_tablet_manager.cc:1397] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.073s	user 0.025s	sys 0.021s
I20260925 16:47:38.498181 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.499258 19053 raft_consensus.cc:348] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.500048 19053 raft_consensus.cc:374] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.500329 19053 raft_consensus.cc:729] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
W20260925 16:47:38.500483 18821 leader_election.cc:341] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.499364 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.501067 19053 consensus_queue.cc:260] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.501856 18932 raft_consensus.cc:3037] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.503525 19305 leader_election.cc:288] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
W20260925 16:47:38.505321 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:38.507253 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:38.507915 19006 raft_consensus.cc:3037] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.501843 19178 leader_election.cc:288] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:38.517599 18932 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:38.502220 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:47:38.523568 18824 leader_election.cc:341] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.524080 18824 leader_election.cc:302] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:38.520310 19006 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:38.520851 19305 raft_consensus.cc:482] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.525864 19178 raft_consensus.cc:2726] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.526284 19305 raft_consensus.cc:504] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.526943 18749 leader_election.cc:302] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:38.527594 19051 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:38.527767 19301 raft_consensus.cc:2781] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.528275 19301 raft_consensus.cc:686] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:38.529021 19301 consensus_queue.cc:237] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.531603 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df1e87cab2c64f9f870050016e4677f3" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.522353 19053 ts_tablet_manager.cc:1428] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260925 16:47:38.525203 19130 raft_consensus.cc:504] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.556270 19053 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.558478 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:38.558923 19131 raft_consensus.cc:482] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.559168 18857 raft_consensus.cc:3037] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.559432 19131 raft_consensus.cc:504] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.561570 19131 leader_election.cc:288] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:38.529021 19305 leader_election.cc:288] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:38.532892 18929 raft_consensus.cc:2379] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:38.554600 19052 tablet_bootstrap.cc:492] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:38.565006 19052 ts_tablet_manager.cc:1397] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.208s	user 0.034s	sys 0.033s
I20260925 16:47:38.564743 19130 leader_election.cc:288] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.567318 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acdc1cf1c6854ba3a3f9819d8afccccc" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.568747 19052 raft_consensus.cc:348] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.569563 19052 raft_consensus.cc:374] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.569811 19052 raft_consensus.cc:729] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.570423 19052 consensus_queue.cc:260] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.570803 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acdc1cf1c6854ba3a3f9819d8afccccc" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.571722 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df1e87cab2c64f9f870050016e4677f3" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.573079 19053 tablet_bootstrap.cc:654] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.573076 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "dd5c1c958e2143a6972ab64a912fa7d5" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.574708 18929 raft_consensus.cc:3037] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.572275 19052 ts_tablet_manager.cc:1428] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260925 16:47:38.576568 19052 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:38.581598 19052 tablet_bootstrap.cc:654] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.583461 18749 leader_election.cc:302] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:38.584352 19305 raft_consensus.cc:3037] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.585992 19178 raft_consensus.cc:482] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.586615 19178 raft_consensus.cc:504] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.590373 19178 leader_election.cc:288] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
W20260925 16:47:38.573861 18969 leader_election.cc:341] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.591797 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:38.592335 18970 leader_election.cc:341] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:38.593127 18821 leader_election.cc:341] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.593214 18970 leader_election.cc:302] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:38.599159 19131 raft_consensus.cc:2726] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.604801 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.603148 19120 raft_consensus.cc:504] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.612203 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:38.613651 18822 leader_election.cc:341] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:38.616262 18824 leader_election.cc:341] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.616858 18824 leader_election.cc:302] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:38.617623 19275 raft_consensus.cc:2726] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.618629 18857 raft_consensus.cc:2454] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:38.619875 18970 leader_election.cc:302] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:38.621481 19131 raft_consensus.cc:2781] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.622596 19131 raft_consensus.cc:686] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
W20260925 16:47:38.626591 18821 consensus_peers.cc:487] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:38.628834 19051 tablet_bootstrap.cc:654] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.623461 19131 consensus_queue.cc:237] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.632449 19120 leader_election.cc:288] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.633216 18929 raft_consensus.cc:2454] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:38.633208 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.647091 19051 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:38.647369 18932 raft_consensus.cc:3037] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.647827 19051 ts_tablet_manager.cc:1397] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.120s	user 0.011s	sys 0.000s
I20260925 16:47:38.648018 19053 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.648507 19053 ts_tablet_manager.cc:1397] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.093s	user 0.013s	sys 0.030s
I20260925 16:47:38.633997 19305 raft_consensus.cc:2726] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.645574 19054 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.651503 19054 ts_tablet_manager.cc:1397] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.251s	user 0.057s	sys 0.115s
I20260925 16:47:38.653059 19052 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:38.651554 19051 raft_consensus.cc:348] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.653621 19051 raft_consensus.cc:374] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.653762 19052 ts_tablet_manager.cc:1397] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.077s	user 0.031s	sys 0.024s
I20260925 16:47:38.652508 19053 raft_consensus.cc:348] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.654124 19054 raft_consensus.cc:348] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.653925 19051 raft_consensus.cc:729] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.655071 19054 raft_consensus.cc:374] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.655503 19054 raft_consensus.cc:729] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.656239 19054 consensus_queue.cc:260] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.658344 19054 ts_tablet_manager.cc:1428] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260925 16:47:38.660130 18681 catalog_manager.cc:5495] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:38.655591 19051 consensus_queue.cc:260] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.674870 19053 raft_consensus.cc:374] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.675266 19053 raft_consensus.cc:729] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.674909 19305 raft_consensus.cc:482] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.675868 19131 raft_consensus.cc:482] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.675984 19305 raft_consensus.cc:504] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.676213 19053 consensus_queue.cc:260] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.664812 19052 raft_consensus.cc:348] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.677979 19305 leader_election.cc:288] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:38.678292 19052 raft_consensus.cc:374] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.678608 19052 raft_consensus.cc:729] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.676357 19131 raft_consensus.cc:504] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.679207 19052 consensus_queue.cc:260] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.681573 19052 ts_tablet_manager.cc:1428] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.027s	user 0.010s	sys 0.004s
I20260925 16:47:38.682646 19052 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:38.682739 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b8d8271b4e4be4b59fc66ebd6a6938" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:38.683394 18857 raft_consensus.cc:2454] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.684348 18970 leader_election.cc:302] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:38.685074 19131 leader_election.cc:288] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:38.686475 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:38.689466 18747 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.689837 19052 tablet_bootstrap.cc:654] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.693612 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.663627 18680 catalog_manager.cc:5495] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:38.694520 19004 raft_consensus.cc:2454] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:38.695896 18749 leader_election.cc:302] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:38.697430 19124 raft_consensus.cc:2781] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.697875 19124 raft_consensus.cc:482] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.698187 19124 raft_consensus.cc:3037] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.698966 19130 raft_consensus.cc:2781] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.699404 19131 consensus_queue.cc:1035] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:38.688473 19054 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.702841 19275 raft_consensus.cc:482] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.699520 19130 raft_consensus.cc:482] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.703415 19275 raft_consensus.cc:504] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.704241 19130 raft_consensus.cc:3037] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.714172 19131 raft_consensus.cc:482] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.714695 19131 raft_consensus.cc:504] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.705709 19275 leader_election.cc:288] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:38.716284 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.703135 19305 raft_consensus.cc:482] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.718003 19131 leader_election.cc:288] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:38.717800 19237 raft_consensus.cc:482] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.720173 19237 raft_consensus.cc:504] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.722357 19237 leader_election.cc:288] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.722939 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b8d8271b4e4be4b59fc66ebd6a6938" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.723716 18780 raft_consensus.cc:2454] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.723232 19054 tablet_bootstrap.cc:654] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.724371 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:38.725256 18857 raft_consensus.cc:2454] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.730412 18777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.731154 18970 leader_election.cc:302] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:38.732789 19313 consensus_queue.cc:1035] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:38.733147 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.733952 18928 raft_consensus.cc:2454] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.734323 19313 raft_consensus.cc:2781] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.734707 19313 raft_consensus.cc:482] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.735021 19313 raft_consensus.cc:3037] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.735325 18969 leader_election.cc:302] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:38.736171 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.737076 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:38.738991 18821 leader_election.cc:341] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.739131 19237 raft_consensus.cc:482] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.739362 19234 raft_consensus.cc:2781] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:38.739805 19234 raft_consensus.cc:482] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:38.740149 19234 raft_consensus.cc:3037] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.740646 19275 raft_consensus.cc:482] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:38.741123 19275 raft_consensus.cc:504] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.744031 19237 raft_consensus.cc:504] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.744596 18778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.718079 19305 raft_consensus.cc:504] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.746601 18777 raft_consensus.cc:2454] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:38.747298 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.751426 19305 leader_election.cc:288] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
W20260925 16:47:38.751971 18824 leader_election.cc:341] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:38.752673 18822 leader_election.cc:341] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.753113 18822 leader_election.cc:302] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:38.754021 19126 raft_consensus.cc:2726] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.755868 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:38.754089 19313 raft_consensus.cc:504] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.756392 18777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50eab07c6334fde8ca0537cf60c9928" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:38.756711 19275 leader_election.cc:288] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:38.757313 19004 raft_consensus.cc:2379] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95ce93f423f7436fa4863f1c688c9dc5 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:38.757891 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50eab07c6334fde8ca0537cf60c9928" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:38.759512 18970 leader_election.cc:341] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:38.760958 18970 leader_election.cc:341] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.761340 18970 leader_election.cc:302] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:38.762899 18824 leader_election.cc:302] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:38.763754 19131 raft_consensus.cc:2726] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.764932 19126 raft_consensus.cc:3037] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.766800 19124 raft_consensus.cc:504] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.665473 18932 raft_consensus.cc:2454] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:38.770167 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
W20260925 16:47:38.771481 18747 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.774125 19126 raft_consensus.cc:2726] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:38.772254 19234 raft_consensus.cc:504] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.776757 19006 raft_consensus.cc:2379] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:38.770823 19124 leader_election.cc:288] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:38.671176 19051 ts_tablet_manager.cc:1428] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.000s
I20260925 16:47:38.781098 19053 ts_tablet_manager.cc:1428] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.132s	user 0.009s	sys 0.000s
I20260925 16:47:38.781054 19051 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:38.784854 19053 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:38.791321 19051 tablet_bootstrap.cc:654] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.792662 19052 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:38.793818 19052 ts_tablet_manager.cc:1397] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.111s	user 0.028s	sys 0.023s
I20260925 16:47:38.779645 19237 leader_election.cc:288] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:38.796089 19053 tablet_bootstrap.cc:654] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.797421 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:38.802270 19004 raft_consensus.cc:3037] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.797487 18821 leader_election.cc:302] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:38.804577 19126 raft_consensus.cc:2781] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
W20260925 16:47:38.805011 18969 leader_election.cc:341] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.805167 19126 raft_consensus.cc:686] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:38.806385 19126 consensus_queue.cc:237] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.806869 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:38.807546 18932 raft_consensus.cc:2454] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:38.807843 18777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:38.808131 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f55e0c43cee44971a3a7483c91ead27b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.808439 18777 raft_consensus.cc:3037] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.808816 18928 raft_consensus.cc:3037] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.811146 19004 raft_consensus.cc:2454] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:38.815068 19130 raft_consensus.cc:504] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.816159 19052 raft_consensus.cc:348] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.817137 19052 raft_consensus.cc:374] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.817528 19052 raft_consensus.cc:729] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.828799 19052 consensus_queue.cc:260] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:38.830096 19054 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.830575 19054 ts_tablet_manager.cc:1397] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.142s	user 0.018s	sys 0.018s
I20260925 16:47:38.831631 19052 ts_tablet_manager.cc:1428] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.037s	user 0.002s	sys 0.004s
I20260925 16:47:38.797111 19234 leader_election.cc:288] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:38.832742 19052 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:38.836898 18749 leader_election.cc:302] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:38.839658 19305 raft_consensus.cc:2781] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.840164 19305 raft_consensus.cc:686] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:38.840960 19305 consensus_queue.cc:237] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.829300 18746 leader_election.cc:302] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:38.847232 19313 leader_election.cc:288] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:38.848943 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:38.850317 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:38.851235 18777 raft_consensus.cc:2454] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:38.851743 19060 raft_consensus.cc:2741] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260925 16:47:38.858861 19054 raft_consensus.cc:348] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.861256 19054 raft_consensus.cc:374] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.861841 19054 raft_consensus.cc:729] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.878722 18970 leader_election.cc:302] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
W20260925 16:47:38.864724 18969 leader_election.cc:341] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:38.868553 19054 consensus_queue.cc:260] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:38.883373 19352 raft_consensus.cc:2781] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.903122 19130 leader_election.cc:288] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:38.863646 19275 consensus_queue.cc:1035] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.035s
I20260925 16:47:38.911706 19054 ts_tablet_manager.cc:1428] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.004s
I20260925 16:47:38.906105 19352 raft_consensus.cc:686] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:38.915150 19054 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:38.915405 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b8d8271b4e4be4b59fc66ebd6a6938" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:38.915357 19352 consensus_queue.cc:237] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.916290 18857 raft_consensus.cc:3037] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.915603 18777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6b8d8271b4e4be4b59fc66ebd6a6938" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:38.920372 18777 raft_consensus.cc:3037] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:38.920672 18928 raft_consensus.cc:2454] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:38.920912 19054 tablet_bootstrap.cc:654] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.922077 19052 tablet_bootstrap.cc:654] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:38.942716 19051 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:38.942943 18858 raft_consensus.cc:2454] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:38.943195 19051 ts_tablet_manager.cc:1397] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.164s	user 0.018s	sys 0.039s
I20260925 16:47:38.945894 19053 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:38.946396 19053 ts_tablet_manager.cc:1397] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.162s	user 0.046s	sys 0.023s
I20260925 16:47:38.957682 18681 catalog_manager.cc:5495] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:38.962985 18970 leader_election.cc:302] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:38.977741 19131 raft_consensus.cc:2781] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:38.978255 19131 raft_consensus.cc:686] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:38.979024 19131 consensus_queue.cc:237] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:38.979836 19054 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:38.980760 19054 ts_tablet_manager.cc:1397] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.068s	user 0.017s	sys 0.000s
I20260925 16:47:38.990954 19051 raft_consensus.cc:348] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.991532 19051 raft_consensus.cc:374] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.991763 19051 raft_consensus.cc:729] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.992326 19051 consensus_queue.cc:260] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.996459 19053 raft_consensus.cc:348] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:38.997102 19053 raft_consensus.cc:374] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:38.997309 19053 raft_consensus.cc:729] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:38.997771 19053 consensus_queue.cc:260] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.003145 18857 raft_consensus.cc:2454] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:39.007863 19052 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:39.008315 19052 ts_tablet_manager.cc:1397] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.176s	user 0.020s	sys 0.016s
I20260925 16:47:39.010735 19052 raft_consensus.cc:348] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.011348 19052 raft_consensus.cc:374] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.012566 19051 ts_tablet_manager.cc:1428] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.069s	user 0.005s	sys 0.000s
I20260925 16:47:39.014453 19053 ts_tablet_manager.cc:1428] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.001s
I20260925 16:47:39.016971 18970 leader_election.cc:302] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:39.018189 19305 consensus_queue.cc:1035] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.020524 19234 raft_consensus.cc:2781] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:39.021003 19234 raft_consensus.cc:686] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:39.013435 19051 tablet_bootstrap.cc:492] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.015355 19053 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:39.011591 19052 raft_consensus.cc:729] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.021767 19234 consensus_queue.cc:237] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.028782 19052 consensus_queue.cc:260] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.049618 19054 raft_consensus.cc:348] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.050412 19054 raft_consensus.cc:374] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.050772 19054 raft_consensus.cc:729] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.051901 19054 consensus_queue.cc:260] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.059835 19370 raft_consensus.cc:482] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.060560 19370 raft_consensus.cc:504] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.085392 19054 ts_tablet_manager.cc:1428] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.104s	user 0.007s	sys 0.000s
I20260925 16:47:39.086529 19054 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:39.097400 19051 tablet_bootstrap.cc:654] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.099627 18681 catalog_manager.cc:5495] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:39.111270 18777 raft_consensus.cc:2454] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:39.113618 19224 raft_consensus.cc:482] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.114276 19224 raft_consensus.cc:504] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.130788 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:39.106149 19370 leader_election.cc:288] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:39.131531 18856 raft_consensus.cc:2454] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:39.134860 19224 leader_election.cc:288] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:39.152702 19054 tablet_bootstrap.cc:654] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.161748 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:39.185892 19053 tablet_bootstrap.cc:654] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.189239 19305 consensus_queue.cc:1035] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.191097 18681 catalog_manager.cc:5495] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:39.183357 19130 raft_consensus.cc:482] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.202055 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f37dab820e4459b45ad556ef1dcc09" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:39.202732 19006 raft_consensus.cc:2454] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:39.205096 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f37dab820e4459b45ad556ef1dcc09" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:39.205735 18898 leader_election.cc:302] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:39.206650 19224 raft_consensus.cc:2781] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:39.206983 19224 raft_consensus.cc:482] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:39.207293 19224 raft_consensus.cc:3037] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.208259 19352 consensus_queue.cc:1035] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.184902 18896 leader_election.cc:302] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:39.211352 19130 raft_consensus.cc:504] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.223052 19130 leader_election.cc:288] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:39.223636 19224 raft_consensus.cc:504] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.225013 19371 raft_consensus.cc:2781] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:39.225395 19371 raft_consensus.cc:482] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:39.225708 19371 raft_consensus.cc:3037] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.205735 18781 raft_consensus.cc:2454] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:39.226356 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f37dab820e4459b45ad556ef1dcc09" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:39.226953 19006 raft_consensus.cc:3037] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.230014 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "172d70ae40f44cbd8d1f59c037fb2e04" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:39.232229 18970 leader_election.cc:341] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.235687 19006 raft_consensus.cc:2454] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:39.238065 18898 leader_election.cc:302] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:39.238907 19370 raft_consensus.cc:2781] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:39.239344 19370 raft_consensus.cc:686] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:39.240154 19370 consensus_queue.cc:237] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:39.241214 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:44819, user_credentials={real_user=slave}} blocked reactor thread for 61359.7us
W20260925 16:47:39.242862 18896 leader_election.cc:341] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.238054 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "172d70ae40f44cbd8d1f59c037fb2e04" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:39.251816 18970 leader_election.cc:341] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.252310 18970 leader_election.cc:302] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:39.254482 19352 raft_consensus.cc:2726] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:39.256062 19224 leader_election.cc:288] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:39.257165 19372 raft_consensus.cc:482] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.257637 19372 raft_consensus.cc:504] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.260848 18778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:39.262545 18822 leader_election.cc:341] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.264601 19372 leader_election.cc:288] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:39.299199 19052 ts_tablet_manager.cc:1428] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.291s	user 0.054s	sys 0.061s
I20260925 16:47:39.300710 19052 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:39.266019 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80f37dab820e4459b45ad556ef1dcc09" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:39.264829 19371 raft_consensus.cc:504] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.298676 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:39.305325 19372 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.306203 18781 raft_consensus.cc:3037] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:47:39.316859 18822 consensus_peers.cc:487] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:39.317090 19053 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:39.322551 18678 catalog_manager.cc:5495] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
W20260925 16:47:39.327755 18747 consensus_peers.cc:487] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:39.330076 18678 catalog_manager.cc:5495] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:39.331034 19054 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:39.331574 19054 ts_tablet_manager.cc:1397] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.245s	user 0.012s	sys 0.007s
I20260925 16:47:39.334163 19054 raft_consensus.cc:348] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.334816 19054 raft_consensus.cc:374] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.335076 19054 raft_consensus.cc:729] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.329172 19053 ts_tablet_manager.cc:1397] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.314s	user 0.010s	sys 0.006s
I20260925 16:47:39.335670 19054 consensus_queue.cc:260] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.340920 19051 tablet_bootstrap.cc:492] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:39.341429 19051 ts_tablet_manager.cc:1397] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.328s	user 0.017s	sys 0.007s
I20260925 16:47:39.327205 19372 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:39.348799 18824 leader_election.cc:341] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.354357 19371 leader_election.cc:288] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:39.355436 18778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:39.356349 18824 leader_election.cc:302] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
W20260925 16:47:39.357321 18896 leader_election.cc:341] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.358541 19178 raft_consensus.cc:2726] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:39.359282 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:39.359906 18856 raft_consensus.cc:3037] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.361261 19234 raft_consensus.cc:482] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.361729 19234 raft_consensus.cc:504] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.362082 19051 raft_consensus.cc:348] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.362799 19051 raft_consensus.cc:374] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.363062 19051 raft_consensus.cc:729] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.363768 19051 consensus_queue.cc:260] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.364087 19234 leader_election.cc:288] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:39.365761 19372 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:39.366145 18781 raft_consensus.cc:2454] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:39.369412 19052 tablet_bootstrap.cc:654] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.372355 18778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:39.374948 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:39.378363 19053 raft_consensus.cc:348] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:39.380321 18970 leader_election.cc:341] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.387566 19053 raft_consensus.cc:374] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.387576 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:39.388111 19053 raft_consensus.cc:729] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.388796 19053 consensus_queue.cc:260] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:39.389024 18969 leader_election.cc:341] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.389009 18681 catalog_manager.cc:5495] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:39.390913 19053 ts_tablet_manager.cc:1428] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.055s	user 0.005s	sys 0.000s
I20260925 16:47:39.391352 18969 leader_election.cc:302] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:39.391794 19053 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:39.392606 19352 raft_consensus.cc:2726] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260925 16:47:39.392828 18821 leader_election.cc:341] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.380548 19054 ts_tablet_manager.cc:1428] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.049s	user 0.003s	sys 0.002s
I20260925 16:47:39.393616 19130 consensus_queue.cc:1035] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.394459 19054 tablet_bootstrap.cc:492] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:39.382771 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:39.397481 18822 leader_election.cc:341] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.397929 18822 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:39.399176 19178 raft_consensus.cc:2726] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:39.402709 19053 tablet_bootstrap.cc:654] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.383754 19051 ts_tablet_manager.cc:1428] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.042s	user 0.007s	sys 0.001s
I20260925 16:47:39.384243 19237 consensus_queue.cc:1035] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.406862 19051 tablet_bootstrap.cc:492] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.407548 19372 consensus_queue.cc:1035] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:39.376787 18856 raft_consensus.cc:2454] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:39.413210 18896 leader_election.cc:302] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:39.414292 19371 raft_consensus.cc:2781] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:39.415095 19371 raft_consensus.cc:686] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:39.415967 19371 consensus_queue.cc:237] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.417922 19124 raft_consensus.cc:482] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.418393 19124 raft_consensus.cc:504] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.422075 19124 leader_election.cc:288] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:39.431192 19054 tablet_bootstrap.cc:654] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.433666 19051 tablet_bootstrap.cc:654] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.436954 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:39.454741 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:39.457512 18747 leader_election.cc:302] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:39.481899 19052 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:39.482443 19052 ts_tablet_manager.cc:1397] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.182s	user 0.014s	sys 0.017s
I20260925 16:47:39.464579 19124 raft_consensus.cc:2726] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:39.484938 19052 raft_consensus.cc:348] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.485761 19052 raft_consensus.cc:374] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.486058 19052 raft_consensus.cc:729] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.486960 19052 consensus_queue.cc:260] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.493758 19052 ts_tablet_manager.cc:1428] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260925 16:47:39.494755 19052 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:39.494777 19124 consensus_queue.cc:1035] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260925 16:47:39.506613 19053 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:39.507133 19053 ts_tablet_manager.cc:1397] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.116s	user 0.014s	sys 0.017s
I20260925 16:47:39.522804 19234 consensus_queue.cc:1035] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.522586 19053 raft_consensus.cc:348] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.526129 19053 raft_consensus.cc:374] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.526535 19053 raft_consensus.cc:729] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.527359 19053 consensus_queue.cc:260] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.531111 18681 catalog_manager.cc:5495] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:39.537231 19053 ts_tablet_manager.cc:1428] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.003s
I20260925 16:47:39.540256 19052 tablet_bootstrap.cc:654] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.545848 19054 tablet_bootstrap.cc:492] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:39.549456 19051 tablet_bootstrap.cc:492] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:39.548197 19054 ts_tablet_manager.cc:1397] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.015s
I20260925 16:47:39.551039 19051 ts_tablet_manager.cc:1397] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.144s	user 0.025s	sys 0.010s
I20260925 16:47:39.553891 19051 raft_consensus.cc:348] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.554757 19051 raft_consensus.cc:374] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.555105 19051 raft_consensus.cc:729] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.555339 19054 raft_consensus.cc:348] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.556062 19054 raft_consensus.cc:374] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.556362 19054 raft_consensus.cc:729] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.555909 19051 consensus_queue.cc:260] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.556988 19054 consensus_queue.cc:260] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.558495 19051 ts_tablet_manager.cc:1428] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260925 16:47:39.559618 19051 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.562884 19370 raft_consensus.cc:482] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.567502 19370 raft_consensus.cc:504] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.570322 19370 leader_election.cc:288] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:39.570494 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:39.571170 18856 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:39.573361 18896 leader_election.cc:302] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:39.574085 19370 raft_consensus.cc:2781] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:39.574433 19370 raft_consensus.cc:482] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:39.574348 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:39.574858 19370 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.575053 19006 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:39.563133 19053 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:39.565112 19052 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:39.580356 19052 ts_tablet_manager.cc:1397] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.086s	user 0.006s	sys 0.005s
I20260925 16:47:39.565600 19051 tablet_bootstrap.cc:654] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.565982 19352 consensus_queue.cc:1035] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.566916 19054 ts_tablet_manager.cc:1428] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.016s	user 0.002s	sys 0.003s
I20260925 16:47:39.583031 19052 raft_consensus.cc:348] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.583833 19052 raft_consensus.cc:374] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.583729 19370 raft_consensus.cc:504] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.584311 19052 raft_consensus.cc:729] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.583936 19054 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:39.584934 19052 consensus_queue.cc:260] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.588198 19052 ts_tablet_manager.cc:1428] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260925 16:47:39.589028 19052 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:39.590834 19054 tablet_bootstrap.cc:654] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:39.591282 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:39.600366 19051 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:39.600944 19051 ts_tablet_manager.cc:1397] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.041s	user 0.006s	sys 0.004s
I20260925 16:47:39.607679 19352 consensus_queue.cc:1035] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.611577 19052 tablet_bootstrap.cc:654] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.616796 19054 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:39.617239 19054 ts_tablet_manager.cc:1397] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.033s	user 0.005s	sys 0.011s
I20260925 16:47:39.617445 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:39.618090 18857 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.620822 19053 tablet_bootstrap.cc:654] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.621490 19054 raft_consensus.cc:348] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.622282 19054 raft_consensus.cc:374] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.622538 19054 raft_consensus.cc:729] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.623196 19054 consensus_queue.cc:260] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.626559 18857 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:39.627785 18896 leader_election.cc:302] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:39.628614 19224 raft_consensus.cc:2781] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:39.629216 19051 raft_consensus.cc:348] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.629786 19224 raft_consensus.cc:686] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:39.630155 19051 raft_consensus.cc:374] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.630860 19224 consensus_queue.cc:237] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.632346 19054 ts_tablet_manager.cc:1428] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260925 16:47:39.633424 19371 consensus_queue.cc:1035] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.630539 19051 raft_consensus.cc:729] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.635458 19051 consensus_queue.cc:260] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.642283 19352 consensus_queue.cc:1035] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:39.648571 19370 leader_election.cc:288] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:39.650532 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:39.654307 19006 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.659101 19060 raft_consensus.cc:482] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.659636 19060 raft_consensus.cc:504] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.660245 19051 ts_tablet_manager.cc:1428] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.059s	user 0.008s	sys 0.001s
I20260925 16:47:39.661170 19051 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.664279 19060 leader_election.cc:288] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
W20260925 16:47:39.665762 18969 consensus_peers.cc:487] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:39.676267 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:39.677114 18781 raft_consensus.cc:3037] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.633443 19054 tablet_bootstrap.cc:492] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:39.683601 19051 tablet_bootstrap.cc:654] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.695391 18678 catalog_manager.cc:5495] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:39.701457 18858 raft_consensus.cc:3037] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.707904 19370 consensus_queue.cc:1035] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:39.718956 19054 tablet_bootstrap.cc:654] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.703907 19006 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:39.662108 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:39.724880 18857 raft_consensus.cc:2379] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 2214de1d38f74b668aa3139202318338 in this term.
I20260925 16:47:39.725965 18747 leader_election.cc:302] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:39.727109 19060 raft_consensus.cc:3037] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.731109 19051 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:39.731616 19051 ts_tablet_manager.cc:1397] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.003s
I20260925 16:47:39.737505 19060 raft_consensus.cc:2726] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:39.744095 19126 raft_consensus.cc:482] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.744622 19126 raft_consensus.cc:504] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.744765 19054 tablet_bootstrap.cc:492] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:39.746702 19126 leader_election.cc:288] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:39.747427 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "172d70ae40f44cbd8d1f59c037fb2e04" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:39.747874 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "172d70ae40f44cbd8d1f59c037fb2e04" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:39.748175 19006 raft_consensus.cc:2454] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:39.749300 18824 leader_election.cc:302] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
W20260925 16:47:39.749841 18822 leader_election.cc:341] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.750247 19126 raft_consensus.cc:2781] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:39.751823 19126 raft_consensus.cc:482] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:39.752169 19126 raft_consensus.cc:3037] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.756171 19054 ts_tablet_manager.cc:1397] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.123s	user 0.011s	sys 0.000s
I20260925 16:47:39.759135 19126 raft_consensus.cc:504] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.770891 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "172d70ae40f44cbd8d1f59c037fb2e04" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:39.771471 19006 raft_consensus.cc:3037] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.778777 19006 raft_consensus.cc:2454] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:39.782974 18824 leader_election.cc:302] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:39.783908 19373 raft_consensus.cc:2781] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:39.784396 19373 raft_consensus.cc:686] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:39.785228 19373 consensus_queue.cc:237] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.787468 19052 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:39.787977 19052 ts_tablet_manager.cc:1397] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.199s	user 0.013s	sys 0.054s
I20260925 16:47:39.788429 19126 leader_election.cc:288] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
W20260925 16:47:39.760939 19395 log.cc:924] Time spent T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260925 16:47:39.789448 18778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "172d70ae40f44cbd8d1f59c037fb2e04" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:39.766124 19051 raft_consensus.cc:348] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.790660 19051 raft_consensus.cc:374] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 16:47:39.791013 18822 leader_election.cc:341] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.791031 19051 raft_consensus.cc:729] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.792899 19051 consensus_queue.cc:260] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.795204 19051 ts_tablet_manager.cc:1428] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.063s	user 0.004s	sys 0.002s
I20260925 16:47:39.792923 19054 raft_consensus.cc:348] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.796423 19054 raft_consensus.cc:374] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.796736 19054 raft_consensus.cc:729] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.799762 19051 tablet_bootstrap.cc:492] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.806797 19051 tablet_bootstrap.cc:654] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.810930 19054 consensus_queue.cc:260] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.813246 19053 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:39.813738 19053 ts_tablet_manager.cc:1397] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.251s	user 0.015s	sys 0.040s
I20260925 16:47:39.816197 19053 raft_consensus.cc:348] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.816772 19051 tablet_bootstrap.cc:492] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:39.817827 19051 ts_tablet_manager.cc:1397] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260925 16:47:39.819394 19052 raft_consensus.cc:348] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.820116 19052 raft_consensus.cc:374] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.820354 19051 raft_consensus.cc:348] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.821668 19051 raft_consensus.cc:374] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.821938 19051 raft_consensus.cc:729] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.816857 19053 raft_consensus.cc:374] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.822597 19051 consensus_queue.cc:260] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.822966 19053 raft_consensus.cc:729] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.820391 19052 raft_consensus.cc:729] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.823725 19053 consensus_queue.cc:260] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.824275 19052 consensus_queue.cc:260] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.825750 19053 ts_tablet_manager.cc:1428] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260925 16:47:39.826246 19052 ts_tablet_manager.cc:1428] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.038s	user 0.005s	sys 0.000s
I20260925 16:47:39.826611 19053 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:39.827265 19052 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:39.838876 19051 ts_tablet_manager.cc:1428] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260925 16:47:39.839571 18932 raft_consensus.cc:3037] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.843428 19051 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.857401 19053 tablet_bootstrap.cc:654] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.857563 19352 raft_consensus.cc:482] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.858186 19052 tablet_bootstrap.cc:654] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.858003 19352 raft_consensus.cc:504] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.862162 19051 tablet_bootstrap.cc:654] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.863044 19352 leader_election.cc:288] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:39.864300 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:39.865202 18928 raft_consensus.cc:2454] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:39.841990 18681 catalog_manager.cc:5495] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:39.866601 18969 leader_election.cc:302] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:39.882381 19052 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:39.881597 19054 ts_tablet_manager.cc:1428] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.125s	user 0.008s	sys 0.000s
I20260925 16:47:39.884366 19352 raft_consensus.cc:2781] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:39.884759 19352 raft_consensus.cc:482] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:39.884869 19054 tablet_bootstrap.cc:492] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:39.885126 19352 raft_consensus.cc:3037] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.879900 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:39.887531 18970 leader_election.cc:341] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.889580 19052 ts_tablet_manager.cc:1397] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.062s	user 0.014s	sys 0.005s
I20260925 16:47:39.891433 19054 tablet_bootstrap.cc:654] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.892136 19052 raft_consensus.cc:348] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.892989 19052 raft_consensus.cc:374] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.893278 19052 raft_consensus.cc:729] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.893982 19052 consensus_queue.cc:260] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.896880 19052 ts_tablet_manager.cc:1428] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260925 16:47:39.898041 19052 tablet_bootstrap.cc:492] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:39.901000 19053 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:39.901520 19053 ts_tablet_manager.cc:1397] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.075s	user 0.012s	sys 0.016s
I20260925 16:47:39.905732 19053 raft_consensus.cc:348] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.906497 19053 raft_consensus.cc:374] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.906790 19053 raft_consensus.cc:729] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.907415 19053 consensus_queue.cc:260] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:39.915242 19352 raft_consensus.cc:504] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.917723 19053 ts_tablet_manager.cc:1428] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260925 16:47:39.918390 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:39.918700 19053 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:39.918951 19052 tablet_bootstrap.cc:654] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:39.919950 18970 leader_election.cc:341] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:39.922896 19051 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:39.923372 19051 ts_tablet_manager.cc:1397] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.080s	user 0.019s	sys 0.007s
I20260925 16:47:39.925689 19051 raft_consensus.cc:348] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.926360 19051 raft_consensus.cc:374] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.926602 19051 raft_consensus.cc:729] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.928905 19352 leader_election.cc:288] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:39.927130 19051 consensus_queue.cc:260] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:39.929116 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:39.929790 18928 raft_consensus.cc:3037] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:39.931051 19051 ts_tablet_manager.cc:1428] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:47:39.932040 19051 tablet_bootstrap.cc:492] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:39.941778 19053 tablet_bootstrap.cc:654] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.944137 19370 consensus_queue.cc:1035] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:39.944957 18928 raft_consensus.cc:2454] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:39.946647 18969 leader_election.cc:302] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:39.948154 19130 raft_consensus.cc:2781] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:39.948781 19130 raft_consensus.cc:686] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:39.949792 19130 consensus_queue.cc:237] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.952587 19054 tablet_bootstrap.cc:492] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:39.953084 19054 ts_tablet_manager.cc:1397] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.068s	user 0.010s	sys 0.001s
I20260925 16:47:39.956393 19054 raft_consensus.cc:348] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.957042 19054 raft_consensus.cc:374] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.957291 19054 raft_consensus.cc:729] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.958036 19054 consensus_queue.cc:260] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.958914 19051 tablet_bootstrap.cc:654] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.960309 19054 ts_tablet_manager.cc:1428] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260925 16:47:39.961241 19054 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:39.961583 19370 raft_consensus.cc:482] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.965022 19370 raft_consensus.cc:504] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.969069 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:39.969653 19053 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:39.970145 19053 ts_tablet_manager.cc:1397] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.052s	user 0.014s	sys 0.003s
I20260925 16:47:39.971194 19052 tablet_bootstrap.cc:492] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:39.971751 19052 ts_tablet_manager.cc:1397] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.074s	user 0.023s	sys 0.019s
I20260925 16:47:39.972114 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:39.973930 19053 raft_consensus.cc:348] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.974262 18898 leader_election.cc:302] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:39.974663 19053 raft_consensus.cc:374] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.974946 19053 raft_consensus.cc:729] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.975976 19352 raft_consensus.cc:482] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:39.976802 19224 raft_consensus.cc:2726] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:39.976603 19052 raft_consensus.cc:348] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.978196 19053 consensus_queue.cc:260] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.976609 19352 raft_consensus.cc:504] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:39.979415 19052 raft_consensus.cc:374] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:39.979775 19052 raft_consensus.cc:729] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:39.981021 19052 consensus_queue.cc:260] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:39.982599 19053 ts_tablet_manager.cc:1428] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260925 16:47:39.983117 19054 tablet_bootstrap.cc:654] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:39.984401 18681 catalog_manager.cc:5495] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:39.983508 19053 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:39.989982 19352 leader_election.cc:288] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:39.991051 19370 leader_election.cc:288] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:39.991859 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:39.992516 18782 raft_consensus.cc:2454] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:39.994562 18970 leader_election.cc:302] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:39.995791 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:39.996313 19130 raft_consensus.cc:2781] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:39.996665 18856 raft_consensus.cc:2454] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:39.996937 19130 raft_consensus.cc:482] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:39.997464 19130 raft_consensus.cc:3037] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.000267 19052 ts_tablet_manager.cc:1428] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.028s	user 0.006s	sys 0.000s
I20260925 16:47:40.001523 19052 tablet_bootstrap.cc:492] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:40.004266 19372 raft_consensus.cc:482] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.004878 19372 raft_consensus.cc:504] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.006335 19370 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.006973 19370 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.008013 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:40.008440 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:40.008776 18928 raft_consensus.cc:2379] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 95ce93f423f7436fa4863f1c688c9dc5 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:40.008965 19372 leader_election.cc:288] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:40.010721 18824 leader_election.cc:302] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:40.012187 19126 raft_consensus.cc:3037] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.013239 19052 tablet_bootstrap.cc:654] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.018869 19126 raft_consensus.cc:2726] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:40.019127 19054 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:40.019640 19054 ts_tablet_manager.cc:1397] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.012s
I20260925 16:47:40.022104 19052 tablet_bootstrap.cc:492] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:40.026685 19052 ts_tablet_manager.cc:1397] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.001s
I20260925 16:47:40.029541 19052 raft_consensus.cc:348] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.030329 19052 raft_consensus.cc:374] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.030678 19052 raft_consensus.cc:729] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.023924 19224 consensus_queue.cc:1035] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260925 16:47:40.023298 19054 raft_consensus.cc:348] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.031481 19052 consensus_queue.cc:260] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.032634 19053 tablet_bootstrap.cc:654] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.034559 19052 ts_tablet_manager.cc:1428] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260925 16:47:40.032277 19054 raft_consensus.cc:374] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.035598 19052 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:40.039248 19126 raft_consensus.cc:482] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.039748 19126 raft_consensus.cc:504] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.043267 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:40.035293 19054 raft_consensus.cc:729] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.044320 19054 consensus_queue.cc:260] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:40.045553 18822 leader_election.cc:341] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.047523 19126 leader_election.cc:288] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:40.047785 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:40.049223 18821 leader_election.cc:341] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.049400 19054 ts_tablet_manager.cc:1428] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260925 16:47:40.049404 19060 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.050455 19054 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:40.050122 19060 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.052663 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:40.052798 19060 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:40.053264 18857 raft_consensus.cc:2454] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:40.054399 18747 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:40.055438 19305 raft_consensus.cc:2781] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:40.055482 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:40.056020 19305 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:40.056257 18928 raft_consensus.cc:2454] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:40.056399 19305 raft_consensus.cc:3037] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.055461 18821 leader_election.cc:302] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:40.061481 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:40.063733 19126 raft_consensus.cc:2726] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:40.064061 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:40.066090 18858 raft_consensus.cc:2454] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:40.068696 19370 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:40.068616 18896 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:40.070593 19378 raft_consensus.cc:2781] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:40.068569 19054 tablet_bootstrap.cc:654] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.070963 19378 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:40.072024 19378 raft_consensus.cc:3037] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.073204 19224 consensus_queue.cc:1035] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:40.077732 19372 raft_consensus.cc:482] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.070915 19305 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.078184 19372 raft_consensus.cc:504] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.080173 19372 leader_election.cc:288] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:40.081156 18781 raft_consensus.cc:2379] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 4de55b75c594486d94ca1518de4b3e6f in this term.
I20260925 16:47:40.081732 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50eab07c6334fde8ca0537cf60c9928" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:40.081082 19224 consensus_queue.cc:1035] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:47:40.082321 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:40.083318 18857 raft_consensus.cc:3037] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.082450 18782 raft_consensus.cc:2454] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:40.082484 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50eab07c6334fde8ca0537cf60c9928" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:40.084702 18928 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:40.085057 19006 raft_consensus.cc:2454] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:40.086184 18822 leader_election.cc:302] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:40.086262 19130 raft_consensus.cc:504] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.086994 19052 tablet_bootstrap.cc:654] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.107663 19051 tablet_bootstrap.cc:492] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:40.094852 19305 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:40.112232 19051 ts_tablet_manager.cc:1397] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.180s	user 0.022s	sys 0.015s
I20260925 16:47:40.094372 19126 raft_consensus.cc:2781] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:40.117038 19126 raft_consensus.cc:482] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:40.119921 19126 raft_consensus.cc:3037] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.122370 19051 raft_consensus.cc:348] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.125762 19051 raft_consensus.cc:374] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.123046 19378 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.126745 19126 raft_consensus.cc:504] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.127924 19378 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:40.125223 19130 leader_election.cc:288] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:40.128656 19126 leader_election.cc:288] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:40.126183 19051 raft_consensus.cc:729] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.101625 18857 raft_consensus.cc:2454] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:40.199213 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50eab07c6334fde8ca0537cf60c9928" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:40.201170 18782 raft_consensus.cc:3037] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.203368 18747 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
W20260925 16:47:40.211687 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.193:36337, user_credentials={real_user=slave}} blocked reactor thread for 102882us
I20260925 16:47:40.214932 18928 raft_consensus.cc:2379] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 2214de1d38f74b668aa3139202318338 in this term.
I20260925 16:47:40.214921 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:40.223076 18931 raft_consensus.cc:3037] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.130110 19051 consensus_queue.cc:260] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.231289 18778 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:40.232363 18778 raft_consensus.cc:3037] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.234975 19054 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:40.243564 19053 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
W20260925 16:47:40.252467 18747 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.7.158.194:44819, user_credentials={real_user=slave}} blocked reactor thread for 49607.8us
W20260925 16:47:40.255245 18822 consensus_peers.cc:487] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:40.257400 18781 raft_consensus.cc:2379] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 4de55b75c594486d94ca1518de4b3e6f in this term.
I20260925 16:47:40.259151 19051 ts_tablet_manager.cc:1428] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.146s	user 0.001s	sys 0.007s
I20260925 16:47:40.253165 19054 ts_tablet_manager.cc:1397] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.203s	user 0.014s	sys 0.000s
I20260925 16:47:40.260998 19052 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:40.268362 18778 raft_consensus.cc:2454] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:40.269315 19130 raft_consensus.cc:482] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.269985 19130 raft_consensus.cc:504] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.273442 19374 raft_consensus.cc:482] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.274191 19374 raft_consensus.cc:504] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.267180 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a50eab07c6334fde8ca0537cf60c9928" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:40.280898 19003 raft_consensus.cc:3037] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.283353 19054 raft_consensus.cc:348] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.284358 19054 raft_consensus.cc:374] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.284562 19374 leader_election.cc:288] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:40.284698 19054 raft_consensus.cc:729] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.287271 19053 ts_tablet_manager.cc:1397] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.304s	user 0.013s	sys 0.010s
I20260925 16:47:40.288568 19124 raft_consensus.cc:2781] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:40.289207 19124 raft_consensus.cc:686] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:40.290606 19124 consensus_queue.cc:237] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.296525 19052 ts_tablet_manager.cc:1397] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.261s	user 0.017s	sys 0.000s
I20260925 16:47:40.303175 19051 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:40.302302 19054 consensus_queue.cc:260] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.306984 18970 leader_election.cc:302] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:40.307272 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:40.308027 19004 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:40.308313 19234 raft_consensus.cc:2781] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:40.308944 19234 raft_consensus.cc:686] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:40.310223 19234 consensus_queue.cc:237] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.312179 18898 leader_election.cc:302] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:40.313196 19224 raft_consensus.cc:2781] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:40.313623 19224 raft_consensus.cc:482] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:40.314111 19224 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.306587 19054 ts_tablet_manager.cc:1428] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.047s	user 0.009s	sys 0.000s
I20260925 16:47:40.366616 19054 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:40.345597 19053 raft_consensus.cc:348] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.368058 19053 raft_consensus.cc:374] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.368351 19053 raft_consensus.cc:729] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.369031 19053 consensus_queue.cc:260] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.372684 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:40.373435 18858 raft_consensus.cc:3037] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.377799 19053 ts_tablet_manager.cc:1428] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.000s
I20260925 16:47:40.352767 19052 raft_consensus.cc:348] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.396065 19052 raft_consensus.cc:374] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.396359 19052 raft_consensus.cc:729] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.396997 19052 consensus_queue.cc:260] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.398722 19052 ts_tablet_manager.cc:1428] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.000s
I20260925 16:47:40.405339 19130 leader_election.cc:288] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
W20260925 16:47:40.353348 18896 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:44819, user_credentials={real_user=slave}} blocked reactor thread for 136379us
I20260925 16:47:40.415149 19053 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:40.416965 18854 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:40.418044 18854 raft_consensus.cc:2379] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 4de55b75c594486d94ca1518de4b3e6f in this term.
I20260925 16:47:40.418416 19003 raft_consensus.cc:2454] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:40.420073 19434 consensus_queue.cc:1035] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:40.417762 19052 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
W20260925 16:47:40.444373 18970 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:36337, user_credentials={real_user=slave}} blocked reactor thread for 104945us
I20260925 16:47:40.415522 18782 raft_consensus.cc:2454] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:40.468900 19054 tablet_bootstrap.cc:654] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.469635 19433 raft_consensus.cc:482] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.470419 19433 raft_consensus.cc:504] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.490060 18822 leader_election.cc:302] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:40.496068 19126 raft_consensus.cc:2781] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:40.496601 19126 raft_consensus.cc:686] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:40.497582 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:40.497720 19126 consensus_queue.cc:237] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.498443 18857 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:40.466671 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaca9c07b0a4e0e8859c15c7f0e43d1" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:40.512755 19433 leader_election.cc:288] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:40.518874 19120 raft_consensus.cc:482] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.519528 19120 raft_consensus.cc:504] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.518903 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaca9c07b0a4e0e8859c15c7f0e43d1" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:40.529485 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acdc1cf1c6854ba3a3f9819d8afccccc" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:40.530402 19005 raft_consensus.cc:2454] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:40.530795 19352 raft_consensus.cc:482] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.531275 19352 raft_consensus.cc:504] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.538589 19352 leader_election.cc:288] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:40.538821 19052 tablet_bootstrap.cc:654] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
W20260925 16:47:40.541108 18970 leader_election.cc:341] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.543951 19436 consensus_queue.cc:1035] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:40.540299 18679 catalog_manager.cc:5495] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:40.545858 18898 leader_election.cc:302] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:40.547056 19370 raft_consensus.cc:2781] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:40.547457 19370 raft_consensus.cc:482] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:40.547812 19370 raft_consensus.cc:3037] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.547056 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:40.505175 18858 raft_consensus.cc:2454] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:40.568897 18856 raft_consensus.cc:2454] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:40.574857 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:40.555608 18969 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:33127, user_credentials={real_user=slave}} blocked reactor thread for 70078.8us
I20260925 16:47:40.578965 19120 leader_election.cc:288] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:40.581610 18970 leader_election.cc:302] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:40.582453 19352 raft_consensus.cc:2781] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:40.582837 19352 raft_consensus.cc:482] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:40.583166 19352 raft_consensus.cc:3037] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.599751 19370 raft_consensus.cc:504] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:40.601753 18970 leader_election.cc:341] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.615602 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acdc1cf1c6854ba3a3f9819d8afccccc" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:40.617322 19005 raft_consensus.cc:3037] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.656100 18681 catalog_manager.cc:5495] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:40.662246 19052 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:40.662829 19052 ts_tablet_manager.cc:1397] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.245s	user 0.017s	sys 0.002s
I20260925 16:47:40.664891 19005 raft_consensus.cc:2454] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:40.631963 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb250f028fa4a75a53db16d27a92efa" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:40.653602 19352 raft_consensus.cc:504] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.641846 19370 leader_election.cc:288] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
W20260925 16:47:40.688647 18821 leader_election.cc:341] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.692255 19052 raft_consensus.cc:348] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.692797 19052 raft_consensus.cc:374] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.693060 19052 raft_consensus.cc:729] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.694128 19052 consensus_queue.cc:260] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.675140 19224 raft_consensus.cc:504] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:40.701814 19052 ts_tablet_manager.cc:1428] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.039s	user 0.007s	sys 0.000s
I20260925 16:47:40.704222 19054 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:40.704636 19054 ts_tablet_manager.cc:1397] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.338s	user 0.026s	sys 0.031s
I20260925 16:47:40.707864 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acdc1cf1c6854ba3a3f9819d8afccccc" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:40.710642 18782 raft_consensus.cc:2454] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:40.711043 19053 tablet_bootstrap.cc:654] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.698503 18898 leader_election.cc:302] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:40.716400 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:40.718457 19051 tablet_bootstrap.cc:654] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.719050 19352 leader_election.cc:288] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:40.720089 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:40.720741 18858 raft_consensus.cc:3037] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.723224 19378 raft_consensus.cc:2781] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:40.723747 19378 raft_consensus.cc:686] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:40.724337 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:40.725148 19054 raft_consensus.cc:348] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.726718 19054 raft_consensus.cc:374] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260925 16:47:40.727552 18970 leader_election.cc:341] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.727895 19054 raft_consensus.cc:729] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.729346 19054 consensus_queue.cc:260] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.724936 19003 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.737248 19052 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5: Bootstrap starting.
I20260925 16:47:40.720711 19224 leader_election.cc:288] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:40.739513 19054 ts_tablet_manager.cc:1428] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.001s
I20260925 16:47:40.750052 19054 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
W20260925 16:47:40.752401 18969 leader_election.cc:341] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.753692 19004 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb250f028fa4a75a53db16d27a92efa" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:40.754046 18969 leader_election.cc:302] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:40.756016 18896 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:40.758633 19371 raft_consensus.cc:2726] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:47:40.764714 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:40.773288 18857 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:40.724587 19378 consensus_queue.cc:237] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:40.778391 19436 raft_consensus.cc:2726] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:40.784200 19178 raft_consensus.cc:482] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:40.784711 19178 raft_consensus.cc:504] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.788379 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fdff79a8c884e798cefb59b1884b37b" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:40.795372 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fdff79a8c884e798cefb59b1884b37b" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:40.787730 19178 leader_election.cc:288] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:40.809104 19054 tablet_bootstrap.cc:654] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.797255 18857 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:40.818161 18858 raft_consensus.cc:2454] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:40.826644 18970 leader_election.cc:302] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:40.827533 19352 raft_consensus.cc:2781] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:40.828058 19352 raft_consensus.cc:686] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:40.828851 19352 consensus_queue.cc:237] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.829457 19052 tablet_bootstrap.cc:654] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:40.821854 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "acdc1cf1c6854ba3a3f9819d8afccccc" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:40.831220 18781 raft_consensus.cc:3037] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:47:40.822393 18822 leader_election.cc:341] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:40.836473 18821 leader_election.cc:341] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.838215 19003 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:40.840987 19443 consensus_queue.cc:1035] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:40.842968 18896 leader_election.cc:302] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:40.846293 19370 raft_consensus.cc:2781] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:40.846911 19370 raft_consensus.cc:686] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:40.848060 19370 consensus_queue.cc:237] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
W20260925 16:47:40.851316 18824 leader_election.cc:341] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:40.851835 18824 leader_election.cc:302] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:40.852226 19131 consensus_queue.cc:1035] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:40.854311 19120 raft_consensus.cc:2726] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:40.854517 18821 leader_election.cc:302] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:40.856739 19126 raft_consensus.cc:2726] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:40.864519 19124 consensus_queue.cc:1035] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:40.881958 19054 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:40.882488 19054 ts_tablet_manager.cc:1397] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.133s	user 0.011s	sys 0.008s
I20260925 16:47:40.909278 19053 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:40.909888 19053 ts_tablet_manager.cc:1397] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.531s	user 0.016s	sys 0.020s
I20260925 16:47:40.915222 19051 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:40.915784 19051 ts_tablet_manager.cc:1397] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.613s	user 0.013s	sys 0.054s
I20260925 16:47:40.916844 18781 raft_consensus.cc:2454] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:40.922422 19054 raft_consensus.cc:348] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.923209 19054 raft_consensus.cc:374] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.924477 19052 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5: No bootstrap required, opened a new log
I20260925 16:47:40.924947 19052 ts_tablet_manager.cc:1397] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5: Time spent bootstrapping tablet: real 0.193s	user 0.010s	sys 0.033s
I20260925 16:47:40.930030 19352 consensus_queue.cc:1035] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:40.931452 19124 consensus_queue.cc:1035] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:40.923467 19054 raft_consensus.cc:729] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.934929 19054 consensus_queue.cc:260] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.918431 19051 raft_consensus.cc:348] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.942178 19051 raft_consensus.cc:374] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.942466 19051 raft_consensus.cc:729] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.940023 19053 raft_consensus.cc:348] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.943302 19053 raft_consensus.cc:374] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.943555 19053 raft_consensus.cc:729] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.950343 19051 consensus_queue.cc:260] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.957078 19053 consensus_queue.cc:260] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:40.975945 18680 catalog_manager.cc:5495] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:40.968331 19052 raft_consensus.cc:348] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.978511 19052 raft_consensus.cc:374] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:40.977289 19053 ts_tablet_manager.cc:1428] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.067s	user 0.005s	sys 0.002s
I20260925 16:47:40.978801 19052 raft_consensus.cc:729] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Initialized, Role: FOLLOWER
I20260925 16:47:40.979628 19053 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:40.979571 19052 consensus_queue.cc:260] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:40.980481 19051 ts_tablet_manager.cc:1428] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.063s	user 0.005s	sys 0.002s
I20260925 16:47:40.983143 19052 ts_tablet_manager.cc:1428] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5: Time spent starting tablet: real 0.058s	user 0.007s	sys 0.000s
I20260925 16:47:40.985461 19054 ts_tablet_manager.cc:1428] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.103s	user 0.007s	sys 0.000s
I20260925 16:47:40.985949 19051 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:41.000669 19054 tablet_bootstrap.cc:492] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4: Bootstrap starting.
I20260925 16:47:41.000684 19376 consensus_queue.cc:1035] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260925 16:47:41.011837 19053 tablet_bootstrap.cc:654] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.029137 19178 consensus_queue.cc:1035] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:41.057202 19051 tablet_bootstrap.cc:654] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.068024 19054 tablet_bootstrap.cc:654] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.081499 19126 raft_consensus.cc:482] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.082033 19126 raft_consensus.cc:504] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.085536 19126 leader_election.cc:288] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:41.085507 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:41.086319 19006 raft_consensus.cc:2454] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 0.
I20260925 16:47:41.086730 18782 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:41.088109 18822 leader_election.cc:341] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.091368 18824 leader_election.cc:302] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:41.092506 19126 raft_consensus.cc:2781] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:41.092813 19126 raft_consensus.cc:482] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:41.093106 19126 raft_consensus.cc:3037] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.108103 18681 catalog_manager.cc:5495] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:41.128773 19378 raft_consensus.cc:482] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.129256 19378 raft_consensus.cc:504] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.133780 19378 leader_election.cc:288] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:41.134550 19054 tablet_bootstrap.cc:492] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4: No bootstrap required, opened a new log
I20260925 16:47:41.137089 19054 ts_tablet_manager.cc:1397] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4: Time spent bootstrapping tablet: real 0.137s	user 0.010s	sys 0.006s
I20260925 16:47:41.136915 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fdff79a8c884e798cefb59b1884b37b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:41.136456 18681 catalog_manager.cc:5495] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:41.137918 19053 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.138461 19053 ts_tablet_manager.cc:1397] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.159s	user 0.047s	sys 0.033s
W20260925 16:47:41.140210 18896 leader_election.cc:341] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.140836 19053 raft_consensus.cc:348] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.141522 19053 raft_consensus.cc:374] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.141968 19053 raft_consensus.cc:729] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.142699 19053 consensus_queue.cc:260] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.143786 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fdff79a8c884e798cefb59b1884b37b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:41.136247 19051 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:41.145691 19051 ts_tablet_manager.cc:1397] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.164s	user 0.015s	sys 0.009s
I20260925 16:47:41.141124 19126 raft_consensus.cc:504] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.139680 19054 raft_consensus.cc:348] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:41.146804 19054 raft_consensus.cc:374] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.147121 19054 raft_consensus.cc:729] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.147295 19126 leader_election.cc:288] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:41.144768 18858 raft_consensus.cc:2454] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:41.145167 19053 ts_tablet_manager.cc:1428] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260925 16:47:41.148583 18896 leader_election.cc:302] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:41.148700 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:41.149109 19053 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.149469 19005 raft_consensus.cc:3037] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.149943 19378 raft_consensus.cc:2781] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:41.150315 19378 raft_consensus.cc:482] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:41.150638 19378 raft_consensus.cc:3037] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.152300 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:41.152084 19054 consensus_queue.cc:260] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
W20260925 16:47:41.154140 18822 leader_election.cc:341] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.159765 19053 tablet_bootstrap.cc:654] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.168557 18680 catalog_manager.cc:5495] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:41.189343 19054 ts_tablet_manager.cc:1428] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4: Time spent starting tablet: real 0.052s	user 0.007s	sys 0.001s
I20260925 16:47:41.188598 19051 raft_consensus.cc:348] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.190232 19051 raft_consensus.cc:374] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.190532 19051 raft_consensus.cc:729] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.190625 19234 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.191073 19234 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.204938 19234 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:41.207427 19376 raft_consensus.cc:482] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.207653 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:41.208027 19376 raft_consensus.cc:504] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:41.209213 18969 leader_election.cc:341] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.211948 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0fa06962e2429484873fcd69d3591d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:41.213253 18822 leader_election.cc:341] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.214810 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:41.215065 19376 leader_election.cc:288] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:41.163615 19005 raft_consensus.cc:2454] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
W20260925 16:47:41.216205 18970 leader_election.cc:341] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.200098 19051 consensus_queue.cc:260] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.216629 18970 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:41.216727 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0fa06962e2429484873fcd69d3591d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:41.218052 18821 leader_election.cc:341] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.218529 18821 leader_election.cc:302] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:41.219662 19376 raft_consensus.cc:2726] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:41.220284 19234 raft_consensus.cc:2726] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:41.199622 19053 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.223141 19053 ts_tablet_manager.cc:1397] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.074s	user 0.016s	sys 0.011s
I20260925 16:47:41.196367 19378 raft_consensus.cc:504] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.220177 18824 leader_election.cc:302] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:41.225275 19376 raft_consensus.cc:2781] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:41.226392 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fdff79a8c884e798cefb59b1884b37b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:41.227061 18781 raft_consensus.cc:3037] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.226388 19376 raft_consensus.cc:686] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:41.233922 19376 consensus_queue.cc:237] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.239110 19051 ts_tablet_manager.cc:1428] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.093s	user 0.005s	sys 0.000s
I20260925 16:47:41.239566 19370 consensus_queue.cc:1035] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:41.242185 19051 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:41.242427 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fdff79a8c884e798cefb59b1884b37b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:41.245303 19053 raft_consensus.cc:348] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.246021 19053 raft_consensus.cc:374] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.246308 19053 raft_consensus.cc:729] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
W20260925 16:47:41.199277 18729 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:47:41.249311 19053 consensus_queue.cc:260] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.250458 18858 raft_consensus.cc:3037] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.251561 19053 ts_tablet_manager.cc:1428] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.028s	user 0.001s	sys 0.003s
I20260925 16:47:41.252584 19053 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.256196 18781 raft_consensus.cc:2454] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:41.257519 18896 leader_election.cc:302] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:41.258630 19370 raft_consensus.cc:2781] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:41.259086 19370 raft_consensus.cc:686] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:41.259894 19370 consensus_queue.cc:237] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.240756 19378 leader_election.cc:288] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:41.268008 19234 consensus_queue.cc:1035] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:41.269019 19053 tablet_bootstrap.cc:654] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.277202 19051 tablet_bootstrap.cc:654] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.280648 19433 consensus_queue.cc:1035] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260925 16:47:41.293318 19374 raft_consensus.cc:482] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.293004 18680 catalog_manager.cc:5495] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:41.293773 19374 raft_consensus.cc:504] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.301213 19053 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.301707 19053 ts_tablet_manager.cc:1397] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.049s	user 0.008s	sys 0.003s
I20260925 16:47:41.304318 19053 raft_consensus.cc:348] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.304994 19053 raft_consensus.cc:374] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.305219 19053 raft_consensus.cc:729] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.305769 19053 consensus_queue.cc:260] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.308400 18858 raft_consensus.cc:2454] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:41.309514 19374 leader_election.cc:288] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:41.310144 19234 raft_consensus.cc:482] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.310701 19234 raft_consensus.cc:504] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.311120 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:41.312435 18896 leader_election.cc:341] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.312927 19234 leader_election.cc:288] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:41.314325 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:41.315732 18929 raft_consensus.cc:2454] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
I20260925 16:47:41.316855 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:41.317471 18969 leader_election.cc:302] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:41.320770 18781 raft_consensus.cc:3037] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:47:41.322530 18970 leader_election.cc:341] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.324374 19234 raft_consensus.cc:2781] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:41.324800 19234 raft_consensus.cc:482] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:41.325140 19234 raft_consensus.cc:3037] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.330549 19053 ts_tablet_manager.cc:1428] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260925 16:47:41.331663 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:41.337595 18680 catalog_manager.cc:5495] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:41.335407 19053 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.343124 19051 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:41.343716 19051 ts_tablet_manager.cc:1397] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.102s	user 0.014s	sys 0.001s
I20260925 16:47:41.349678 19370 consensus_queue.cc:1035] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:41.353564 19470 raft_consensus.cc:482] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.354115 19470 raft_consensus.cc:504] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.356153 19053 tablet_bootstrap.cc:654] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.356551 19470 leader_election.cc:288] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:41.362452 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:41.371204 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88a1af2c233844768c8ba7778f5a58ae" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:41.373068 18747 leader_election.cc:302] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:41.374101 19470 raft_consensus.cc:2726] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:41.375138 18782 raft_consensus.cc:3037] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.351430 19051 raft_consensus.cc:348] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.386749 19131 consensus_queue.cc:1035] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:41.388166 19234 raft_consensus.cc:504] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.389590 19003 raft_consensus.cc:2379] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2214de1d38f74b668aa3139202318338 in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:41.393271 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:41.394140 18930 raft_consensus.cc:3037] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.394563 19234 leader_election.cc:288] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:41.398329 18777 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:41.399222 18898 leader_election.cc:302] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
W20260925 16:47:41.407385 18970 leader_election.cc:341] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.410532 19374 consensus_queue.cc:1035] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:41.382707 19051 raft_consensus.cc:374] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.423497 19051 raft_consensus.cc:729] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.429947 19051 consensus_queue.cc:260] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.418838 18930 raft_consensus.cc:2454] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:41.467881 19433 raft_consensus.cc:2726] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:41.479076 18969 leader_election.cc:302] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:41.480916 19352 raft_consensus.cc:2781] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:41.481386 19352 raft_consensus.cc:686] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:41.482105 19352 consensus_queue.cc:237] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.510510 19051 ts_tablet_manager.cc:1428] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.167s	user 0.006s	sys 0.000s
I20260925 16:47:41.525449 19051 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:41.549512 19053 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.550031 19053 ts_tablet_manager.cc:1397] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.215s	user 0.024s	sys 0.023s
I20260925 16:47:41.552882 19053 raft_consensus.cc:348] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.553402 19053 raft_consensus.cc:374] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.553791 19053 raft_consensus.cc:729] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.554278 19053 consensus_queue.cc:260] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.557301 19051 tablet_bootstrap.cc:654] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.558385 19470 raft_consensus.cc:482] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.558877 19470 raft_consensus.cc:504] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.559451 19053 ts_tablet_manager.cc:1428] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260925 16:47:41.562955 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:41.563728 19053 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.564086 18929 raft_consensus.cc:2454] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:41.565176 19470 leader_election.cc:288] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:41.568493 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:41.570201 18857 raft_consensus.cc:2454] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:41.570530 19053 tablet_bootstrap.cc:654] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.572239 19470 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.573073 19470 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.573424 18680 catalog_manager.cc:5495] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:41.571805 18747 leader_election.cc:302] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:41.568828 19051 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:41.579162 19051 ts_tablet_manager.cc:1397] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.006s
I20260925 16:47:41.579753 19470 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:41.580412 19124 raft_consensus.cc:2781] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:41.581261 19124 raft_consensus.cc:482] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:41.581569 19124 raft_consensus.cc:3037] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.581701 19051 raft_consensus.cc:348] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.582455 19051 raft_consensus.cc:374] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.582717 19051 raft_consensus.cc:729] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.585326 19051 consensus_queue.cc:260] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.586794 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:41.587559 19005 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:41.590024 18749 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:41.591025 19430 raft_consensus.cc:2781] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:41.591378 19430 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:41.591691 19430 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.591965 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:41.600443 18932 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 0.
I20260925 16:47:41.605350 19124 raft_consensus.cc:504] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.608894 19430 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.610653 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:41.612879 18857 raft_consensus.cc:3037] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.612071 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:41.613808 18932 raft_consensus.cc:3037] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.620555 18932 raft_consensus.cc:2454] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:41.621940 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:41.622078 18746 leader_election.cc:302] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:41.611177 19124 leader_election.cc:288] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:41.622925 18930 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.623062 19305 raft_consensus.cc:2781] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:41.623571 19305 raft_consensus.cc:686] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:41.624161 19051 ts_tablet_manager.cc:1428] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.045s	user 0.002s	sys 0.004s
I20260925 16:47:41.624450 19305 consensus_queue.cc:237] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.625283 18857 raft_consensus.cc:2454] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:41.626334 19051 tablet_bootstrap.cc:492] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:41.624497 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:41.632220 19005 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.641999 19005 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:41.642748 18930 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 1.
I20260925 16:47:41.645550 18749 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:41.645869 19352 raft_consensus.cc:482] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.646375 19124 raft_consensus.cc:2781] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:41.646404 19352 raft_consensus.cc:504] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:41.647310 19124 raft_consensus.cc:686] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:41.623522 19430 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:41.649287 19124 consensus_queue.cc:237] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.649134 18680 catalog_manager.cc:5495] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:41.652980 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb250f028fa4a75a53db16d27a92efa" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
W20260925 16:47:41.655937 18822 consensus_peers.cc:487] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:41.659880 19352 leader_election.cc:288] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:41.659775 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb250f028fa4a75a53db16d27a92efa" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:41.660593 18858 raft_consensus.cc:2454] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 0.
W20260925 16:47:41.656028 18969 leader_election.cc:341] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:41.662727 18970 leader_election.cc:302] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 2214de1d38f74b668aa3139202318338
I20260925 16:47:41.663297 19051 tablet_bootstrap.cc:654] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.663622 19053 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.663861 19234 raft_consensus.cc:2781] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:41.664204 19053 ts_tablet_manager.cc:1397] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.101s	user 0.032s	sys 0.026s
I20260925 16:47:41.664350 19234 raft_consensus.cc:482] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:41.664800 19234 raft_consensus.cc:3037] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.667912 19053 raft_consensus.cc:348] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.668669 19053 raft_consensus.cc:374] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.668920 19053 raft_consensus.cc:729] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.669782 19053 consensus_queue.cc:260] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.672245 19053 ts_tablet_manager.cc:1428] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:47:41.674108 19053 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.675406 19051 tablet_bootstrap.cc:492] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:41.676095 19051 ts_tablet_manager.cc:1397] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.050s	user 0.009s	sys 0.004s
I20260925 16:47:41.675534 19234 raft_consensus.cc:504] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:41.678190 19234 leader_election.cc:288] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:41.678411 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb250f028fa4a75a53db16d27a92efa" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:41.679030 18858 raft_consensus.cc:3037] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.678745 19051 raft_consensus.cc:348] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:41.679426 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb250f028fa4a75a53db16d27a92efa" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:41.679507 19051 raft_consensus.cc:374] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.680094 19051 raft_consensus.cc:729] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.679442 18680 catalog_manager.cc:5495] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 0 to 1, leader changed from <none> to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 1 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:41.680768 19051 consensus_queue.cc:260] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:41.681695 18930 raft_consensus.cc:3037] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.683723 19051 ts_tablet_manager.cc:1428] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:47:41.684912 19051 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:41.688841 18930 raft_consensus.cc:2454] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:41.690413 19051 tablet_bootstrap.cc:654] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.690914 18858 raft_consensus.cc:2454] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:41.691927 18970 leader_election.cc:302] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:41.692672 19234 raft_consensus.cc:2781] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:41.693157 19234 raft_consensus.cc:686] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:41.693888 19234 consensus_queue.cc:237] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:41.699402 19053 tablet_bootstrap.cc:654] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.708875 19120 consensus_queue.cc:1035] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:41.710392 19053 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.710878 19053 ts_tablet_manager.cc:1397] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.002s
I20260925 16:47:41.713649 18678 catalog_manager.cc:5495] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 1 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:41.714387 19053 raft_consensus.cc:348] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.715952 19053 raft_consensus.cc:374] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.716279 19053 raft_consensus.cc:729] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.717000 19053 consensus_queue.cc:260] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.725226 19053 ts_tablet_manager.cc:1428] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260925 16:47:41.726195 19053 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.733238 19053 tablet_bootstrap.cc:654] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.733888 19051 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:41.734273 19051 ts_tablet_manager.cc:1397] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.050s	user 0.020s	sys 0.006s
I20260925 16:47:41.736351 19051 raft_consensus.cc:348] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.737031 19051 raft_consensus.cc:374] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.737269 19051 raft_consensus.cc:729] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.737887 19051 consensus_queue.cc:260] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.739306 19053 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.739790 19053 ts_tablet_manager.cc:1397] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.014s	user 0.007s	sys 0.003s
I20260925 16:47:41.742285 19053 raft_consensus.cc:348] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.742935 19053 raft_consensus.cc:374] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.743191 19053 raft_consensus.cc:729] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.743826 19053 consensus_queue.cc:260] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.745916 19053 ts_tablet_manager.cc:1428] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:47:41.747218 19053 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:41.750510 19051 ts_tablet_manager.cc:1428] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260925 16:47:41.751940 19051 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338: Bootstrap starting.
I20260925 16:47:41.752393 19053 tablet_bootstrap.cc:654] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.757606 19051 tablet_bootstrap.cc:654] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338: Neither blocks nor log segments found. Creating new log.
I20260925 16:47:41.832747 19433 consensus_queue.cc:1035] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:47:41.874945 19433 consensus_queue.cc:1035] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260925 16:47:41.884291 19430 raft_consensus.cc:482] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.884982 19430 raft_consensus.cc:504] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.888404 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:41.889021 19051 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338: No bootstrap required, opened a new log
I20260925 16:47:41.889173 18930 raft_consensus.cc:2379] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4de55b75c594486d94ca1518de4b3e6f in current term 1: Already voted for candidate 45f690dc20794b529fdeabff43202cf4 in this term.
I20260925 16:47:41.889508 19051 ts_tablet_manager.cc:1397] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338: Time spent bootstrapping tablet: real 0.138s	user 0.055s	sys 0.068s
I20260925 16:47:41.889731 19430 leader_election.cc:288] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:41.892081 19051 raft_consensus.cc:348] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.892800 19051 raft_consensus.cc:374] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.893049 19051 raft_consensus.cc:729] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.893623 19051 consensus_queue.cc:260] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:41.895277 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79157399a8fb41009d17ca277792780b" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:41.895927 19051 ts_tablet_manager.cc:1428] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260925 16:47:41.898968 18749 leader_election.cc:302] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:41.899681 19124 raft_consensus.cc:3037] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:41.906179 19053 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: No bootstrap required, opened a new log
I20260925 16:47:41.906806 19053 ts_tablet_manager.cc:1397] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.160s	user 0.020s	sys 0.036s
I20260925 16:47:41.909368 19053 raft_consensus.cc:348] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.910161 19053 raft_consensus.cc:374] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:47:41.910476 19053 raft_consensus.cc:729] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:41.913012 19053 consensus_queue.cc:260] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:41.916417 19053 ts_tablet_manager.cc:1428] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260925 16:47:41.913882 19124 raft_consensus.cc:2726] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:41.941044 19305 raft_consensus.cc:482] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:41.941486 19305 raft_consensus.cc:504] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:41.942953 19305 leader_election.cc:288] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:41.943755 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:41.944022 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:41.945330 18747 leader_election.cc:302] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:41.946000 19305 raft_consensus.cc:2726] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:47:42.017477 19352 consensus_queue.cc:1035] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.026675 19352 consensus_queue.cc:1035] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.045925 18780 raft_consensus.cc:3037] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.058580 19305 consensus_queue.cc:1035] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.071841 19305 consensus_queue.cc:1035] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.090189 19433 raft_consensus.cc:482] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:42.090660 19433 raft_consensus.cc:504] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:42.092612 19433 leader_election.cc:288] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:42.094586 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0fa06962e2429484873fcd69d3591d" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:42.095338 18856 raft_consensus.cc:2454] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:42.096594 18896 leader_election.cc:302] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:42.096668 19352 consensus_queue.cc:1035] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.094697 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0fa06962e2429484873fcd69d3591d" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:42.098601 18780 raft_consensus.cc:2454] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:42.099637 19370 raft_consensus.cc:2781] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:42.100069 19370 raft_consensus.cc:482] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:42.100374 19370 raft_consensus.cc:3037] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.109229 19370 raft_consensus.cc:504] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:42.111322 19370 leader_election.cc:288] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:42.112200 18780 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0fa06962e2429484873fcd69d3591d" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:42.112855 18780 raft_consensus.cc:3037] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.112938 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd0fa06962e2429484873fcd69d3591d" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:42.113612 18856 raft_consensus.cc:3037] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.119159 18780 raft_consensus.cc:2454] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:42.120362 18896 leader_election.cc:302] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:42.120457 18856 raft_consensus.cc:2454] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:42.121315 19505 raft_consensus.cc:2781] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:42.121824 19505 raft_consensus.cc:686] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:42.122617 19505 consensus_queue.cc:237] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:42.145838 19305 consensus_queue.cc:1035] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.155314 19352 consensus_queue.cc:1035] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.180521 18678 catalog_manager.cc:5495] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:42.187527 19305 consensus_queue.cc:1035] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.190757 19505 raft_consensus.cc:482] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:47:42.191222 19505 raft_consensus.cc:504] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:42.193153 19505 leader_election.cc:288] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:42.196465 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaca9c07b0a4e0e8859c15c7f0e43d1" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:42.197477 19003 raft_consensus.cc:2454] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:42.195637 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaca9c07b0a4e0e8859c15c7f0e43d1" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:42.198870 18781 raft_consensus.cc:2454] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 0.
I20260925 16:47:42.199115 18898 leader_election.cc:302] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:42.200626 19370 raft_consensus.cc:2781] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:47:42.201085 19370 raft_consensus.cc:482] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:47:42.201472 19370 raft_consensus.cc:3037] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.213502 19370 raft_consensus.cc:504] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:42.216830 19370 leader_election.cc:288] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:42.217648 18781 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaca9c07b0a4e0e8859c15c7f0e43d1" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:42.217779 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cfaca9c07b0a4e0e8859c15c7f0e43d1" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:42.218309 18781 raft_consensus.cc:3037] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.218386 19003 raft_consensus.cc:3037] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:47:42.224531 18781 raft_consensus.cc:2454] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:42.224834 19003 raft_consensus.cc:2454] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:42.225919 18898 leader_election.cc:302] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:42.226560 19370 raft_consensus.cc:2781] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:47:42.227108 19370 raft_consensus.cc:686] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:42.227909 19370 consensus_queue.cc:237] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:42.238189 18681 catalog_manager.cc:5495] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:42.523458 19370 consensus_queue.cc:1035] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.538676 19505 consensus_queue.cc:1035] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.635667 19370 consensus_queue.cc:1035] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:42.646282 19505 consensus_queue.cc:1035] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:47:43.055647  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
W20260925 16:47:43.067639 18822 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260925 16:47:43.085402 18822 consensus_peers.cc:487] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.089453 18970 consensus_peers.cc:487] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.092730 18970 consensus_peers.cc:487] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.099215 18896 consensus_peers.cc:487] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.103855 18896 consensus_peers.cc:487] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.106701 18896 consensus_peers.cc:487] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.107297 18970 consensus_peers.cc:487] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.107971 18970 consensus_peers.cc:487] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.108453 18970 consensus_peers.cc:487] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.109762 18970 consensus_peers.cc:487] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.120266 18822 consensus_peers.cc:487] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.120901 18970 consensus_peers.cc:487] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.126370 18896 consensus_peers.cc:487] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.132716 18896 consensus_peers.cc:487] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.132910 18822 consensus_peers.cc:487] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.133948  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:47:43.134768  7803 tablet_replica.cc:330] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.135798  7803 raft_consensus.cc:2229] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.136308  7803 raft_consensus.cc:2258] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.139890  7803 tablet_replica.cc:330] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.140722  7803 raft_consensus.cc:2229] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.141229  7803 raft_consensus.cc:2258] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.143114  7803 tablet_replica.cc:330] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.144217  7803 raft_consensus.cc:2229] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.144685  7803 raft_consensus.cc:2258] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.146947  7803 tablet_replica.cc:330] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.147651  7803 raft_consensus.cc:2229] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.148638  7803 raft_consensus.cc:2258] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.149049 18970 consensus_peers.cc:487] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.150707  7803 tablet_replica.cc:330] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.151321  7803 raft_consensus.cc:2229] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.151654  7803 raft_consensus.cc:2258] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.153707  7803 tablet_replica.cc:330] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.154294  7803 raft_consensus.cc:2229] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.154631  7803 raft_consensus.cc:2258] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.156904  7803 tablet_replica.cc:330] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.157454  7803 raft_consensus.cc:2229] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.157842  7803 raft_consensus.cc:2258] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.159637  7803 tablet_replica.cc:330] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.160245  7803 raft_consensus.cc:2229] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.160635  7803 raft_consensus.cc:2258] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.163139  7803 tablet_replica.cc:330] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.163931  7803 raft_consensus.cc:2229] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.164448  7803 raft_consensus.cc:2258] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.164535 18896 consensus_peers.cc:487] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.164959 18822 consensus_peers.cc:487] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.167057  7803 tablet_replica.cc:330] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.167902  7803 raft_consensus.cc:2229] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.168340  7803 raft_consensus.cc:2258] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.171167  7803 tablet_replica.cc:330] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.172124  7803 raft_consensus.cc:2229] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 16:47:43.172559 18896 consensus_peers.cc:487] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.172689  7803 raft_consensus.cc:2258] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.175242  7803 tablet_replica.cc:330] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.176012  7803 raft_consensus.cc:2229] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.176856  7803 raft_consensus.cc:2258] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.179394  7803 tablet_replica.cc:330] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.180159  7803 raft_consensus.cc:2229] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.181145  7803 raft_consensus.cc:2258] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.181085 18822 consensus_peers.cc:487] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.183514  7803 tablet_replica.cc:330] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.184352  7803 raft_consensus.cc:2229] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.184782  7803 raft_consensus.cc:2258] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.187064  7803 tablet_replica.cc:330] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.187638  7803 raft_consensus.cc:2229] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.188112  7803 raft_consensus.cc:2258] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.189704  7803 tablet_replica.cc:330] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.190179  7803 raft_consensus.cc:2229] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.191075  7803 raft_consensus.cc:2258] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.192889  7803 tablet_replica.cc:330] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.193475  7803 raft_consensus.cc:2229] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.193854  7803 raft_consensus.cc:2258] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.195766  7803 tablet_replica.cc:330] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.196424  7803 raft_consensus.cc:2229] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.197445  7803 raft_consensus.cc:2258] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.199960  7803 tablet_replica.cc:330] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.200639  7803 raft_consensus.cc:2229] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.201144  7803 raft_consensus.cc:2258] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.203634  7803 tablet_replica.cc:330] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.204398  7803 raft_consensus.cc:2229] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.204854  7803 raft_consensus.cc:2258] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.207226  7803 tablet_replica.cc:330] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.207948  7803 raft_consensus.cc:2229] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.208428  7803 raft_consensus.cc:2258] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.211007  7803 tablet_replica.cc:330] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.211678  7803 raft_consensus.cc:2229] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.212157  7803 raft_consensus.cc:2258] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.214598  7803 tablet_replica.cc:330] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.215339  7803 raft_consensus.cc:2229] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.216591  7803 raft_consensus.cc:2258] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.217065 18970 consensus_peers.cc:487] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.218922  7803 tablet_replica.cc:330] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.219733  7803 raft_consensus.cc:2229] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.220165  7803 raft_consensus.cc:2258] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.222671  7803 tablet_replica.cc:330] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.223345  7803 raft_consensus.cc:2229] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.223867  7803 raft_consensus.cc:2258] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.226204  7803 tablet_replica.cc:330] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.226866  7803 raft_consensus.cc:2229] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.227325  7803 raft_consensus.cc:2258] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.228474 18970 consensus_peers.cc:487] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.229583  7803 tablet_replica.cc:330] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.230142  7803 raft_consensus.cc:2229] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.230551  7803 raft_consensus.cc:2258] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.232455  7803 tablet_replica.cc:330] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.232967  7803 raft_consensus.cc:2229] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.233803  7803 raft_consensus.cc:2258] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.236184  7803 tablet_replica.cc:330] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.236680  7803 raft_consensus.cc:2229] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.237066  7803 raft_consensus.cc:2258] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.238897  7803 tablet_replica.cc:330] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.239449  7803 raft_consensus.cc:2229] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.240224  7803 raft_consensus.cc:2258] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.242152  7803 tablet_replica.cc:330] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.242687  7803 raft_consensus.cc:2229] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.243090  7803 raft_consensus.cc:2258] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.245121  7803 tablet_replica.cc:330] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.245667  7803 raft_consensus.cc:2229] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.246269  7803 raft_consensus.cc:2258] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.248294  7803 tablet_replica.cc:330] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.248797  7803 raft_consensus.cc:2229] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.249213  7803 raft_consensus.cc:2258] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.251279  7803 tablet_replica.cc:330] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.251966  7803 raft_consensus.cc:2229] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.252513  7803 raft_consensus.cc:2258] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.255111  7803 tablet_replica.cc:330] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.255965  7803 raft_consensus.cc:2229] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.256407  7803 raft_consensus.cc:2258] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.258301  7803 tablet_replica.cc:330] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.258826  7803 raft_consensus.cc:2229] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.259202  7803 raft_consensus.cc:2258] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.261181  7803 tablet_replica.cc:330] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.261734  7803 raft_consensus.cc:2229] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.262120  7803 raft_consensus.cc:2258] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.264552  7803 tablet_replica.cc:330] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.265110  7803 raft_consensus.cc:2229] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.265558  7803 raft_consensus.cc:2258] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.267889  7803 tablet_replica.cc:330] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.268499  7803 raft_consensus.cc:2229] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.268976  7803 raft_consensus.cc:2258] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.271677  7803 tablet_replica.cc:330] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.272540  7803 raft_consensus.cc:2229] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.273509  7803 raft_consensus.cc:2258] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.274891 18822 consensus_peers.cc:487] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.276041  7803 tablet_replica.cc:330] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.276882  7803 raft_consensus.cc:2229] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.277410  7803 raft_consensus.cc:2258] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.279995  7803 tablet_replica.cc:330] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.280511  7803 raft_consensus.cc:2229] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:47:43.281385  7803 raft_consensus.cc:2258] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:47:43.283887  7803 tablet_replica.cc:330] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.284590  7803 raft_consensus.cc:2229] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.285123  7803 raft_consensus.cc:2258] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.287518 18822 consensus_peers.cc:487] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.288072  7803 tablet_replica.cc:330] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.288708  7803 raft_consensus.cc:2229] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.289311  7803 raft_consensus.cc:2258] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.291838 18896 consensus_peers.cc:487] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.293130  7803 tablet_replica.cc:330] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: stopping tablet replica
I20260925 16:47:43.293678  7803 raft_consensus.cc:2229] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:47:43.294195  7803 raft_consensus.cc:2258] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:47:43.300043 18896 consensus_peers.cc:487] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.310668 18896 consensus_peers.cc:487] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.345650 18970 consensus_peers.cc:487] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.378774 18970 consensus_peers.cc:487] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.380446  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
W20260925 16:47:43.384254 18822 consensus_peers.cc:487] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.424468 18822 consensus_peers.cc:487] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.446065  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:47:43.449930 18896 consensus_peers.cc:487] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.456912 19523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:43.458988 19524 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:47:43.459770 18896 consensus_peers.cc:487] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.460492 19526 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:47:43.464217  7803 server_base.cc:1034] running on GCE node
I20260925 16:47:43.467541  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:47:43.467870  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:47:43.468070  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354863468054 us; error 0 us; skew 500 ppm
I20260925 16:47:43.468807  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20260925 16:47:43.480986 18970 consensus_peers.cc:487] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:43.486254 18970 consensus_peers.cc:487] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.492995  7803 webserver.cc:460] Webserver started at http://127.7.158.193:34921/ using document root <none> and password file <none>
I20260925 16:47:43.493820  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:47:43.494062  7803 fs_manager.cc:362] Using existing metadata directory in first data directory
W20260925 16:47:43.499589 18896 consensus_peers.cc:487] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:43.505069  7803 fs_manager.cc:709] Time spent opening directory manager: real 0.010s	user 0.010s	sys 0.001s
I20260925 16:47:43.513120 19532 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:47:43.513854  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.004s	sys 0.001s
I20260925 16:47:43.514178  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "4de55b75c594486d94ca1518de4b3e6f"
format_stamp: "Formatted at 2026-09-25 16:47:32 on dist-test-slave-fknp"
I20260925 16:47:43.514604  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:47:43.534816  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:47:43.536536  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:47:43.540185  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:47:43.549887 19539 ts_tablet_manager.cc:542] Loading tablet metadata (0/45 complete)
I20260925 16:47:43.850505  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260925 16:47:43.850819  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.304s	user 0.007s	sys 0.001s
I20260925 16:47:43.851137  7803 ts_tablet_manager.cc:594] Registering tablets (0/45 complete)
I20260925 16:47:43.857858 19539 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:43.872282 19539 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:43.873184 19539 tablet_bootstrap.cc:492] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:43.873755 19539 ts_tablet_manager.cc:1397] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.016s	user 0.010s	sys 0.004s
I20260925 16:47:43.876075 19539 raft_consensus.cc:348] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:43.876746 19539 raft_consensus.cc:729] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:43.877534 19539 consensus_queue.cc:260] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:43.880478 19539 ts_tablet_manager.cc:1428] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260925 16:47:43.881225 19539 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:43.896204 19539 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:43.897096 19539 tablet_bootstrap.cc:492] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:43.897687 19539 ts_tablet_manager.cc:1397] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.004s
I20260925 16:47:43.899863 19539 raft_consensus.cc:348] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:43.900506 19539 raft_consensus.cc:729] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:43.901085 19539 consensus_queue.cc:260] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:43.902781 19539 ts_tablet_manager.cc:1428] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260925 16:47:43.903468 19539 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:43.916885 19539 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:43.917748 19539 tablet_bootstrap.cc:492] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:43.918339 19539 ts_tablet_manager.cc:1397] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260925 16:47:43.920517 19539 raft_consensus.cc:348] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:43.921164 19539 raft_consensus.cc:729] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:43.921726 19539 consensus_queue.cc:260] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:43.923437 19539 ts_tablet_manager.cc:1428] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260925 16:47:43.924183 19539 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:43.939298 19539 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:43.940238 19539 tablet_bootstrap.cc:492] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:43.940830 19539 ts_tablet_manager.cc:1397] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260925 16:47:43.943112 19539 raft_consensus.cc:348] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:43.943804 19539 raft_consensus.cc:729] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:43.944401 19539 consensus_queue.cc:260] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:43.946300 19539 ts_tablet_manager.cc:1428] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260925 16:47:43.946990 19539 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:43.961819 19539 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:43.962805 19539 tablet_bootstrap.cc:492] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:43.963400 19539 ts_tablet_manager.cc:1397] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.017s	user 0.012s	sys 0.000s
I20260925 16:47:43.965533 19539 raft_consensus.cc:348] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:43.966245 19539 raft_consensus.cc:729] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:43.966827 19539 consensus_queue.cc:260] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:43.968706 19539 ts_tablet_manager.cc:1428] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260925 16:47:43.969445 19539 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:43.984812 19539 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:43.985725 19539 tablet_bootstrap.cc:492] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:43.986321 19539 ts_tablet_manager.cc:1397] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.017s	user 0.008s	sys 0.006s
I20260925 16:47:43.988487 19539 raft_consensus.cc:348] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:43.989167 19539 raft_consensus.cc:729] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:43.989742 19539 consensus_queue.cc:260] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:43.991566 19539 ts_tablet_manager.cc:1428] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260925 16:47:43.992308 19539 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.015184 19539 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.016113 19539 tablet_bootstrap.cc:492] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.016722 19539 ts_tablet_manager.cc:1397] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.006s
I20260925 16:47:44.029695 19539 raft_consensus.cc:348] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.030370 19539 raft_consensus.cc:729] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.035389 19539 consensus_queue.cc:260] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.037443 19539 ts_tablet_manager.cc:1428] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.020s	user 0.000s	sys 0.005s
I20260925 16:47:44.038167 19539 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.059680 19539 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.060591 19539 tablet_bootstrap.cc:492] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.061172 19539 ts_tablet_manager.cc:1397] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.005s
I20260925 16:47:44.063301 19539 raft_consensus.cc:348] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.063978 19539 raft_consensus.cc:729] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.064668 19539 consensus_queue.cc:260] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.066920 19539 ts_tablet_manager.cc:1428] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260925 16:47:44.067621 19539 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.081245 19539 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.082149 19539 tablet_bootstrap.cc:492] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.082890 19539 ts_tablet_manager.cc:1397] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.015s	user 0.008s	sys 0.004s
I20260925 16:47:44.085059 19539 raft_consensus.cc:348] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.085598 19539 raft_consensus.cc:729] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.086249 19539 consensus_queue.cc:260] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.088075 19539 ts_tablet_manager.cc:1428] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260925 16:47:44.088658 19539 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.101105 19539 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.101783 19539 tablet_bootstrap.cc:492] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.102320 19539 ts_tablet_manager.cc:1397] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260925 16:47:44.104099 19539 raft_consensus.cc:348] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.104594 19539 raft_consensus.cc:729] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.105122 19539 consensus_queue.cc:260] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.106534 19539 ts_tablet_manager.cc:1428] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.004s	user 0.004s	sys 0.000s
I20260925 16:47:44.107136 19539 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.108352  7803 ts_tablet_manager.cc:610] Registered 45 tablets
I20260925 16:47:44.108647  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.258s	user 0.246s	sys 0.008s
I20260925 16:47:44.127290 19374 raft_consensus.cc:482] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.127669 19539 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.127871 19374 raft_consensus.cc:504] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.130442 19539 tablet_bootstrap.cc:492] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.130879 19505 raft_consensus.cc:482] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.131388 19539 ts_tablet_manager.cc:1397] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.024s	user 0.011s	sys 0.004s
I20260925 16:47:44.132678 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.136436 19539 raft_consensus.cc:348] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.137161 19539 raft_consensus.cc:729] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.131405 19505 raft_consensus.cc:504] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.137868 19539 consensus_queue.cc:260] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.139777 19505 leader_election.cc:288] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:44.141273 19539 ts_tablet_manager.cc:1428] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:47:44.142568 19539 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.143482 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:44.146209 18896 leader_election.cc:334] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:47:44.146692 19374 leader_election.cc:288] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.146632 18896 leader_election.cc:302] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:44.149295 19374 raft_consensus.cc:2726] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260925 16:47:44.152762 18896 leader_election.cc:334] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:47:44.153350 18896 leader_election.cc:302] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.154157 19374 raft_consensus.cc:2726] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.161100 19539 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.162369 19539 tablet_bootstrap.cc:492] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.163187 19539 ts_tablet_manager.cc:1397] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.003s
I20260925 16:47:44.166110 19539 raft_consensus.cc:348] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.167145 19539 raft_consensus.cc:729] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.167956 19539 consensus_queue.cc:260] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.170336 19539 ts_tablet_manager.cc:1428] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.004s
I20260925 16:47:44.171190 19539 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.189164 19539 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.190217 19539 tablet_bootstrap.cc:492] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.190939 19539 ts_tablet_manager.cc:1397] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260925 16:47:44.193826 19539 raft_consensus.cc:348] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.194737 19539 raft_consensus.cc:729] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.195619 19539 consensus_queue.cc:260] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.198498 19539 ts_tablet_manager.cc:1428] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260925 16:47:44.199358 19539 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.216264 19539 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.217407 19539 tablet_bootstrap.cc:492] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.218207 19539 ts_tablet_manager.cc:1397] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.019s	user 0.016s	sys 0.000s
I20260925 16:47:44.220714 19539 raft_consensus.cc:348] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.221547 19539 raft_consensus.cc:729] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.222303 19539 consensus_queue.cc:260] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.224593 19539 ts_tablet_manager.cc:1428] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260925 16:47:44.225488 19539 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.229012  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:36337
I20260925 16:47:44.229190 19612 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:36337 every 8 connection(s)
I20260925 16:47:44.241477 19539 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.242362 19539 tablet_bootstrap.cc:492] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.243050 19539 ts_tablet_manager.cc:1397] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.018s	user 0.014s	sys 0.000s
I20260925 16:47:44.245658 19539 raft_consensus.cc:348] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.246546 19539 raft_consensus.cc:729] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.247264 19539 consensus_queue.cc:260] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.250919 19374 raft_consensus.cc:482] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.251340 19539 ts_tablet_manager.cc:1428] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.008s	user 0.009s	sys 0.000s
I20260925 16:47:44.251516 19374 raft_consensus.cc:504] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.252437 19539 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.253648 19374 leader_election.cc:288] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.255550 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.261878 19587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.262559 19587 raft_consensus.cc:2454] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:44.267007 18896 leader_election.cc:302] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:44.268072 19370 raft_consensus.cc:2781] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.268412 19370 raft_consensus.cc:482] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.268713 19370 raft_consensus.cc:3037] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.283633 19614 heartbeater.cc:347] Connected to a master server at 127.7.158.254:38107
I20260925 16:47:44.284363 19614 heartbeater.cc:464] Registering TS with master...
I20260925 16:47:44.285600 19614 heartbeater.cc:511] Master 127.7.158.254:38107 requested a full tablet report, sending...
I20260925 16:47:44.284243 19370 raft_consensus.cc:504] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.288682 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:44.292271 19540 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.292737 19540 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.296818 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.297012 19540 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.301182 19374 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.311316 19587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:44.312001 19587 raft_consensus.cc:3037] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.307446 19374 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.316306 19370 leader_election.cc:288] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.318547 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.319192 19005 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
I20260925 16:47:44.320407 19587 raft_consensus.cc:2454] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:44.321771 18898 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.323880 19374 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.324366 19374 raft_consensus.cc:2781] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.324704 19374 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.325243 19374 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.325946 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.324774 18896 leader_election.cc:302] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:44.335265 18680 ts_manager.cc:194] Re-registered known tserver with Master: 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.341809 19539 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.343015 19539 tablet_bootstrap.cc:492] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.344125 19539 ts_tablet_manager.cc:1397] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.092s	user 0.047s	sys 0.043s
I20260925 16:47:44.347295 19539 raft_consensus.cc:348] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.348747 19539 raft_consensus.cc:729] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.349594 19539 consensus_queue.cc:260] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.352403 19539 ts_tablet_manager.cc:1428] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:47:44.353415 19539 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.362860 19370 raft_consensus.cc:2781] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
W20260925 16:47:44.366077 18896 leader_election.cc:341] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.372553 19370 raft_consensus.cc:686] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:44.373428 19370 consensus_queue.cc:237] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.379302 19374 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.380067 19539 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.381192 19539 tablet_bootstrap.cc:492] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.381981 19539 ts_tablet_manager.cc:1397] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.000s
I20260925 16:47:44.385239 19539 raft_consensus.cc:348] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.386106 19539 raft_consensus.cc:729] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.386806 19539 consensus_queue.cc:260] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.389554 19539 ts_tablet_manager.cc:1428] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:47:44.390323 19539 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.398849 19540 raft_consensus.cc:482] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.399374 19540 raft_consensus.cc:504] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.401333 19540 leader_election.cc:288] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.402254 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.403050 18930 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:44.403213 19120 raft_consensus.cc:482] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.403651 19120 raft_consensus.cc:504] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.404220 18969 leader_election.cc:302] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.409225 19539 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.409363 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.410100 19539 tablet_bootstrap.cc:492] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.410750 19539 ts_tablet_manager.cc:1397] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.004s
I20260925 16:47:44.410802 19516 raft_consensus.cc:2781] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.411271 19516 raft_consensus.cc:482] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.411603 19516 raft_consensus.cc:3037] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.413465 19539 raft_consensus.cc:348] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.414441 19539 raft_consensus.cc:729] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.415216 19539 consensus_queue.cc:260] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
W20260925 16:47:44.416155 18822 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.417972 19539 ts_tablet_manager.cc:1428] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:47:44.419019 19539 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.420051 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.421579 18824 leader_election.cc:302] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 95ce93f423f7436fa4863f1c688c9dc5; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.422973 19120 leader_election.cc:288] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.422921 19632 raft_consensus.cc:2726] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.425328 18681 catalog_manager.cc:5495] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.427984 19516 raft_consensus.cc:504] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.438668 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:44.439262 18929 raft_consensus.cc:3037] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.446241 19352 raft_consensus.cc:482] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.446724 19352 raft_consensus.cc:504] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.448460 19352 leader_election.cc:288] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.451254 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.464865 19516 leader_election.cc:288] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.465595 18929 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 2.
I20260925 16:47:44.466975 18969 leader_election.cc:302] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.467684 19516 raft_consensus.cc:2781] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.468175 19516 raft_consensus.cc:686] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:44.468952 19516 consensus_queue.cc:237] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.469429 19374 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.470125 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:44.470738 19005 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.477990 19005 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:44.480079 18898 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.470746 19539 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.481231 19628 raft_consensus.cc:2781] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.481791 19539 tablet_bootstrap.cc:492] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.483232 19539 ts_tablet_manager.cc:1397] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.064s	user 0.019s	sys 0.009s
I20260925 16:47:44.482430 19628 raft_consensus.cc:686] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:44.483337 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:44.484438 19628 consensus_queue.cc:237] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.490191 19541 raft_consensus.cc:482] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.490890 19541 raft_consensus.cc:504] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.493355 19541 leader_election.cc:288] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:44.494027 19587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.494518 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.495671 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.496230 19587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.496729 18929 raft_consensus.cc:2454] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:44.498325 19582 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7293be9e009d40c88899bbef09077e1c" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:44.498812 18822 leader_election.cc:341] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.499776 18821 leader_election.cc:302] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.500756 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.500993 19632 raft_consensus.cc:2781] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.501368 19632 raft_consensus.cc:482] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.501696 19632 raft_consensus.cc:3037] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.496861 19587 raft_consensus.cc:2454] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
W20260925 16:47:44.518044 18896 leader_election.cc:341] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.515213 19539 raft_consensus.cc:348] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.521797 19539 raft_consensus.cc:729] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.524323 19539 consensus_queue.cc:260] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:44.528481 18970 leader_election.cc:341] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.530601 19539 ts_tablet_manager.cc:1428] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.047s	user 0.006s	sys 0.000s
I20260925 16:47:44.531774 19539 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.533756 19622 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.529878 18970 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
W20260925 16:47:44.542626 18970 leader_election.cc:341] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.543275 18970 leader_election.cc:302] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.544242 19352 raft_consensus.cc:2726] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.545017 19352 raft_consensus.cc:2726] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.527514 19540 raft_consensus.cc:482] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.557849 19352 raft_consensus.cc:482] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.562492 19352 raft_consensus.cc:504] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.522297 19632 raft_consensus.cc:504] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.534235 19622 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.572996 19370 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.573578 19370 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.564740 19540 raft_consensus.cc:504] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.576257 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.577932 19540 leader_election.cc:288] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:44.578487 19370 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.583786 19352 leader_election.cc:288] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.592123 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.603142 19632 leader_election.cc:288] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:44.605506 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:44.606969 18822 leader_election.cc:341] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.608449 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59dd7657b032497789d2fc68f2f969b7" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:44.609031 18930 raft_consensus.cc:3037] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.612550 19622 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:44.614349 19585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.615895 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:44.621411 18896 leader_election.cc:341] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.622475 19541 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.623155 18896 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:44.622977 19541 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.624902 19541 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:44.623894 19622 raft_consensus.cc:2726] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.627286 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.627683 18930 raft_consensus.cc:2454] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 2.
I20260925 16:47:44.627997 18929 raft_consensus.cc:2454] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:44.629284 18821 leader_election.cc:302] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.630012 19120 raft_consensus.cc:2781] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.630339 18821 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:44.630482 19120 raft_consensus.cc:686] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:44.631145 19632 raft_consensus.cc:2781] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.631503 19632 raft_consensus.cc:482] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.631935 19632 raft_consensus.cc:3037] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.631634 19120 consensus_queue.cc:237] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.632956 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.633479 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
I20260925 16:47:44.634112 18857 raft_consensus.cc:2454] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
I20260925 16:47:44.638072 19632 raft_consensus.cc:504] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.630441 19585 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.640763 19587 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:44.641065 19632 leader_election.cc:288] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
W20260925 16:47:44.642226 18822 leader_election.cc:341] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.642475 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca3a94319c924815ac7fb94f095c36ed" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:44.639525 19622 raft_consensus.cc:482] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.643028 18929 raft_consensus.cc:3037] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.642167 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a5c4d8141b90433fbf058da0d0641809" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.643893 19586 raft_consensus.cc:2379] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 45f690dc20794b529fdeabff43202cf4 in current term 2: Already voted for candidate 2214de1d38f74b668aa3139202318338 in this term.
I20260925 16:47:44.643276 19622 raft_consensus.cc:504] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:44.643294 18822 leader_election.cc:341] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.645591 19622 leader_election.cc:288] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.646337 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.646562 19586 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.646982 19003 raft_consensus.cc:2454] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 1.
W20260925 16:47:44.647840 18896 leader_election.cc:341] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.648814 19642 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.648833 18898 leader_election.cc:302] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.649289 19642 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.649714 18929 raft_consensus.cc:2454] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 2.
I20260925 16:47:44.650894 18821 leader_election.cc:302] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.651235 19622 raft_consensus.cc:2781] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.651361 19642 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.651749 19622 raft_consensus.cc:482] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.652248 19120 raft_consensus.cc:2781] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.652774 19120 raft_consensus.cc:686] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:44.653534 19120 consensus_queue.cc:237] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.657553 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338" is_pre_election: true
I20260925 16:47:44.658160 18929 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 1.
W20260925 16:47:44.658344 18970 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.652249 19622 raft_consensus.cc:3037] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.659117 18969 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.659310 18970 leader_election.cc:302] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.659929 19352 raft_consensus.cc:2781] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.660288 19352 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.660625 19352 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.661804 19516 raft_consensus.cc:3037] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.665206 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
W20260925 16:47:44.666617 18896 leader_election.cc:341] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.666991 18896 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.668025 19370 raft_consensus.cc:2726] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.669756 19622 raft_consensus.cc:504] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.671144 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.673897 19516 raft_consensus.cc:2726] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.674409 18970 leader_election.cc:302] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.675398 19642 raft_consensus.cc:2781] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.675920 19642 raft_consensus.cc:482] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.676230 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:44.676393 19642 raft_consensus.cc:3037] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.676841 19003 raft_consensus.cc:3037] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.677207 19352 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.679639 18929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:44.680240 18929 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.687361 18929 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 2.
I20260925 16:47:44.687932 19003 raft_consensus.cc:2454] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:44.688447 18969 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.689232 18898 leader_election.cc:302] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:44.689990 19370 raft_consensus.cc:2781] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.690433 19370 raft_consensus.cc:686] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:44.690649 19516 raft_consensus.cc:2781] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.690658 19622 leader_election.cc:288] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.691666 19352 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.691185 19370 consensus_queue.cc:237] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.693523 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0ef360c253d749e49df7441283aa6f50" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:44.695051 18896 leader_election.cc:341] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.697444 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:44.699309 18970 leader_election.cc:341] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:47:44.700284 18970 leader_election.cc:341] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.700284 19516 raft_consensus.cc:686] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:44.700600 19539 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.701653 19539 tablet_bootstrap.cc:492] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.701388 19516 consensus_queue.cc:237] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.701898 19540 raft_consensus.cc:482] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.702330 19539 ts_tablet_manager.cc:1397] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.171s	user 0.013s	sys 0.004s
I20260925 16:47:44.702395 19540 raft_consensus.cc:504] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.704366 19540 leader_election.cc:288] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:44.704808 19539 raft_consensus.cc:348] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.705523 19539 raft_consensus.cc:729] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.706266 19539 consensus_queue.cc:260] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:44.708283 19539 ts_tablet_manager.cc:1428] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260925 16:47:44.713917 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.717789 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5" is_pre_election: true
W20260925 16:47:44.725360 18970 leader_election.cc:341] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.727924 18970 leader_election.cc:302] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:44.729151 19539 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.729086 19352 raft_consensus.cc:2726] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260925 16:47:44.732560 19642 raft_consensus.cc:504] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.737102 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
I20260925 16:47:44.737318 18681 catalog_manager.cc:5495] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
W20260925 16:47:44.740235 18970 leader_election.cc:341] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.745105 18681 catalog_manager.cc:5495] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.757561 18679 catalog_manager.cc:5495] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.760200 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a21dbc5af1e44992abcf69b0d4a3d238" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:44.760982 18857 raft_consensus.cc:3037] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.767518 18857 raft_consensus.cc:2454] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 2.
I20260925 16:47:44.768622 18678 catalog_manager.cc:5495] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 2 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.773404 19120 raft_consensus.cc:482] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.773903 19120 raft_consensus.cc:504] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.775660 19120 leader_election.cc:288] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.776340 19539 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.777248 19539 tablet_bootstrap.cc:492] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.777908 19539 ts_tablet_manager.cc:1397] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.069s	user 0.017s	sys 0.005s
I20260925 16:47:44.778921 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f" is_pre_election: true
I20260925 16:47:44.780428 19539 raft_consensus.cc:348] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.781178 19539 raft_consensus.cc:729] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.780041 18970 leader_election.cc:302] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.758471 19642 leader_election.cc:288] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:44.781920 19539 consensus_queue.cc:260] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
W20260925 16:47:44.780829 18822 leader_election.cc:341] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.783511 19516 raft_consensus.cc:2781] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.784776 19539 ts_tablet_manager.cc:1428] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:47:44.785001 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
I20260925 16:47:44.785645 19539 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.785730 19003 raft_consensus.cc:2454] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 1.
I20260925 16:47:44.786993 18824 leader_election.cc:302] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.788426 19632 raft_consensus.cc:2781] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:47:44.788811 19632 raft_consensus.cc:482] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:47:44.789179 19632 raft_consensus.cc:3037] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.784595 19516 raft_consensus.cc:686] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:44.796648 19516 consensus_queue.cc:237] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.801180 19632 raft_consensus.cc:504] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.802826 18680 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60882
I20260925 16:47:44.804625 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:44.805393 19005 raft_consensus.cc:3037] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.809682 19614 heartbeater.cc:503] Master 127.7.158.254:38107 was elected leader, sending a full tablet report...
I20260925 16:47:44.807379 18677 catalog_manager.cc:5495] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.821503 19584 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "877d01ad1b7146388b608954cbc4574d" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
W20260925 16:47:44.822856 18822 leader_election.cc:341] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Tablet error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:47:44.823396 19632 leader_election.cc:288] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:47:44.824201 19005 raft_consensus.cc:2454] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 2.
I20260925 16:47:44.824769 19539 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.825300 18824 leader_election.cc:302] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:44.825711 19539 tablet_bootstrap.cc:492] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.826512 19539 ts_tablet_manager.cc:1397] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.041s	user 0.015s	sys 0.006s
I20260925 16:47:44.826902 19120 raft_consensus.cc:2781] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:44.827378 19120 raft_consensus.cc:686] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:44.828114 19120 consensus_queue.cc:237] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.828343 19539 raft_consensus.cc:348] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.829033 19539 raft_consensus.cc:729] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.829703 19539 consensus_queue.cc:260] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.832229 19539 ts_tablet_manager.cc:1428] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.000s
I20260925 16:47:44.832902 19539 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.839743 18679 catalog_manager.cc:5495] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 2 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.841977 18679 catalog_manager.cc:5495] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 2 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:44.860894 18679 catalog_manager.cc:5495] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 1 to 2, leader changed from 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193) to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:44.883482 19539 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.884658 19539 tablet_bootstrap.cc:492] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.885299 19539 ts_tablet_manager.cc:1397] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.053s	user 0.016s	sys 0.004s
I20260925 16:47:44.887761 19539 raft_consensus.cc:348] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.889276 19539 raft_consensus.cc:729] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.889922 19539 consensus_queue.cc:260] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:44.893285 19539 ts_tablet_manager.cc:1428] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260925 16:47:44.894050 19539 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.909207 19539 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.910038 19539 tablet_bootstrap.cc:492] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.910602 19539 ts_tablet_manager.cc:1397] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.017s	user 0.010s	sys 0.003s
I20260925 16:47:44.911988 19584 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:44.912817 19539 raft_consensus.cc:348] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.913411 19539 raft_consensus.cc:729] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.914309 19539 consensus_queue.cc:260] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.926136 19005 raft_consensus.cc:1261] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:44.926975 19539 ts_tablet_manager.cc:1428] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260925 16:47:44.927950 19539 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:44.928733 19622 consensus_queue.cc:1035] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:44.930998 19584 raft_consensus.cc:1261] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:44.939565 19370 consensus_queue.cc:1035] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:44.940574 19586 raft_consensus.cc:1261] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:44.950815 19370 consensus_queue.cc:1035] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:44.954073 19539 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:44.954609 19003 raft_consensus.cc:1261] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:44.956688 19539 tablet_bootstrap.cc:492] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:44.957554 19539 ts_tablet_manager.cc:1397] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.004s
I20260925 16:47:44.957417 19370 consensus_queue.cc:1035] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:44.960014 19539 raft_consensus.cc:348] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.960681 19539 raft_consensus.cc:729] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:44.961328 19539 consensus_queue.cc:260] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:44.963560 19539 ts_tablet_manager.cc:1428] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:47:44.964314 19539 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.021313 19539 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.022289 19539 tablet_bootstrap.cc:492] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.022871 19539 ts_tablet_manager.cc:1397] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.059s	user 0.026s	sys 0.027s
I20260925 16:47:45.025282 19539 raft_consensus.cc:348] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.025939 19539 raft_consensus.cc:729] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.026692 19539 consensus_queue.cc:260] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.030745 18929 raft_consensus.cc:1261] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.032253 19352 consensus_queue.cc:1035] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:45.048794 19539 ts_tablet_manager.cc:1428] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.026s	user 0.009s	sys 0.000s
I20260925 16:47:45.058992 19539 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.060073 18930 raft_consensus.cc:1261] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.061520 19632 consensus_queue.cc:1035] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:47:45.064659 18822 consensus_peers.cc:487] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:47:45.074793 18822 consensus_peers.cc:487] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:45.090428 19586 raft_consensus.cc:3037] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:45.105032 19586 raft_consensus.cc:1261] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.107201 19003 raft_consensus.cc:1261] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.109700 19374 consensus_queue.cc:1035] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:45.118630 19539 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.119817 19539 tablet_bootstrap.cc:492] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.120464 19539 ts_tablet_manager.cc:1397] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.062s	user 0.021s	sys 0.008s
I20260925 16:47:45.124329 19648 consensus_queue.cc:1035] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:45.122977 19539 raft_consensus.cc:348] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.141520 19539 raft_consensus.cc:729] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.142338 19539 consensus_queue.cc:260] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.149446 19587 raft_consensus.cc:3037] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:45.157470 19539 ts_tablet_manager.cc:1428] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.037s	user 0.006s	sys 0.000s
I20260925 16:47:45.163419 18929 raft_consensus.cc:1261] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.165337 19352 consensus_queue.cc:1035] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:45.165915 19539 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.192878 19587 raft_consensus.cc:1261] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.213970 19622 consensus_queue.cc:1035] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260925 16:47:45.266950 18970 consensus_peers.cc:487] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:45.279551 18929 raft_consensus.cc:1261] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.281631 19672 consensus_queue.cc:1035] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:45.308713 18857 raft_consensus.cc:1261] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.311143 19648 consensus_queue.cc:1035] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:45.330762 19539 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.332226 19539 tablet_bootstrap.cc:492] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.333134 19539 ts_tablet_manager.cc:1397] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.175s	user 0.029s	sys 0.037s
I20260925 16:47:45.338421 19584 raft_consensus.cc:3037] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:45.338865 19539 raft_consensus.cc:348] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.339561 19539 raft_consensus.cc:729] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.340229 19539 consensus_queue.cc:260] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.344485 19539 ts_tablet_manager.cc:1428] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260925 16:47:45.345381 19539 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
W20260925 16:47:45.379374 18822 consensus_peers.cc:487] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:47:45.388530 19584 raft_consensus.cc:1261] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.390079 19352 consensus_queue.cc:1035] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:45.393211 19539 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.394287 19539 tablet_bootstrap.cc:492] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.394972 19539 ts_tablet_manager.cc:1397] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.050s	user 0.022s	sys 0.009s
I20260925 16:47:45.397742 19539 raft_consensus.cc:348] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.398495 19539 raft_consensus.cc:729] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.399184 19539 consensus_queue.cc:260] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.400921 19539 ts_tablet_manager.cc:1428] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260925 16:47:45.404282 19539 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.424849 19539 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.425863 19539 tablet_bootstrap.cc:492] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.426589 19539 ts_tablet_manager.cc:1397] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260925 16:47:45.428819 19539 raft_consensus.cc:348] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.430724 19539 raft_consensus.cc:729] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.431358 19539 consensus_queue.cc:260] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.433375 19539 ts_tablet_manager.cc:1428] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260925 16:47:45.434177 19539 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.452555 19539 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.453466 19539 tablet_bootstrap.cc:492] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.454130 19539 ts_tablet_manager.cc:1397] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.000s
I20260925 16:47:45.456420 19005 raft_consensus.cc:1261] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:45.456750 19539 raft_consensus.cc:348] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.457439 19539 raft_consensus.cc:729] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.458051 19539 consensus_queue.cc:260] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.459506 19539 ts_tablet_manager.cc:1428] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260925 16:47:45.460139 19539 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.462173 19676 consensus_queue.cc:1035] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260925 16:47:45.477092 18970 consensus_peers.cc:487] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:45.479338 19539 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.480304 19539 tablet_bootstrap.cc:492] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.480927 19539 ts_tablet_manager.cc:1397] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.000s
I20260925 16:47:45.483179 19539 raft_consensus.cc:348] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.483835 19539 raft_consensus.cc:729] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.484411 19539 consensus_queue.cc:260] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.486405 19539 ts_tablet_manager.cc:1428] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260925 16:47:45.487126 19539 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.500139 19539 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.501034 19539 tablet_bootstrap.cc:492] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.501621 19539 ts_tablet_manager.cc:1397] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.015s	user 0.012s	sys 0.000s
I20260925 16:47:45.503907 19539 raft_consensus.cc:348] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.504426 19539 raft_consensus.cc:729] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.505084 19539 consensus_queue.cc:260] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.506929 19539 ts_tablet_manager.cc:1428] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260925 16:47:45.508124 19539 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.524869 19539 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.525843 19539 tablet_bootstrap.cc:492] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.526522 19539 ts_tablet_manager.cc:1397] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.000s
I20260925 16:47:45.528964 19539 raft_consensus.cc:348] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.529711 19539 raft_consensus.cc:729] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.530357 19539 consensus_queue.cc:260] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.532953 19539 ts_tablet_manager.cc:1428] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260925 16:47:45.533754 19539 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
W20260925 16:47:45.537806 18896 consensus_peers.cc:487] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:45.547605 19539 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.548511 19539 tablet_bootstrap.cc:492] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.549188 19539 ts_tablet_manager.cc:1397] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260925 16:47:45.551445 19539 raft_consensus.cc:348] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.552307 19539 raft_consensus.cc:729] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.553052 19539 consensus_queue.cc:260] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.555413 19539 ts_tablet_manager.cc:1428] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.004s
I20260925 16:47:45.556273 19539 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
W20260925 16:47:45.556175 18970 consensus_peers.cc:487] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260925 16:47:45.572252 19539 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.573253 19539 tablet_bootstrap.cc:492] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.574033 19539 ts_tablet_manager.cc:1397] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.018s	user 0.015s	sys 0.000s
I20260925 16:47:45.576488 19539 raft_consensus.cc:348] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.577245 19539 raft_consensus.cc:729] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.577906 19539 consensus_queue.cc:260] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.580277 19539 ts_tablet_manager.cc:1428] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260925 16:47:45.581041 19539 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.621793 19539 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.622538 19539 tablet_bootstrap.cc:492] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.623080 19539 ts_tablet_manager.cc:1397] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.004s
I20260925 16:47:45.625239 19539 raft_consensus.cc:348] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.625883 19539 raft_consensus.cc:729] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.626487 19539 consensus_queue.cc:260] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.628523 19539 ts_tablet_manager.cc:1428] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260925 16:47:45.630259 19539 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.648820 19539 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.649725 19539 tablet_bootstrap.cc:492] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.650336 19539 ts_tablet_manager.cc:1397] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.010s
I20260925 16:47:45.652559 19539 raft_consensus.cc:348] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.653213 19539 raft_consensus.cc:729] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.653795 19539 consensus_queue.cc:260] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.655829 19539 ts_tablet_manager.cc:1428] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260925 16:47:45.656559 19539 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.683853 19539 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.684752 19539 tablet_bootstrap.cc:492] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.685395 19539 ts_tablet_manager.cc:1397] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.008s
I20260925 16:47:45.687754 19539 raft_consensus.cc:348] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.688443 19539 raft_consensus.cc:729] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.689091 19539 consensus_queue.cc:260] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.690605 19539 ts_tablet_manager.cc:1428] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260925 16:47:45.691691 19539 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.706230 19539 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.706950 19539 tablet_bootstrap.cc:492] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.707574 19539 ts_tablet_manager.cc:1397] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260925 16:47:45.710132 19539 raft_consensus.cc:348] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.710850 19539 raft_consensus.cc:729] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.711459 19539 consensus_queue.cc:260] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.713514 19539 ts_tablet_manager.cc:1428] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:47:45.714274 19539 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.727134 19539 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.727916 19539 tablet_bootstrap.cc:492] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.728430 19539 ts_tablet_manager.cc:1397] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.014s	user 0.009s	sys 0.004s
I20260925 16:47:45.729943 19539 raft_consensus.cc:348] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.730481 19539 raft_consensus.cc:729] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.731086 19539 consensus_queue.cc:260] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.732785 19539 ts_tablet_manager.cc:1428] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.001s
I20260925 16:47:45.733834 19539 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.768864 19539 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.769731 19539 tablet_bootstrap.cc:492] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.770357 19539 ts_tablet_manager.cc:1397] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.012s
I20260925 16:47:45.772487 19539 raft_consensus.cc:348] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.773144 19539 raft_consensus.cc:729] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.773757 19539 consensus_queue.cc:260] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:45.775979 19539 ts_tablet_manager.cc:1428] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.005s	user 0.008s	sys 0.000s
I20260925 16:47:45.777467 19539 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.777642 19584 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:45.797699 19539 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.798887 19539 tablet_bootstrap.cc:492] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.799935 19539 ts_tablet_manager.cc:1397] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.003s
I20260925 16:47:45.802537 19539 raft_consensus.cc:348] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.803237 19539 raft_consensus.cc:729] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.804163 19539 consensus_queue.cc:260] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:45.806131 19539 ts_tablet_manager.cc:1428] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.001s
I20260925 16:47:45.807574 19539 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.824779 19539 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.825696 19539 tablet_bootstrap.cc:492] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.826344 19539 ts_tablet_manager.cc:1397] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.002s
I20260925 16:47:45.828559 19539 raft_consensus.cc:348] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.829202 19539 raft_consensus.cc:729] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.829782 19539 consensus_queue.cc:260] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.838153 19539 ts_tablet_manager.cc:1428] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.002s
I20260925 16:47:45.838482 19584 raft_consensus.cc:3037] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:45.839159 19539 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap starting.
I20260925 16:47:45.866585 19539 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260925 16:47:45.880558 19539 tablet_bootstrap.cc:492] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Bootstrap complete.
I20260925 16:47:45.881807 19539 ts_tablet_manager.cc:1397] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.005s
I20260925 16:47:45.885308 19587 raft_consensus.cc:3037] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:45.893497 19539 raft_consensus.cc:348] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.894274 19539 raft_consensus.cc:729] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Initialized, Role: FOLLOWER
I20260925 16:47:45.894948 19539 consensus_queue.cc:260] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:45.897064 19539 ts_tablet_manager.cc:1428] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.000s
I20260925 16:47:46.117928 19584 raft_consensus.cc:3037] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.239959  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:54.298820 18857 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "284fe7e2abae4c75999bec672a911342"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:59902
I20260925 16:47:54.299875 18857 raft_consensus.cc:595] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:54.317560 19005 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:54.318120 19005 raft_consensus.cc:595] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:54.335513 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:54.336089 18932 raft_consensus.cc:595] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:54.338603 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:54.339181 18932 raft_consensus.cc:595] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:54.341464 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:54.341989 18932 raft_consensus.cc:595] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:54.344717 19003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d871558c98cc4c489854c783d1585d95"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:54.345242 19003 raft_consensus.cc:595] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 2214de1d38f74b668aa3139202318338
I20260925 16:47:54.346390  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:47:54.347792  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:47:54.348505  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:54.448518 19728 raft_consensus.cc:979] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:54.449157 19730 raft_consensus.cc:1067] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:54.450776 18930 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d871558c98cc4c489854c783d1585d95"
dest_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:33568
I20260925 16:47:54.451324 18930 raft_consensus.cc:482] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:54.451679 18930 raft_consensus.cc:3037] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.461203 18930 raft_consensus.cc:504] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:54.464592 18930 leader_election.cc:288] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:54.465927 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:54.466898 18857 raft_consensus.cc:3037] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.468580 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d871558c98cc4c489854c783d1585d95" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:54.469190 19005 raft_consensus.cc:3032] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:54.469512 19005 raft_consensus.cc:729] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:54.471640 19005 consensus_queue.cc:260] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:54.472898 19005 raft_consensus.cc:3037] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.474279 18857 raft_consensus.cc:2454] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:54.475797 18896 leader_election.cc:302] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:54.477324 19727 raft_consensus.cc:2781] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:54.477761 19727 raft_consensus.cc:686] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:54.478607 19727 consensus_queue.cc:237] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:54.486950 19005 raft_consensus.cc:2454] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:54.491477 19711 raft_consensus.cc:979] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.491883 19711 raft_consensus.cc:1067] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.493780 19587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33854
I20260925 16:47:54.494244 19587 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:54.494513 19587 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:54.497100 18677 catalog_manager.cc:5495] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:54.500186 19587 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:54.502024 19587 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 3 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:54.521045 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:54.521685 18930 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:54.524646 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:54.525393 19005 raft_consensus.cc:3032] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:47:54.525656 19005 raft_consensus.cc:729] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:54.526382 19005 consensus_queue.cc:260] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:54.527732 19005 raft_consensus.cc:3037] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:54.528931 18930 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 3.
I20260925 16:47:54.530149 19533 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:54.532021 19744 raft_consensus.cc:2781] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:47:54.532377 19005 raft_consensus.cc:2454] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 3.
I20260925 16:47:54.533422 19744 raft_consensus.cc:686] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 3 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:54.534368 19744 consensus_queue.cc:237] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:54.545115 18677 catalog_manager.cc:5495] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 2 to 3, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 3 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:54.560487 19727 raft_consensus.cc:979] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.561017 19727 raft_consensus.cc:1067] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.562762 19584 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33836
I20260925 16:47:54.563443 19584 raft_consensus.cc:482] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:54.563832 19584 raft_consensus.cc:3037] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.570785 19584 raft_consensus.cc:504] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.574291 19584 leader_election.cc:288] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:54.574450 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:54.575287 18930 raft_consensus.cc:3032] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:54.575582 18930 raft_consensus.cc:729] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:54.576515 18930 consensus_queue.cc:260] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.577788 18930 raft_consensus.cc:3037] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.585028 19727 raft_consensus.cc:979] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.585544 19727 raft_consensus.cc:1067] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.586193 18930 raft_consensus.cc:2454] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.586835 19725 raft_consensus.cc:979] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.587287 19584 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33836
I20260925 16:47:54.587440 19716 raft_consensus.cc:1067] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.587888 19584 raft_consensus.cc:482] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:54.588241 19533 leader_election.cc:302] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:54.588568 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c76592461bbe4904ac4715bc51953d7f" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:54.589151 18857 raft_consensus.cc:3037] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.589962 19585 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "284fe7e2abae4c75999bec672a911342"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33848
I20260925 16:47:54.588279 19584 raft_consensus.cc:3037] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.590852 19585 raft_consensus.cc:482] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:54.591624 19585 raft_consensus.cc:3037] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.597138 18857 raft_consensus.cc:2454] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.598135 19584 raft_consensus.cc:504] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.599975 19584 leader_election.cc:288] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:54.600617 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:54.601155 18857 raft_consensus.cc:3037] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.601692 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "70ad3553e755461c9a8e998b4f54a138" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:54.602239 18930 raft_consensus.cc:3032] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:54.602599 18930 raft_consensus.cc:729] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:54.602553 19585 raft_consensus.cc:504] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.590226 19744 raft_consensus.cc:2781] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:54.603613 18930 consensus_queue.cc:260] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.604075 19744 raft_consensus.cc:686] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:54.604965 18930 raft_consensus.cc:3037] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.605048 19744 consensus_queue.cc:237] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.608103 18857 raft_consensus.cc:2454] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.609258 19534 leader_election.cc:302] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:54.610142 19745 raft_consensus.cc:2781] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:54.610726 19585 leader_election.cc:288] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:54.610812 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:54.611487 18932 raft_consensus.cc:3037] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.611686 18930 raft_consensus.cc:2454] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.615406 19745 raft_consensus.cc:686] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:54.616462 19745 consensus_queue.cc:237] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.621551 18677 catalog_manager.cc:5495] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:54.624648 18932 raft_consensus.cc:2454] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.610808 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "284fe7e2abae4c75999bec672a911342" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:54.625860 18857 raft_consensus.cc:3032] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:54.625880 19533 leader_election.cc:302] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:54.626314 18857 raft_consensus.cc:729] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:54.627086 19749 raft_consensus.cc:2781] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:54.627205 18857 consensus_queue.cc:260] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.627676 19749 raft_consensus.cc:686] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:54.629088 19749 consensus_queue.cc:237] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.632457 18857 raft_consensus.cc:3037] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.639480 18857 raft_consensus.cc:2454] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.643513 18677 catalog_manager.cc:5495] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:54.644878 18677 catalog_manager.cc:5495] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:54.726660 19731 raft_consensus.cc:979] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.727224 19731 raft_consensus.cc:1067] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:54.728801 19585 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33836
I20260925 16:47:54.732046 19585 raft_consensus.cc:482] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:54.732405 19585 raft_consensus.cc:3037] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.744174 19585 raft_consensus.cc:504] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.746126 19585 leader_election.cc:288] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:54.747190 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:54.747295 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7f2847dc34a04a54912396f67a4d07b2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:54.747996 18932 raft_consensus.cc:3032] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:54.748286 18932 raft_consensus.cc:729] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:54.748624 18857 raft_consensus.cc:3037] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.749125 18932 consensus_queue.cc:260] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.750456 18932 raft_consensus.cc:3037] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:54.756896 18857 raft_consensus.cc:2454] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.757516 18932 raft_consensus.cc:2454] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:54.758109 19534 leader_election.cc:302] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:54.759159 19749 raft_consensus.cc:2781] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:54.759591 19749 raft_consensus.cc:686] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:54.760464 19749 consensus_queue.cc:237] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:54.782855 18677 catalog_manager.cc:5495] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:54.896052 19003 raft_consensus.cc:1261] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:54.897444 19747 consensus_queue.cc:1035] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:54.928012 18857 raft_consensus.cc:1261] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:54.935902 19731 consensus_queue.cc:1035] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:54.991070 18932 raft_consensus.cc:1261] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:54.992852 19749 consensus_queue.cc:1035] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:55.013746 19005 raft_consensus.cc:1261] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:55.015027 19745 consensus_queue.cc:1035] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:55.056339 18857 raft_consensus.cc:1261] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.057749 19745 consensus_queue.cc:1035] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:55.068828 18932 raft_consensus.cc:1261] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.071126 19745 consensus_queue.cc:1035] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260925 16:47:55.118274 18856 raft_consensus.cc:1261] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.119752 19745 consensus_queue.cc:1035] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:55.121999 18932 raft_consensus.cc:1261] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.126037 19745 consensus_queue.cc:1035] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:55.140128 18856 raft_consensus.cc:1261] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.140530 18932 raft_consensus.cc:1261] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.142149 19745 consensus_queue.cc:1035] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:55.143905 19749 consensus_queue.cc:1035] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:55.265625 18857 raft_consensus.cc:1261] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.266949 19749 consensus_queue.cc:1035] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:55.277992 18930 raft_consensus.cc:1261] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:55.285347 19745 consensus_queue.cc:1035] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:55.395219  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:55.432825 19005 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:55.433459 19005 raft_consensus.cc:595] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:55.436617 18857 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
mode: GRACEFUL
new_leader_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:59902
I20260925 16:47:55.437311 18857 raft_consensus.cc:595] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Received request to transfer leadership to TS 2214de1d38f74b668aa3139202318338
I20260925 16:47:55.441731 18930 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:55.442327 18930 raft_consensus.cc:595] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:55.445209 19003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:55.445745 19003 raft_consensus.cc:595] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:55.448127 19003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:55.448760 19003 raft_consensus.cc:595] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:55.451107 19003 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:55.451661 19003 raft_consensus.cc:595] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 2214de1d38f74b668aa3139202318338
I20260925 16:47:55.452754  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260925 16:47:55.455860  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:47:55.456496  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:55.630224 19769 raft_consensus.cc:979] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.630860 19731 raft_consensus.cc:1067] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.632500 19587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33836
I20260925 16:47:55.633064 19587 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:55.633352 19587 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:55.640199 19587 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:55.642412 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:55.642910 18932 raft_consensus.cc:3032] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:47:55.643222 18932 raft_consensus.cc:729] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:55.642923 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "37ccdcd526ba47b2b415825e4b37e361" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:55.644141 19003 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:55.644182 18932 consensus_queue.cc:260] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:55.645323 18932 raft_consensus.cc:3037] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:55.650211 19003 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 3.
I20260925 16:47:55.650388 18932 raft_consensus.cc:2454] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 3.
I20260925 16:47:55.650612 19587 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 3 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:55.651383 19536 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:55.652562 19749 raft_consensus.cc:2781] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:47:55.653059 19749 raft_consensus.cc:686] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 3 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:55.654330 19749 consensus_queue.cc:237] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:55.666958 18677 catalog_manager.cc:5495] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 2 to 3, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 3 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:55.676865 19711 raft_consensus.cc:979] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.677407 19728 raft_consensus.cc:1067] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.681175 19587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33854
I20260925 16:47:55.682086 19587 raft_consensus.cc:482] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:55.682431 19587 raft_consensus.cc:3037] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.689265 19587 raft_consensus.cc:504] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.691016 19587 leader_election.cc:288] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:55.692163 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:55.692816 19005 raft_consensus.cc:3032] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:55.693065 19005 raft_consensus.cc:729] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:55.693428 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8b11e95748c4f57ace6efc0aa7344c4" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:55.694042 18856 raft_consensus.cc:3037] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.693742 19005 consensus_queue.cc:260] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.695506 19005 raft_consensus.cc:3037] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.697300 19716 raft_consensus.cc:979] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: : Instructing follower 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:55.698067 19716 raft_consensus.cc:1067] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Signalling peer 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:55.703809 19005 raft_consensus.cc:2454] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:55.704226 18856 raft_consensus.cc:2454] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:55.704916 19536 leader_election.cc:302] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:55.705935 19749 raft_consensus.cc:2781] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:55.706449 19749 raft_consensus.cc:686] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:55.707288 19749 consensus_queue.cc:237] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.708141 18932 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba"
dest_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:33560
I20260925 16:47:55.712520 18932 raft_consensus.cc:482] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:55.712857 18932 raft_consensus.cc:3037] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.729337 18932 raft_consensus.cc:504] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:55.732079 18932 leader_election.cc:288] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:55.732010 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:55.733006 19003 raft_consensus.cc:3037] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.732009 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "179c5529bce9433e91b98e095c37f5ba" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:55.739995 18677 catalog_manager.cc:5495] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:55.741220 18858 raft_consensus.cc:3032] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:55.741683 18858 raft_consensus.cc:729] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:55.742442 18858 consensus_queue.cc:260] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:55.746728 18858 raft_consensus.cc:3037] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.741179 19003 raft_consensus.cc:2454] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:55.760152 18858 raft_consensus.cc:2454] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:55.761125 18898 leader_election.cc:302] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:55.761950 19769 raft_consensus.cc:2781] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:55.762534 19769 raft_consensus.cc:686] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:55.763425 19769 consensus_queue.cc:237] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:55.775769 18677 catalog_manager.cc:5495] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:55.906329 19774 raft_consensus.cc:979] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.906791 19711 raft_consensus.cc:1067] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.908126 19584 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33854
I20260925 16:47:55.908589 19584 raft_consensus.cc:482] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:55.908965 19584 raft_consensus.cc:3037] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.914780 19584 raft_consensus.cc:504] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.916234 19584 leader_election.cc:288] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:55.917428 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:55.917766 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "10b8d7fdd5d24fdf82b70406d9cd5a37" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:55.918036 18858 raft_consensus.cc:3037] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.918793 19003 raft_consensus.cc:3032] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:55.919142 19003 raft_consensus.cc:729] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:55.919950 19003 consensus_queue.cc:260] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.921128 19003 raft_consensus.cc:3037] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.925168 18858 raft_consensus.cc:2454] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:55.926294 19534 leader_election.cc:302] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:55.927053 19749 raft_consensus.cc:2781] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:55.927553 19749 raft_consensus.cc:686] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:55.928280 19003 raft_consensus.cc:2454] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:55.928406 19749 consensus_queue.cc:237] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.940598 18677 catalog_manager.cc:5495] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:55.965708 19774 raft_consensus.cc:979] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.966245 19774 raft_consensus.cc:1067] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:55.968161 19584 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33854
I20260925 16:47:55.968693 19584 raft_consensus.cc:482] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:55.969018 19584 raft_consensus.cc:3037] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.974037 19584 raft_consensus.cc:504] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.976213 19584 leader_election.cc:288] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:55.977192 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:55.977430 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a8d68e12cdea4099aa6d278a53a7af17" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:55.977854 19003 raft_consensus.cc:3032] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:55.977916 18858 raft_consensus.cc:3037] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.978260 19003 raft_consensus.cc:729] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:55.979513 19003 consensus_queue.cc:260] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.980788 19003 raft_consensus.cc:3037] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:55.986158 18858 raft_consensus.cc:2454] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:55.987167 19003 raft_consensus.cc:2454] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:55.987221 19534 leader_election.cc:302] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:55.988171 19749 raft_consensus.cc:2781] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:55.988637 19749 raft_consensus.cc:686] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:55.989337 19749 consensus_queue.cc:237] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:55.999930 18677 catalog_manager.cc:5495] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:56.038144 19711 raft_consensus.cc:979] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:56.038682 19711 raft_consensus.cc:1067] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:56.040445 18932 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a"
dest_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:33568
I20260925 16:47:56.040971 18932 raft_consensus.cc:482] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:56.041313 18932 raft_consensus.cc:3037] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.049656 18932 raft_consensus.cc:504] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.052269 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:56.052856 19003 raft_consensus.cc:3032] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:56.053160 19003 raft_consensus.cc:729] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:56.054422 19003 consensus_queue.cc:260] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.053036 18858 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eeb6462147004a588cfd7aa36658ae4a" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:56.055773 18858 raft_consensus.cc:3037] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.054384 18932 leader_election.cc:288] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:56.055796 19003 raft_consensus.cc:3037] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.062175 19003 raft_consensus.cc:2454] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:56.063088 18898 leader_election.cc:302] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:56.063238 18858 raft_consensus.cc:2454] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:56.063782 19731 raft_consensus.cc:2781] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:56.064292 19731 raft_consensus.cc:686] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:56.065214 19731 consensus_queue.cc:237] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.076221 18677 catalog_manager.cc:5495] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:56.094995 18858 raft_consensus.cc:1261] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.096912 19749 consensus_queue.cc:1035] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.137858 19003 raft_consensus.cc:1261] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.139988 19744 consensus_queue.cc:1035] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.183874 18856 raft_consensus.cc:1261] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.185173 19731 consensus_queue.cc:1035] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.194051 19003 raft_consensus.cc:1261] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.196355 19731 consensus_queue.cc:1035] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:56.206439 18932 raft_consensus.cc:1261] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:56.207849 19744 consensus_queue.cc:1035] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:56.224066 19003 raft_consensus.cc:1261] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:56.225987 19749 consensus_queue.cc:1035] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:56.314163 18856 raft_consensus.cc:1261] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.315486 19749 consensus_queue.cc:1035] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.332815 19003 raft_consensus.cc:1261] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.334213 19749 consensus_queue.cc:1035] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.390662 18856 raft_consensus.cc:1261] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.392102 19749 consensus_queue.cc:1035] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.401687 19003 raft_consensus.cc:1261] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.403213 19790 consensus_queue.cc:1035] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.508343  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:56.529247 19003 raft_consensus.cc:1261] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.530642 19731 consensus_queue.cc:1035] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.548290 18856 raft_consensus.cc:1261] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:56.550510 19769 consensus_queue.cc:1035] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:56.563092 19005 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:56.563668 19005 raft_consensus.cc:595] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:56.571102 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:56.571736 18932 raft_consensus.cc:595] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:56.575213 19005 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:56.575830 19005 raft_consensus.cc:595] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:56.579070 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:56.579622 18932 raft_consensus.cc:595] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:56.587091 18856 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
mode: GRACEFUL
new_leader_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:59902
I20260925 16:47:56.587738 18856 raft_consensus.cc:595] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Received request to transfer leadership to TS 2214de1d38f74b668aa3139202318338
I20260925 16:47:56.590823  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260925 16:47:56.592531  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:47:56.599838  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:56.781724 19731 raft_consensus.cc:979] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: : Instructing follower 95ce93f423f7436fa4863f1c688c9dc5 to start an election
I20260925 16:47:56.782258 19731 raft_consensus.cc:1067] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 95ce93f423f7436fa4863f1c688c9dc5 to start an election
I20260925 16:47:56.783594 18857 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
 from {username='slave'} at 127.0.0.1:38156
I20260925 16:47:56.784071 18857 raft_consensus.cc:482] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:56.784298 18857 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.789180 18857 raft_consensus.cc:504] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.791826 18857 leader_election.cc:288] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:56.791800 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:56.792062 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:56.792430 18930 raft_consensus.cc:3032] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:56.792696 19003 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.792783 18930 raft_consensus.cc:729] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:56.793684 18930 consensus_queue.cc:260] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.795230 18930 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.800572 19003 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 2.
I20260925 16:47:56.802263 18824 leader_election.cc:302] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:56.803220 19799 raft_consensus.cc:2781] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:56.803656 19799 raft_consensus.cc:686] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:56.805123 19799 consensus_queue.cc:237] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.807574 18930 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 2.
I20260925 16:47:56.815230 19800 raft_consensus.cc:979] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: : Instructing follower 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:56.815858 19799 raft_consensus.cc:1067] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Signalling peer 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:56.817678 18930 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354"
dest_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:33560
I20260925 16:47:56.818398 18930 raft_consensus.cc:482] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:56.818779 18930 raft_consensus.cc:3037] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.817368 18679 catalog_manager.cc:5495] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:56.826102 18930 raft_consensus.cc:504] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.828229 18930 leader_election.cc:288] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:56.829239 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:56.829870 18856 raft_consensus.cc:3032] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:56.830123 18856 raft_consensus.cc:729] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:56.829257 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fb9e866f82fd42c7a217585eda8e7354" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:56.836319 19003 raft_consensus.cc:3037] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.830806 18856 consensus_queue.cc:260] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.842059 18856 raft_consensus.cc:3037] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.858857 19003 raft_consensus.cc:2454] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:56.859980 18898 leader_election.cc:302] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:56.860566 18856 raft_consensus.cc:2454] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 2.
I20260925 16:47:56.861215 19797 raft_consensus.cc:2781] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:56.861764 19797 raft_consensus.cc:686] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:56.862601 19797 consensus_queue.cc:237] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:56.874974 18679 catalog_manager.cc:5495] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 1 to 2, leader changed from 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:56.882161 19774 raft_consensus.cc:979] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:56.882822 19801 raft_consensus.cc:1067] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:56.884567 19587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33854
I20260925 16:47:56.885147 19587 raft_consensus.cc:482] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:56.886096 19587 raft_consensus.cc:3037] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.893086 19587 raft_consensus.cc:504] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:56.894388 19587 leader_election.cc:288] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:56.895061 18930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:56.895526 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c3fea8b7be6841d6a16f563afcf1916e" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:56.895728 18930 raft_consensus.cc:3037] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.896157 19003 raft_consensus.cc:3032] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:56.896458 19003 raft_consensus.cc:729] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:56.897203 19003 consensus_queue.cc:260] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:56.899004 19003 raft_consensus.cc:3037] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.904469 18930 raft_consensus.cc:2454] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:56.906126 19003 raft_consensus.cc:2454] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:56.906567 19533 leader_election.cc:302] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:47:56.907423 19749 raft_consensus.cc:2781] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:56.908414 19749 raft_consensus.cc:686] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:56.909255 19749 consensus_queue.cc:237] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:47:56.920914 18679 catalog_manager.cc:5495] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:56.971374 19774 raft_consensus.cc:979] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:56.971876 19801 raft_consensus.cc:1067] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:56.973317 19587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33854
I20260925 16:47:56.973996 19587 raft_consensus.cc:482] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:56.974253 19587 raft_consensus.cc:3037] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.981263 19587 raft_consensus.cc:504] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:56.983220 19587 leader_election.cc:288] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:47:56.984123 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:56.984232 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2570db54563a404ba0205e9af2d7cc1a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:56.984732 19003 raft_consensus.cc:3032] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:56.984788 18856 raft_consensus.cc:3037] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.985164 19003 raft_consensus.cc:729] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:56.985931 19003 consensus_queue.cc:260] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:56.987306 19003 raft_consensus.cc:3037] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:56.990896 18856 raft_consensus.cc:2454] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:56.992270 19003 raft_consensus.cc:2454] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:56.992062 19534 leader_election.cc:302] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:56.993464 19745 raft_consensus.cc:2781] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:56.993896 19745 raft_consensus.cc:686] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:56.994647 19745 consensus_queue.cc:237] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:47:57.005342 18679 catalog_manager.cc:5495] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:57.067579 19731 raft_consensus.cc:979] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:57.068131 19797 raft_consensus.cc:1067] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:57.069557 19584 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33836
I20260925 16:47:57.070061 19584 raft_consensus.cc:482] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:57.070358 19584 raft_consensus.cc:3037] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:57.076771 19584 raft_consensus.cc:504] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:57.078543 19584 leader_election.cc:288] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:57.079160 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:57.079942 18856 raft_consensus.cc:3037] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:57.080948 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5e6afc805c294e3497a293a015f886c2" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:57.081667 18932 raft_consensus.cc:3032] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:57.081952 18932 raft_consensus.cc:729] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:57.082737 18932 consensus_queue.cc:260] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:57.083953 18932 raft_consensus.cc:3037] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:57.086908 18856 raft_consensus.cc:2454] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:57.088042 19534 leader_election.cc:302] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:57.089005 19749 raft_consensus.cc:2781] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:57.089437 19749 raft_consensus.cc:686] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:57.090252 19749 consensus_queue.cc:237] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:57.092621 18932 raft_consensus.cc:2454] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:57.101400 18679 catalog_manager.cc:5495] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:57.279340 18932 raft_consensus.cc:1261] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.280848 19800 consensus_queue.cc:1035] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.301601 19003 raft_consensus.cc:1261] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.303133 19799 consensus_queue.cc:1035] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.319561 19003 raft_consensus.cc:1261] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.320990 19749 consensus_queue.cc:1035] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.362171 18932 raft_consensus.cc:1261] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.366088 19809 consensus_queue.cc:1035] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.411221 18856 raft_consensus.cc:1261] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.413127 19731 consensus_queue.cc:1035] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.425740 19005 raft_consensus.cc:1261] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.427670 19769 consensus_queue.cc:1035] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.501345 18856 raft_consensus.cc:1261] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.502810 19809 consensus_queue.cc:1035] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.512787 19005 raft_consensus.cc:1261] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.516153 19749 consensus_queue.cc:1035] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:57.565335 18857 raft_consensus.cc:1261] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.566929 19809 consensus_queue.cc:1035] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:47:57.576450 18932 raft_consensus.cc:1261] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:57.578001 19749 consensus_queue.cc:1035] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:57.652190  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:57.694789 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "45f690dc20794b529fdeabff43202cf4"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:57.695422 18932 raft_consensus.cc:595] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 45f690dc20794b529fdeabff43202cf4
I20260925 16:47:57.697904 18857 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
mode: GRACEFUL
new_leader_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:59902
I20260925 16:47:57.698565 18857 raft_consensus.cc:595] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Received request to transfer leadership to TS 2214de1d38f74b668aa3139202318338
I20260925 16:47:57.699602  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:47:57.700979  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:47:57.701449  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:57.831030 19799 raft_consensus.cc:979] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: : Instructing follower 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:57.831591 19814 raft_consensus.cc:1067] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Signalling peer 2214de1d38f74b668aa3139202318338 to start an election
I20260925 16:47:57.833046 18932 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30"
dest_uuid: "2214de1d38f74b668aa3139202318338"
 from {username='slave'} at 127.0.0.1:33560
I20260925 16:47:57.833514 18932 raft_consensus.cc:482] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:57.833848 18932 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:57.840276 18932 raft_consensus.cc:504] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:57.842170 18932 leader_election.cc:288] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 3 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:57.842670 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:57.842888 18856 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cd74375a5e1c4503b89b69b20e68de30" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:57.843317 19003 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:57.843508 18856 raft_consensus.cc:3032] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:47:57.843880 18856 raft_consensus.cc:729] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:57.844547 18856 consensus_queue.cc:260] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:57.845675 18856 raft_consensus.cc:3037] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:57.848408 19003 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 3.
I20260925 16:47:57.849548 18898 leader_election.cc:302] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 45f690dc20794b529fdeabff43202cf4; no voters: 
I20260925 16:47:57.850196 19731 raft_consensus.cc:2781] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:47:57.850364 18856 raft_consensus.cc:2454] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2214de1d38f74b668aa3139202318338 in term 3.
I20260925 16:47:57.850693 19731 raft_consensus.cc:686] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 3 LEADER]: Becoming Leader. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:57.851565 19731 consensus_queue.cc:237] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:57.861763 18677 catalog_manager.cc:5495] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 reported cstate change: term changed from 2 to 3, leader changed from 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194) to 2214de1d38f74b668aa3139202318338 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "2214de1d38f74b668aa3139202318338" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:58.273505 19731 raft_consensus.cc:979] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: : Instructing follower 45f690dc20794b529fdeabff43202cf4 to start an election
I20260925 16:47:58.274367 19831 raft_consensus.cc:1067] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 45f690dc20794b529fdeabff43202cf4 to start an election
I20260925 16:47:58.276440 19003 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
 from {username='slave'} at 127.0.0.1:52826
I20260925 16:47:58.276952 19003 raft_consensus.cc:482] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:58.277226 19003 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:58.282888 19003 raft_consensus.cc:504] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:58.284935 19003 leader_election.cc:288] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:58.285669 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:58.286269 18857 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:58.288676 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "45f690dc20794b529fdeabff43202cf4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:58.289304 18932 raft_consensus.cc:3032] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:58.289645 18932 raft_consensus.cc:729] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:58.290335 18932 consensus_queue.cc:260] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:58.291260 18932 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:58.292770 18857 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 2.
I20260925 16:47:58.294049 18970 leader_election.cc:302] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:58.295104 19801 raft_consensus.cc:2781] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:58.295908 19801 raft_consensus.cc:686] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Becoming Leader. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:58.297214 19801 consensus_queue.cc:237] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:58.299309 18932 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 45f690dc20794b529fdeabff43202cf4 in term 2.
I20260925 16:47:58.314441 18677 catalog_manager.cc:5495] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 45f690dc20794b529fdeabff43202cf4 (127.7.158.196). New cstate: current_term: 2 leader_uuid: "45f690dc20794b529fdeabff43202cf4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: HEALTHY } } }
I20260925 16:47:58.339566 18857 raft_consensus.cc:1261] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:58.341136 19831 consensus_queue.cc:1035] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:58.351946 19003 raft_consensus.cc:1261] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Refusing update from remote peer 2214de1d38f74b668aa3139202318338: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:58.355144 19831 consensus_queue.cc:1035] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:58.745550  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:58.756774 18857 raft_consensus.cc:1261] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:58.758839 19832 consensus_queue.cc:1035] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:58.773581 18932 raft_consensus.cc:1261] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 45f690dc20794b529fdeabff43202cf4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:58.776173 19801 consensus_queue.cc:1035] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:58.815088 19005 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6"
dest_uuid: "45f690dc20794b529fdeabff43202cf4"
mode: GRACEFUL
new_leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
 from {username='slave'} at 127.0.0.1:51374
I20260925 16:47:58.815749 19005 raft_consensus.cc:595] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Received request to transfer leadership to TS 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:47:58.819343 18932 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44"
dest_uuid: "2214de1d38f74b668aa3139202318338"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33794
I20260925 16:47:58.819977 18932 raft_consensus.cc:595] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:58.824035  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:47:58.825376  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:47:58.825852  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:58.887434 19836 raft_consensus.cc:979] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:58.888056 19769 raft_consensus.cc:1067] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:47:58.889642 19587 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33836
I20260925 16:47:58.890187 19587 raft_consensus.cc:482] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:58.890467 19587 raft_consensus.cc:3037] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:58.901419 19587 raft_consensus.cc:504] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:58.902765 19587 leader_election.cc:288] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819), 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127)
I20260925 16:47:58.903798 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:58.903798 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7fb80fbc80ab4acc921f87c842434d44" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:47:58.904654 18932 raft_consensus.cc:3032] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:47:58.904685 18857 raft_consensus.cc:3037] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:58.905287 18932 raft_consensus.cc:729] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 2214de1d38f74b668aa3139202318338, State: Running, Role: LEADER
I20260925 16:47:58.906023 18932 consensus_queue.cc:260] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:58.907258 18932 raft_consensus.cc:3037] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:47:58.913887 18857 raft_consensus.cc:2454] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:58.915108 19534 leader_election.cc:302] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:58.915966 19809 raft_consensus.cc:2781] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:47:58.916463 19809 raft_consensus.cc:686] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:47:58.917588 18932 raft_consensus.cc:2454] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:47:58.917335 19809 consensus_queue.cc:237] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } }
I20260925 16:47:58.930932 18679 catalog_manager.cc:5495] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 2214de1d38f74b668aa3139202318338 (127.7.158.195) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:59.324213 19832 raft_consensus.cc:979] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: : Instructing follower 95ce93f423f7436fa4863f1c688c9dc5 to start an election
I20260925 16:47:59.324747 19801 raft_consensus.cc:1067] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Signalling peer 95ce93f423f7436fa4863f1c688c9dc5 to start an election
I20260925 16:47:59.326462 18857 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
 from {username='slave'} at 127.0.0.1:38142
I20260925 16:47:59.326975 18857 raft_consensus.cc:482] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:47:59.327565 18857 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:59.335875 18857 raft_consensus.cc:504] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:59.337247 18857 leader_election.cc:288] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 3 election: Requested vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765)
I20260925 16:47:59.338248 19005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:47:59.338150 18932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "49eeeb50567d415782d85c029c855ef6" candidate_uuid: "95ce93f423f7436fa4863f1c688c9dc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "2214de1d38f74b668aa3139202318338"
I20260925 16:47:59.339058 19005 raft_consensus.cc:3032] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:47:59.339382 18932 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:59.339398 19005 raft_consensus.cc:729] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 45f690dc20794b529fdeabff43202cf4, State: Running, Role: LEADER
I20260925 16:47:59.340514 19005 consensus_queue.cc:260] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:59.341583 19005 raft_consensus.cc:3037] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:47:59.346103 18932 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 3.
I20260925 16:47:59.347332 18821 leader_election.cc:302] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2214de1d38f74b668aa3139202318338, 95ce93f423f7436fa4863f1c688c9dc5; no voters: 
I20260925 16:47:59.347563 19005 raft_consensus.cc:2454] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 95ce93f423f7436fa4863f1c688c9dc5 in term 3.
I20260925 16:47:59.348126 19814 raft_consensus.cc:2781] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:47:59.348654 19814 raft_consensus.cc:686] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 LEADER]: Becoming Leader. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:47:59.349524 19814 consensus_queue.cc:237] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } }
I20260925 16:47:59.359549 18679 catalog_manager.cc:5495] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 reported cstate change: term changed from 2 to 3, leader changed from 45f690dc20794b529fdeabff43202cf4 (127.7.158.196) to 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194). New cstate: current_term: 3 leader_uuid: "95ce93f423f7436fa4863f1c688c9dc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } }
I20260925 16:47:59.399106 18857 raft_consensus.cc:1261] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:59.400568 19809 consensus_queue.cc:1035] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:59.411247 18932 raft_consensus.cc:1261] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:47:59.412901 19809 consensus_queue.cc:1035] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:47:59.867341  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:59.899228 18932 raft_consensus.cc:1261] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:59.900749 19799 consensus_queue.cc:1035] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:47:59.905249 18856 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a"
dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
mode: GRACEFUL
new_leader_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:59902
I20260925 16:47:59.905962 18856 raft_consensus.cc:595] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Received request to transfer leadership to TS 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:47:59.907560  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260925 16:47:59.909396  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:47:59.910058  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:47:59.911181 19005 raft_consensus.cc:1261] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Refusing update from remote peer 95ce93f423f7436fa4863f1c688c9dc5: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:47:59.914383 19814 consensus_queue.cc:1035] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:48:00.144133 19814 raft_consensus.cc:979] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: : Instructing follower 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:48:00.144624 19799 raft_consensus.cc:1067] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Signalling peer 4de55b75c594486d94ca1518de4b3e6f to start an election
I20260925 16:48:00.145957 19585 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a"
dest_uuid: "4de55b75c594486d94ca1518de4b3e6f"
 from {username='slave'} at 127.0.0.1:33848
I20260925 16:48:00.146526 19585 raft_consensus.cc:482] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:00.146870 19585 raft_consensus.cc:3037] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:00.152956 19585 raft_consensus.cc:504] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:00.154830 19585 leader_election.cc:288] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Requested vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:48:00.155902 18857 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "95ce93f423f7436fa4863f1c688c9dc5"
I20260925 16:48:00.156064 19003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8108992d4cfa4399a5c0c6efd1291f6a" candidate_uuid: "4de55b75c594486d94ca1518de4b3e6f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "45f690dc20794b529fdeabff43202cf4"
I20260925 16:48:00.156551 18857 raft_consensus.cc:3032] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:00.156587 19003 raft_consensus.cc:3037] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:00.157085 18857 raft_consensus.cc:729] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 95ce93f423f7436fa4863f1c688c9dc5, State: Running, Role: LEADER
I20260925 16:48:00.157866 18857 consensus_queue.cc:260] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:00.159058 18857 raft_consensus.cc:3037] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:00.163882 19003 raft_consensus.cc:2454] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:48:00.165113 19536 leader_election.cc:302] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f; no voters: 
I20260925 16:48:00.166070 19790 raft_consensus.cc:2781] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:00.166067 18857 raft_consensus.cc:2454] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4de55b75c594486d94ca1518de4b3e6f in term 2.
I20260925 16:48:00.166680 19790 raft_consensus.cc:686] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Becoming Leader. State: Replica: 4de55b75c594486d94ca1518de4b3e6f, State: Running, Role: LEADER
I20260925 16:48:00.167577 19790 consensus_queue.cc:237] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:00.179270 18679 catalog_manager.cc:5495] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f reported cstate change: term changed from 1 to 2, leader changed from 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194) to 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193). New cstate: current_term: 2 leader_uuid: "4de55b75c594486d94ca1518de4b3e6f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:00.711630 19005 raft_consensus.cc:1261] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:00.713788 19790 consensus_queue.cc:1035] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:00.725927 18856 raft_consensus.cc:1261] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Refusing update from remote peer 4de55b75c594486d94ca1518de4b3e6f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:00.727591 19790 consensus_queue.cc:1035] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [LEADER]: Connected to new peer: Peer: permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:00.966522  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:01.011760  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:01.013036  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:01.013547  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:01.053117  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:01.097388  7803 tablet_server.cc:178] TabletServer@127.7.158.193:36337 shutting down...
W20260925 16:48:01.146301 18970 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 90 similar messages]
W20260925 16:48:01.154157 18970 consensus_peers.cc:487] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.159446 18970 consensus_peers.cc:487] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.159603 18822 consensus_peers.cc:487] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.161876 18896 consensus_peers.cc:487] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.164143  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:01.165158  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.166431  7803 raft_consensus.cc:2229] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.167770  7803 raft_consensus.cc:2258] T 2570db54563a404ba0205e9af2d7cc1a P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.171058  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.171897  7803 raft_consensus.cc:2229] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.172475  7803 raft_consensus.cc:2258] T 88a1af2c233844768c8ba7778f5a58ae P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.176496  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.177443  7803 raft_consensus.cc:2229] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.178443  7803 raft_consensus.cc:2258] T 5e6afc805c294e3497a293a015f886c2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.182272  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.183213  7803 raft_consensus.cc:2229] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.184808  7803 raft_consensus.cc:2258] T 541076ccaed74b828fdaa39a9e33a1c0 P 4de55b75c594486d94ca1518de4b3e6f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.187845  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.188881  7803 raft_consensus.cc:2229] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.189512  7803 raft_consensus.cc:2258] T 79157399a8fb41009d17ca277792780b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.193562  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.194478  7803 raft_consensus.cc:2229] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.195650  7803 raft_consensus.cc:2258] T 877d01ad1b7146388b608954cbc4574d P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.197446 18822 consensus_peers.cc:487] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.199168  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.200179  7803 raft_consensus.cc:2229] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.200810  7803 raft_consensus.cc:2258] T b9f1f43de2364a66ae54b5b6eba041d2 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.204334  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.205165  7803 raft_consensus.cc:2229] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.205713  7803 raft_consensus.cc:2258] T cd0fa06962e2429484873fcd69d3591d P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.208721  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.209596  7803 raft_consensus.cc:2229] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.210124  7803 raft_consensus.cc:2258] T b4232305d9da417abeca7e94118abe8e P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.213589  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.214432  7803 raft_consensus.cc:2229] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.215730  7803 raft_consensus.cc:2258] T c3fea8b7be6841d6a16f563afcf1916e P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.216421 18970 consensus_peers.cc:487] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.219456  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.220592  7803 raft_consensus.cc:2229] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
W20260925 16:48:01.221191 18970 consensus_peers.cc:487] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.221292  7803 raft_consensus.cc:2258] T a21dbc5af1e44992abcf69b0d4a3d238 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.224516  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.225198  7803 raft_consensus.cc:2229] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.225549  7803 raft_consensus.cc:2258] T eaf54561cd6d421890074238dbb8a57a P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.227972  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.228715  7803 raft_consensus.cc:2229] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.229209  7803 raft_consensus.cc:2258] T 0ef360c253d749e49df7441283aa6f50 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.232144  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.233071  7803 raft_consensus.cc:2229] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.233695  7803 raft_consensus.cc:2258] T 8fdff79a8c884e798cefb59b1884b37b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.237311 18970 consensus_peers.cc:487] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.237560  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.238514  7803 raft_consensus.cc:2229] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.239431  7803 raft_consensus.cc:2258] T 8108992d4cfa4399a5c0c6efd1291f6a P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.242981  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.243602  7803 raft_consensus.cc:2229] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.244169  7803 raft_consensus.cc:2258] T 59dd7657b032497789d2fc68f2f969b7 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.247398  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.248176  7803 raft_consensus.cc:2229] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.248579  7803 raft_consensus.cc:2258] T 39c4fd5349684aa580c163b167f15aa0 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.250813  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.251650  7803 raft_consensus.cc:2229] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.252748  7803 raft_consensus.cc:2258] T 37ccdcd526ba47b2b415825e4b37e361 P 4de55b75c594486d94ca1518de4b3e6f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.254909 18822 consensus_peers.cc:487] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.255673 18822 consensus_peers.cc:487] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.256106  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.256852  7803 raft_consensus.cc:2229] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.257282  7803 raft_consensus.cc:2258] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.259655  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.260380  7803 raft_consensus.cc:2229] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.260885  7803 raft_consensus.cc:2258] T 49fbefc46cf84318a696efb38b7f44ff P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.263924  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.264535  7803 raft_consensus.cc:2229] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.265636  7803 raft_consensus.cc:2258] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.268512  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.269299  7803 raft_consensus.cc:2229] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.270437  7803 raft_consensus.cc:2258] T 284fe7e2abae4c75999bec672a911342 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.271605 18896 consensus_peers.cc:487] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.273777  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.274741  7803 raft_consensus.cc:2229] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.275146  7803 raft_consensus.cc:2258] T e68a2deed8c14bf4bdfe7deb5417cc56 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.277992  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.278738  7803 raft_consensus.cc:2229] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.279855  7803 raft_consensus.cc:2258] T c76592461bbe4904ac4715bc51953d7f P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.281040 18896 consensus_peers.cc:487] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.282604  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.283306  7803 raft_consensus.cc:2229] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.283764  7803 raft_consensus.cc:2258] T acdc1cf1c6854ba3a3f9819d8afccccc P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.286716  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.287593  7803 raft_consensus.cc:2229] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.288182  7803 raft_consensus.cc:2258] T 19e0d07bb13a4413983a58ea3449cc0c P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.290680  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.291443  7803 raft_consensus.cc:2229] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.291971  7803 raft_consensus.cc:2258] T 172d70ae40f44cbd8d1f59c037fb2e04 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.294015  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.294610  7803 raft_consensus.cc:2229] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.295135  7803 raft_consensus.cc:2258] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.298077  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.298657  7803 raft_consensus.cc:2229] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.299563  7803 raft_consensus.cc:2258] T 7fb80fbc80ab4acc921f87c842434d44 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.301916  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.302467  7803 raft_consensus.cc:2229] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.303311  7803 raft_consensus.cc:2258] T 70ad3553e755461c9a8e998b4f54a138 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.305557  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.306109  7803 raft_consensus.cc:2229] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.306578  7803 raft_consensus.cc:2258] T f55e0c43cee44971a3a7483c91ead27b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.308960  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.309768  7803 raft_consensus.cc:2229] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.310261  7803 raft_consensus.cc:2258] T bfc7929e7dd84f6fba5909bdcab84721 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.313130  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.313771  7803 raft_consensus.cc:2229] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.314172  7803 raft_consensus.cc:2258] T 9c4452fe3a6e47749633e00bb65aeb8b P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.317005  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.317899  7803 raft_consensus.cc:2229] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.318430  7803 raft_consensus.cc:2258] T a5c4d8141b90433fbf058da0d0641809 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.318867 18822 consensus_peers.cc:487] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.321796  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.322492  7803 raft_consensus.cc:2229] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.322956  7803 raft_consensus.cc:2258] T df1e87cab2c64f9f870050016e4677f3 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.325387  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.325912  7803 raft_consensus.cc:2229] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.326351  7803 raft_consensus.cc:2258] T 4267fb73e9d54bbbb335e2137af161b4 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.328557  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.329077  7803 raft_consensus.cc:2229] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.329535  7803 raft_consensus.cc:2258] T 7293be9e009d40c88899bbef09077e1c P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.331562  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.332098  7803 raft_consensus.cc:2229] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.332548  7803 raft_consensus.cc:2258] T ca3a94319c924815ac7fb94f095c36ed P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.335628  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.336871  7803 raft_consensus.cc:2229] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.338456  7803 raft_consensus.cc:2258] T d8b11e95748c4f57ace6efc0aa7344c4 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.339953 18896 consensus_peers.cc:487] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.343323  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.344411  7803 raft_consensus.cc:2229] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.345808  7803 raft_consensus.cc:2258] T 7f2847dc34a04a54912396f67a4d07b2 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.348654  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.349350  7803 raft_consensus.cc:2229] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.349740  7803 raft_consensus.cc:2258] T a50eab07c6334fde8ca0537cf60c9928 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.352932  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.353590  7803 raft_consensus.cc:2229] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.354071  7803 raft_consensus.cc:2258] T 5aa425847ff64d34a5137a5224513e75 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.356833  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.357405  7803 raft_consensus.cc:2229] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.358771  7803 raft_consensus.cc:2258] T a8d68e12cdea4099aa6d278a53a7af17 P 4de55b75c594486d94ca1518de4b3e6f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.361877  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.362630  7803 raft_consensus.cc:2229] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
W20260925 16:48:01.362496 18970 consensus_peers.cc:487] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.363502  7803 raft_consensus.cc:2258] T 80f37dab820e4459b45ad556ef1dcc09 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.365968  7803 tablet_replica.cc:330] stopping tablet replica
I20260925 16:48:01.366640  7803 raft_consensus.cc:2229] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.367085  7803 raft_consensus.cc:2258] T 22bc127e42794a80991754fc732a2f60 P 4de55b75c594486d94ca1518de4b3e6f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.380899 18896 consensus_peers.cc:487] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.402105 18896 consensus_peers.cc:487] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.429042 18896 consensus_peers.cc:487] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.461174  7803 tablet_server.cc:194] TabletServer@127.7.158.193:36337 shutdown complete.
W20260925 16:48:01.476251 18896 consensus_peers.cc:487] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.489392 18970 consensus_peers.cc:487] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.490121 18896 consensus_peers.cc:487] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.490139 18970 consensus_peers.cc:487] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.499436 18822 consensus_peers.cc:487] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.520396 18822 consensus_peers.cc:487] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.530558 18822 consensus_peers.cc:487] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.539656 18970 consensus_peers.cc:487] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.541342 18896 consensus_peers.cc:487] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.551662 18970 consensus_peers.cc:487] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.570950  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:48:01.596841 18822 consensus_peers.cc:487] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.660768 18822 consensus_peers.cc:487] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.665868  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:01.668828  7803 tablet_replica.cc:330] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.669994  7803 raft_consensus.cc:2229] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.670717  7803 raft_consensus.cc:2258] T cd0fa06962e2429484873fcd69d3591d P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.674175  7803 tablet_replica.cc:330] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.675014  7803 raft_consensus.cc:2229] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.675655  7803 raft_consensus.cc:2258] T eeb6462147004a588cfd7aa36658ae4a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.676538 18896 consensus_peers.cc:487] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.684232 18970 consensus_peers.cc:487] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 -> Peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Couldn't send request to peer 4de55b75c594486d94ca1518de4b3e6f. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.701298 18970 consensus_peers.cc:487] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.704182 18970 consensus_peers.cc:487] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.707712  7803 tablet_replica.cc:330] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.708721  7803 raft_consensus.cc:2229] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.709336  7803 raft_consensus.cc:2258] T a21dbc5af1e44992abcf69b0d4a3d238 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.712750  7803 tablet_replica.cc:330] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.713707  7803 raft_consensus.cc:2229] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.715014  7803 raft_consensus.cc:2258] T 172d70ae40f44cbd8d1f59c037fb2e04 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.717897  7803 tablet_replica.cc:330] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.718662  7803 raft_consensus.cc:2229] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.719223  7803 raft_consensus.cc:2258] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.721527  7803 tablet_replica.cc:330] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.722229  7803 raft_consensus.cc:2229] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.722744  7803 raft_consensus.cc:2258] T 284fe7e2abae4c75999bec672a911342 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.726783  7803 tablet_replica.cc:330] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
W20260925 16:48:01.727643 18970 consensus_peers.cc:487] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.727825  7803 raft_consensus.cc:2229] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.729071  7803 raft_consensus.cc:2258] T 5bb250f028fa4a75a53db16d27a92efa P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.732226  7803 tablet_replica.cc:330] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.733208  7803 raft_consensus.cc:2229] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.733790  7803 raft_consensus.cc:2258] T d871558c98cc4c489854c783d1585d95 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.737046  7803 tablet_replica.cc:330] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.737882  7803 raft_consensus.cc:2229] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.739028  7803 raft_consensus.cc:2258] T 49eeeb50567d415782d85c029c855ef6 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.742285  7803 tablet_replica.cc:330] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.743124  7803 raft_consensus.cc:2229] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.744315  7803 raft_consensus.cc:2258] T 22bc127e42794a80991754fc732a2f60 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.748112  7803 tablet_replica.cc:330] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.748997  7803 raft_consensus.cc:2229] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.749505  7803 raft_consensus.cc:2258] T 8108992d4cfa4399a5c0c6efd1291f6a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.752717  7803 tablet_replica.cc:330] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.754534  7803 raft_consensus.cc:2229] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.755156  7803 raft_consensus.cc:2258] T 8fdff79a8c884e798cefb59b1884b37b P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.758039  7803 tablet_replica.cc:330] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.759209  7803 raft_consensus.cc:2229] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.760900  7803 raft_consensus.cc:2258] T 59dd7657b032497789d2fc68f2f969b7 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.763556  7803 tablet_replica.cc:330] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.764245  7803 raft_consensus.cc:2229] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.765000  7803 raft_consensus.cc:2258] T 39c4fd5349684aa580c163b167f15aa0 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.767050  7803 tablet_replica.cc:330] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.767596  7803 raft_consensus.cc:2229] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.768465  7803 raft_consensus.cc:2258] T a50eab07c6334fde8ca0537cf60c9928 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.770330  7803 tablet_replica.cc:330] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.770916  7803 raft_consensus.cc:2229] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.771387  7803 raft_consensus.cc:2258] T 7f2847dc34a04a54912396f67a4d07b2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.773471  7803 tablet_replica.cc:330] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.774163  7803 raft_consensus.cc:2229] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.774659  7803 raft_consensus.cc:2258] T eaf54561cd6d421890074238dbb8a57a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.777305  7803 tablet_replica.cc:330] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.778147  7803 raft_consensus.cc:2229] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.778710  7803 raft_consensus.cc:2258] T 70ad3553e755461c9a8e998b4f54a138 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.780016 18970 consensus_peers.cc:487] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.781766 18896 consensus_peers.cc:487] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.782061  7803 tablet_replica.cc:330] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.783056  7803 raft_consensus.cc:2229] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.783566  7803 raft_consensus.cc:2258] T 7fb80fbc80ab4acc921f87c842434d44 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.785686  7803 tablet_replica.cc:330] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.786317  7803 raft_consensus.cc:2229] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.786921  7803 raft_consensus.cc:2258] T fb9e866f82fd42c7a217585eda8e7354 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.788909  7803 tablet_replica.cc:330] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.789486  7803 raft_consensus.cc:2229] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.789965  7803 raft_consensus.cc:2258] T 2570db54563a404ba0205e9af2d7cc1a P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.792309  7803 tablet_replica.cc:330] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.793162  7803 raft_consensus.cc:2229] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.793741  7803 raft_consensus.cc:2258] T bfc7929e7dd84f6fba5909bdcab84721 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.797124 18970 consensus_peers.cc:487] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.797582  7803 tablet_replica.cc:330] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.798880  7803 raft_consensus.cc:2229] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.799649  7803 raft_consensus.cc:2258] T a8d68e12cdea4099aa6d278a53a7af17 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.803221  7803 tablet_replica.cc:330] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.804051  7803 raft_consensus.cc:2229] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.804608  7803 raft_consensus.cc:2258] T b9f1f43de2364a66ae54b5b6eba041d2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.807643  7803 tablet_replica.cc:330] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.808460  7803 raft_consensus.cc:2229] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.808950  7803 raft_consensus.cc:2258] T 39936f93e1a64ff290f8bcb31e35b2ee P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.819766  7803 tablet_replica.cc:330] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.820611  7803 raft_consensus.cc:2229] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.821223  7803 raft_consensus.cc:2258] T 5e6afc805c294e3497a293a015f886c2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.823827  7803 tablet_replica.cc:330] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.824471  7803 raft_consensus.cc:2229] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.825186  7803 raft_consensus.cc:2258] T 179c5529bce9433e91b98e095c37f5ba P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.827922  7803 tablet_replica.cc:330] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.828620  7803 raft_consensus.cc:2229] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.829561  7803 raft_consensus.cc:2258] T 9db46060b3a2424ba8e4a67debeeda7a P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.832486  7803 tablet_replica.cc:330] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.832981  7803 raft_consensus.cc:2229] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.833694  7803 raft_consensus.cc:2258] T b7081600b02b48fb83f2b33eae404adf P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.835603  7803 tablet_replica.cc:330] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.836238  7803 raft_consensus.cc:2229] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.836688  7803 raft_consensus.cc:2258] T c76592461bbe4904ac4715bc51953d7f P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.838680  7803 tablet_replica.cc:330] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.839236  7803 raft_consensus.cc:2229] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.840121  7803 raft_consensus.cc:2258] T e68a2deed8c14bf4bdfe7deb5417cc56 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.842720  7803 tablet_replica.cc:330] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.843333  7803 raft_consensus.cc:2229] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.844275  7803 raft_consensus.cc:2258] T ca3a94319c924815ac7fb94f095c36ed P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.846791  7803 tablet_replica.cc:330] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.847368  7803 raft_consensus.cc:2229] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.848008  7803 raft_consensus.cc:2258] T d8b11e95748c4f57ace6efc0aa7344c4 P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.848930 18970 consensus_peers.cc:487] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.850725  7803 tablet_replica.cc:330] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.851399  7803 raft_consensus.cc:2229] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.852365  7803 raft_consensus.cc:2258] T e068820a06364f1cb92b7b4701f9d8e2 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.854995  7803 tablet_replica.cc:330] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
W20260925 16:48:01.855548 18896 consensus_peers.cc:487] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.855763  7803 raft_consensus.cc:2229] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.856669  7803 raft_consensus.cc:2258] T 19e0d07bb13a4413983a58ea3449cc0c P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.858592  7803 tablet_replica.cc:330] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.859586  7803 raft_consensus.cc:2229] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.860183  7803 raft_consensus.cc:2258] T 61c81981a43a4ea180b0ac988ba75519 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.862403  7803 tablet_replica.cc:330] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.863075  7803 raft_consensus.cc:2229] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.863517  7803 raft_consensus.cc:2258] T 88a1af2c233844768c8ba7778f5a58ae P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.865428  7803 tablet_replica.cc:330] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.865945  7803 raft_consensus.cc:2229] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.866802  7803 raft_consensus.cc:2258] T 17301ed72d3d4a7abaebb081f70f39c9 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.869120  7803 tablet_replica.cc:330] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.869935  7803 raft_consensus.cc:2229] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.870574  7803 raft_consensus.cc:2258] T cd74375a5e1c4503b89b69b20e68de30 P 95ce93f423f7436fa4863f1c688c9dc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.873365  7803 tablet_replica.cc:330] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.874276  7803 raft_consensus.cc:2229] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.875661  7803 raft_consensus.cc:2258] T 877d01ad1b7146388b608954cbc4574d P 95ce93f423f7436fa4863f1c688c9dc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.878398  7803 tablet_replica.cc:330] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.879114  7803 raft_consensus.cc:2229] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.880000  7803 raft_consensus.cc:2258] T dd5c1c958e2143a6972ab64a912fa7d5 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.883349  7803 tablet_replica.cc:330] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.884040  7803 raft_consensus.cc:2229] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.884871  7803 raft_consensus.cc:2258] T b4232305d9da417abeca7e94118abe8e P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.886821  7803 tablet_replica.cc:330] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.887405  7803 raft_consensus.cc:2229] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:01.887895  7803 raft_consensus.cc:2258] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:01.890391  7803 tablet_replica.cc:330] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5: stopping tablet replica
I20260925 16:48:01.891011  7803 raft_consensus.cc:2229] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:01.891957  7803 raft_consensus.cc:2258] T 49fbefc46cf84318a696efb38b7f44ff P 95ce93f423f7436fa4863f1c688c9dc5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:01.893242 18896 consensus_peers.cc:487] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.910073 18970 consensus_peers.cc:487] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.911000 18896 consensus_peers.cc:487] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.911738 18896 consensus_peers.cc:487] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.923605 18970 consensus_peers.cc:487] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:01.947988 18896 consensus_peers.cc:487] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:01.996417  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:48:02.090174 19851 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.090952 19851 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:48:02.093464 19851 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 45f690dc20794b529fdeabff43202cf4 (127.7.158.196:45765), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:48:02.096134 19006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "541076ccaed74b828fdaa39a9e33a1c0" candidate_uuid: "2214de1d38f74b668aa3139202318338" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "45f690dc20794b529fdeabff43202cf4" is_pre_election: true
W20260925 16:48:02.098660 18896 leader_election.cc:334] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:48:02.099133 18896 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2214de1d38f74b668aa3139202318338; no voters: 45f690dc20794b529fdeabff43202cf4, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:48:02.100126 19851 raft_consensus.cc:2726] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260925 16:48:02.106602 18896 consensus_peers.cc:487] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.108584  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
W20260925 16:48:02.151057 18970 consensus_peers.cc:487] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:02.170709 18970 consensus_peers.cc:487] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 -> Peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Couldn't send request to peer 95ce93f423f7436fa4863f1c688c9dc5. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.182236  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:02.183377  7803 tablet_replica.cc:330] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.184199  7803 raft_consensus.cc:2229] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.185153  7803 raft_consensus.cc:2258] T cd0fa06962e2429484873fcd69d3591d P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.187530  7803 tablet_replica.cc:330] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.188215  7803 raft_consensus.cc:2229] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.188696  7803 raft_consensus.cc:2258] T 541076ccaed74b828fdaa39a9e33a1c0 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.190757  7803 tablet_replica.cc:330] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.191324  7803 raft_consensus.cc:2229] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.191771  7803 raft_consensus.cc:2258] T 79157399a8fb41009d17ca277792780b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.193732  7803 tablet_replica.cc:330] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.194255  7803 raft_consensus.cc:2229] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.195447  7803 raft_consensus.cc:2258] T cd74375a5e1c4503b89b69b20e68de30 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.198110  7803 tablet_replica.cc:330] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.198596  7803 raft_consensus.cc:2229] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.199056  7803 raft_consensus.cc:2258] T 5bb250f028fa4a75a53db16d27a92efa P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.200882  7803 tablet_replica.cc:330] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.201406  7803 raft_consensus.cc:2229] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.202235  7803 raft_consensus.cc:2258] T d871558c98cc4c489854c783d1585d95 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.204273  7803 tablet_replica.cc:330] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.204813  7803 raft_consensus.cc:2229] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.205253  7803 raft_consensus.cc:2258] T ca3a94319c924815ac7fb94f095c36ed P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.208375  7803 tablet_replica.cc:330] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.209232  7803 raft_consensus.cc:2229] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.209811  7803 raft_consensus.cc:2258] T 22bc127e42794a80991754fc732a2f60 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.212338  7803 tablet_replica.cc:330] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.213110  7803 raft_consensus.cc:2229] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.213927  7803 raft_consensus.cc:2258] T 80f37dab820e4459b45ad556ef1dcc09 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.215934  7803 tablet_replica.cc:330] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.216583  7803 raft_consensus.cc:2229] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.217084  7803 raft_consensus.cc:2258] T 7f2847dc34a04a54912396f67a4d07b2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.219467  7803 tablet_replica.cc:330] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.220067  7803 raft_consensus.cc:2229] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.220522  7803 raft_consensus.cc:2258] T dd5c1c958e2143a6972ab64a912fa7d5 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.223119  7803 tablet_replica.cc:330] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.223753  7803 raft_consensus.cc:2229] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.224217  7803 raft_consensus.cc:2258] T 7293be9e009d40c88899bbef09077e1c P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.226967  7803 tablet_replica.cc:330] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.227793  7803 raft_consensus.cc:2229] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.228325  7803 raft_consensus.cc:2258] T f55e0c43cee44971a3a7483c91ead27b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.230597  7803 tablet_replica.cc:330] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.231194  7803 raft_consensus.cc:2229] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.231594  7803 raft_consensus.cc:2258] T df1e87cab2c64f9f870050016e4677f3 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.233659  7803 tablet_replica.cc:330] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.234232  7803 raft_consensus.cc:2229] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.234877  7803 raft_consensus.cc:2258] T 49eeeb50567d415782d85c029c855ef6 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.237416  7803 tablet_replica.cc:330] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.238129  7803 raft_consensus.cc:2229] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.239289  7803 raft_consensus.cc:2258] T 4267fb73e9d54bbbb335e2137af161b4 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.242805  7803 tablet_replica.cc:330] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.243743  7803 raft_consensus.cc:2229] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.244307  7803 raft_consensus.cc:2258] T 17301ed72d3d4a7abaebb081f70f39c9 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.247215  7803 tablet_replica.cc:330] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.248023  7803 raft_consensus.cc:2229] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.248967  7803 raft_consensus.cc:2258] T eaf54561cd6d421890074238dbb8a57a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:02.251329 18969 consensus_peers.cc:487] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.251623  7803 tablet_replica.cc:330] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.252593  7803 raft_consensus.cc:2229] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.253111  7803 raft_consensus.cc:2258] T 9db46060b3a2424ba8e4a67debeeda7a P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.256376  7803 tablet_replica.cc:330] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.257205  7803 raft_consensus.cc:2229] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.257880  7803 raft_consensus.cc:2258] T b7081600b02b48fb83f2b33eae404adf P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.261468  7803 tablet_replica.cc:330] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.262154  7803 raft_consensus.cc:2229] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.263334  7803 raft_consensus.cc:2258] T fb9e866f82fd42c7a217585eda8e7354 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.265856  7803 tablet_replica.cc:330] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.266635  7803 raft_consensus.cc:2229] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.267130  7803 raft_consensus.cc:2258] T 70ad3553e755461c9a8e998b4f54a138 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.269797  7803 tablet_replica.cc:330] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.270532  7803 raft_consensus.cc:2229] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.271353  7803 raft_consensus.cc:2258] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.274003  7803 tablet_replica.cc:330] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.275166  7803 raft_consensus.cc:2229] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.275749  7803 raft_consensus.cc:2258] T 7fb80fbc80ab4acc921f87c842434d44 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.277829  7803 tablet_replica.cc:330] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.278404  7803 raft_consensus.cc:2229] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.278887  7803 raft_consensus.cc:2258] T c3fea8b7be6841d6a16f563afcf1916e P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.281312  7803 tablet_replica.cc:330] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.281929  7803 raft_consensus.cc:2229] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.282398  7803 raft_consensus.cc:2258] T 9c4452fe3a6e47749633e00bb65aeb8b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.284538  7803 tablet_replica.cc:330] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.285266  7803 raft_consensus.cc:2229] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.287309  7803 raft_consensus.cc:2258] T eeb6462147004a588cfd7aa36658ae4a P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.290122  7803 tablet_replica.cc:330] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.290834  7803 raft_consensus.cc:2229] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.291757  7803 raft_consensus.cc:2258] T a5c4d8141b90433fbf058da0d0641809 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.293941  7803 tablet_replica.cc:330] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.294479  7803 raft_consensus.cc:2229] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.295665  7803 raft_consensus.cc:2258] T 179c5529bce9433e91b98e095c37f5ba P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.297886  7803 tablet_replica.cc:330] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.298761  7803 raft_consensus.cc:2229] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.299564  7803 raft_consensus.cc:2258] T 5e6afc805c294e3497a293a015f886c2 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.301555  7803 tablet_replica.cc:330] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.302258  7803 raft_consensus.cc:2229] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.302840  7803 raft_consensus.cc:2258] T 284fe7e2abae4c75999bec672a911342 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.304993  7803 tablet_replica.cc:330] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.305624  7803 raft_consensus.cc:2229] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.306092  7803 raft_consensus.cc:2258] T 39936f93e1a64ff290f8bcb31e35b2ee P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.308113  7803 tablet_replica.cc:330] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.308693  7803 raft_consensus.cc:2229] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.309136  7803 raft_consensus.cc:2258] T b4232305d9da417abeca7e94118abe8e P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.311823  7803 tablet_replica.cc:330] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.312516  7803 raft_consensus.cc:2229] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.313194  7803 raft_consensus.cc:2258] T 59dd7657b032497789d2fc68f2f969b7 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.316368  7803 tablet_replica.cc:330] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.316982  7803 raft_consensus.cc:2229] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.317906  7803 raft_consensus.cc:2258] T 8fdff79a8c884e798cefb59b1884b37b P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.320761  7803 tablet_replica.cc:330] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.321401  7803 raft_consensus.cc:2229] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.321990  7803 raft_consensus.cc:2258] T 39c4fd5349684aa580c163b167f15aa0 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.324824  7803 tablet_replica.cc:330] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.325428  7803 raft_consensus.cc:2229] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.325855  7803 raft_consensus.cc:2258] T 37ccdcd526ba47b2b415825e4b37e361 P 2214de1d38f74b668aa3139202318338 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.327637  7803 tablet_replica.cc:330] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.328199  7803 raft_consensus.cc:2229] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.328608  7803 raft_consensus.cc:2258] T 49fbefc46cf84318a696efb38b7f44ff P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.330603  7803 tablet_replica.cc:330] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.331127  7803 raft_consensus.cc:2229] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.332121  7803 raft_consensus.cc:2258] T 0ef360c253d749e49df7441283aa6f50 P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.334787  7803 tablet_replica.cc:330] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.335562  7803 raft_consensus.cc:2229] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
W20260925 16:48:02.336140 18969 consensus_peers.cc:487] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.336916  7803 raft_consensus.cc:2258] T 5aa425847ff64d34a5137a5224513e75 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.339970  7803 tablet_replica.cc:330] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.340570  7803 raft_consensus.cc:2229] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.341050  7803 raft_consensus.cc:2258] T c76592461bbe4904ac4715bc51953d7f P 2214de1d38f74b668aa3139202318338 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.343462  7803 tablet_replica.cc:330] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.344089  7803 raft_consensus.cc:2229] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.345448  7803 raft_consensus.cc:2258] T acdc1cf1c6854ba3a3f9819d8afccccc P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.348547  7803 tablet_replica.cc:330] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
W20260925 16:48:02.349243 18969 consensus_peers.cc:487] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.349264  7803 raft_consensus.cc:2229] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.350097  7803 raft_consensus.cc:2258] T e068820a06364f1cb92b7b4701f9d8e2 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.352758  7803 tablet_replica.cc:330] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338: stopping tablet replica
I20260925 16:48:02.353366  7803 raft_consensus.cc:2229] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.353909  7803 raft_consensus.cc:2258] T 61c81981a43a4ea180b0ac988ba75519 P 2214de1d38f74b668aa3139202318338 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:02.364849 18969 consensus_peers.cc:487] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.400478 19865 raft_consensus.cc:482] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.401196 19865 raft_consensus.cc:504] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:48:02.403771 19865 leader_election.cc:288] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
W20260925 16:48:02.406793 18969 leader_election.cc:334] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260925 16:48:02.408133 18970 leader_election.cc:334] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:48:02.408600 18970 leader_election.cc:302] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:48:02.409301 19865 raft_consensus.cc:2726] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:48:02.442180  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
W20260925 16:48:02.469693 18969 consensus_peers.cc:487] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.513595  7803 tablet_server.cc:178] TabletServer@127.7.158.196:0 shutting down...
I20260925 16:48:02.524655 19865 raft_consensus.cc:482] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.525337 19865 raft_consensus.cc:504] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:02.527601 19865 leader_election.cc:288] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
W20260925 16:48:02.533185 18970 leader_election.cc:334] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
W20260925 16:48:02.533874 18970 leader_election.cc:334] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111)
I20260925 16:48:02.534307 18970 leader_election.cc:302] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:48:02.535478 19865 raft_consensus.cc:2726] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:48:02.544351 19865 raft_consensus.cc:482] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.545001 19865 raft_consensus.cc:504] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:48:02.547067 19865 leader_election.cc:288] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
W20260925 16:48:02.553076 18969 leader_election.cc:334] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111)
W20260925 16:48:02.554217 18970 leader_election.cc:334] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:48:02.555028 18970 leader_election.cc:302] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:48:02.556118 19865 raft_consensus.cc:2726] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:48:02.559894 19865 raft_consensus.cc:482] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.560377 19865 raft_consensus.cc:504] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:02.562340 19865 leader_election.cc:288] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
W20260925 16:48:02.569267 18970 leader_election.cc:334] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
W20260925 16:48:02.571321 18970 leader_election.cc:334] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111)
I20260925 16:48:02.571679 18970 leader_election.cc:302] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:48:02.572359 19865 raft_consensus.cc:2726] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:48:02.586540  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:02.587814  7803 tablet_replica.cc:330] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.588940  7803 raft_consensus.cc:2229] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.589825  7803 raft_consensus.cc:2258] T 541076ccaed74b828fdaa39a9e33a1c0 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.592718  7803 tablet_replica.cc:330] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.593420  7803 raft_consensus.cc:2229] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.593883  7803 raft_consensus.cc:2258] T cfaca9c07b0a4e0e8859c15c7f0e43d1 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.596751  7803 tablet_replica.cc:330] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.597409  7803 raft_consensus.cc:2229] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.598278  7803 raft_consensus.cc:2258] T 10b8d7fdd5d24fdf82b70406d9cd5a37 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.601682  7803 tablet_replica.cc:330] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.602784  7803 raft_consensus.cc:2229] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
W20260925 16:48:02.603649 18969 consensus_peers.cc:487] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.603976  7803 raft_consensus.cc:2258] T 79157399a8fb41009d17ca277792780b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:02.604383 18969 consensus_peers.cc:487] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:02.604831 18969 consensus_peers.cc:487] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.606688  7803 tablet_replica.cc:330] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.607398  7803 raft_consensus.cc:2229] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.607983  7803 raft_consensus.cc:2258] T 172d70ae40f44cbd8d1f59c037fb2e04 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.610525  7803 tablet_replica.cc:330] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
W20260925 16:48:02.610757 18969 consensus_peers.cc:487] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 -> Peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Couldn't send request to peer 2214de1d38f74b668aa3139202318338. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:02.611299  7803 raft_consensus.cc:2229] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.611783  7803 raft_consensus.cc:2258] T a50eab07c6334fde8ca0537cf60c9928 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.613792  7803 tablet_replica.cc:330] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.614320  7803 raft_consensus.cc:2229] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.615059  7803 raft_consensus.cc:2258] T f55e0c43cee44971a3a7483c91ead27b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.617017  7803 tablet_replica.cc:330] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.617502  7803 raft_consensus.cc:2229] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.618250  7803 raft_consensus.cc:2258] T e6b8d8271b4e4be4b59fc66ebd6a6938 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.621372  7803 tablet_replica.cc:330] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.622076  7803 raft_consensus.cc:2229] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.623150  7803 raft_consensus.cc:2258] T 5bb250f028fa4a75a53db16d27a92efa P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.625540  7803 tablet_replica.cc:330] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.626420  7803 raft_consensus.cc:2229] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.626994  7803 raft_consensus.cc:2258] T d871558c98cc4c489854c783d1585d95 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.629441  7803 tablet_replica.cc:330] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.630074  7803 raft_consensus.cc:2229] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.631249  7803 raft_consensus.cc:2258] T a21dbc5af1e44992abcf69b0d4a3d238 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.632911 19880 raft_consensus.cc:482] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.633416 19880 raft_consensus.cc:504] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2214de1d38f74b668aa3139202318338" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 33127 } } peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } }
I20260925 16:48:02.634116  7803 tablet_replica.cc:330] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.634820  7803 raft_consensus.cc:2229] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.635380 19880 leader_election.cc:288] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127), 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337)
I20260925 16:48:02.635877  7803 raft_consensus.cc:2258] T dd5c1c958e2143a6972ab64a912fa7d5 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.637048 19880 raft_consensus.cc:482] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.637567 19880 raft_consensus.cc:504] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:02.638129 19865 raft_consensus.cc:482] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 4de55b75c594486d94ca1518de4b3e6f)
I20260925 16:48:02.638825  7803 tablet_replica.cc:330] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.638653 19865 raft_consensus.cc:504] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "45f690dc20794b529fdeabff43202cf4" member_type: VOTER last_known_addr { host: "127.7.158.196" port: 45765 } } peers { permanent_uuid: "4de55b75c594486d94ca1518de4b3e6f" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 36337 } } peers { permanent_uuid: "95ce93f423f7436fa4863f1c688c9dc5" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 44819 } }
I20260925 16:48:02.639745  7803 raft_consensus.cc:2229] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.640072 19880 leader_election.cc:288] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
W20260925 16:48:02.640305 18969 leader_election.cc:334] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 2214de1d38f74b668aa3139202318338 (127.7.158.195:33127): Network error: Client connection negotiation failed: client connection to 127.7.158.195:33127: connect: Connection refused (error 111)
I20260925 16:48:02.640583 19865 leader_election.cc:288] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337), 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819)
I20260925 16:48:02.640827  7803 raft_consensus.cc:2258] T df1e87cab2c64f9f870050016e4677f3 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:02.642828 18970 leader_election.cc:334] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:48:02.643200 18970 leader_election.cc:302] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 2214de1d38f74b668aa3139202318338, 4de55b75c594486d94ca1518de4b3e6f
I20260925 16:48:02.643492  7803 tablet_replica.cc:330] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.643838 19865 raft_consensus.cc:2726] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260925 16:48:02.644474  7803 raft_consensus.cc:2229] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.645032  7803 raft_consensus.cc:2258] T cd74375a5e1c4503b89b69b20e68de30 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.647825  7803 tablet_replica.cc:330] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
W20260925 16:48:02.647908 18970 leader_election.cc:334] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:48:02.648494  7803 raft_consensus.cc:2229] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260925 16:48:02.648615 18970 leader_election.cc:334] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 4de55b75c594486d94ca1518de4b3e6f (127.7.158.193:36337): Network error: Client connection negotiation failed: client connection to 127.7.158.193:36337: connect: Connection refused (error 111)
I20260925 16:48:02.649109  7803 raft_consensus.cc:2258] T 877d01ad1b7146388b608954cbc4574d P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:02.649313 18970 leader_election.cc:334] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111)
I20260925 16:48:02.649753 18970 leader_election.cc:302] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:48:02.650455 19865 raft_consensus.cc:2726] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260925 16:48:02.650548 18970 leader_election.cc:334] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 95ce93f423f7436fa4863f1c688c9dc5 (127.7.158.194:44819): Network error: Client connection negotiation failed: client connection to 127.7.158.194:44819: connect: Connection refused (error 111)
I20260925 16:48:02.651181 18970 leader_election.cc:302] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 45f690dc20794b529fdeabff43202cf4; no voters: 4de55b75c594486d94ca1518de4b3e6f, 95ce93f423f7436fa4863f1c688c9dc5
I20260925 16:48:02.651914  7803 tablet_replica.cc:330] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.651960 19865 raft_consensus.cc:2726] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260925 16:48:02.652953  7803 raft_consensus.cc:2229] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.653546  7803 raft_consensus.cc:2258] T 49eeeb50567d415782d85c029c855ef6 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.655737  7803 tablet_replica.cc:330] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.656533  7803 raft_consensus.cc:2229] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.657054  7803 raft_consensus.cc:2258] T 4267fb73e9d54bbbb335e2137af161b4 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.659169  7803 tablet_replica.cc:330] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.660008  7803 raft_consensus.cc:2229] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.661103  7803 raft_consensus.cc:2258] T 7293be9e009d40c88899bbef09077e1c P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.664399  7803 tablet_replica.cc:330] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.665055  7803 raft_consensus.cc:2229] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.665594  7803 raft_consensus.cc:2258] T 8108992d4cfa4399a5c0c6efd1291f6a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.667570  7803 tablet_replica.cc:330] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.668241  7803 raft_consensus.cc:2229] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.668680  7803 raft_consensus.cc:2258] T 37ccdcd526ba47b2b415825e4b37e361 P 45f690dc20794b529fdeabff43202cf4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.670516  7803 tablet_replica.cc:330] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.671041  7803 raft_consensus.cc:2229] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.671471  7803 raft_consensus.cc:2258] T fb9e866f82fd42c7a217585eda8e7354 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.673329  7803 tablet_replica.cc:330] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.673857  7803 raft_consensus.cc:2229] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.674283  7803 raft_consensus.cc:2258] T 2570db54563a404ba0205e9af2d7cc1a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.676939  7803 tablet_replica.cc:330] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.677655  7803 raft_consensus.cc:2229] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.678175  7803 raft_consensus.cc:2258] T b7081600b02b48fb83f2b33eae404adf P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.680631  7803 tablet_replica.cc:330] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.681316  7803 raft_consensus.cc:2229] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.681754  7803 raft_consensus.cc:2258] T 9db46060b3a2424ba8e4a67debeeda7a P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.683626  7803 tablet_replica.cc:330] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.684176  7803 raft_consensus.cc:2229] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.684589  7803 raft_consensus.cc:2258] T 5aa425847ff64d34a5137a5224513e75 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.686622  7803 tablet_replica.cc:330] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.687217  7803 raft_consensus.cc:2229] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.688053  7803 raft_consensus.cc:2258] T 9c4452fe3a6e47749633e00bb65aeb8b P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.689949  7803 tablet_replica.cc:330] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.690466  7803 raft_consensus.cc:2229] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.691599  7803 raft_consensus.cc:2258] T bfc7929e7dd84f6fba5909bdcab84721 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.693946  7803 tablet_replica.cc:330] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.694756  7803 raft_consensus.cc:2229] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.695343  7803 raft_consensus.cc:2258] T 80f37dab820e4459b45ad556ef1dcc09 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.698168  7803 tablet_replica.cc:330] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.699084  7803 raft_consensus.cc:2229] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.699676  7803 raft_consensus.cc:2258] T a8d68e12cdea4099aa6d278a53a7af17 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.702147  7803 tablet_replica.cc:330] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.702919  7803 raft_consensus.cc:2229] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.703409  7803 raft_consensus.cc:2258] T d8b11e95748c4f57ace6efc0aa7344c4 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.705348  7803 tablet_replica.cc:330] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.706004  7803 raft_consensus.cc:2229] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.706414  7803 raft_consensus.cc:2258] T acdc1cf1c6854ba3a3f9819d8afccccc P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.708465  7803 tablet_replica.cc:330] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.708973  7803 raft_consensus.cc:2229] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.709396  7803 raft_consensus.cc:2258] T e068820a06364f1cb92b7b4701f9d8e2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.711262  7803 tablet_replica.cc:330] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.711855  7803 raft_consensus.cc:2229] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.712252  7803 raft_consensus.cc:2258] T 19e0d07bb13a4413983a58ea3449cc0c P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.714108  7803 tablet_replica.cc:330] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.714856  7803 raft_consensus.cc:2229] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.716426  7803 raft_consensus.cc:2258] T 61c81981a43a4ea180b0ac988ba75519 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.718592  7803 tablet_replica.cc:330] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.719187  7803 raft_consensus.cc:2229] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.720028  7803 raft_consensus.cc:2258] T e68a2deed8c14bf4bdfe7deb5417cc56 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.722097  7803 tablet_replica.cc:330] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.722980  7803 raft_consensus.cc:2229] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.724009  7803 raft_consensus.cc:2258] T 39936f93e1a64ff290f8bcb31e35b2ee P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.726173  7803 tablet_replica.cc:330] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.726930  7803 raft_consensus.cc:2229] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.727775  7803 raft_consensus.cc:2258] T b9f1f43de2364a66ae54b5b6eba041d2 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.729743  7803 tablet_replica.cc:330] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.730266  7803 raft_consensus.cc:2229] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.731062  7803 raft_consensus.cc:2258] T 88a1af2c233844768c8ba7778f5a58ae P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.733045  7803 tablet_replica.cc:330] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.733579  7803 raft_consensus.cc:2229] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.734032  7803 raft_consensus.cc:2258] T 17301ed72d3d4a7abaebb081f70f39c9 P 45f690dc20794b529fdeabff43202cf4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.736964  7803 tablet_replica.cc:330] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.737939  7803 raft_consensus.cc:2229] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.738514  7803 raft_consensus.cc:2258] T eeb6462147004a588cfd7aa36658ae4a P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.740593  7803 tablet_replica.cc:330] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.741112  7803 raft_consensus.cc:2229] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.741528  7803 raft_consensus.cc:2258] T a5c4d8141b90433fbf058da0d0641809 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.743643  7803 tablet_replica.cc:330] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.744187  7803 raft_consensus.cc:2229] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.744647  7803 raft_consensus.cc:2258] T c3fea8b7be6841d6a16f563afcf1916e P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.746522  7803 tablet_replica.cc:330] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.746984  7803 raft_consensus.cc:2229] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.747397  7803 raft_consensus.cc:2258] T 179c5529bce9433e91b98e095c37f5ba P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.749127  7803 tablet_replica.cc:330] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4: stopping tablet replica
I20260925 16:48:02.749589  7803 raft_consensus.cc:2229] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:02.749987  7803 raft_consensus.cc:2258] T 0ef360c253d749e49df7441283aa6f50 P 45f690dc20794b529fdeabff43202cf4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.817196  7803 tablet_server.cc:194] TabletServer@127.7.158.196:0 shutdown complete.
I20260925 16:48:02.889101  7803 master.cc:537] Master@127.7.158.254:38107 shutting down...
I20260925 16:48:02.926779  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:02.927490  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:02.927917  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P 3a71b1bb5de94141ba2f2500af109ed2: stopping tablet replica
I20260925 16:48:02.951916  7803 master.cc:552] Master@127.7.158.254:38107 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (31130 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:471: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (7 ms)
[----------] 5 tests from LeaderRebalancerTest (407970 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260925 16:48:03.060523  7803 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.158.254:35965
I20260925 16:48:03.062139  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:03.069380 19883 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:03.069494 19884 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:03.069662 19886 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.070806  7803 server_base.cc:1034] running on GCE node
I20260925 16:48:03.071949  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:03.072134  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:03.072296  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354883072285 us; error 0 us; skew 500 ppm
I20260925 16:48:03.072871  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:03.075452  7803 webserver.cc:460] Webserver started at http://127.7.158.254:35673/ using document root <none> and password file <none>
I20260925 16:48:03.075946  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:03.076104  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:03.076469  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:03.077651  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/master-0-root/instance:
uuid: "19c9319c0f694f5b88814005ce6f2126"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.083555  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.001s
I20260925 16:48:03.088047 19891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.089119  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.003s
I20260925 16:48:03.089555  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/master-0-root
uuid: "19c9319c0f694f5b88814005ce6f2126"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.089905  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:03.104923  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:03.106580  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:03.156816  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.254:35965
I20260925 16:48:03.156994 19942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.254:35965 every 8 connection(s)
I20260925 16:48:03.161444 19943 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.172709 19943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126: Bootstrap starting.
I20260925 16:48:03.177345 19943 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:03.182911 19943 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126: No bootstrap required, opened a new log
I20260925 16:48:03.185171 19943 raft_consensus.cc:348] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c9319c0f694f5b88814005ce6f2126" member_type: VOTER }
I20260925 16:48:03.185577 19943 raft_consensus.cc:374] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:03.185860 19943 raft_consensus.cc:729] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 19c9319c0f694f5b88814005ce6f2126, State: Initialized, Role: FOLLOWER
I20260925 16:48:03.186564 19943 consensus_queue.cc:260] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c9319c0f694f5b88814005ce6f2126" member_type: VOTER }
I20260925 16:48:03.187005 19943 raft_consensus.cc:388] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 16:48:03.187238 19943 raft_consensus.cc:482] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 16:48:03.187522 19943 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:03.192611 19943 raft_consensus.cc:504] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c9319c0f694f5b88814005ce6f2126" member_type: VOTER }
I20260925 16:48:03.193135 19943 leader_election.cc:302] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 19c9319c0f694f5b88814005ce6f2126; no voters: 
I20260925 16:48:03.194307 19943 leader_election.cc:288] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260925 16:48:03.194876 19946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:03.196688 19946 raft_consensus.cc:686] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 1 LEADER]: Becoming Leader. State: Replica: 19c9319c0f694f5b88814005ce6f2126, State: Running, Role: LEADER
I20260925 16:48:03.197300 19946 consensus_queue.cc:237] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c9319c0f694f5b88814005ce6f2126" member_type: VOTER }
I20260925 16:48:03.197489 19943 sys_catalog.cc:564] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 16:48:03.202029 19948 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 19c9319c0f694f5b88814005ce6f2126. Latest consensus state: current_term: 1 leader_uuid: "19c9319c0f694f5b88814005ce6f2126" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c9319c0f694f5b88814005ce6f2126" member_type: VOTER } }
I20260925 16:48:03.202718 19948 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [sys.catalog]: This master's current role is: LEADER
I20260925 16:48:03.202266 19947 sys_catalog.cc:455] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "19c9319c0f694f5b88814005ce6f2126" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "19c9319c0f694f5b88814005ce6f2126" member_type: VOTER } }
I20260925 16:48:03.204270 19947 sys_catalog.cc:458] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [sys.catalog]: This master's current role is: LEADER
I20260925 16:48:03.205935 19954 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 16:48:03.211239 19954 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 16:48:03.215262  7803 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260925 16:48:03.221555 19954 catalog_manager.cc:1347] Generated new cluster ID: 5c64156a909a41eebed4b3176537a240
I20260925 16:48:03.221884 19954 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 16:48:03.242028 19954 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 16:48:03.243911 19954 catalog_manager.cc:1504] Loading token signing keys...
I20260925 16:48:03.263211 19954 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126: Generated new TSK 0
I20260925 16:48:03.263972 19954 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 16:48:03.283330  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:03.291013 19964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:03.292546 19965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.294484  7803 server_base.cc:1034] running on GCE node
W20260925 16:48:03.294667 19967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.295652  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:03.295954  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:03.296119  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354883296102 us; error 0 us; skew 500 ppm
I20260925 16:48:03.296733  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:03.299901  7803 webserver.cc:460] Webserver started at http://127.7.158.193:43865/ using document root <none> and password file <none>
I20260925 16:48:03.300371  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:03.300524  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:03.300860  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:03.301913  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-0-root/instance:
uuid: "f35c6952e0eb439d98570c4ae1201d22"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.307560  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.000s
I20260925 16:48:03.312237 19972 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.313392  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.001s	sys 0.003s
I20260925 16:48:03.313678  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "f35c6952e0eb439d98570c4ae1201d22"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.314041  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:03.339496  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:03.340696  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:03.342165  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:48:03.345320  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:48:03.345549  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.345911  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:48:03.346112  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.394906 20034 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:33321 every 8 connection(s)
I20260925 16:48:03.394922  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:33321
I20260925 16:48:03.400875  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:03.409070 20040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:03.410588 20039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.416275 20035 heartbeater.cc:347] Connected to a master server at 127.7.158.254:35965
I20260925 16:48:03.416808 20035 heartbeater.cc:464] Registering TS with master...
I20260925 16:48:03.417675 20035 heartbeater.cc:511] Master 127.7.158.254:35965 requested a full tablet report, sending...
I20260925 16:48:03.417804  7803 server_base.cc:1034] running on GCE node
W20260925 16:48:03.418239 20042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.419989  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:03.420271  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:03.420454  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354883420441 us; error 0 us; skew 500 ppm
I20260925 16:48:03.420714 19908 ts_manager.cc:194] Registered new tserver with Master: f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321)
I20260925 16:48:03.421216  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:03.423902 19908 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41850
I20260925 16:48:03.424726  7803 webserver.cc:460] Webserver started at http://127.7.158.194:46561/ using document root <none> and password file <none>
I20260925 16:48:03.425407  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:03.425654  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:03.425972  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:03.427248  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-1-root/instance:
uuid: "59508d11ed7c4adb8e955f04ed531bd2"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.431820  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260925 16:48:03.435961 20047 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.436983  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260925 16:48:03.437258  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-1-root
uuid: "59508d11ed7c4adb8e955f04ed531bd2"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.437544  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:03.449013  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:03.450136  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:03.451615  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:48:03.454068  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:48:03.454257  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.454530  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:48:03.454721  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.504683  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.194:34431
I20260925 16:48:03.504876 20109 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.194:34431 every 8 connection(s)
I20260925 16:48:03.509930  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:03.518023 20113 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:03.519431 20114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.523468  7803 server_base.cc:1034] running on GCE node
W20260925 16:48:03.523929 20117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:03.525012  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:03.525247  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:03.525437  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354883525422 us; error 0 us; skew 500 ppm
I20260925 16:48:03.526069  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:03.527055 20110 heartbeater.cc:347] Connected to a master server at 127.7.158.254:35965
I20260925 16:48:03.527491 20110 heartbeater.cc:464] Registering TS with master...
I20260925 16:48:03.528294 20110 heartbeater.cc:511] Master 127.7.158.254:35965 requested a full tablet report, sending...
I20260925 16:48:03.529003  7803 webserver.cc:460] Webserver started at http://127.7.158.195:33261/ using document root <none> and password file <none>
I20260925 16:48:03.529676  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:03.529912  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:03.530217  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:03.530496 19908 ts_manager.cc:194] Registered new tserver with Master: 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:03.531795  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-2-root/instance:
uuid: "61b84bba30914cdd91efb8fd6d470653"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.532743 19908 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41856
I20260925 16:48:03.538332  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.001s
I20260925 16:48:03.542425 20121 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.543319  7803 fs_manager.cc:725] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260925 16:48:03.543771  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-2-root
uuid: "61b84bba30914cdd91efb8fd6d470653"
format_stamp: "Formatted at 2026-09-25 16:48:03 on dist-test-slave-fknp"
I20260925 16:48:03.544102  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1790354474930402-7803-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:03.569339  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:03.570566  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:03.572062  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:48:03.574340  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:48:03.574563  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.574823  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:48:03.575003  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:03.624147  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.195:43461
I20260925 16:48:03.624267 20183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.195:43461 every 8 connection(s)
I20260925 16:48:03.642390 20184 heartbeater.cc:347] Connected to a master server at 127.7.158.254:35965
I20260925 16:48:03.643100 20184 heartbeater.cc:464] Registering TS with master...
I20260925 16:48:03.643985 20184 heartbeater.cc:511] Master 127.7.158.254:35965 requested a full tablet report, sending...
I20260925 16:48:03.646230 19908 ts_manager.cc:194] Registered new tserver with Master: 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:03.646585  7803 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.019289526s
I20260925 16:48:03.648238 19908 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:41866
I20260925 16:48:03.649530  7803 test_util.cc:268] Using random seed: 2061279196
I20260925 16:48:03.678328 19908 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41872:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:48:03.681952 19908 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:48:03.757236 20000 tablet_service.cc:1467] Processing CreateTablet for tablet e6741ad6d36b4299a0708fabb97a736d (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:03.758929 20000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6741ad6d36b4299a0708fabb97a736d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.772780 19999 tablet_service.cc:1467] Processing CreateTablet for tablet b01f86069ec94323ae288fc01060d989 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:03.774461 19999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01f86069ec94323ae288fc01060d989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.781447 19997 tablet_service.cc:1467] Processing CreateTablet for tablet efe9b8f993494b4991ab0113567cca33 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:03.782073 20149 tablet_service.cc:1467] Processing CreateTablet for tablet e6741ad6d36b4299a0708fabb97a736d (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:03.782929 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe9b8f993494b4991ab0113567cca33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.783360 20149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6741ad6d36b4299a0708fabb97a736d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.784869 19995 tablet_service.cc:1467] Processing CreateTablet for tablet 287190b0bfc6445b837ad8768e83e382 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:03.786173 19995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287190b0bfc6445b837ad8768e83e382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.788756 19996 tablet_service.cc:1467] Processing CreateTablet for tablet f81b7d9d4f3f46f4bc905aeb0d65822f (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:03.790051 19996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81b7d9d4f3f46f4bc905aeb0d65822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.792224 20068 tablet_service.cc:1467] Processing CreateTablet for tablet d96e2ad8f27f4963b7e60e446336ae69 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:03.792906 20074 tablet_service.cc:1467] Processing CreateTablet for tablet b01f86069ec94323ae288fc01060d989 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:03.793604 20068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d96e2ad8f27f4963b7e60e446336ae69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.794239 20070 tablet_service.cc:1467] Processing CreateTablet for tablet 287190b0bfc6445b837ad8768e83e382 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:03.794200 20074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01f86069ec94323ae288fc01060d989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.795599 20067 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc27310de7544c880d9aaa19e9329e0 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:03.796975 20067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc27310de7544c880d9aaa19e9329e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.797295 20071 tablet_service.cc:1467] Processing CreateTablet for tablet f81b7d9d4f3f46f4bc905aeb0d65822f (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:03.795523 20069 tablet_service.cc:1467] Processing CreateTablet for tablet 69995226adb749468909c567c7a560c3 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:03.799175 20071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81b7d9d4f3f46f4bc905aeb0d65822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.799994 20069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69995226adb749468909c567c7a560c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.801617 20148 tablet_service.cc:1467] Processing CreateTablet for tablet b01f86069ec94323ae288fc01060d989 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:03.802989 20148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b01f86069ec94323ae288fc01060d989. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.803267 20072 tablet_service.cc:1467] Processing CreateTablet for tablet efe9b8f993494b4991ab0113567cca33 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:03.805019 20072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe9b8f993494b4991ab0113567cca33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.778986 19998 tablet_service.cc:1467] Processing CreateTablet for tablet 8e43fbba2c9d41c086f540d40abbb949 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:03.802136 20073 tablet_service.cc:1467] Processing CreateTablet for tablet 8e43fbba2c9d41c086f540d40abbb949 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:03.815287 20147 tablet_service.cc:1467] Processing CreateTablet for tablet 8e43fbba2c9d41c086f540d40abbb949 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:03.816967 20144 tablet_service.cc:1467] Processing CreateTablet for tablet 287190b0bfc6445b837ad8768e83e382 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:03.818809 19998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e43fbba2c9d41c086f540d40abbb949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.819598 20143 tablet_service.cc:1467] Processing CreateTablet for tablet 69995226adb749468909c567c7a560c3 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:03.821864 20141 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc27310de7544c880d9aaa19e9329e0 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:03.823837 20142 tablet_service.cc:1467] Processing CreateTablet for tablet d96e2ad8f27f4963b7e60e446336ae69 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:03.826217 19994 tablet_service.cc:1467] Processing CreateTablet for tablet 69995226adb749468909c567c7a560c3 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:03.829970 19993 tablet_service.cc:1467] Processing CreateTablet for tablet d96e2ad8f27f4963b7e60e446336ae69 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:03.815371 20145 tablet_service.cc:1467] Processing CreateTablet for tablet f81b7d9d4f3f46f4bc905aeb0d65822f (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:03.832192 19994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69995226adb749468909c567c7a560c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.817360 20147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e43fbba2c9d41c086f540d40abbb949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.836118 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287190b0bfc6445b837ad8768e83e382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.836920 20073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8e43fbba2c9d41c086f540d40abbb949. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.837440 20144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 287190b0bfc6445b837ad8768e83e382. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.840037 20143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 69995226adb749468909c567c7a560c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.807154 20075 tablet_service.cc:1467] Processing CreateTablet for tablet e6741ad6d36b4299a0708fabb97a736d (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:03.844825 20075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e6741ad6d36b4299a0708fabb97a736d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.814944 20146 tablet_service.cc:1467] Processing CreateTablet for tablet efe9b8f993494b4991ab0113567cca33 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:03.854921 20141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc27310de7544c880d9aaa19e9329e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.856433 20142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d96e2ad8f27f4963b7e60e446336ae69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.857132 19993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d96e2ad8f27f4963b7e60e446336ae69. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.858386 20145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f81b7d9d4f3f46f4bc905aeb0d65822f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.877592 20146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet efe9b8f993494b4991ab0113567cca33. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.883113 19992 tablet_service.cc:1467] Processing CreateTablet for tablet 8bc27310de7544c880d9aaa19e9329e0 (DEFAULT_TABLE table=test-workload [id=fe4414027fb0417b99a2fa650bceccdc]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:03.884871 19992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8bc27310de7544c880d9aaa19e9329e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:03.883819 20199 tablet_bootstrap.cc:492] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:03.944705 20200 tablet_bootstrap.cc:492] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:03.959813 20201 tablet_bootstrap.cc:492] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:03.967139 20201 tablet_bootstrap.cc:654] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:03.970650 20199 tablet_bootstrap.cc:654] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:03.973260 20200 tablet_bootstrap.cc:654] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:03.982095 20201 tablet_bootstrap.cc:492] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:03.982862 20201 ts_tablet_manager.cc:1397] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.024s	user 0.006s	sys 0.013s
I20260925 16:48:03.985567 20201 raft_consensus.cc:348] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:03.986212 20201 raft_consensus.cc:374] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:03.986529 20201 raft_consensus.cc:729] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:03.987663 20201 consensus_queue.cc:260] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:03.990428 20184 heartbeater.cc:503] Master 127.7.158.254:35965 was elected leader, sending a full tablet report...
I20260925 16:48:03.991110 20201 ts_tablet_manager.cc:1428] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.005s
I20260925 16:48:03.992126 20201 tablet_bootstrap.cc:492] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:03.998256 20201 tablet_bootstrap.cc:654] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:03.998256 20199 tablet_bootstrap.cc:492] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:03.998490 20200 tablet_bootstrap.cc:492] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:03.999349 20200 ts_tablet_manager.cc:1397] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.055s	user 0.000s	sys 0.014s
I20260925 16:48:03.999397 20199 ts_tablet_manager.cc:1397] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.116s	user 0.009s	sys 0.004s
I20260925 16:48:04.002914 20200 raft_consensus.cc:348] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.003785 20200 raft_consensus.cc:374] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.002993 20199 raft_consensus.cc:348] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.004125 20200 raft_consensus.cc:729] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.004536 20199 raft_consensus.cc:374] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.005038 20199 raft_consensus.cc:729] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.005071 20200 consensus_queue.cc:260] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.006708 20199 consensus_queue.cc:260] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.021102 20110 heartbeater.cc:503] Master 127.7.158.254:35965 was elected leader, sending a full tablet report...
I20260925 16:48:04.021457 20200 ts_tablet_manager.cc:1428] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.022s	user 0.009s	sys 0.011s
I20260925 16:48:04.021912 20035 heartbeater.cc:503] Master 127.7.158.254:35965 was elected leader, sending a full tablet report...
I20260925 16:48:04.022557 20200 tablet_bootstrap.cc:492] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.021953 20201 tablet_bootstrap.cc:492] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.026347 20201 ts_tablet_manager.cc:1397] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.034s	user 0.015s	sys 0.014s
I20260925 16:48:04.026569 20199 ts_tablet_manager.cc:1428] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.027s	user 0.020s	sys 0.000s
I20260925 16:48:04.027575 20199 tablet_bootstrap.cc:492] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.027773 20200 tablet_bootstrap.cc:654] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.029240 20201 raft_consensus.cc:348] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.030066 20201 raft_consensus.cc:374] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.030347 20201 raft_consensus.cc:729] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.031147 20201 consensus_queue.cc:260] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.033435 20201 ts_tablet_manager.cc:1428] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260925 16:48:04.033632 20199 tablet_bootstrap.cc:654] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.034415 20201 tablet_bootstrap.cc:492] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.043497 20201 tablet_bootstrap.cc:654] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.045787 20199 tablet_bootstrap.cc:492] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.046363 20199 ts_tablet_manager.cc:1397] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260925 16:48:04.050040 20199 raft_consensus.cc:348] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.051021 20199 raft_consensus.cc:374] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.051378 20199 raft_consensus.cc:729] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.052484 20199 consensus_queue.cc:260] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.055357 20199 ts_tablet_manager.cc:1428] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260925 16:48:04.056586 20199 tablet_bootstrap.cc:492] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.062594 20201 tablet_bootstrap.cc:492] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.063196 20201 ts_tablet_manager.cc:1397] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.029s	user 0.008s	sys 0.016s
I20260925 16:48:04.064054 20199 tablet_bootstrap.cc:654] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.066054 20201 raft_consensus.cc:348] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.066941 20201 raft_consensus.cc:374] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.067317 20201 raft_consensus.cc:729] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.068528 20201 consensus_queue.cc:260] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.071529 20201 ts_tablet_manager.cc:1428] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260925 16:48:04.072870 20201 tablet_bootstrap.cc:492] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.081775 20201 tablet_bootstrap.cc:654] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.092834 20207 raft_consensus.cc:482] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.093932 20207 raft_consensus.cc:504] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.100750 20207 leader_election.cc:288] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
W20260925 16:48:04.129562 20185 tablet.cc:2369] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260925 16:48:04.152920 20200 tablet_bootstrap.cc:492] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.153573 20200 ts_tablet_manager.cc:1397] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.131s	user 0.055s	sys 0.072s
I20260925 16:48:04.156132 20204 raft_consensus.cc:482] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.156490 20200 raft_consensus.cc:348] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.156646 20204 raft_consensus.cc:504] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.157289 20200 raft_consensus.cc:374] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.157586 20200 raft_consensus.cc:729] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.158380 20200 consensus_queue.cc:260] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.160867 20200 ts_tablet_manager.cc:1428] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260925 16:48:04.161847 20200 tablet_bootstrap.cc:492] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.162595 20204 leader_election.cc:288] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.169015 20200 tablet_bootstrap.cc:654] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.181977 20200 tablet_bootstrap.cc:492] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.182550 20200 ts_tablet_manager.cc:1397] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.004s
I20260925 16:48:04.185462 20200 raft_consensus.cc:348] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.186275 20200 raft_consensus.cc:374] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.186584 20200 raft_consensus.cc:729] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.187441 20200 consensus_queue.cc:260] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.190380 20200 ts_tablet_manager.cc:1428] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.001s
I20260925 16:48:04.191426 20200 tablet_bootstrap.cc:492] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.192466 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
W20260925 16:48:04.194034 20124 leader_election.cc:341] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.197885 20200 tablet_bootstrap.cc:654] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
W20260925 16:48:04.216434 19956 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:48:04.237701 20199 tablet_bootstrap.cc:492] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.238577 20199 ts_tablet_manager.cc:1397] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.182s	user 0.046s	sys 0.097s
I20260925 16:48:04.247613 20201 tablet_bootstrap.cc:492] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.248926 20201 ts_tablet_manager.cc:1397] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.176s	user 0.066s	sys 0.099s
I20260925 16:48:04.252418 20201 raft_consensus.cc:348] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.253212 20201 raft_consensus.cc:374] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.253506 20201 raft_consensus.cc:729] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.254490 20200 tablet_bootstrap.cc:492] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.254401 20201 consensus_queue.cc:260] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.255426 20200 ts_tablet_manager.cc:1397] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.064s	user 0.034s	sys 0.026s
I20260925 16:48:04.257158 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.242750 20199 raft_consensus.cc:348] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.259927 20199 raft_consensus.cc:374] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.260314 20199 raft_consensus.cc:729] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.259986 20200 raft_consensus.cc:348] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.261127 20200 raft_consensus.cc:374] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.261973 20200 raft_consensus.cc:729] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.261660 20199 consensus_queue.cc:260] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.262535 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.263571 20010 raft_consensus.cc:2454] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:04.263208 20200 consensus_queue.cc:260] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.264788 20201 ts_tablet_manager.cc:1428] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260925 16:48:04.267053 20199 ts_tablet_manager.cc:1428] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.028s	user 0.011s	sys 0.000s
I20260925 16:48:04.267874 20200 ts_tablet_manager.cc:1428] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.012s	user 0.010s	sys 0.000s
I20260925 16:48:04.268344 20199 tablet_bootstrap.cc:492] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.269490 20200 tablet_bootstrap.cc:492] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.272213 20123 leader_election.cc:302] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:04.273437 20204 raft_consensus.cc:2781] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.273963 20204 raft_consensus.cc:482] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.274500 20204 raft_consensus.cc:3037] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:48:04.261538 20049 leader_election.cc:341] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.276968 20201 tablet_bootstrap.cc:492] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.277788 20199 tablet_bootstrap.cc:654] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.284191 20200 tablet_bootstrap.cc:654] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.287148 20201 tablet_bootstrap.cc:654] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.288344 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
W20260925 16:48:04.290010 20049 leader_election.cc:341] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.290638 20049 leader_election.cc:302] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2; no voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:04.291664 20207 raft_consensus.cc:2726] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:04.294039 20204 raft_consensus.cc:504] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.297936 20200 tablet_bootstrap.cc:492] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.298768 20200 ts_tablet_manager.cc:1397] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.029s	user 0.013s	sys 0.004s
I20260925 16:48:04.298841 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:04.299822 20010 raft_consensus.cc:3037] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.300856 20207 raft_consensus.cc:482] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.301359 20207 raft_consensus.cc:504] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.303426 20207 leader_election.cc:288] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.302865 20200 raft_consensus.cc:348] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.303996 20200 raft_consensus.cc:374] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.304369 20200 raft_consensus.cc:729] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.305263 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69995226adb749468909c567c7a560c3" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.306092 20159 raft_consensus.cc:2454] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:04.305302 20200 consensus_queue.cc:260] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.306092 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69995226adb749468909c567c7a560c3" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.308895 20200 ts_tablet_manager.cc:1428] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260925 16:48:04.309727 20049 leader_election.cc:302] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:04.310330 20200 tablet_bootstrap.cc:492] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.310665 20207 raft_consensus.cc:2781] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 16:48:04.310966 20049 leader_election.cc:341] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.311254 20207 raft_consensus.cc:482] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.311594 20207 raft_consensus.cc:3037] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.314525 20208 raft_consensus.cc:482] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.315104 20208 raft_consensus.cc:504] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.317571 20208 leader_election.cc:288] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.317929 20010 raft_consensus.cc:2454] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:04.318423 20200 tablet_bootstrap.cc:654] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.322570 20123 leader_election.cc:302] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.329907 20204 leader_election.cc:288] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.330686 20204 raft_consensus.cc:2781] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.331212 20204 raft_consensus.cc:686] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:04.332237 20204 consensus_queue.cc:237] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.339097 20207 raft_consensus.cc:504] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.341802 20207 leader_election.cc:288] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.342527 20207 raft_consensus.cc:482] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.344298 20201 tablet_bootstrap.cc:492] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.335508 20199 tablet_bootstrap.cc:492] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.347882 20201 ts_tablet_manager.cc:1397] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.071s	user 0.020s	sys 0.008s
I20260925 16:48:04.347918 20199 ts_tablet_manager.cc:1397] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.080s	user 0.024s	sys 0.019s
I20260925 16:48:04.351719 20226 raft_consensus.cc:482] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.352216 20226 raft_consensus.cc:504] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.354394 20226 leader_election.cc:288] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.355149 20199 raft_consensus.cc:348] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.355644 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.343080 20207 raft_consensus.cc:504] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:04.357223 20085 raft_consensus.cc:3037] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.357391 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69995226adb749468909c567c7a560c3" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:04.357276 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "69995226adb749468909c567c7a560c3" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:04.358217 20159 raft_consensus.cc:3037] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.361598 20228 raft_consensus.cc:482] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.362167 20228 raft_consensus.cc:504] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.365068 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.365803 20159 raft_consensus.cc:2454] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
W20260925 16:48:04.366798 20123 leader_election.cc:341] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.367681 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.369098 20085 raft_consensus.cc:2454] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:04.369956 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.370050 20049 leader_election.cc:302] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:04.371114 20207 leader_election.cc:288] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.372071 20207 raft_consensus.cc:2781] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.372464 20207 raft_consensus.cc:686] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:04.373188 20207 consensus_queue.cc:237] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.374955 20200 tablet_bootstrap.cc:492] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.375496 20200 ts_tablet_manager.cc:1397] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.065s	user 0.030s	sys 0.029s
W20260925 16:48:04.371223 20049 leader_election.cc:341] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:04.377290 20049 leader_election.cc:341] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.381881 20199 raft_consensus.cc:374] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.380386 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.372923 20228 leader_election.cc:288] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.382287 20199 raft_consensus.cc:729] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.381697 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.378803 20200 raft_consensus.cc:348] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
W20260925 16:48:04.380767 20049 leader_election.cc:341] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.383858 20200 raft_consensus.cc:374] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.379446 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.384279 20200 raft_consensus.cc:729] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.384788 20010 raft_consensus.cc:2379] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59508d11ed7c4adb8e955f04ed531bd2 in current term 1: Already voted for candidate 61b84bba30914cdd91efb8fd6d470653 in this term.
I20260925 16:48:04.383586 20199 consensus_queue.cc:260] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.385258 20200 consensus_queue.cc:260] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.388056 20200 ts_tablet_manager.cc:1428] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.002s
I20260925 16:48:04.372599 20201 raft_consensus.cc:348] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.389073 20200 tablet_bootstrap.cc:492] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.390933 20201 raft_consensus.cc:374] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.391806 20201 raft_consensus.cc:729] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.394191 20199 ts_tablet_manager.cc:1428] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.045s	user 0.010s	sys 0.000s
I20260925 16:48:04.384079 20049 leader_election.cc:302] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2; no voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:04.397324 20200 tablet_bootstrap.cc:654] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
W20260925 16:48:04.398411 20124 leader_election.cc:341] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.399101 20124 leader_election.cc:302] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653; no voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:04.400323 20049 leader_election.cc:302] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2; no voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:04.401450 20226 raft_consensus.cc:2726] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:04.401911 20207 raft_consensus.cc:2726] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:04.399073 19907 catalog_manager.cc:5495] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:04.403438 20207 raft_consensus.cc:482] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.404054 20207 raft_consensus.cc:504] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.408208 20199 tablet_bootstrap.cc:492] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.408860 20228 raft_consensus.cc:2726] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:04.411578 20207 leader_election.cc:288] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.394865 20201 consensus_queue.cc:260] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.414072 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
W20260925 16:48:04.415531 20049 leader_election.cc:341] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.416152 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.417021 20010 raft_consensus.cc:2454] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:04.418452 20049 leader_election.cc:302] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:04.424219 19906 catalog_manager.cc:5495] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:04.426548 20201 ts_tablet_manager.cc:1428] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.077s	user 0.009s	sys 0.000s
I20260925 16:48:04.427806 20207 raft_consensus.cc:2781] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.428328 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.428592 20207 raft_consensus.cc:482] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260925 16:48:04.429961 19974 leader_election.cc:341] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.431001 20207 raft_consensus.cc:3037] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.439893 20201 tablet_bootstrap.cc:492] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.441891 20207 raft_consensus.cc:504] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.444360 20200 tablet_bootstrap.cc:492] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.445457 20200 ts_tablet_manager.cc:1397] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.057s	user 0.021s	sys 0.018s
I20260925 16:48:04.445705 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.449254 20199 tablet_bootstrap.cc:654] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.448679 20200 raft_consensus.cc:348] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.450129 20085 raft_consensus.cc:2379] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f35c6952e0eb439d98570c4ae1201d22 in current term 1: Already voted for candidate 59508d11ed7c4adb8e955f04ed531bd2 in this term.
I20260925 16:48:04.450193 20200 raft_consensus.cc:374] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.450714 20200 raft_consensus.cc:729] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.451676 20200 consensus_queue.cc:260] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.452783 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:04.452863 20207 leader_election.cc:288] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.453404 19975 leader_election.cc:302] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f35c6952e0eb439d98570c4ae1201d22; no voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:04.452744 20201 tablet_bootstrap.cc:654] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
W20260925 16:48:04.454208 20049 leader_election.cc:341] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.454371 20200 ts_tablet_manager.cc:1428] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260925 16:48:04.454592 20208 raft_consensus.cc:3037] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.455586 20200 tablet_bootstrap.cc:492] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.464807 20200 tablet_bootstrap.cc:654] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.466958 20208 raft_consensus.cc:2726] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:04.471868 20208 raft_consensus.cc:482] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.472451 20208 raft_consensus.cc:504] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.476022 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.476868 20085 raft_consensus.cc:2454] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.478574 19975 leader_election.cc:302] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.482752 20238 raft_consensus.cc:2781] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.483261 20238 raft_consensus.cc:482] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.483722 20238 raft_consensus.cc:3037] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.488827 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:04.500193 20010 raft_consensus.cc:2454] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:04.502148 20049 leader_election.cc:302] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:04.503810 20207 raft_consensus.cc:2781] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.504413 20207 raft_consensus.cc:686] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:04.505384 20207 consensus_queue.cc:237] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.513845 20208 leader_election.cc:288] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.514436 20208 raft_consensus.cc:482] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.514530 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.515257 20158 raft_consensus.cc:2454] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.515012 20208 raft_consensus.cc:504] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.518675 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.519467 20085 raft_consensus.cc:2454] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.520731 19975 leader_election.cc:302] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.521829 20241 raft_consensus.cc:2781] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.522235 20241 raft_consensus.cc:482] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.522572 20241 raft_consensus.cc:3037] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.525149 20208 leader_election.cc:288] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.526262 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
W20260925 16:48:04.527864 19974 leader_election.cc:341] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.531605 20238 raft_consensus.cc:504] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.534422 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.535003 20085 raft_consensus.cc:3037] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.539788 20199 tablet_bootstrap.cc:492] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.540346 20199 ts_tablet_manager.cc:1397] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.132s	user 0.023s	sys 0.015s
I20260925 16:48:04.542526 20085 raft_consensus.cc:2454] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.543234 20199 raft_consensus.cc:348] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.543776 19975 leader_election.cc:302] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.544050 20199 raft_consensus.cc:374] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.544363 20199 raft_consensus.cc:729] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.544700 20208 raft_consensus.cc:2781] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.549877 20201 tablet_bootstrap.cc:492] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.550475 20201 ts_tablet_manager.cc:1397] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.111s	user 0.032s	sys 0.055s
I20260925 16:48:04.551676 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:04.552366 20158 raft_consensus.cc:3037] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.553923 20201 raft_consensus.cc:348] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.554814 20201 raft_consensus.cc:374] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.555154 20201 raft_consensus.cc:729] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.550299 19908 catalog_manager.cc:5495] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:04.556360 20238 leader_election.cc:288] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.560021 20241 raft_consensus.cc:504] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.559949 20200 tablet_bootstrap.cc:492] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.562107 20200 ts_tablet_manager.cc:1397] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.107s	user 0.032s	sys 0.055s
I20260925 16:48:04.561702 20201 consensus_queue.cc:260] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.563055 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.563722 20085 raft_consensus.cc:3037] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.565168 20200 raft_consensus.cc:348] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.565541 20158 raft_consensus.cc:2454] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.565959 20200 raft_consensus.cc:374] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.566406 20200 raft_consensus.cc:729] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.567203 20200 consensus_queue.cc:260] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.569520 20200 ts_tablet_manager.cc:1428] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:48:04.569832 20201 ts_tablet_manager.cc:1428] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.000s
I20260925 16:48:04.570544 20200 tablet_bootstrap.cc:492] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:04.571215 20201 tablet_bootstrap.cc:492] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.576602 20200 tablet_bootstrap.cc:654] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.581013 20201 tablet_bootstrap.cc:654] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.556756 20199 consensus_queue.cc:260] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.589538 20199 ts_tablet_manager.cc:1428] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.001s
I20260925 16:48:04.590749 20208 raft_consensus.cc:686] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:04.591116 20199 tablet_bootstrap.cc:492] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.592229 20208 consensus_queue.cc:237] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.594158 20200 tablet_bootstrap.cc:492] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:04.594700 20200 ts_tablet_manager.cc:1397] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.004s
I20260925 16:48:04.595968 20085 raft_consensus.cc:2454] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.597146 19975 leader_election.cc:302] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.597201 20200 raft_consensus.cc:348] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.598454 20200 raft_consensus.cc:374] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.598775 20242 raft_consensus.cc:2781] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.598583 20201 tablet_bootstrap.cc:492] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.599381 20200 raft_consensus.cc:729] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.599982 20201 ts_tablet_manager.cc:1397] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.029s	user 0.020s	sys 0.008s
I20260925 16:48:04.600229 20200 consensus_queue.cc:260] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.601298 20242 raft_consensus.cc:686] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:04.602206 20242 consensus_queue.cc:237] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.604208 20201 raft_consensus.cc:348] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.605284 20201 raft_consensus.cc:374] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.605634 20201 raft_consensus.cc:729] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.606259 20200 ts_tablet_manager.cc:1428] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260925 16:48:04.606313 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:04.607481 20241 leader_election.cc:288] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
W20260925 16:48:04.608359 19974 leader_election.cc:341] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:04.609824 20201 consensus_queue.cc:260] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.613288 19906 catalog_manager.cc:5495] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:04.615397 20199 tablet_bootstrap.cc:654] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.615366 20201 ts_tablet_manager.cc:1428] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.002s
I20260925 16:48:04.617641 20201 tablet_bootstrap.cc:492] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.625478 20201 tablet_bootstrap.cc:654] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.634054 20199 tablet_bootstrap.cc:492] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.634650 20199 ts_tablet_manager.cc:1397] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.044s	user 0.014s	sys 0.009s
I20260925 16:48:04.636843 20201 tablet_bootstrap.cc:492] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.637387 20201 ts_tablet_manager.cc:1397] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.004s
I20260925 16:48:04.637466 20199 raft_consensus.cc:348] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.638345 20199 raft_consensus.cc:374] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.638635 20199 raft_consensus.cc:729] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.639411 20199 consensus_queue.cc:260] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.640600 20201 raft_consensus.cc:348] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.641513 20201 raft_consensus.cc:374] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.641801 20201 raft_consensus.cc:729] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.640833 19906 catalog_manager.cc:5495] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:04.642168 20199 ts_tablet_manager.cc:1428] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:48:04.642506 20201 consensus_queue.cc:260] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.643270 20199 tablet_bootstrap.cc:492] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.644654 20201 ts_tablet_manager.cc:1428] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.002s
I20260925 16:48:04.647449 20201 tablet_bootstrap.cc:492] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:04.650128 20199 tablet_bootstrap.cc:654] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.654110 20201 tablet_bootstrap.cc:654] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.671123 20199 tablet_bootstrap.cc:492] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.671600 20199 ts_tablet_manager.cc:1397] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.029s	user 0.009s	sys 0.016s
I20260925 16:48:04.671967 20201 tablet_bootstrap.cc:492] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:04.672683 20201 ts_tablet_manager.cc:1397] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.009s
I20260925 16:48:04.673997 20199 raft_consensus.cc:348] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.675033 20199 raft_consensus.cc:374] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.675407 20201 raft_consensus.cc:348] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.675432 20199 raft_consensus.cc:729] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.676170 20201 raft_consensus.cc:374] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.676496 20201 raft_consensus.cc:729] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.676676 20199 consensus_queue.cc:260] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.677057 20201 consensus_queue.cc:260] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.678702 20201 ts_tablet_manager.cc:1428] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:48:04.678850 20199 ts_tablet_manager.cc:1428] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:48:04.679893 20199 tablet_bootstrap.cc:492] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.686296 20199 tablet_bootstrap.cc:654] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.691570 20199 tablet_bootstrap.cc:492] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.692044 20199 ts_tablet_manager.cc:1397] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.012s	user 0.011s	sys 0.000s
I20260925 16:48:04.693964 20199 raft_consensus.cc:348] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.694471 20199 raft_consensus.cc:374] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.694897 20199 raft_consensus.cc:729] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.695606 20199 consensus_queue.cc:260] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.697942 20199 ts_tablet_manager.cc:1428] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:48:04.699400 20199 tablet_bootstrap.cc:492] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:04.705019 20199 tablet_bootstrap.cc:654] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:04.709429 20199 tablet_bootstrap.cc:492] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:04.709911 20199 ts_tablet_manager.cc:1397] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260925 16:48:04.711760 20199 raft_consensus.cc:348] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.712265 20199 raft_consensus.cc:374] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:04.712471 20199 raft_consensus.cc:729] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:04.713034 20199 consensus_queue.cc:260] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.714556 20199 ts_tablet_manager.cc:1428] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.004s	user 0.003s	sys 0.000s
I20260925 16:48:04.738404 20242 raft_consensus.cc:482] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.739127 20242 raft_consensus.cc:504] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.740969 20242 leader_election.cc:288] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.741987 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.742044 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.742605 20085 raft_consensus.cc:2454] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.742899 20158 raft_consensus.cc:2454] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.743767 19975 leader_election.cc:302] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.744496 20242 raft_consensus.cc:2781] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.744879 20242 raft_consensus.cc:482] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.745178 20242 raft_consensus.cc:3037] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.750397 20242 raft_consensus.cc:504] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.752323 20242 leader_election.cc:288] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.753238 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.753544 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:04.753942 20085 raft_consensus.cc:3037] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.754640 20158 raft_consensus.cc:3037] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.762296 20158 raft_consensus.cc:2454] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.762744 20085 raft_consensus.cc:2454] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.763007 20232 consensus_queue.cc:1035] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:04.763412 19974 leader_election.cc:302] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.764293 20242 raft_consensus.cc:2781] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.764757 20242 raft_consensus.cc:686] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:04.765525 20242 consensus_queue.cc:237] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.775833 20204 consensus_queue.cc:1035] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:04.777971 19907 catalog_manager.cc:5495] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:04.794296 20204 raft_consensus.cc:482] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.794979 20204 raft_consensus.cc:504] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.797374 20204 leader_election.cc:288] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.797991 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.798902 20010 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:04.799216 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.799940 20123 leader_election.cc:302] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.800072 20085 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:04.800671 20204 raft_consensus.cc:2781] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.801040 20204 raft_consensus.cc:482] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.801369 20204 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.806097 20204 raft_consensus.cc:504] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.807691 20204 leader_election.cc:288] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.808751 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.808772 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:04.809353 20085 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.809538 20010 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.814026 20085 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:04.814149 20010 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:04.815418 20124 leader_election.cc:302] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:04.816170 20204 raft_consensus.cc:2781] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.816726 20204 raft_consensus.cc:686] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:04.817828 20204 consensus_queue.cc:237] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.826524 19907 catalog_manager.cc:5495] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:04.845170 20204 raft_consensus.cc:482] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.845817 20204 raft_consensus.cc:504] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.847419 20204 leader_election.cc:288] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.848517 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.848553 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.849275 20010 raft_consensus.cc:2454] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:04.849385 20085 raft_consensus.cc:2454] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:04.850386 20123 leader_election.cc:302] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.851213 20204 raft_consensus.cc:2781] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.851573 20204 raft_consensus.cc:482] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.851832 20204 raft_consensus.cc:3037] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.856777 20204 raft_consensus.cc:504] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.858342 20204 leader_election.cc:288] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.859326 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.859390 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:04.859969 20085 raft_consensus.cc:3037] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.860261 20010 raft_consensus.cc:3037] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.865006 20085 raft_consensus.cc:2454] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:04.866189 20124 leader_election.cc:302] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:04.866886 20204 raft_consensus.cc:482] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.866998 20232 raft_consensus.cc:2781] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.867578 20232 raft_consensus.cc:686] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:04.867497 20204 raft_consensus.cc:504] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.868315 20010 raft_consensus.cc:2454] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:04.868494 20232 consensus_queue.cc:237] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.869581 20204 leader_election.cc:288] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:04.870603 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.870644 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:04.871732 20010 raft_consensus.cc:2379] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 61b84bba30914cdd91efb8fd6d470653 in current term 1: Already voted for candidate 59508d11ed7c4adb8e955f04ed531bd2 in this term.
I20260925 16:48:04.872785 20123 leader_election.cc:302] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653; no voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:04.873756 20242 raft_consensus.cc:482] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:04.874245 20242 raft_consensus.cc:504] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.874495 20232 raft_consensus.cc:3037] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.876433 20242 leader_election.cc:288] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.877679 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:04.878029 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:04.877471 19907 catalog_manager.cc:5495] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:04.878785 20158 raft_consensus.cc:2454] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.879194 20085 raft_consensus.cc:2454] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:04.880010 19974 leader_election.cc:302] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.881047 20242 raft_consensus.cc:2781] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:04.881356 20242 raft_consensus.cc:482] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:04.881717 20242 raft_consensus.cc:3037] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.888935 20242 raft_consensus.cc:504] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.891245 20207 consensus_queue.cc:1035] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:04.887120 20232 raft_consensus.cc:2726] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:04.892800 20242 leader_election.cc:288] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:04.892812 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:04.892998 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:04.894527 20085 raft_consensus.cc:3037] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.894619 20158 raft_consensus.cc:3037] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.901728 20158 raft_consensus.cc:2454] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.903080 19974 leader_election.cc:302] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:04.903097 20085 raft_consensus.cc:2454] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:04.904206 20242 raft_consensus.cc:2781] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:04.905175 20010 raft_consensus.cc:3037] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:04.905429 20242 raft_consensus.cc:686] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:04.906288 20242 consensus_queue.cc:237] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:04.915320 20262 consensus_queue.cc:1035] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:04.928117 19907 catalog_manager.cc:5495] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.024151 20158 raft_consensus.cc:3037] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:05.030750 20242 consensus_queue.cc:1035] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.037925 20226 consensus_queue.cc:1035] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.047041 20242 consensus_queue.cc:1035] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.058144 20207 consensus_queue.cc:1035] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.095984 20242 consensus_queue.cc:1035] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.109254 20208 consensus_queue.cc:1035] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.212144 20158 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
mode: GRACEFUL
new_leader_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:46130
I20260925 16:48:05.213060 20158 raft_consensus.cc:595] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Received request to transfer leadership to TS f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:05.220248 20158 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b01f86069ec94323ae288fc01060d989"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
mode: GRACEFUL
new_leader_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:46130
I20260925 16:48:05.220927 20158 raft_consensus.cc:595] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Received request to transfer leadership to TS f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:05.241431 20085 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
mode: GRACEFUL
new_leader_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:42780
I20260925 16:48:05.241963 20085 raft_consensus.cc:595] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Received request to transfer leadership to TS f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:05.259215 20010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
mode: GRACEFUL
new_leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:45714
I20260925 16:48:05.259918 20010 raft_consensus.cc:595] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Received request to transfer leadership to TS 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:05.260116 20232 consensus_queue.cc:1035] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.262127 20204 raft_consensus.cc:979] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: : Instructing follower f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:05.262578 20232 raft_consensus.cc:1067] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Signalling peer f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:05.264218 20009 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:45712
I20260925 16:48:05.264712 20009 raft_consensus.cc:482] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.265072 20009 raft_consensus.cc:3037] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.267155 20158 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
mode: GRACEFUL
new_leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:46130
I20260925 16:48:05.267889 20158 raft_consensus.cc:595] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Received request to transfer leadership to TS 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:05.271948 20204 consensus_queue.cc:1035] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.272790 20009 raft_consensus.cc:504] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:05.276185 20084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:05.277122 20084 raft_consensus.cc:3037] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.278017 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6741ad6d36b4299a0708fabb97a736d" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:05.278656 20158 raft_consensus.cc:3032] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.278967 20158 raft_consensus.cc:729] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:05.279753 20158 consensus_queue.cc:260] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:05.280956 20158 raft_consensus.cc:3037] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.284335 20009 leader_election.cc:288] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Requested vote from peers 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:05.291375 20158 raft_consensus.cc:2454] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:05.292013 20084 raft_consensus.cc:2454] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:05.293923 19975 leader_election.cc:302] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:05.292171 20009 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
mode: GRACEFUL
new_leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:45714
I20260925 16:48:05.295148 20208 raft_consensus.cc:2781] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.295651 20208 raft_consensus.cc:686] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:05.296797 20009 raft_consensus.cc:595] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Received request to transfer leadership to TS 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:05.296645 20208 consensus_queue.cc:237] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } }
I20260925 16:48:05.303339 20009 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
mode: GRACEFUL
new_leader_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:45714
I20260925 16:48:05.304042 20009 raft_consensus.cc:595] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Received request to transfer leadership to TS 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:05.307821 20228 raft_consensus.cc:979] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: : Instructing follower f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:05.308282 20204 raft_consensus.cc:1067] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Signalling peer f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:05.310617 20009 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b01f86069ec94323ae288fc01060d989"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:45712
I20260925 16:48:05.313586 20009 raft_consensus.cc:482] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.314088 20009 raft_consensus.cc:3037] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.313265 19905 catalog_manager.cc:5495] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 1 to 2, leader changed from 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195) to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.319986 20009 raft_consensus.cc:504] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.323383 20009 leader_election.cc:288] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:05.324508 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:05.324605 20084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b01f86069ec94323ae288fc01060d989" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:05.325419 20084 raft_consensus.cc:3037] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.325284 20158 raft_consensus.cc:3032] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.326007 20158 raft_consensus.cc:729] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:05.327044 20158 consensus_queue.cc:260] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.328400 20158 raft_consensus.cc:3037] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.332063 20084 raft_consensus.cc:2454] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:05.333380 19975 leader_election.cc:302] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:05.333771 20158 raft_consensus.cc:2454] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:05.334395 20208 raft_consensus.cc:2781] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.334916 20208 raft_consensus.cc:686] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:05.335623 20208 consensus_queue.cc:237] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.340817 20208 consensus_queue.cc:1035] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.343997 19905 catalog_manager.cc:5495] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 1 to 2, leader changed from 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195) to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.349895 20242 raft_consensus.cc:979] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: : Instructing follower 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:05.350667 20270 raft_consensus.cc:1067] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Signalling peer 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:05.355332 20158 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:46114
I20260925 16:48:05.356357 20158 raft_consensus.cc:482] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.356776 20158 raft_consensus.cc:3037] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.357538 20270 consensus_queue.cc:1035] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.364319 20158 raft_consensus.cc:504] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.366506 20158 leader_election.cc:288] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:05.367547 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:05.368247 20085 raft_consensus.cc:3037] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.373056 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bc27310de7544c880d9aaa19e9329e0" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:05.373741 20009 raft_consensus.cc:3032] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.373974 20009 raft_consensus.cc:729] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:05.374751 20009 consensus_queue.cc:260] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.376130 20009 raft_consensus.cc:3037] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.377164 20085 raft_consensus.cc:2454] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:05.377460 20242 consensus_queue.cc:1035] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:05.378523 20124 leader_election.cc:302] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:05.379793 20228 raft_consensus.cc:2781] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.380270 20228 raft_consensus.cc:686] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:05.381104 20228 consensus_queue.cc:237] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.383270 20278 consensus_queue.cc:1035] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.386883 20242 consensus_queue.cc:1035] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.402642 20009 raft_consensus.cc:2454] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:05.407262 19905 catalog_manager.cc:5495] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 1 to 2, leader changed from f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193) to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:05.408699 20228 raft_consensus.cc:979] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: : Instructing follower 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:05.413954 20204 raft_consensus.cc:1067] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Signalling peer 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:05.418562 20084 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:42760
I20260925 16:48:05.419181 20084 raft_consensus.cc:482] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.419541 20084 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.423530 20204 consensus_queue.cc:1035] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:05.427836 20242 raft_consensus.cc:979] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: : Instructing follower 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:05.428349 20242 raft_consensus.cc:1067] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Signalling peer 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:05.432386 20083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:42772
I20260925 16:48:05.432950 20083 raft_consensus.cc:482] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.433302 20083 raft_consensus.cc:3037] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.437098 20084 raft_consensus.cc:504] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.443202 20083 raft_consensus.cc:504] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.447674 20083 leader_election.cc:288] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:05.449055 20085 raft_consensus.cc:1226] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Rejecting Update request from peer f35c6952e0eb439d98570c4ae1201d22 for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:05.449329 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:05.450055 20008 raft_consensus.cc:3032] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.449855 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d96e2ad8f27f4963b7e60e446336ae69" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:05.450534 20008 raft_consensus.cc:729] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:05.450770 20158 raft_consensus.cc:3037] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.452790 20084 leader_election.cc:288] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:05.455580 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:05.455574 20207 raft_consensus.cc:979] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: : Instructing follower f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:05.456326 20010 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.456535 20262 raft_consensus.cc:1067] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Signalling peer f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:05.451473 20008 consensus_queue.cc:260] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.460172 20158 raft_consensus.cc:2454] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:05.460737 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:05.461453 20159 raft_consensus.cc:3032] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.461774 20159 raft_consensus.cc:729] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:05.461890 20009 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:45708
I20260925 16:48:05.460783 20270 consensus_queue.cc:1046] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.003s
I20260925 16:48:05.462642 20159 consensus_queue.cc:260] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.462643 20009 raft_consensus.cc:482] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.464212 20159 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.464514 20009 raft_consensus.cc:3037] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.465330 20010 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:05.466601 20049 leader_election.cc:302] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:05.467511 20262 raft_consensus.cc:2781] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.468020 20262 raft_consensus.cc:686] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:05.468077 20008 raft_consensus.cc:3037] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.468930 20262 consensus_queue.cc:237] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.471266 20009 raft_consensus.cc:504] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.473340 20009 leader_election.cc:288] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:05.474141 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:05.474232 20159 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:05.474849 20083 raft_consensus.cc:3032] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.475284 20083 raft_consensus.cc:729] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:05.474838 20049 leader_election.cc:302] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:05.476223 20083 consensus_queue.cc:260] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.475167 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "efe9b8f993494b4991ab0113567cca33" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:05.477468 20262 raft_consensus.cc:2781] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.477795 20158 raft_consensus.cc:3037] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.478155 20262 raft_consensus.cc:686] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:05.479177 20262 consensus_queue.cc:237] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.479758 20008 raft_consensus.cc:2454] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:05.479945 19905 catalog_manager.cc:5495] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 1 to 2, leader changed from 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195) to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.483640 20083 raft_consensus.cc:3037] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.485723 20158 raft_consensus.cc:2454] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:05.487128 19974 leader_election.cc:302] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:05.488081 20242 raft_consensus.cc:2781] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.488742 20242 raft_consensus.cc:686] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:05.489662 20083 raft_consensus.cc:2454] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:05.490006 20242 consensus_queue.cc:237] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.498068 19908 catalog_manager.cc:5495] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 1 to 2, leader changed from f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193) to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.500277 19905 catalog_manager.cc:5495] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 1 to 2, leader changed from 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194) to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.506670 20270 raft_consensus.cc:979] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: : Instructing follower 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:05.507221 20241 raft_consensus.cc:1067] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Signalling peer 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:05.509069 20083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:42772
I20260925 16:48:05.509580 20083 raft_consensus.cc:482] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:05.509902 20083 raft_consensus.cc:3037] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.515098 20083 raft_consensus.cc:504] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.516640 20083 leader_election.cc:288] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:05.518083 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:05.518437 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f81b7d9d4f3f46f4bc905aeb0d65822f" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:05.518852 20008 raft_consensus.cc:3032] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:05.519069 20158 raft_consensus.cc:3037] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.519292 20008 raft_consensus.cc:729] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:05.520171 20008 consensus_queue.cc:260] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.521159 20008 raft_consensus.cc:3037] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:05.525733 20008 raft_consensus.cc:2454] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:05.526166 20158 raft_consensus.cc:2454] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:05.527024 20049 leader_election.cc:302] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:05.528034 20262 raft_consensus.cc:2781] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:05.528563 20262 raft_consensus.cc:686] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:05.529384 20262 consensus_queue.cc:237] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:05.539095 19905 catalog_manager.cc:5495] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 1 to 2, leader changed from f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193) to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:05.766034 20158 raft_consensus.cc:1261] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.768035 20270 consensus_queue.cc:1035] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.778100 20083 raft_consensus.cc:1261] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.779736 20242 consensus_queue.cc:1035] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.781441 20158 raft_consensus.cc:1261] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.783438 20242 consensus_queue.cc:1035] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:05.796149 20083 raft_consensus.cc:1261] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.797789 20270 consensus_queue.cc:1035] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.868954 20008 raft_consensus.cc:1261] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.870232 20262 consensus_queue.cc:1035] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.875802 20158 raft_consensus.cc:1261] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.877655 20207 consensus_queue.cc:1035] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:05.882120 20158 raft_consensus.cc:1261] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.883602 20207 consensus_queue.cc:1035] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.896495 20008 raft_consensus.cc:1261] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.896975 20083 raft_consensus.cc:1261] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.898557 20204 consensus_queue.cc:1035] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.900273 20226 consensus_queue.cc:1035] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:05.912031 20008 raft_consensus.cc:1261] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.913408 20278 consensus_queue.cc:1035] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.973930 20158 raft_consensus.cc:1261] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.975661 20287 consensus_queue.cc:1035] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.983407 20008 raft_consensus.cc:1261] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.985224 20207 consensus_queue.cc:1035] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:05.994307 20158 raft_consensus.cc:1261] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:05.995998 20270 consensus_queue.cc:1035] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:06.004410 20083 raft_consensus.cc:1261] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:06.005934 20242 consensus_queue.cc:1035] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:08.305485  7803 test_util.cc:268] Using random seed: 2065935151
I20260925 16:48:08.353986 19907 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:41886:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:48:08.356873 19907 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:48:08.417778 19992 tablet_service.cc:1467] Processing CreateTablet for tablet b65bcfa4f124455dbb854358f8de1c1d (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:08.418022 20070 tablet_service.cc:1467] Processing CreateTablet for tablet b65bcfa4f124455dbb854358f8de1c1d (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:08.419420 19992 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b65bcfa4f124455dbb854358f8de1c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.419649 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b65bcfa4f124455dbb854358f8de1c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.421357 19995 tablet_service.cc:1467] Processing CreateTablet for tablet a84b24672cb4471babe0b7dbc632b9bc (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:08.422645 19995 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84b24672cb4471babe0b7dbc632b9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.419445 20141 tablet_service.cc:1467] Processing CreateTablet for tablet b65bcfa4f124455dbb854358f8de1c1d (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:08.424077 20141 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet b65bcfa4f124455dbb854358f8de1c1d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.425168 20068 tablet_service.cc:1467] Processing CreateTablet for tablet a84b24672cb4471babe0b7dbc632b9bc (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:08.426509 20068 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84b24672cb4471babe0b7dbc632b9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.435626 20071 tablet_service.cc:1467] Processing CreateTablet for tablet 036d45d4a3174a19a34c29e7d7f03929 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:08.436939 20073 tablet_service.cc:1467] Processing CreateTablet for tablet 4d63d1c2761e449a8f749ae6f696d757 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:08.439141 20069 tablet_service.cc:1467] Processing CreateTablet for tablet 13996b0de40a4030a8e54a950f82a91b (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:08.439596 20074 tablet_service.cc:1467] Processing CreateTablet for tablet 3643cf7fdd1c40e29daf29a6c7514da4 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:08.441543 20067 tablet_service.cc:1467] Processing CreateTablet for tablet 94d316e188fc47b795aeb4fd55a2448e (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:08.437450 20071 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 036d45d4a3174a19a34c29e7d7f03929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.447553 20069 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13996b0de40a4030a8e54a950f82a91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.449926 20145 tablet_service.cc:1467] Processing CreateTablet for tablet a84b24672cb4471babe0b7dbc632b9bc (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:08.450788 20146 tablet_service.cc:1467] Processing CreateTablet for tablet 4d63d1c2761e449a8f749ae6f696d757 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:08.451333 20145 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a84b24672cb4471babe0b7dbc632b9bc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.452250 20149 tablet_service.cc:1467] Processing CreateTablet for tablet 13996b0de40a4030a8e54a950f82a91b (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:08.452732 20148 tablet_service.cc:1467] Processing CreateTablet for tablet 036d45d4a3174a19a34c29e7d7f03929 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:08.454355 20147 tablet_service.cc:1467] Processing CreateTablet for tablet 94d316e188fc47b795aeb4fd55a2448e (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:08.454895 20144 tablet_service.cc:1467] Processing CreateTablet for tablet 3643cf7fdd1c40e29daf29a6c7514da4 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:08.456825 20143 tablet_service.cc:1467] Processing CreateTablet for tablet 070f7a46f44d471fadad6db92c66714d (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:08.459476 20142 tablet_service.cc:1467] Processing CreateTablet for tablet 7b5dab16d51a4e5caa2a5698633de31e (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:08.461714 19993 tablet_service.cc:1467] Processing CreateTablet for tablet 4d63d1c2761e449a8f749ae6f696d757 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:08.462121 19994 tablet_service.cc:1467] Processing CreateTablet for tablet 036d45d4a3174a19a34c29e7d7f03929 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:08.463227 19998 tablet_service.cc:1467] Processing CreateTablet for tablet 070f7a46f44d471fadad6db92c66714d (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:08.464339 19997 tablet_service.cc:1467] Processing CreateTablet for tablet 94d316e188fc47b795aeb4fd55a2448e (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:08.464421 19999 tablet_service.cc:1467] Processing CreateTablet for tablet 13996b0de40a4030a8e54a950f82a91b (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:08.463227 19993 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d63d1c2761e449a8f749ae6f696d757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.465881 19997 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d316e188fc47b795aeb4fd55a2448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.466575 19994 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 036d45d4a3174a19a34c29e7d7f03929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.467448 20000 tablet_service.cc:1467] Processing CreateTablet for tablet 7b5dab16d51a4e5caa2a5698633de31e (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:08.467943 19996 tablet_service.cc:1467] Processing CreateTablet for tablet 3643cf7fdd1c40e29daf29a6c7514da4 (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:08.468806 20000 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b5dab16d51a4e5caa2a5698633de31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.470167 20067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d316e188fc47b795aeb4fd55a2448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.473335 19999 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13996b0de40a4030a8e54a950f82a91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.476221 20074 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3643cf7fdd1c40e29daf29a6c7514da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.480168 19998 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 070f7a46f44d471fadad6db92c66714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.480417 20146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d63d1c2761e449a8f749ae6f696d757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.482129 20075 tablet_service.cc:1467] Processing CreateTablet for tablet 7b5dab16d51a4e5caa2a5698633de31e (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:08.484434 20144 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3643cf7fdd1c40e29daf29a6c7514da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.486686 19996 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3643cf7fdd1c40e29daf29a6c7514da4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.489248 20072 tablet_service.cc:1467] Processing CreateTablet for tablet 070f7a46f44d471fadad6db92c66714d (DEFAULT_TABLE table=soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:08.480265 20073 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 4d63d1c2761e449a8f749ae6f696d757. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.492133 20075 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b5dab16d51a4e5caa2a5698633de31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.496004 20072 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 070f7a46f44d471fadad6db92c66714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.513584 20143 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 070f7a46f44d471fadad6db92c66714d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.516548 20142 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7b5dab16d51a4e5caa2a5698633de31e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.520244 20147 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 94d316e188fc47b795aeb4fd55a2448e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.522089 20149 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 13996b0de40a4030a8e54a950f82a91b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.524145 20148 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 036d45d4a3174a19a34c29e7d7f03929. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:08.544687 20300 tablet_bootstrap.cc:492] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.551208 20300 tablet_bootstrap.cc:654] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.628050 20301 tablet_bootstrap.cc:492] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.649180 20299 tablet_bootstrap.cc:492] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:08.647732 20301 tablet_bootstrap.cc:654] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.661091 20300 tablet_bootstrap.cc:492] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:08.661672 20300 ts_tablet_manager.cc:1397] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.117s	user 0.008s	sys 0.006s
I20260925 16:48:08.663460 20299 tablet_bootstrap.cc:654] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.664508 20300 raft_consensus.cc:348] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.667145 20300 raft_consensus.cc:374] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.667439 20300 raft_consensus.cc:729] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.669706 20301 tablet_bootstrap.cc:492] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:08.668740 20300 consensus_queue.cc:260] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.670297 20301 ts_tablet_manager.cc:1397] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.042s	user 0.013s	sys 0.006s
I20260925 16:48:08.673101 20300 ts_tablet_manager.cc:1428] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.000s
I20260925 16:48:08.673350 20301 raft_consensus.cc:348] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.674198 20301 raft_consensus.cc:374] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.674482 20301 raft_consensus.cc:729] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.675498 20300 tablet_bootstrap.cc:492] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.675307 20301 consensus_queue.cc:260] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.677870 20301 ts_tablet_manager.cc:1428] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260925 16:48:08.680387 20301 tablet_bootstrap.cc:492] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.686682 20301 tablet_bootstrap.cc:654] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.698143 20301 tablet_bootstrap.cc:492] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:08.698704 20301 ts_tablet_manager.cc:1397] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.005s
I20260925 16:48:08.701610 20299 tablet_bootstrap.cc:492] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:08.702241 20299 ts_tablet_manager.cc:1397] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.053s	user 0.019s	sys 0.024s
I20260925 16:48:08.701833 20301 raft_consensus.cc:348] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.702664 20301 raft_consensus.cc:374] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.703317 20301 raft_consensus.cc:729] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.704635 20300 tablet_bootstrap.cc:654] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.704380 20301 consensus_queue.cc:260] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.706041 20299 raft_consensus.cc:348] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.706962 20299 raft_consensus.cc:374] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.707343 20299 raft_consensus.cc:729] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.707818 20301 ts_tablet_manager.cc:1428] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260925 16:48:08.708323 20299 consensus_queue.cc:260] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.711009 20299 ts_tablet_manager.cc:1428] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:48:08.712404 20301 tablet_bootstrap.cc:492] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.712668 20299 tablet_bootstrap.cc:492] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:08.720289 20301 tablet_bootstrap.cc:654] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.720652 20299 tablet_bootstrap.cc:654] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.729032 20300 tablet_bootstrap.cc:492] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:08.729847 20300 ts_tablet_manager.cc:1397] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.055s	user 0.016s	sys 0.000s
I20260925 16:48:08.734213 20300 raft_consensus.cc:348] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.735426 20300 raft_consensus.cc:374] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.735936 20300 raft_consensus.cc:729] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.737106 20300 consensus_queue.cc:260] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.740818 20300 ts_tablet_manager.cc:1428] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260925 16:48:08.742246 20300 tablet_bootstrap.cc:492] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.766052 20300 tablet_bootstrap.cc:654] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
W20260925 16:48:08.771126 19974 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:43461, user_credentials={real_user=slave}} blocked reactor thread for 45973.8us
I20260925 16:48:08.775179 20299 tablet_bootstrap.cc:492] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:08.776124 20299 ts_tablet_manager.cc:1397] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.064s	user 0.027s	sys 0.020s
I20260925 16:48:08.776695 20301 tablet_bootstrap.cc:492] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:08.777319 20301 ts_tablet_manager.cc:1397] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.065s	user 0.040s	sys 0.023s
I20260925 16:48:08.779539 20299 raft_consensus.cc:348] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.780439 20299 raft_consensus.cc:374] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.780821 20299 raft_consensus.cc:729] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.780498 20301 raft_consensus.cc:348] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.781865 20301 raft_consensus.cc:374] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.781808 20299 consensus_queue.cc:260] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.782429 20301 raft_consensus.cc:729] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.782675 20300 tablet_bootstrap.cc:492] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:08.783483 20300 ts_tablet_manager.cc:1397] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.042s	user 0.018s	sys 0.004s
I20260925 16:48:08.783614 20301 consensus_queue.cc:260] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.784603 20299 ts_tablet_manager.cc:1428] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:48:08.785687 20299 tablet_bootstrap.cc:492] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:08.786378 20301 ts_tablet_manager.cc:1428] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260925 16:48:08.787429 20301 tablet_bootstrap.cc:492] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.792934 20299 tablet_bootstrap.cc:654] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.793257 20301 tablet_bootstrap.cc:654] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.786731 20300 raft_consensus.cc:348] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.794488 20300 raft_consensus.cc:374] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.795001 20300 raft_consensus.cc:729] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.796422 20300 consensus_queue.cc:260] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.807240 20287 raft_consensus.cc:482] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:08.807978 20287 raft_consensus.cc:504] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.813951 20287 leader_election.cc:288] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.814673 20287 raft_consensus.cc:482] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:08.817731 20287 raft_consensus.cc:504] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.818727 20299 tablet_bootstrap.cc:492] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:08.819761 20299 ts_tablet_manager.cc:1397] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.034s	user 0.016s	sys 0.007s
I20260925 16:48:08.821288 20287 leader_election.cc:288] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.822652 20299 raft_consensus.cc:348] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.823783 20300 ts_tablet_manager.cc:1428] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.040s	user 0.005s	sys 0.002s
I20260925 16:48:08.824566 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036d45d4a3174a19a34c29e7d7f03929" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:08.825011 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:08.823773 20299 raft_consensus.cc:374] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.825812 20010 raft_consensus.cc:2454] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:08.825891 20299 raft_consensus.cc:729] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.825345 20300 tablet_bootstrap.cc:492] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.826788 20299 consensus_queue.cc:260] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.827344 20301 tablet_bootstrap.cc:492] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:08.827536 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036d45d4a3174a19a34c29e7d7f03929" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:08.827931 20301 ts_tablet_manager.cc:1397] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.041s	user 0.024s	sys 0.003s
I20260925 16:48:08.828915 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:08.829243 20299 ts_tablet_manager.cc:1428] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260925 16:48:08.829592 20159 raft_consensus.cc:2454] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:08.830238 20299 tablet_bootstrap.cc:492] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:08.831171 20301 raft_consensus.cc:348] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.831939 20301 raft_consensus.cc:374] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.832211 20301 raft_consensus.cc:729] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.832866 20301 consensus_queue.cc:260] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.836894 20299 tablet_bootstrap.cc:654] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.839273 20300 tablet_bootstrap.cc:654] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.845211 20301 ts_tablet_manager.cc:1428] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.017s	user 0.009s	sys 0.000s
I20260925 16:48:08.850968 20301 tablet_bootstrap.cc:492] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.852233 20300 tablet_bootstrap.cc:492] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:08.852788 20300 ts_tablet_manager.cc:1397] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.009s
W20260925 16:48:08.845000 20049 leader_election.cc:341] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.855268 20049 leader_election.cc:302] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:08.856325 20300 raft_consensus.cc:348] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.856885 20313 raft_consensus.cc:2781] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:08.857142 20300 raft_consensus.cc:374] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.857523 20313 raft_consensus.cc:482] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:08.857630 20300 raft_consensus.cc:729] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.858126 20313 raft_consensus.cc:3037] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.858655 20300 consensus_queue.cc:260] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.861109 20300 ts_tablet_manager.cc:1428] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:48:08.862322 20300 tablet_bootstrap.cc:492] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.862423 20301 tablet_bootstrap.cc:654] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.865738 20299 tablet_bootstrap.cc:492] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:08.866266 20299 ts_tablet_manager.cc:1397] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.036s	user 0.014s	sys 0.013s
W20260925 16:48:08.866994 20049 leader_election.cc:341] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.868919 20300 tablet_bootstrap.cc:654] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.868985 20049 leader_election.cc:302] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2; no voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:08.869395 20299 raft_consensus.cc:348] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.868136 20313 raft_consensus.cc:504] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.871682 20313 leader_election.cc:288] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.872185 20287 raft_consensus.cc:2726] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:08.870172 20299 raft_consensus.cc:374] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.874452 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:08.876283 20287 raft_consensus.cc:482] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:08.876494 20010 raft_consensus.cc:3037] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.876765 20287 raft_consensus.cc:504] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.879109 20287 leader_election.cc:288] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.879217 20300 tablet_bootstrap.cc:492] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:08.879878 20300 ts_tablet_manager.cc:1397] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260925 16:48:08.875174 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:08.881161 20159 raft_consensus.cc:3037] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.881819 20301 tablet_bootstrap.cc:492] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:08.882383 20301 ts_tablet_manager.cc:1397] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.007s
I20260925 16:48:08.883051 20300 raft_consensus.cc:348] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.883882 20300 raft_consensus.cc:374] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.884153 20300 raft_consensus.cc:729] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.884960 20300 consensus_queue.cc:260] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.887375 20300 ts_tablet_manager.cc:1428] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:48:08.887254 20010 raft_consensus.cc:2454] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:08.887809 20299 raft_consensus.cc:729] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.888657 20299 consensus_queue.cc:260] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.889211 20300 tablet_bootstrap.cc:492] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.891126 20278 raft_consensus.cc:482] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:08.891240 20299 ts_tablet_manager.cc:1428] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.000s
I20260925 16:48:08.891659 20278 raft_consensus.cc:504] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.892700 20299 tablet_bootstrap.cc:492] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:08.893707 20159 raft_consensus.cc:2454] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:08.893836 20278 leader_election.cc:288] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:08.898252 20300 tablet_bootstrap.cc:654] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.885419 20301 raft_consensus.cc:348] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.905119 20301 raft_consensus.cc:374] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.905467 20301 raft_consensus.cc:729] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.906255 20301 consensus_queue.cc:260] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.910059 20301 ts_tablet_manager.cc:1428] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.027s	user 0.008s	sys 0.001s
I20260925 16:48:08.911510 20301 tablet_bootstrap.cc:492] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.912509 20208 raft_consensus.cc:482] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:08.913064 20208 raft_consensus.cc:504] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.917209 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84b24672cb4471babe0b7dbc632b9bc" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:08.917893 20159 raft_consensus.cc:2454] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:08.919234 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84b24672cb4471babe0b7dbc632b9bc" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:08.902129 20299 tablet_bootstrap.cc:654] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.903590 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:08.920298 19974 leader_election.cc:302] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:08.922693 20309 raft_consensus.cc:2781] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:08.923094 20309 raft_consensus.cc:482] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:08.923424 20309 raft_consensus.cc:3037] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.920503 20301 tablet_bootstrap.cc:654] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
W20260925 16:48:08.927850 19975 leader_election.cc:341] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.901835 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:08.929986 20313 raft_consensus.cc:482] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:08.930464 20313 raft_consensus.cc:504] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.930997 20208 leader_election.cc:288] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
W20260925 16:48:08.931054 20123 leader_election.cc:341] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.932469 20313 leader_election.cc:288] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.934861 20309 raft_consensus.cc:504] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.937377 20049 leader_election.cc:302] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:08.937875 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:08.938256 20313 raft_consensus.cc:2781] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:08.938779 20313 raft_consensus.cc:686] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:08.939335 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:08.939612 20313 consensus_queue.cc:237] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.943013 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84b24672cb4471babe0b7dbc632b9bc" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
W20260925 16:48:08.943398 20049 leader_election.cc:341] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.945097 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:08.945771 20008 raft_consensus.cc:2454] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
W20260925 16:48:08.945189 20124 leader_election.cc:341] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:08.946511 20049 leader_election.cc:341] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.946682 20124 leader_election.cc:302] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653; no voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:08.947009 20049 leader_election.cc:302] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2; no voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:08.947801 20313 raft_consensus.cc:2726] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:08.947942 20278 raft_consensus.cc:2726] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:08.949918 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
W20260925 16:48:08.950728 19975 leader_election.cc:341] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:08.951427 20159 raft_consensus.cc:2454] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:08.952760 20049 leader_election.cc:302] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:08.953840 20299 tablet_bootstrap.cc:492] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:08.951620 20301 tablet_bootstrap.cc:492] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:08.954571 20313 raft_consensus.cc:2781] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:08.955242 20313 raft_consensus.cc:482] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:08.955054 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a84b24672cb4471babe0b7dbc632b9bc" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:08.955729 20313 raft_consensus.cc:3037] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.955884 20159 raft_consensus.cc:3037] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.956176 20299 ts_tablet_manager.cc:1397] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.064s	user 0.014s	sys 0.009s
I20260925 16:48:08.953712 20309 leader_election.cc:288] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.954566 20301 ts_tablet_manager.cc:1397] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.012s
I20260925 16:48:08.953119 20300 tablet_bootstrap.cc:492] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:08.961279 19907 catalog_manager.cc:5495] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:08.964320 20299 raft_consensus.cc:348] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.964943 20313 raft_consensus.cc:504] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.966202 20299 raft_consensus.cc:374] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.966636 20299 raft_consensus.cc:729] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.966387 20301 raft_consensus.cc:348] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.961283 20300 ts_tablet_manager.cc:1397] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.072s	user 0.023s	sys 0.028s
I20260925 16:48:08.967422 20301 raft_consensus.cc:374] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.968087 20301 raft_consensus.cc:729] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.965593 20159 raft_consensus.cc:2454] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:08.968518 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:08.969097 20008 raft_consensus.cc:3037] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.970629 20300 raft_consensus.cc:348] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.971575 20313 leader_election.cc:288] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:08.971086 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:08.972137 19974 leader_election.cc:302] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:08.972472 20159 raft_consensus.cc:3037] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:08.967434 20299 consensus_queue.cc:260] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.974387 20301 consensus_queue.cc:260] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.978312 20301 ts_tablet_manager.cc:1428] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.004s
I20260925 16:48:08.978857 20008 raft_consensus.cc:2454] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:08.979442 20159 raft_consensus.cc:2454] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:08.979527 20301 tablet_bootstrap.cc:492] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:08.971624 20300 raft_consensus.cc:374] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:08.981209 20300 raft_consensus.cc:729] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:08.982115 20300 consensus_queue.cc:260] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:08.976148 20299 ts_tablet_manager.cc:1428] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.019s	user 0.002s	sys 0.006s
I20260925 16:48:08.984678 20299 tablet_bootstrap.cc:492] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:08.985522 20300 ts_tablet_manager.cc:1428] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.001s
I20260925 16:48:08.987023 20300 tablet_bootstrap.cc:492] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:08.989127 20049 leader_election.cc:302] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:08.992446 20299 tablet_bootstrap.cc:654] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.993965 20300 tablet_bootstrap.cc:654] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:08.973222 20309 raft_consensus.cc:2781] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:08.995011 20309 raft_consensus.cc:686] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:08.996659 20287 raft_consensus.cc:2781] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:08.996523 20309 consensus_queue.cc:237] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.000209 20301 tablet_bootstrap.cc:654] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.021952 20287 raft_consensus.cc:686] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:09.025410 20287 consensus_queue.cc:237] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.030684 20299 tablet_bootstrap.cc:492] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:09.031301 20299 ts_tablet_manager.cc:1397] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.008s
I20260925 16:48:09.034232 20299 raft_consensus.cc:348] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.034617 20301 tablet_bootstrap.cc:492] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:09.035004 20299 raft_consensus.cc:374] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.035405 20299 raft_consensus.cc:729] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.034353 19907 catalog_manager.cc:5495] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:09.035652 20301 ts_tablet_manager.cc:1397] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.056s	user 0.015s	sys 0.007s
I20260925 16:48:09.036923 20300 tablet_bootstrap.cc:492] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:09.037408 20300 ts_tablet_manager.cc:1397] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.010s
I20260925 16:48:09.040266 20300 raft_consensus.cc:348] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.040270 20299 consensus_queue.cc:260] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.041155 20300 raft_consensus.cc:374] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.041461 20300 raft_consensus.cc:729] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.042268 20300 consensus_queue.cc:260] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.043079 20299 ts_tablet_manager.cc:1428] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260925 16:48:09.044121 20299 tablet_bootstrap.cc:492] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:09.044731 20300 ts_tablet_manager.cc:1428] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260925 16:48:09.045979 20301 raft_consensus.cc:348] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.046919 20301 raft_consensus.cc:374] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.047286 20301 raft_consensus.cc:729] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.047008 20300 tablet_bootstrap.cc:492] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:09.048199 20301 consensus_queue.cc:260] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.050973 20301 ts_tablet_manager.cc:1428] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260925 16:48:09.052003 20301 tablet_bootstrap.cc:492] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:09.054232 20300 tablet_bootstrap.cc:654] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.056401 20301 tablet_bootstrap.cc:654] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.059702 19905 catalog_manager.cc:5495] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:09.062522 20300 tablet_bootstrap.cc:492] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:09.063014 20300 ts_tablet_manager.cc:1397] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.000s
I20260925 16:48:09.065418 20300 raft_consensus.cc:348] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.066071 20300 raft_consensus.cc:374] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.066341 20300 raft_consensus.cc:729] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.067144 20300 consensus_queue.cc:260] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.073987 20299 tablet_bootstrap.cc:654] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.076757 20300 ts_tablet_manager.cc:1428] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260925 16:48:09.081828 20301 tablet_bootstrap.cc:492] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:09.082476 20301 ts_tablet_manager.cc:1397] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.015s
I20260925 16:48:09.084484 20300 tablet_bootstrap.cc:492] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: Bootstrap starting.
I20260925 16:48:09.085183 20301 raft_consensus.cc:348] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.086433 20301 raft_consensus.cc:374] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.086752 20301 raft_consensus.cc:729] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.087363 20301 consensus_queue.cc:260] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.089780 20300 tablet_bootstrap.cc:654] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.089900 20299 tablet_bootstrap.cc:492] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:09.090642 20299 ts_tablet_manager.cc:1397] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.047s	user 0.015s	sys 0.000s
I20260925 16:48:09.091877 20301 ts_tablet_manager.cc:1428] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260925 16:48:09.092818 20301 tablet_bootstrap.cc:492] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: Bootstrap starting.
I20260925 16:48:09.098269 20300 tablet_bootstrap.cc:492] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: No bootstrap required, opened a new log
I20260925 16:48:09.098846 20300 ts_tablet_manager.cc:1397] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: Time spent bootstrapping tablet: real 0.015s	user 0.000s	sys 0.013s
I20260925 16:48:09.099401 20301 tablet_bootstrap.cc:654] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.101544 20300 raft_consensus.cc:348] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.102259 20300 raft_consensus.cc:374] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.102528 20300 raft_consensus.cc:729] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.102398 20299 raft_consensus.cc:348] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.103560 20300 consensus_queue.cc:260] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.104212 20299 raft_consensus.cc:374] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.104622 20299 raft_consensus.cc:729] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.105518 20300 ts_tablet_manager.cc:1428] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:48:09.105294 20299 consensus_queue.cc:260] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.107947 20299 ts_tablet_manager.cc:1428] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.003s
I20260925 16:48:09.110153 20299 tablet_bootstrap.cc:492] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:09.117237 20301 tablet_bootstrap.cc:492] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: No bootstrap required, opened a new log
I20260925 16:48:09.117812 20301 ts_tablet_manager.cc:1397] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.004s
I20260925 16:48:09.120151 20299 tablet_bootstrap.cc:654] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.121430 20301 raft_consensus.cc:348] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.122547 20301 raft_consensus.cc:374] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.122978 20301 raft_consensus.cc:729] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.123930 20301 consensus_queue.cc:260] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.126309 20301 ts_tablet_manager.cc:1428] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:48:09.126572 20299 tablet_bootstrap.cc:492] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:09.127055 20299 ts_tablet_manager.cc:1397] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.003s
I20260925 16:48:09.128357 20287 raft_consensus.cc:482] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.129446 20326 raft_consensus.cc:482] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.129066 20287 raft_consensus.cc:504] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.129676 20299 raft_consensus.cc:348] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.130014 20326 raft_consensus.cc:504] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.130570 20299 raft_consensus.cc:374] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.130887 20299 raft_consensus.cc:729] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.131657 20278 raft_consensus.cc:482] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.131856 20299 consensus_queue.cc:260] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.132205 20278 raft_consensus.cc:504] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.133641 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:09.134306 20008 raft_consensus.cc:2454] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:09.131461 20287 leader_election.cc:288] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.134850 20299 ts_tablet_manager.cc:1428] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260925 16:48:09.135450 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:09.135861 20318 raft_consensus.cc:482] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.136220 20159 raft_consensus.cc:2454] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:09.136787 20299 tablet_bootstrap.cc:492] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: Bootstrap starting.
I20260925 16:48:09.136355 20318 raft_consensus.cc:504] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.138422 20318 leader_election.cc:288] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:09.139993 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:09.140156 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:09.140666 20008 raft_consensus.cc:2454] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:09.140939 20010 raft_consensus.cc:2454] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:09.141515 20326 leader_election.cc:288] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.139513 20049 leader_election.cc:302] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.134333 20278 leader_election.cc:288] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:09.143193 20299 tablet_bootstrap.cc:654] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:09.143137 20326 raft_consensus.cc:2781] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.143815 20326 raft_consensus.cc:482] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.143855 20123 leader_election.cc:302] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.144315 20326 raft_consensus.cc:3037] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.145455 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:09.146291 20083 raft_consensus.cc:2454] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:09.147976 20278 raft_consensus.cc:2781] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.148556 20278 raft_consensus.cc:482] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.149027 20278 raft_consensus.cc:3037] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.151460 20123 leader_election.cc:302] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.153071 20318 raft_consensus.cc:2781] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.153540 20318 raft_consensus.cc:482] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.153956 20318 raft_consensus.cc:3037] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.156567 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:09.157326 20083 raft_consensus.cc:2454] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:09.157014 20326 raft_consensus.cc:504] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.158043 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:09.159210 20326 leader_election.cc:288] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.159932 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:09.160619 20008 raft_consensus.cc:2454] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:09.162060 20299 tablet_bootstrap.cc:492] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: No bootstrap required, opened a new log
I20260925 16:48:09.162566 20299 ts_tablet_manager.cc:1397] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: Time spent bootstrapping tablet: real 0.026s	user 0.012s	sys 0.012s
I20260925 16:48:09.163072 20049 leader_election.cc:302] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.163215 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:09.163826 20158 raft_consensus.cc:3037] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.165195 20299 raft_consensus.cc:348] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.165890 20299 raft_consensus.cc:374] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:09.166142 20299 raft_consensus.cc:729] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Initialized, Role: FOLLOWER
I20260925 16:48:09.166657 20287 raft_consensus.cc:2781] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.166762 20299 consensus_queue.cc:260] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.167472 20287 raft_consensus.cc:482] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.167847 20287 raft_consensus.cc:3037] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.169085 20299 ts_tablet_manager.cc:1428] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260925 16:48:09.169991 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:09.170702 20008 raft_consensus.cc:3037] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.173597 20158 raft_consensus.cc:2454] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:09.176664 20049 leader_election.cc:302] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:09.177723 20326 raft_consensus.cc:2781] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:09.178527 20326 raft_consensus.cc:686] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:09.179443 20326 consensus_queue.cc:237] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.180913 20278 raft_consensus.cc:504] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.182439 20159 raft_consensus.cc:2379] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 59508d11ed7c4adb8e955f04ed531bd2 in current term 1: Already voted for candidate 61b84bba30914cdd91efb8fd6d470653 in this term.
I20260925 16:48:09.183749 20008 raft_consensus.cc:2454] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:09.185396 20318 raft_consensus.cc:504] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.186795 20278 leader_election.cc:288] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:09.189266 20318 leader_election.cc:288] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:09.191849 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:09.192310 20008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:09.193054 20008 raft_consensus.cc:3037] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.193625 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:09.194339 20085 raft_consensus.cc:3037] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.192507 20010 raft_consensus.cc:3037] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.195746 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:09.200618 19908 catalog_manager.cc:5495] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:09.201938 20085 raft_consensus.cc:2454] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:09.203245 20124 leader_election.cc:302] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:09.204582 20287 raft_consensus.cc:504] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.205195 20010 raft_consensus.cc:2454] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:09.205931 20083 raft_consensus.cc:2379] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61b84bba30914cdd91efb8fd6d470653 in current term 1: Already voted for candidate 59508d11ed7c4adb8e955f04ed531bd2 in this term.
I20260925 16:48:09.207381 20287 leader_election.cc:288] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.208766 20318 raft_consensus.cc:482] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.209236 20318 raft_consensus.cc:504] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.209659 20309 raft_consensus.cc:482] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.210139 20309 raft_consensus.cc:504] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.210407 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:09.212123 20278 raft_consensus.cc:2781] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:09.212391 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:09.212715 20008 raft_consensus.cc:2454] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 1.
I20260925 16:48:09.213140 20009 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:09.214509 20123 leader_election.cc:302] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:09.215230 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:09.216318 20083 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:09.216200 20159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:09.217216 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:09.217610 20159 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:09.217971 20085 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 0.
I20260925 16:48:09.219133 19975 leader_election.cc:302] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.220250 20318 leader_election.cc:288] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:09.220534 20208 raft_consensus.cc:2781] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.221185 20208 raft_consensus.cc:482] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.221566 20208 raft_consensus.cc:3037] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.223345 20309 leader_election.cc:288] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.227407 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:09.228456 20123 leader_election.cc:302] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.221385 20318 raft_consensus.cc:2781] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:09.229732 20278 raft_consensus.cc:686] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:09.231051 20278 consensus_queue.cc:237] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.233537 20340 raft_consensus.cc:2781] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.234058 20340 raft_consensus.cc:482] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.234436 20340 raft_consensus.cc:3037] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.230494 20318 raft_consensus.cc:686] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:09.237788 20318 consensus_queue.cc:237] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.240612 20208 raft_consensus.cc:504] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.243512 20208 leader_election.cc:288] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.242970 19908 catalog_manager.cc:5495] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:09.243549 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:09.244722 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:09.244987 20085 raft_consensus.cc:3037] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.250296 20085 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:09.249987 20340 raft_consensus.cc:504] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.251427 19975 leader_election.cc:302] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.252362 20309 raft_consensus.cc:2781] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:09.253731 20340 leader_election.cc:288] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:09.254987 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:09.252354 20157 raft_consensus.cc:2379] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f35c6952e0eb439d98570c4ae1201d22 in current term 1: Already voted for candidate 61b84bba30914cdd91efb8fd6d470653 in this term.
I20260925 16:48:09.256552 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:09.257385 20085 raft_consensus.cc:2379] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 61b84bba30914cdd91efb8fd6d470653 in current term 1: Already voted for candidate f35c6952e0eb439d98570c4ae1201d22 in this term.
I20260925 16:48:09.262462 20309 raft_consensus.cc:686] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:09.263777 20309 consensus_queue.cc:237] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.265169 20049 leader_election.cc:302] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2; no voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:09.266335 20313 raft_consensus.cc:2726] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:48:09.270520 20123 leader_election.cc:302] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653; no voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:09.270071 19908 catalog_manager.cc:5495] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 0 to 1, leader changed from <none> to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 1 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:09.271692 20318 raft_consensus.cc:2726] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260925 16:48:09.276203 19907 catalog_manager.cc:5495] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
W20260925 16:48:09.277305 19956 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:48:09.379690 20085 raft_consensus.cc:3037] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.387208 20208 raft_consensus.cc:482] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.387339 20309 consensus_queue.cc:1035] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:09.387706 20208 raft_consensus.cc:504] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.389526 20208 leader_election.cc:288] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.390528 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036d45d4a3174a19a34c29e7d7f03929" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:09.390504 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036d45d4a3174a19a34c29e7d7f03929" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2" is_pre_election: true
I20260925 16:48:09.391379 20158 raft_consensus.cc:2454] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:09.391433 20083 raft_consensus.cc:2454] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 0.
I20260925 16:48:09.392684 19974 leader_election.cc:302] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.393704 20208 raft_consensus.cc:2781] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.394018 20208 raft_consensus.cc:482] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.394330 20208 raft_consensus.cc:3037] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.404724 20309 consensus_queue.cc:1035] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:09.406934 20208 raft_consensus.cc:504] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.409718 20208 leader_election.cc:288] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.410800 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036d45d4a3174a19a34c29e7d7f03929" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:09.411669 20157 raft_consensus.cc:3037] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.413607 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "036d45d4a3174a19a34c29e7d7f03929" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:09.414330 20085 raft_consensus.cc:3037] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.422119 20313 consensus_queue.cc:1035] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.424078 20085 raft_consensus.cc:2454] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:09.425396 19975 leader_election.cc:302] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.426343 20208 raft_consensus.cc:2781] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:09.426887 20208 raft_consensus.cc:686] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:09.427335 20157 raft_consensus.cc:2454] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 1.
I20260925 16:48:09.427896 20208 consensus_queue.cc:237] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.441368 20313 consensus_queue.cc:1035] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.448022 19905 catalog_manager.cc:5495] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 0 to 1, leader changed from <none> to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 1 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:09.524261 20313 consensus_queue.cc:1035] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.530289 20313 raft_consensus.cc:482] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:09.530772 20313 raft_consensus.cc:504] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.533051 20313 leader_election.cc:288] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.534291 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22" is_pre_election: true
I20260925 16:48:09.535036 20009 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:09.535373 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653" is_pre_election: true
I20260925 16:48:09.536012 20158 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 0.
I20260925 16:48:09.538261 20049 leader_election.cc:302] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:09.540891 20355 raft_consensus.cc:2781] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:09.541256 20355 raft_consensus.cc:482] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:09.541597 20355 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.543236 20326 consensus_queue.cc:1035] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.551250 20355 raft_consensus.cc:504] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.554463 20010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:09.555083 20010 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.555383 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:09.556097 20158 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:09.560499 20355 leader_election.cc:288] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:09.562987 20010 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:09.563666 20158 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 1.
I20260925 16:48:09.564111 20049 leader_election.cc:302] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:09.564991 20355 raft_consensus.cc:2781] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:09.565559 20355 raft_consensus.cc:686] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:09.566373 20355 consensus_queue.cc:237] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:09.574553 19908 catalog_manager.cc:5495] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 1 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:09.617169 20355 consensus_queue.cc:1035] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.618458 20318 consensus_queue.cc:1035] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:09.629724 20355 consensus_queue.cc:1035] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.634087 20278 consensus_queue.cc:1035] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:09.662180 20318 consensus_queue.cc:1035] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:09.684969 20340 consensus_queue.cc:1035] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.699973 20208 consensus_queue.cc:1035] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.712575 20208 consensus_queue.cc:1035] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.827905 20085 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
mode: GRACEFUL
new_leader_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:42780
I20260925 16:48:09.828413 20085 raft_consensus.cc:595] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Received request to transfer leadership to TS f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:09.836799 20083 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
mode: GRACEFUL
new_leader_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:42780
I20260925 16:48:09.837352 20083 raft_consensus.cc:595] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Received request to transfer leadership to TS f35c6952e0eb439d98570c4ae1201d22
I20260925 16:48:09.850023 20208 consensus_queue.cc:1035] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:09.850816 20010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
mode: GRACEFUL
new_leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:45714
I20260925 16:48:09.851644 20010 raft_consensus.cc:595] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Received request to transfer leadership to TS 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:09.858407 20157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
mode: GRACEFUL
new_leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:46130
I20260925 16:48:09.859159 20157 raft_consensus.cc:595] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Received request to transfer leadership to TS 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:09.861289 20208 consensus_queue.cc:1035] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.866926 20157 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
mode: GRACEFUL
new_leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:46130
I20260925 16:48:09.867657 20157 raft_consensus.cc:595] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Received request to transfer leadership to TS 59508d11ed7c4adb8e955f04ed531bd2
I20260925 16:48:09.877534 20083 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
mode: GRACEFUL
new_leader_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:42780
I20260925 16:48:09.878090 20083 raft_consensus.cc:595] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Received request to transfer leadership to TS 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:09.970705 20355 consensus_queue.cc:1035] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.985054 20355 consensus_queue.cc:1035] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:09.994606 20326 raft_consensus.cc:979] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: : Instructing follower f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:09.995412 20355 raft_consensus.cc:1067] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Signalling peer f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:09.997315 20010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:45708
I20260925 16:48:09.998023 20010 raft_consensus.cc:482] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:09.998500 20010 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.005810 20010 raft_consensus.cc:504] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.009068 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:10.009258 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:10.009599 20010 leader_election.cc:288] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:10.009737 20083 raft_consensus.cc:3032] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:10.009907 20158 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.010217 20083 raft_consensus.cc:729] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:10.011263 20083 consensus_queue.cc:260] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.012910 20083 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.013233 20326 raft_consensus.cc:979] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: : Instructing follower f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:10.013890 20326 raft_consensus.cc:1067] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Signalling peer f35c6952e0eb439d98570c4ae1201d22 to start an election
I20260925 16:48:10.017235 20009 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
 from {username='slave'} at 127.0.0.1:45708
I20260925 16:48:10.018023 20009 raft_consensus.cc:482] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:10.018595 20009 raft_consensus.cc:3037] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.019039 20158 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:10.020406 19974 leader_election.cc:302] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:10.020829 20083 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:10.021376 20369 raft_consensus.cc:2781] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:10.021963 20369 raft_consensus.cc:686] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:10.022884 20369 consensus_queue.cc:237] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.026599 20009 raft_consensus.cc:504] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.028895 20009 leader_election.cc:288] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Requested vote from peers 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:10.029692 20085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:10.030440 20085 raft_consensus.cc:3032] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:10.030802 20085 raft_consensus.cc:729] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:10.031203 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b65bcfa4f124455dbb854358f8de1c1d" candidate_uuid: "f35c6952e0eb439d98570c4ae1201d22" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:10.031909 20278 raft_consensus.cc:979] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: : Instructing follower 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:10.031725 20085 consensus_queue.cc:260] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.031867 20157 raft_consensus.cc:3037] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.032558 20278 raft_consensus.cc:1067] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Signalling peer 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:10.033242 20085 raft_consensus.cc:3037] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.034578 20083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:42760
I20260925 16:48:10.035173 20083 raft_consensus.cc:482] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:10.035523 20083 raft_consensus.cc:3037] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.038496 19908 catalog_manager.cc:5495] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 1 to 2, leader changed from 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194) to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:10.040844 20157 raft_consensus.cc:2454] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:10.041844 20085 raft_consensus.cc:2454] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f35c6952e0eb439d98570c4ae1201d22 in term 2.
I20260925 16:48:10.042064 19974 leader_election.cc:302] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:10.042862 20083 raft_consensus.cc:504] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.043663 20369 raft_consensus.cc:2781] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:10.044391 20369 raft_consensus.cc:686] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Becoming Leader. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:10.045739 20083 leader_election.cc:288] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:10.045643 20369 consensus_queue.cc:237] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.046649 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:10.047266 20009 raft_consensus.cc:3037] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.049253 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "94d316e188fc47b795aeb4fd55a2448e" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:10.050374 20157 raft_consensus.cc:3032] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:10.050803 20157 raft_consensus.cc:729] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:10.051864 20157 consensus_queue.cc:260] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.053431 20157 raft_consensus.cc:3037] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.055680 20009 raft_consensus.cc:2454] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:10.057672 20049 leader_election.cc:302] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:10.058452 20355 raft_consensus.cc:2781] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:10.058241 19908 catalog_manager.cc:5495] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 reported cstate change: term changed from 1 to 2, leader changed from 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194) to f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193). New cstate: current_term: 2 leader_uuid: "f35c6952e0eb439d98570c4ae1201d22" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:10.058970 20355 raft_consensus.cc:686] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:10.059876 20355 consensus_queue.cc:237] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.061955 20157 raft_consensus.cc:2454] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:10.070456 19905 catalog_manager.cc:5495] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 1 to 2, leader changed from 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195) to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:10.099885 20278 raft_consensus.cc:979] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: : Instructing follower 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:10.100488 20340 raft_consensus.cc:1067] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Signalling peer 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:10.102226 20083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:42760
I20260925 16:48:10.103286 20083 raft_consensus.cc:482] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:10.103735 20083 raft_consensus.cc:3037] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.109200 20083 raft_consensus.cc:504] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.110877 20083 leader_election.cc:288] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:10.112234 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:10.112231 20157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "070f7a46f44d471fadad6db92c66714d" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:10.113240 20009 raft_consensus.cc:3037] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.113387 20157 raft_consensus.cc:3032] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:10.113775 20157 raft_consensus.cc:729] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:10.114526 20157 consensus_queue.cc:260] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.116429 20157 raft_consensus.cc:3037] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.121502 20009 raft_consensus.cc:2454] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:10.123180 20049 leader_election.cc:302] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:10.124092 20355 raft_consensus.cc:2781] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:10.124629 20355 raft_consensus.cc:686] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:10.125574 20157 raft_consensus.cc:2454] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:10.125505 20355 consensus_queue.cc:237] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.133749 20313 raft_consensus.cc:979] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: : Instructing follower 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:10.133643 19905 catalog_manager.cc:5495] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 1 to 2, leader changed from 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195) to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:10.134341 20355 raft_consensus.cc:1067] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Signalling peer 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:10.136992 20157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:46102
I20260925 16:48:10.137645 20157 raft_consensus.cc:482] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:10.138118 20157 raft_consensus.cc:3037] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.145016 20157 raft_consensus.cc:504] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.147104 20157 leader_election.cc:288] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:10.148221 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:10.149142 20009 raft_consensus.cc:3037] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.148237 20083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7b5dab16d51a4e5caa2a5698633de31e" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:10.149694 20083 raft_consensus.cc:3032] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:10.149991 20083 raft_consensus.cc:729] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:10.150755 20083 consensus_queue.cc:260] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.152206 20083 raft_consensus.cc:3037] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.156162 20009 raft_consensus.cc:2454] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:10.157444 20123 leader_election.cc:302] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:10.158460 20340 raft_consensus.cc:2781] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:10.158550 20083 raft_consensus.cc:2454] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:10.159296 20340 raft_consensus.cc:686] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:10.160239 20340 consensus_queue.cc:237] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.167300 19905 catalog_manager.cc:5495] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 1 to 2, leader changed from 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194) to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:10.322607 20369 raft_consensus.cc:979] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: : Instructing follower 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:10.323238 20344 raft_consensus.cc:1067] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Signalling peer 59508d11ed7c4adb8e955f04ed531bd2 to start an election
I20260925 16:48:10.325304 20083 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
 from {username='slave'} at 127.0.0.1:42772
I20260925 16:48:10.326032 20083 raft_consensus.cc:482] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:10.326398 20083 raft_consensus.cc:3037] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.333868 20083 raft_consensus.cc:504] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.335661 20083 leader_election.cc:288] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195:43461)
I20260925 16:48:10.336871 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:10.337530 20009 raft_consensus.cc:3032] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:10.337392 20158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3643cf7fdd1c40e29daf29a6c7514da4" candidate_uuid: "59508d11ed7c4adb8e955f04ed531bd2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
I20260925 16:48:10.338052 20009 raft_consensus.cc:729] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:10.338212 20158 raft_consensus.cc:3037] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.338963 20009 consensus_queue.cc:260] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.340257 20009 raft_consensus.cc:3037] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:10.345167 20158 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:10.346539 20049 leader_election.cc:302] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:10.346827 20009 raft_consensus.cc:2454] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59508d11ed7c4adb8e955f04ed531bd2 in term 2.
I20260925 16:48:10.347433 20355 raft_consensus.cc:2781] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:10.347942 20355 raft_consensus.cc:686] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Leader. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:10.348676 20355 consensus_queue.cc:237] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:10.356544 19908 catalog_manager.cc:5495] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 reported cstate change: term changed from 1 to 2, leader changed from f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193) to 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194). New cstate: current_term: 2 leader_uuid: "59508d11ed7c4adb8e955f04ed531bd2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:10.428649 20158 raft_consensus.cc:1261] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.430342 20344 consensus_queue.cc:1035] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:10.442374 20085 raft_consensus.cc:1261] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.444654 20309 consensus_queue.cc:1035] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:10.531019 20158 raft_consensus.cc:1261] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.531647 20085 raft_consensus.cc:1261] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.534422 20157 raft_consensus.cc:1261] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer f35c6952e0eb439d98570c4ae1201d22: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.534669 20326 consensus_queue.cc:1035] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.538019 20344 consensus_queue.cc:1035] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.539582 20369 consensus_queue.cc:1035] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.572269 20009 raft_consensus.cc:1261] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.574910 20355 consensus_queue.cc:1035] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.602085 20009 raft_consensus.cc:1261] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.603895 20355 consensus_queue.cc:1035] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:10.616487 20157 raft_consensus.cc:1261] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.619763 20355 consensus_queue.cc:1035] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.627476 20083 raft_consensus.cc:1261] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.629393 20340 consensus_queue.cc:1035] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.646659 20010 raft_consensus.cc:1261] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.649552 20340 consensus_queue.cc:1035] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.787271 20010 raft_consensus.cc:1261] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.789014 20355 consensus_queue.cc:1035] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:10.800099 20157 raft_consensus.cc:1261] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Refusing update from remote peer 59508d11ed7c4adb8e955f04ed531bd2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:10.801468 20355 consensus_queue.cc:1035] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:12.882721 19905 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:41886:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260925 16:48:12.909471 19905 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:41886:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260925 16:48:12.960273  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
W20260925 16:48:13.110201 20123 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:33321, user_credentials={real_user=slave}} blocked reactor thread for 67531.4us
W20260925 16:48:13.119936 20049 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:43461, user_credentials={real_user=slave}} blocked reactor thread for 46328.6us
W20260925 16:48:13.180773 20411 log.cc:924] Time spent T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260925 16:48:13.281562 20435 tablet.cc:1722] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.261541 20433 tablet.cc:1722] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.327297 20440 tablet.cc:1722] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.331645 20436 tablet.cc:1722] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260925 16:48:13.329063 20422 log.cc:924] Time spent T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: Append to log took a long time: real 0.124s	user 0.002s	sys 0.000s
I20260925 16:48:13.360926 20082 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
mode: GRACEFUL
new_leader_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:40148
W20260925 16:48:13.386677 20423 log.cc:924] Time spent T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260925 16:48:13.388963 20437 tablet.cc:1722] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260925 16:48:13.401531 20036 tablet_mm_ops.cc:140] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:036d45d4a3174a19a34c29e7d7f03929)
I20260925 16:48:13.403249 20438 tablet.cc:1722] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260925 16:48:13.406031 20429 log.cc:924] Time spent T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
W20260925 16:48:13.412829 20036 tablet_mm_ops.cc:305] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:036d45d4a3174a19a34c29e7d7f03929)
W20260925 16:48:13.413812 20036 tablet_mm_ops.cc:221] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:036d45d4a3174a19a34c29e7d7f03929)
I20260925 16:48:13.414215 20446 tablet.cc:1722] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.418325 20443 tablet.cc:1722] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.451086 20082 raft_consensus.cc:595] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Received request to transfer leadership to TS 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:13.471766 20442 tablet.cc:1722] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.473908 20443 tablet.cc:1722] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.474468 20445 tablet.cc:1722] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.488718 20449 tablet.cc:1722] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.451593 20450 tablet.cc:1722] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.522645 20435 tablet.cc:1722] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.516990 20436 tablet.cc:1722] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.526899 20445 tablet.cc:1722] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.533346 20442 tablet.cc:1722] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.539224 20433 tablet.cc:1722] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.562374 20449 tablet.cc:1722] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.598845 20446 tablet.cc:1722] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.612216 20438 tablet.cc:1722] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.621205 20440 tablet.cc:1722] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.622538 20443 tablet.cc:1722] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.629828 20009 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
mode: GRACEFUL
new_leader_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:38676
I20260925 16:48:13.630566 20009 raft_consensus.cc:595] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Received request to transfer leadership to TS 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:13.630926 20436 tablet.cc:1722] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.620110 20437 tablet.cc:1722] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.632669  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260925 16:48:13.633610  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:13.635789 20446 tablet.cc:1722] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.639911 19907 catalog_manager.cc:5587] TS f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321) does not have the latest schema for tablet a84b24672cb4471babe0b7dbc632b9bc (table soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]). Expected version 1 got 0
I20260925 16:48:13.644420 20082 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382"
dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
mode: GRACEFUL
new_leader_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:40148
I20260925 16:48:13.645260 20082 raft_consensus.cc:595] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Received request to transfer leadership to TS 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:13.647068 20450 tablet.cc:1722] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:13.645435 19907 catalog_manager.cc:5587] TS f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321) does not have the latest schema for tablet b65bcfa4f124455dbb854358f8de1c1d (table soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d]). Expected version 1 got 0
I20260925 16:48:13.649669 20009 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949"
dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
mode: GRACEFUL
new_leader_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:38676
I20260925 16:48:13.650297 20009 raft_consensus.cc:595] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Received request to transfer leadership to TS 61b84bba30914cdd91efb8fd6d470653
I20260925 16:48:13.651515  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:48:13.652186  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:13.670024 20416 raft_consensus.cc:979] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: : Instructing follower 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:13.670531 20416 raft_consensus.cc:1067] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Signalling peer 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:13.672329 20157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:46102
I20260925 16:48:13.672925 20157 raft_consensus.cc:482] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:13.673346 20157 raft_consensus.cc:3037] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:13.681305 20157 raft_consensus.cc:504] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.685527 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:13.686074 20082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "13996b0de40a4030a8e54a950f82a91b" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:13.686275 20009 raft_consensus.cc:3037] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:13.686741 20082 raft_consensus.cc:3032] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:13.687071 19905 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126: soft_deleted_table [id=192a76f4761040f4ad8d94719bf3024d] alter complete (version 1)
I20260925 16:48:13.687103 20082 raft_consensus.cc:729] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:13.688143 20082 consensus_queue.cc:260] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.689936 20082 raft_consensus.cc:3037] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:13.693135 20157 leader_election.cc:288] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:13.700119 20009 raft_consensus.cc:2454] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:13.701452 20123 leader_election.cc:302] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:13.702221 20082 raft_consensus.cc:2454] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:13.702419 20381 raft_consensus.cc:2781] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:13.703029 20381 raft_consensus.cc:686] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:13.704036 20381 consensus_queue.cc:237] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.714509 19907 catalog_manager.cc:5495] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 1 to 2, leader changed from 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194) to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:13.919168 20447 raft_consensus.cc:979] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: : Instructing follower 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:13.919909 20451 raft_consensus.cc:1067] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Signalling peer 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:13.922024 20157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:46114
I20260925 16:48:13.922683 20157 raft_consensus.cc:482] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:13.923074 20157 raft_consensus.cc:3037] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:13.928519 20157 raft_consensus.cc:504] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.930117 20157 leader_election.cc:288] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:13.931453 20082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:13.931354 20006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e43fbba2c9d41c086f540d40abbb949" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:13.932278 20082 raft_consensus.cc:3037] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:13.932289 20006 raft_consensus.cc:3032] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:13.932822 20006 raft_consensus.cc:729] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:13.933629 20006 consensus_queue.cc:260] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.934966 20006 raft_consensus.cc:3037] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:13.939607 20082 raft_consensus.cc:2454] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:13.941013 20124 leader_election.cc:302] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:13.942266 20006 raft_consensus.cc:2454] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 2.
I20260925 16:48:13.942415 20381 raft_consensus.cc:2781] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:13.943177 20381 raft_consensus.cc:686] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:13.944152 20381 consensus_queue.cc:237] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.954360 19907 catalog_manager.cc:5495] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 1 to 2, leader changed from f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193) to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 2 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:13.967082 20447 raft_consensus.cc:979] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: : Instructing follower 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:13.967674 20451 raft_consensus.cc:1067] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Signalling peer 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:13.969588 20157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:46114
I20260925 16:48:13.970209 20157 raft_consensus.cc:482] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:13.970723 20157 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:13.976692 20157 raft_consensus.cc:504] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.978328 20157 leader_election.cc:288] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 3 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:13.979336 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:13.979663 20082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d63d1c2761e449a8f749ae6f696d757" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:13.980000 20009 raft_consensus.cc:3032] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:48:13.980553 20009 raft_consensus.cc:729] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f35c6952e0eb439d98570c4ae1201d22, State: Running, Role: LEADER
I20260925 16:48:13.980556 20082 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:13.981439 20009 consensus_queue.cc:260] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.982703 20009 raft_consensus.cc:3037] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:13.987638 20082 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 3.
I20260925 16:48:13.988790 20124 leader_election.cc:302] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59508d11ed7c4adb8e955f04ed531bd2, 61b84bba30914cdd91efb8fd6d470653; no voters: 
I20260925 16:48:13.989490 20381 raft_consensus.cc:2781] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:48:13.989986 20381 raft_consensus.cc:686] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 3 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:13.990788 20009 raft_consensus.cc:2454] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 3.
I20260925 16:48:13.990933 20381 consensus_queue.cc:237] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:13.999429 19907 catalog_manager.cc:5495] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 2 to 3, leader changed from f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193) to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:14.153293 20425 raft_consensus.cc:979] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: : Instructing follower 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:14.153761 20413 raft_consensus.cc:1067] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Signalling peer 61b84bba30914cdd91efb8fd6d470653 to start an election
I20260925 16:48:14.155117 20157 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382"
dest_uuid: "61b84bba30914cdd91efb8fd6d470653"
 from {username='slave'} at 127.0.0.1:46102
I20260925 16:48:14.155575 20157 raft_consensus.cc:482] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:14.155923 20157 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:14.160955 20157 raft_consensus.cc:504] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:14.162298 20157 leader_election.cc:288] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 3 election: Requested vote from peers f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321), 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431)
I20260925 16:48:14.163280 20009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f35c6952e0eb439d98570c4ae1201d22"
I20260925 16:48:14.163486 20082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "287190b0bfc6445b837ad8768e83e382" candidate_uuid: "61b84bba30914cdd91efb8fd6d470653" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "59508d11ed7c4adb8e955f04ed531bd2"
I20260925 16:48:14.163982 20009 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:14.164074 20082 raft_consensus.cc:3032] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:48:14.164454 20082 raft_consensus.cc:729] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 59508d11ed7c4adb8e955f04ed531bd2, State: Running, Role: LEADER
I20260925 16:48:14.165304 20082 consensus_queue.cc:260] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:14.166682 20082 raft_consensus.cc:3037] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:14.170928 20009 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 3.
I20260925 16:48:14.172341 20123 leader_election.cc:302] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 61b84bba30914cdd91efb8fd6d470653, f35c6952e0eb439d98570c4ae1201d22; no voters: 
I20260925 16:48:14.173260 20381 raft_consensus.cc:2781] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:48:14.173339 20082 raft_consensus.cc:2454] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 61b84bba30914cdd91efb8fd6d470653 in term 3.
I20260925 16:48:14.174258 20381 raft_consensus.cc:686] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 3 LEADER]: Becoming Leader. State: Replica: 61b84bba30914cdd91efb8fd6d470653, State: Running, Role: LEADER
I20260925 16:48:14.175376 20381 consensus_queue.cc:237] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } }
I20260925 16:48:14.183434 19907 catalog_manager.cc:5495] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 reported cstate change: term changed from 2 to 3, leader changed from 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194) to 61b84bba30914cdd91efb8fd6d470653 (127.7.158.195). New cstate: current_term: 3 leader_uuid: "61b84bba30914cdd91efb8fd6d470653" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "61b84bba30914cdd91efb8fd6d470653" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 43461 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:14.243541 20009 raft_consensus.cc:1261] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:48:14.244727 20381 consensus_queue.cc:1035] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:14.255355 20082 raft_consensus.cc:1261] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260925 16:48:14.256628 20381 consensus_queue.cc:1035] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:14.409806 20082 raft_consensus.cc:1261] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260925 16:48:14.411415 20381 consensus_queue.cc:1035] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260925 16:48:14.419755 20009 raft_consensus.cc:1261] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260925 16:48:14.421160 20462 consensus_queue.cc:1035] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260925 16:48:14.451309 20009 raft_consensus.cc:1261] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:14.452669 20462 consensus_queue.cc:1035] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:14.464059 20082 raft_consensus.cc:1261] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:14.466322 20408 consensus_queue.cc:1035] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:14.620296 20009 raft_consensus.cc:1261] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:48:14.621645 20462 consensus_queue.cc:1035] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f35c6952e0eb439d98570c4ae1201d22" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 33321 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:14.631177 20082 raft_consensus.cc:1261] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Refusing update from remote peer 61b84bba30914cdd91efb8fd6d470653: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:48:14.633703 20408 consensus_queue.cc:1035] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59508d11ed7c4adb8e955f04ed531bd2" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 34431 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:14.653342  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:14.660120  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:14.660526  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:14.664923  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:14.665287  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:15.666424  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:15.672183  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:15.672648  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:15.678679  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:15.679208  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:16.680193  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:16.685484  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:16.685927  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:16.690313  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:16.690757  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:17.691805  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:17.696715  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:17.697183  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:17.703212  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:17.703660  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:18.704535  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:18.709923  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:18.710683  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:18.716049  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:18.716527  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:19.717337  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:19.722321  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:19.722908  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:19.730384  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:19.730837  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:20.732093  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:20.740572  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:20.741256  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:20.746263  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:20.746655  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:21.748023  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:21.753903  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:21.754419  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:21.760245  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:21.760785  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:22.761624  7803 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20260925 16:48:22.768693  7803 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260925 16:48:22.769189  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:22.774646  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:22.775252  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:23.842686  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
I20260925 16:48:23.889688  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:23.890652  7803 tablet_replica.cc:330] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.892194  7803 raft_consensus.cc:2229] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.892937  7803 raft_consensus.cc:2258] T 3643cf7fdd1c40e29daf29a6c7514da4 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.896961  7803 tablet_replica.cc:330] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
W20260925 16:48:23.897806 20049 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 128 similar messages]
I20260925 16:48:23.898236  7803 raft_consensus.cc:2229] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.899571  7803 raft_consensus.cc:2258] T 070f7a46f44d471fadad6db92c66714d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:23.902664 20123 consensus_peers.cc:487] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:23.902923 20049 consensus_peers.cc:487] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:23.904021  7803 tablet_replica.cc:330] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.904603  7803 raft_consensus.cc:2229] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:23.905548  7803 raft_consensus.cc:2258] T 036d45d4a3174a19a34c29e7d7f03929 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.908263  7803 tablet_replica.cc:330] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.908916  7803 raft_consensus.cc:2229] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.909427  7803 raft_consensus.cc:2258] T 7b5dab16d51a4e5caa2a5698633de31e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.913038  7803 tablet_replica.cc:330] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.913761  7803 raft_consensus.cc:2229] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.914379  7803 raft_consensus.cc:2258] T 8bc27310de7544c880d9aaa19e9329e0 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.918170  7803 tablet_replica.cc:330] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.919090  7803 raft_consensus.cc:2229] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.919859  7803 raft_consensus.cc:2258] T 69995226adb749468909c567c7a560c3 P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.922634  7803 tablet_replica.cc:330] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.923647  7803 raft_consensus.cc:2229] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:23.924728  7803 raft_consensus.cc:2258] T b01f86069ec94323ae288fc01060d989 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.927963  7803 tablet_replica.cc:330] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.928545  7803 raft_consensus.cc:2229] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.929078  7803 raft_consensus.cc:2258] T 287190b0bfc6445b837ad8768e83e382 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.931460  7803 tablet_replica.cc:330] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.932019  7803 raft_consensus.cc:2229] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.932461  7803 raft_consensus.cc:2258] T 4d63d1c2761e449a8f749ae6f696d757 P f35c6952e0eb439d98570c4ae1201d22 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.934788  7803 tablet_replica.cc:330] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.935343  7803 raft_consensus.cc:2229] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.935794  7803 raft_consensus.cc:2258] T 8e43fbba2c9d41c086f540d40abbb949 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.938086  7803 tablet_replica.cc:330] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.938642  7803 raft_consensus.cc:2229] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.939543  7803 raft_consensus.cc:2258] T f81b7d9d4f3f46f4bc905aeb0d65822f P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.942214  7803 tablet_replica.cc:330] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.942778  7803 raft_consensus.cc:2229] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:23.943765  7803 raft_consensus.cc:2258] T efe9b8f993494b4991ab0113567cca33 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.946385  7803 tablet_replica.cc:330] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.946981  7803 raft_consensus.cc:2229] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.947734  7803 raft_consensus.cc:2258] T 13996b0de40a4030a8e54a950f82a91b P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.950371  7803 tablet_replica.cc:330] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.950935  7803 raft_consensus.cc:2229] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:23.951951  7803 raft_consensus.cc:2258] T a84b24672cb4471babe0b7dbc632b9bc P f35c6952e0eb439d98570c4ae1201d22 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.954249  7803 tablet_replica.cc:330] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.954825  7803 raft_consensus.cc:2229] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.955451  7803 raft_consensus.cc:2258] T 94d316e188fc47b795aeb4fd55a2448e P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.958600  7803 tablet_replica.cc:330] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.959100  7803 raft_consensus.cc:2229] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:23.960085  7803 raft_consensus.cc:2258] T b65bcfa4f124455dbb854358f8de1c1d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.962327  7803 tablet_replica.cc:330] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.962846  7803 raft_consensus.cc:2229] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:23.963346  7803 raft_consensus.cc:2258] T d96e2ad8f27f4963b7e60e446336ae69 P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:23.966032  7803 tablet_replica.cc:330] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22: stopping tablet replica
I20260925 16:48:23.966678  7803 raft_consensus.cc:2229] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:23.967747  7803 raft_consensus.cc:2258] T e6741ad6d36b4299a0708fabb97a736d P f35c6952e0eb439d98570c4ae1201d22 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:23.982493 20123 consensus_peers.cc:487] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:24.009068 20123 consensus_peers.cc:487] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:33321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.009704  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
W20260925 16:48:24.010317 20049 consensus_peers.cc:487] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:33321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:24.033373 20049 consensus_peers.cc:487] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:33321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.057274  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:48:24.067334 20123 consensus_peers.cc:487] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:33321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.098096  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:24.099077  7803 tablet_replica.cc:330] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.100107  7803 raft_consensus.cc:2229] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.100855  7803 raft_consensus.cc:2258] T a84b24672cb4471babe0b7dbc632b9bc P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.103106  7803 tablet_replica.cc:330] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.103782  7803 raft_consensus.cc:2229] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.104205  7803 raft_consensus.cc:2258] T 13996b0de40a4030a8e54a950f82a91b P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.106415  7803 tablet_replica.cc:330] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.107155  7803 raft_consensus.cc:2229] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.108217  7803 raft_consensus.cc:2258] T 3643cf7fdd1c40e29daf29a6c7514da4 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.110702  7803 tablet_replica.cc:330] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.111255  7803 raft_consensus.cc:2229] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.111886  7803 raft_consensus.cc:2258] T 7b5dab16d51a4e5caa2a5698633de31e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.114064  7803 tablet_replica.cc:330] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.114634  7803 raft_consensus.cc:2229] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.115501  7803 raft_consensus.cc:2258] T 070f7a46f44d471fadad6db92c66714d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.117915  7803 tablet_replica.cc:330] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.118423  7803 raft_consensus.cc:2229] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.119524  7803 raft_consensus.cc:2258] T 94d316e188fc47b795aeb4fd55a2448e P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.122080  7803 tablet_replica.cc:330] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.122625  7803 raft_consensus.cc:2229] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.123360  7803 raft_consensus.cc:2258] T b65bcfa4f124455dbb854358f8de1c1d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.126009  7803 tablet_replica.cc:330] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.126480  7803 raft_consensus.cc:2229] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.127359  7803 raft_consensus.cc:2258] T d96e2ad8f27f4963b7e60e446336ae69 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.129432  7803 tablet_replica.cc:330] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.129904  7803 raft_consensus.cc:2229] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.130330  7803 raft_consensus.cc:2258] T 287190b0bfc6445b837ad8768e83e382 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.132302  7803 tablet_replica.cc:330] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.132998  7803 raft_consensus.cc:2229] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.133620  7803 raft_consensus.cc:2258] T 4d63d1c2761e449a8f749ae6f696d757 P 59508d11ed7c4adb8e955f04ed531bd2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.136616  7803 tablet_replica.cc:330] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.137355  7803 raft_consensus.cc:2229] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.137902  7803 raft_consensus.cc:2258] T 8e43fbba2c9d41c086f540d40abbb949 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:24.137903 20124 consensus_peers.cc:487] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 -> Peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Couldn't send request to peer 59508d11ed7c4adb8e955f04ed531bd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.140292  7803 tablet_replica.cc:330] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.140854  7803 raft_consensus.cc:2229] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.141741  7803 raft_consensus.cc:2258] T f81b7d9d4f3f46f4bc905aeb0d65822f P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.144057  7803 tablet_replica.cc:330] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.144686  7803 raft_consensus.cc:2229] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.145221  7803 raft_consensus.cc:2258] T 036d45d4a3174a19a34c29e7d7f03929 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.147539  7803 tablet_replica.cc:330] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.148281  7803 raft_consensus.cc:2229] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.148859  7803 raft_consensus.cc:2258] T e6741ad6d36b4299a0708fabb97a736d P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:24.150684 20124 consensus_peers.cc:487] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 -> Peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Couldn't send request to peer 59508d11ed7c4adb8e955f04ed531bd2. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.151558  7803 tablet_replica.cc:330] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.152263  7803 raft_consensus.cc:2229] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.152825  7803 raft_consensus.cc:2258] T efe9b8f993494b4991ab0113567cca33 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.154857  7803 tablet_replica.cc:330] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.155407  7803 raft_consensus.cc:2229] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.155906  7803 raft_consensus.cc:2258] T b01f86069ec94323ae288fc01060d989 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.158048  7803 tablet_replica.cc:330] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.158577  7803 raft_consensus.cc:2229] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.159384  7803 raft_consensus.cc:2258] T 69995226adb749468909c567c7a560c3 P 59508d11ed7c4adb8e955f04ed531bd2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.161530  7803 tablet_replica.cc:330] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2: stopping tablet replica
I20260925 16:48:24.162017  7803 raft_consensus.cc:2229] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.162583  7803 raft_consensus.cc:2258] T 8bc27310de7544c880d9aaa19e9329e0 P 59508d11ed7c4adb8e955f04ed531bd2 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:24.194392 20124 consensus_peers.cc:487] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 -> Peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Couldn't send request to peer 59508d11ed7c4adb8e955f04ed531bd2. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:34431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.208770  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:48:24.248471  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
W20260925 16:48:24.266346 20123 consensus_peers.cc:487] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 -> Peer f35c6952e0eb439d98570c4ae1201d22 (127.7.158.193:33321): Couldn't send request to peer f35c6952e0eb439d98570c4ae1201d22. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:33321: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:24.267565 20124 consensus_peers.cc:487] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 -> Peer 59508d11ed7c4adb8e955f04ed531bd2 (127.7.158.194:34431): Couldn't send request to peer 59508d11ed7c4adb8e955f04ed531bd2. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.194:34431: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:24.290088  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:24.291198  7803 tablet_replica.cc:330] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.292390  7803 raft_consensus.cc:2229] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.293205  7803 raft_consensus.cc:2258] T 036d45d4a3174a19a34c29e7d7f03929 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.295500  7803 tablet_replica.cc:330] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.296160  7803 raft_consensus.cc:2229] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.296633  7803 raft_consensus.cc:2258] T 3643cf7fdd1c40e29daf29a6c7514da4 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.298805  7803 tablet_replica.cc:330] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.299427  7803 raft_consensus.cc:2229] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.299932  7803 raft_consensus.cc:2258] T 070f7a46f44d471fadad6db92c66714d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.301993  7803 tablet_replica.cc:330] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.302529  7803 raft_consensus.cc:2229] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.303879  7803 raft_consensus.cc:2258] T 7b5dab16d51a4e5caa2a5698633de31e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.306342  7803 tablet_replica.cc:330] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.306960  7803 raft_consensus.cc:2229] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.308022  7803 raft_consensus.cc:2258] T 8bc27310de7544c880d9aaa19e9329e0 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.310204  7803 tablet_replica.cc:330] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.310686  7803 raft_consensus.cc:2229] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.311116  7803 raft_consensus.cc:2258] T efe9b8f993494b4991ab0113567cca33 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.312981  7803 tablet_replica.cc:330] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.313431  7803 raft_consensus.cc:2229] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.313868  7803 raft_consensus.cc:2258] T f81b7d9d4f3f46f4bc905aeb0d65822f P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.315749  7803 tablet_replica.cc:330] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.316212  7803 raft_consensus.cc:2229] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.317021  7803 raft_consensus.cc:2258] T 4d63d1c2761e449a8f749ae6f696d757 P 61b84bba30914cdd91efb8fd6d470653 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.318992  7803 tablet_replica.cc:330] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.320116  7803 raft_consensus.cc:2229] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.320941  7803 raft_consensus.cc:2258] T 8e43fbba2c9d41c086f540d40abbb949 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.322919  7803 tablet_replica.cc:330] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.323419  7803 raft_consensus.cc:2229] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.324285  7803 raft_consensus.cc:2258] T 287190b0bfc6445b837ad8768e83e382 P 61b84bba30914cdd91efb8fd6d470653 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.326421  7803 tablet_replica.cc:330] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.326978  7803 raft_consensus.cc:2229] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.327391  7803 raft_consensus.cc:2258] T b01f86069ec94323ae288fc01060d989 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.329416  7803 tablet_replica.cc:330] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.329881  7803 raft_consensus.cc:2229] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.330247  7803 raft_consensus.cc:2258] T 69995226adb749468909c567c7a560c3 P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.334038  7803 tablet_replica.cc:330] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.334523  7803 raft_consensus.cc:2229] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.335394  7803 raft_consensus.cc:2258] T 13996b0de40a4030a8e54a950f82a91b P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.337708  7803 tablet_replica.cc:330] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.338147  7803 raft_consensus.cc:2229] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.338581  7803 raft_consensus.cc:2258] T a84b24672cb4471babe0b7dbc632b9bc P 61b84bba30914cdd91efb8fd6d470653 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.340648  7803 tablet_replica.cc:330] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.341181  7803 raft_consensus.cc:2229] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.341856  7803 raft_consensus.cc:2258] T 94d316e188fc47b795aeb4fd55a2448e P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.344086  7803 tablet_replica.cc:330] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.344578  7803 raft_consensus.cc:2229] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.345112  7803 raft_consensus.cc:2258] T b65bcfa4f124455dbb854358f8de1c1d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.347437  7803 tablet_replica.cc:330] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.347975  7803 raft_consensus.cc:2229] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.348428  7803 raft_consensus.cc:2258] T d96e2ad8f27f4963b7e60e446336ae69 P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.350411  7803 tablet_replica.cc:330] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653: stopping tablet replica
I20260925 16:48:24.350888  7803 raft_consensus.cc:2229] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:24.351370  7803 raft_consensus.cc:2258] T e6741ad6d36b4299a0708fabb97a736d P 61b84bba30914cdd91efb8fd6d470653 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.395537  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:48:24.442813  7803 master.cc:537] Master@127.7.158.254:35965 shutting down...
I20260925 16:48:24.477424  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:24.477986  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:24.478271  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P 19c9319c0f694f5b88814005ce6f2126: stopping tablet replica
I20260925 16:48:24.500649  7803 master.cc:552] Master@127.7.158.254:35965 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (21497 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260925 16:48:24.558538  7803 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.7.158.254:33515
I20260925 16:48:24.559634  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:24.565681 20493 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:24.565721 20494 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:24.566526 20496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:24.567807  7803 server_base.cc:1034] running on GCE node
I20260925 16:48:24.568742  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:24.568923  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:24.569032  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354904569025 us; error 0 us; skew 500 ppm
I20260925 16:48:24.569471  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:24.571990  7803 webserver.cc:460] Webserver started at http://127.7.158.254:46023/ using document root <none> and password file <none>
I20260925 16:48:24.572399  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:24.572646  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:24.572933  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:24.574071  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/master-0-root/instance:
uuid: "9e870c6e171946239b7a2a76ce63db68"
format_stamp: "Formatted at 2026-09-25 16:48:24 on dist-test-slave-fknp"
I20260925 16:48:24.578536  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.000s	sys 0.006s
I20260925 16:48:24.582926 20501 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.583988  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260925 16:48:24.584304  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/master-0-root
uuid: "9e870c6e171946239b7a2a76ce63db68"
format_stamp: "Formatted at 2026-09-25 16:48:24 on dist-test-slave-fknp"
I20260925 16:48:24.584728  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:24.613546  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:24.614830  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:24.660274  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.254:33515
I20260925 16:48:24.660462 20552 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.254:33515 every 8 connection(s)
I20260925 16:48:24.664682 20553 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:24.677822 20553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: Bootstrap starting.
I20260925 16:48:24.682790 20553 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:24.687299 20553 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: No bootstrap required, opened a new log
I20260925 16:48:24.689798 20553 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e870c6e171946239b7a2a76ce63db68" member_type: VOTER }
I20260925 16:48:24.690321 20553 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:24.690507 20553 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e870c6e171946239b7a2a76ce63db68, State: Initialized, Role: FOLLOWER
I20260925 16:48:24.691094 20553 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e870c6e171946239b7a2a76ce63db68" member_type: VOTER }
I20260925 16:48:24.691506 20553 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260925 16:48:24.691685 20553 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260925 16:48:24.691972 20553 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:24.697135 20553 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e870c6e171946239b7a2a76ce63db68" member_type: VOTER }
I20260925 16:48:24.697593 20553 leader_election.cc:302] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e870c6e171946239b7a2a76ce63db68; no voters: 
I20260925 16:48:24.698655 20553 leader_election.cc:288] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260925 16:48:24.699131 20556 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:24.700567 20556 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 LEADER]: Becoming Leader. State: Replica: 9e870c6e171946239b7a2a76ce63db68, State: Running, Role: LEADER
I20260925 16:48:24.701246 20556 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e870c6e171946239b7a2a76ce63db68" member_type: VOTER }
I20260925 16:48:24.701541 20553 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [sys.catalog]: configured and running, proceeding with master startup.
I20260925 16:48:24.706024 20557 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e870c6e171946239b7a2a76ce63db68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e870c6e171946239b7a2a76ce63db68" member_type: VOTER } }
I20260925 16:48:24.706722 20557 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [sys.catalog]: This master's current role is: LEADER
I20260925 16:48:24.706591 20558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e870c6e171946239b7a2a76ce63db68. Latest consensus state: current_term: 1 leader_uuid: "9e870c6e171946239b7a2a76ce63db68" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e870c6e171946239b7a2a76ce63db68" member_type: VOTER } }
I20260925 16:48:24.707562 20558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [sys.catalog]: This master's current role is: LEADER
I20260925 16:48:24.711319 20563 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260925 16:48:24.719430 20563 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260925 16:48:24.720588  7803 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260925 16:48:24.728991 20563 catalog_manager.cc:1347] Generated new cluster ID: d06954914270465ba923086db4c9ae72
I20260925 16:48:24.729487 20563 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260925 16:48:24.749401 20563 catalog_manager.cc:1370] Generated new certificate authority record
I20260925 16:48:24.751307 20563 catalog_manager.cc:1504] Loading token signing keys...
I20260925 16:48:24.768762 20563 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: Generated new TSK 0
I20260925 16:48:24.769546 20563 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260925 16:48:24.788672  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:24.794485 20574 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:24.795603 20575 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:24.796995 20577 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:24.798614  7803 server_base.cc:1034] running on GCE node
I20260925 16:48:24.800309  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:24.800495  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:24.800698  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354904800686 us; error 0 us; skew 500 ppm
I20260925 16:48:24.801295  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:24.803871  7803 webserver.cc:460] Webserver started at http://127.7.158.193:42853/ using document root <none> and password file <none>
I20260925 16:48:24.804346  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:24.804504  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:24.804816  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:24.805912  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-0-root/instance:
uuid: "386b91628c2841c0b0fd0d4f33c5633a"
format_stamp: "Formatted at 2026-09-25 16:48:24 on dist-test-slave-fknp"
I20260925 16:48:24.810448  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260925 16:48:24.814091 20582 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.815189  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.000s	sys 0.002s
I20260925 16:48:24.815624  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-0-root
uuid: "386b91628c2841c0b0fd0d4f33c5633a"
format_stamp: "Formatted at 2026-09-25 16:48:24 on dist-test-slave-fknp"
I20260925 16:48:24.816062  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:24.831619  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:24.832902  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:24.834353  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:48:24.836819  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:48:24.837046  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.837301  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:48:24.837477  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.887513  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.193:39529
I20260925 16:48:24.887605 20644 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.193:39529 every 8 connection(s)
I20260925 16:48:24.892714  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:24.899930 20649 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:24.902690 20650 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:24.904080 20652 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:24.905894  7803 server_base.cc:1034] running on GCE node
I20260925 16:48:24.907791  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:24.908075  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:24.908264  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354904908248 us; error 0 us; skew 500 ppm
I20260925 16:48:24.908952  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:24.908879 20645 heartbeater.cc:347] Connected to a master server at 127.7.158.254:33515
I20260925 16:48:24.909597 20645 heartbeater.cc:464] Registering TS with master...
I20260925 16:48:24.910508 20645 heartbeater.cc:511] Master 127.7.158.254:33515 requested a full tablet report, sending...
I20260925 16:48:24.911782  7803 webserver.cc:460] Webserver started at http://127.7.158.194:33919/ using document root <none> and password file <none>
I20260925 16:48:24.912420  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:24.912616  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:24.912952  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:24.913015 20518 ts_manager.cc:194] Registered new tserver with Master: 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529)
I20260925 16:48:24.914275  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-1-root/instance:
uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
format_stamp: "Formatted at 2026-09-25 16:48:24 on dist-test-slave-fknp"
I20260925 16:48:24.915542 20518 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38288
I20260925 16:48:24.920596  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.006s	user 0.008s	sys 0.000s
I20260925 16:48:24.924868 20657 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.925909  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260925 16:48:24.926349  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-1-root
uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
format_stamp: "Formatted at 2026-09-25 16:48:24 on dist-test-slave-fknp"
I20260925 16:48:24.926822  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:24.939628  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:24.940905  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:24.942579  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:48:24.944864  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:48:24.945075  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.945324  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:48:24.945488  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:24.996526  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.194:43371
I20260925 16:48:24.996840 20719 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.194:43371 every 8 connection(s)
I20260925 16:48:25.001474  7803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260925 16:48:25.009035 20723 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:25.011616 20724 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260925 16:48:25.012511 20726 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260925 16:48:25.013132  7803 server_base.cc:1034] running on GCE node
I20260925 16:48:25.014271  7803 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260925 16:48:25.014540  7803 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260925 16:48:25.014775  7803 hybrid_clock.cc:648] HybridClock initialized: now 1790354905014751 us; error 0 us; skew 500 ppm
I20260925 16:48:25.015508  7803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260925 16:48:25.019400 20720 heartbeater.cc:347] Connected to a master server at 127.7.158.254:33515
I20260925 16:48:25.019824  7803 webserver.cc:460] Webserver started at http://127.7.158.195:35825/ using document root <none> and password file <none>
I20260925 16:48:25.020263 20720 heartbeater.cc:464] Registering TS with master...
I20260925 16:48:25.020859  7803 fs_manager.cc:359] Metadata directory not provided
I20260925 16:48:25.021138  7803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260925 16:48:25.021211 20720 heartbeater.cc:511] Master 127.7.158.254:33515 requested a full tablet report, sending...
I20260925 16:48:25.021546  7803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260925 16:48:25.023458  7803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-2-root/instance:
uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
format_stamp: "Formatted at 2026-09-25 16:48:25 on dist-test-slave-fknp"
I20260925 16:48:25.023905 20518 ts_manager.cc:194] Registered new tserver with Master: cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.025570 20518 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38298
I20260925 16:48:25.029120  7803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.004s
I20260925 16:48:25.032768 20731 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:25.033877  7803 fs_manager.cc:725] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260925 16:48:25.034442  7803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-2-root
uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
format_stamp: "Formatted at 2026-09-25 16:48:25 on dist-test-slave-fknp"
I20260925 16:48:25.034793  7803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260925 16:48:25.047502  7803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips  26 Jan 2017
I20260925 16:48:25.048768  7803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260925 16:48:25.050185  7803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260925 16:48:25.052570  7803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260925 16:48:25.052795  7803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:25.053033  7803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260925 16:48:25.053201  7803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260925 16:48:25.099857  7803 rpc_server.cc:307] RPC server started. Bound to: 127.7.158.195:37719
I20260925 16:48:25.099970 20793 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.7.158.195:37719 every 8 connection(s)
I20260925 16:48:25.117334 20794 heartbeater.cc:347] Connected to a master server at 127.7.158.254:33515
I20260925 16:48:25.117738 20794 heartbeater.cc:464] Registering TS with master...
I20260925 16:48:25.118427 20794 heartbeater.cc:511] Master 127.7.158.254:33515 requested a full tablet report, sending...
I20260925 16:48:25.120975  7803 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016776596s
I20260925 16:48:25.120831 20518 ts_manager.cc:194] Registered new tserver with Master: c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.123911 20518 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38304
I20260925 16:48:25.124470  7803 test_util.cc:268] Using random seed: 2082754140
I20260925 16:48:25.154294 20518 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38320:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:48:25.157276 20518 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:48:25.247390 20684 tablet_service.cc:1467] Processing CreateTablet for tablet de0038eadee24d768982d1a1e63bf6c9 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:25.247421 20685 tablet_service.cc:1467] Processing CreateTablet for tablet 91ee8bf70b67447fb9984a35c0e20075 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:25.249008 20684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de0038eadee24d768982d1a1e63bf6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.249583 20685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ee8bf70b67447fb9984a35c0e20075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.250803 20682 tablet_service.cc:1467] Processing CreateTablet for tablet 218625d375ee426abed709faede5fe55 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:25.252910 20681 tablet_service.cc:1467] Processing CreateTablet for tablet f975ac9ac5854adb83e3bd7f14e3c17a (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:25.256815 20608 tablet_service.cc:1467] Processing CreateTablet for tablet 3fad3381a04e4380875352097dea373f (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:25.258279 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fad3381a04e4380875352097dea373f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.258016 20610 tablet_service.cc:1467] Processing CreateTablet for tablet 91ee8bf70b67447fb9984a35c0e20075 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:25.259315 20610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ee8bf70b67447fb9984a35c0e20075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.261001 20607 tablet_service.cc:1467] Processing CreateTablet for tablet 218625d375ee426abed709faede5fe55 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:25.262679 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 218625d375ee426abed709faede5fe55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.264887 20606 tablet_service.cc:1467] Processing CreateTablet for tablet f975ac9ac5854adb83e3bd7f14e3c17a (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:25.266258 20606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f975ac9ac5854adb83e3bd7f14e3c17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.268945 20604 tablet_service.cc:1467] Processing CreateTablet for tablet 87f458328ca14f06b2900558a057dbab (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:25.270176 20604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87f458328ca14f06b2900558a057dbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.272933 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 6a8d661b42a540c89c4c0dd42988c531 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:25.272815 20602 tablet_service.cc:1467] Processing CreateTablet for tablet d8cc4ec6889c494fb84f818e8695994b (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:25.274403 20679 tablet_service.cc:1467] Processing CreateTablet for tablet 87f458328ca14f06b2900558a057dbab (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:25.275642 20602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8cc4ec6889c494fb84f818e8695994b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.276896 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a8d661b42a540c89c4c0dd42988c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.281569 20609 tablet_service.cc:1467] Processing CreateTablet for tablet de0038eadee24d768982d1a1e63bf6c9 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:25.264889 20605 tablet_service.cc:1467] Processing CreateTablet for tablet 53e44bb9909441df971f01c2fe28cd4f (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:25.249493 20683 tablet_service.cc:1467] Processing CreateTablet for tablet 3fad3381a04e4380875352097dea373f (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:25.254756 20680 tablet_service.cc:1467] Processing CreateTablet for tablet 53e44bb9909441df971f01c2fe28cd4f (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:25.287853 20682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 218625d375ee426abed709faede5fe55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.292434 20609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de0038eadee24d768982d1a1e63bf6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.292925 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f975ac9ac5854adb83e3bd7f14e3c17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.293216 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e44bb9909441df971f01c2fe28cd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.296886 20678 tablet_service.cc:1467] Processing CreateTablet for tablet 6a8d661b42a540c89c4c0dd42988c531 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:25.298194 20678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a8d661b42a540c89c4c0dd42988c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.301026 20679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87f458328ca14f06b2900558a057dbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.302148 20683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fad3381a04e4380875352097dea373f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.303870 20677 tablet_service.cc:1467] Processing CreateTablet for tablet d8cc4ec6889c494fb84f818e8695994b (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:25.305248 20677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8cc4ec6889c494fb84f818e8695994b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.306881 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e44bb9909441df971f01c2fe28cd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.320897 20758 tablet_service.cc:1467] Processing CreateTablet for tablet de0038eadee24d768982d1a1e63bf6c9 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:25.322417 20758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet de0038eadee24d768982d1a1e63bf6c9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.322897 20752 tablet_service.cc:1467] Processing CreateTablet for tablet 6a8d661b42a540c89c4c0dd42988c531 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:25.323316 20753 tablet_service.cc:1467] Processing CreateTablet for tablet 87f458328ca14f06b2900558a057dbab (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:25.324275 20752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 6a8d661b42a540c89c4c0dd42988c531. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.324971 20757 tablet_service.cc:1467] Processing CreateTablet for tablet 3fad3381a04e4380875352097dea373f (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:25.325870 20751 tablet_service.cc:1467] Processing CreateTablet for tablet d8cc4ec6889c494fb84f818e8695994b (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:25.326820 20757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 3fad3381a04e4380875352097dea373f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.328105 20751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d8cc4ec6889c494fb84f818e8695994b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.328876 20756 tablet_service.cc:1467] Processing CreateTablet for tablet 218625d375ee426abed709faede5fe55 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:25.330245 20756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 218625d375ee426abed709faede5fe55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.332867 20754 tablet_service.cc:1467] Processing CreateTablet for tablet 53e44bb9909441df971f01c2fe28cd4f (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:25.334151 20754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53e44bb9909441df971f01c2fe28cd4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.336607 20755 tablet_service.cc:1467] Processing CreateTablet for tablet f975ac9ac5854adb83e3bd7f14e3c17a (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:25.337109 20753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 87f458328ca14f06b2900558a057dbab. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.337898 20755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f975ac9ac5854adb83e3bd7f14e3c17a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.340525 20759 tablet_service.cc:1467] Processing CreateTablet for tablet 91ee8bf70b67447fb9984a35c0e20075 (DEFAULT_TABLE table=test-workload [id=7cc22163a59f498cb81a98d9ac074dc0]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:25.341961 20759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 91ee8bf70b67447fb9984a35c0e20075. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:25.379267 20811 tablet_bootstrap.cc:492] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.385671 20811 tablet_bootstrap.cc:654] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.390877 20809 tablet_bootstrap.cc:492] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.393819 20811 tablet_bootstrap.cc:492] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.394465 20811 ts_tablet_manager.cc:1397] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.016s	user 0.009s	sys 0.005s
I20260925 16:48:25.397614 20811 raft_consensus.cc:348] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.398496 20811 raft_consensus.cc:374] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.398815 20811 raft_consensus.cc:729] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.399833 20811 consensus_queue.cc:260] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.400992 20809 tablet_bootstrap.cc:654] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.409755 20794 heartbeater.cc:503] Master 127.7.158.254:33515 was elected leader, sending a full tablet report...
I20260925 16:48:25.428092 20811 ts_tablet_manager.cc:1428] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.033s	user 0.006s	sys 0.001s
I20260925 16:48:25.430377 20811 tablet_bootstrap.cc:492] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.434957 20809 tablet_bootstrap.cc:492] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.436125 20809 ts_tablet_manager.cc:1397] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.046s	user 0.027s	sys 0.004s
I20260925 16:48:25.440797 20810 tablet_bootstrap.cc:492] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:25.441452 20809 raft_consensus.cc:348] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.442384 20809 raft_consensus.cc:374] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.442667 20809 raft_consensus.cc:729] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.443311 20809 consensus_queue.cc:260] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.449867 20645 heartbeater.cc:503] Master 127.7.158.254:33515 was elected leader, sending a full tablet report...
I20260925 16:48:25.449954 20809 ts_tablet_manager.cc:1428] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.004s
I20260925 16:48:25.451396 20809 tablet_bootstrap.cc:492] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.452538 20811 tablet_bootstrap.cc:654] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.458185 20809 tablet_bootstrap.cc:654] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.460665 20810 tablet_bootstrap.cc:654] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.475539 20809 tablet_bootstrap.cc:492] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.475843 20811 tablet_bootstrap.cc:492] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.476323 20809 ts_tablet_manager.cc:1397] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260925 16:48:25.476447 20811 ts_tablet_manager.cc:1397] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.046s	user 0.021s	sys 0.010s
I20260925 16:48:25.480573 20811 raft_consensus.cc:348] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.480968 20809 raft_consensus.cc:348] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.481763 20811 raft_consensus.cc:374] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.481988 20809 raft_consensus.cc:374] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.482160 20811 raft_consensus.cc:729] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.482494 20809 raft_consensus.cc:729] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.483103 20811 consensus_queue.cc:260] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.483541 20809 consensus_queue.cc:260] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.487111 20809 ts_tablet_manager.cc:1428] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260925 16:48:25.488313 20811 ts_tablet_manager.cc:1428] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260925 16:48:25.489403 20811 tablet_bootstrap.cc:492] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.490819 20809 tablet_bootstrap.cc:492] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.495303 20811 tablet_bootstrap.cc:654] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.499789 20809 tablet_bootstrap.cc:654] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.509958 20810 tablet_bootstrap.cc:492] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:25.510409 20810 ts_tablet_manager.cc:1397] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.070s	user 0.022s	sys 0.032s
I20260925 16:48:25.512900 20810 raft_consensus.cc:348] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.513659 20810 raft_consensus.cc:374] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.513944 20810 raft_consensus.cc:729] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.514083 20811 tablet_bootstrap.cc:492] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.514637 20811 ts_tablet_manager.cc:1397] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.006s
I20260925 16:48:25.514710 20810 consensus_queue.cc:260] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.517046 20809 tablet_bootstrap.cc:492] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.518409 20809 ts_tablet_manager.cc:1397] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.028s	user 0.013s	sys 0.011s
I20260925 16:48:25.518632 20815 raft_consensus.cc:482] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.518769 20811 raft_consensus.cc:348] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.519806 20810 ts_tablet_manager.cc:1428] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260925 16:48:25.519140 20815 raft_consensus.cc:504] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.520045 20811 raft_consensus.cc:374] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.520412 20811 raft_consensus.cc:729] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.520870 20810 tablet_bootstrap.cc:492] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:25.521232 20809 raft_consensus.cc:348] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.522094 20809 raft_consensus.cc:374] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.521113 20811 consensus_queue.cc:260] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.522377 20809 raft_consensus.cc:729] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.522936 20720 heartbeater.cc:503] Master 127.7.158.254:33515 was elected leader, sending a full tablet report...
I20260925 16:48:25.523567 20809 consensus_queue.cc:260] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.524396 20811 ts_tablet_manager.cc:1428] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.009s	user 0.010s	sys 0.000s
I20260925 16:48:25.526167 20811 tablet_bootstrap.cc:492] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.529675 20810 tablet_bootstrap.cc:654] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.534718 20811 tablet_bootstrap.cc:654] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.543303 20809 ts_tablet_manager.cc:1428] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.010s
I20260925 16:48:25.544539 20809 tablet_bootstrap.cc:492] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.545135 20811 tablet_bootstrap.cc:492] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.545809 20811 ts_tablet_manager.cc:1397] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.002s
I20260925 16:48:25.543200 20815 leader_election.cc:288] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.552551 20809 tablet_bootstrap.cc:654] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.553304 20811 raft_consensus.cc:348] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.554073 20811 raft_consensus.cc:374] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.554342 20811 raft_consensus.cc:729] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.554960 20811 consensus_queue.cc:260] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.556834 20811 ts_tablet_manager.cc:1428] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.003s
I20260925 16:48:25.557685 20810 tablet_bootstrap.cc:492] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:25.557783 20811 tablet_bootstrap.cc:492] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.558367 20810 ts_tablet_manager.cc:1397] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.008s
I20260925 16:48:25.562516 20810 raft_consensus.cc:348] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.563783 20810 raft_consensus.cc:374] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.564970 20811 tablet_bootstrap.cc:654] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.570206 20810 raft_consensus.cc:729] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.571275 20810 consensus_queue.cc:260] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.573056 20821 raft_consensus.cc:482] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.573727 20821 raft_consensus.cc:504] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.577270 20821 leader_election.cc:288] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.587386 20810 ts_tablet_manager.cc:1428] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.029s	user 0.010s	sys 0.000s
I20260925 16:48:25.592727 20810 tablet_bootstrap.cc:492] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:25.593811 20813 raft_consensus.cc:482] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.588337 20811 tablet_bootstrap.cc:492] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.594331 20813 raft_consensus.cc:504] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.597196 20813 leader_election.cc:288] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.594825 20811 ts_tablet_manager.cc:1397] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.037s	user 0.017s	sys 0.000s
I20260925 16:48:25.601068 20810 tablet_bootstrap.cc:654] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.601349 20809 tablet_bootstrap.cc:492] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.601898 20809 ts_tablet_manager.cc:1397] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.005s
I20260925 16:48:25.608331 20811 raft_consensus.cc:348] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.609184 20811 raft_consensus.cc:374] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.609504 20811 raft_consensus.cc:729] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.610152 20815 raft_consensus.cc:482] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.610327 20811 consensus_queue.cc:260] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.610739 20815 raft_consensus.cc:504] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.612993 20815 leader_election.cc:288] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.619854 20811 ts_tablet_manager.cc:1428] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.020s	user 0.004s	sys 0.004s
I20260925 16:48:25.629139 20811 tablet_bootstrap.cc:492] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.629765 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
W20260925 16:48:25.631618 20658 leader_election.cc:341] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.643764 20813 raft_consensus.cc:482] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.644681 20813 raft_consensus.cc:504] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.654989 20809 raft_consensus.cc:348] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.656137 20809 raft_consensus.cc:374] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.656474 20809 raft_consensus.cc:729] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.698590 20811 tablet_bootstrap.cc:654] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.698117 20809 consensus_queue.cc:260] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.699434 20815 raft_consensus.cc:482] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.700076 20815 raft_consensus.cc:504] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.702314 20813 leader_election.cc:288] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.706315 20815 leader_election.cc:288] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.709431 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ee8bf70b67447fb9984a35c0e20075" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:25.710007 20695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ee8bf70b67447fb9984a35c0e20075" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:25.710681 20695 raft_consensus.cc:2454] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 0.
I20260925 16:48:25.711427 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:25.711977 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:25.711467 20809 ts_tablet_manager.cc:1428] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.109s	user 0.008s	sys 0.000s
I20260925 16:48:25.712131 20769 raft_consensus.cc:2454] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 0.
I20260925 16:48:25.713630 20809 tablet_bootstrap.cc:492] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.713920 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
W20260925 16:48:25.714589 20566 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20260925 16:48:25.715373 20586 leader_election.cc:341] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.715963 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:25.716495 20586 leader_election.cc:302] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:25.717736 20815 raft_consensus.cc:2781] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:25.718101 20815 raft_consensus.cc:482] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.718429 20815 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.719585 20584 leader_election.cc:302] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:25.720448 20809 tablet_bootstrap.cc:654] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.720768 20823 raft_consensus.cc:2781] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260925 16:48:25.720904 20584 leader_election.cc:341] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.721263 20823 raft_consensus.cc:482] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.721597 20823 raft_consensus.cc:3037] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:48:25.721845 20584 leader_election.cc:341] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.722711 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:25.724087 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
W20260925 16:48:25.725793 20733 leader_election.cc:341] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:25.726471 20733 leader_election.cc:341] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:25.726322 20586 leader_election.cc:341] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.727330 20586 leader_election.cc:302] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a; no voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.732321 20815 raft_consensus.cc:504] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.735476 20811 tablet_bootstrap.cc:492] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.736052 20811 ts_tablet_manager.cc:1397] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.107s	user 0.017s	sys 0.000s
I20260925 16:48:25.735942 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:25.736178 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
W20260925 16:48:25.737531 20584 leader_election.cc:341] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:25.738063 20661 leader_election.cc:341] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.738739 20661 leader_election.cc:302] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:25.738849 20811 raft_consensus.cc:348] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.739948 20821 raft_consensus.cc:2726] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:25.735059 20823 raft_consensus.cc:504] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.742092 20823 leader_election.cc:288] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Requested vote from peers c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.742620 20823 raft_consensus.cc:2726] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:25.742980 20810 tablet_bootstrap.cc:492] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:25.743165 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ee8bf70b67447fb9984a35c0e20075" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:25.743906 20693 raft_consensus.cc:3037] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.746912 20810 ts_tablet_manager.cc:1397] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.151s	user 0.046s	sys 0.037s
I20260925 16:48:25.749512 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:25.735038 20815 leader_election.cc:288] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.751811 20693 raft_consensus.cc:2454] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 1.
I20260925 16:48:25.751464 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ee8bf70b67447fb9984a35c0e20075" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:25.757450 20811 raft_consensus.cc:374] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.759414 20584 leader_election.cc:302] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
W20260925 16:48:25.760409 20586 leader_election.cc:341] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.760411 20815 raft_consensus.cc:2781] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:25.761232 20815 raft_consensus.cc:686] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:25.761549 20810 raft_consensus.cc:348] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.762660 20810 raft_consensus.cc:374] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.762192 20815 consensus_queue.cc:237] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.763646 20811 raft_consensus.cc:729] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.764251 20769 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.764685 20811 consensus_queue.cc:260] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.763255 20810 raft_consensus.cc:729] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.777102 20809 tablet_bootstrap.cc:492] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.777696 20809 ts_tablet_manager.cc:1397] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.064s	user 0.021s	sys 0.037s
I20260925 16:48:25.777559 20810 consensus_queue.cc:260] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.778892 20769 raft_consensus.cc:2454] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 1.
I20260925 16:48:25.782714 20810 ts_tablet_manager.cc:1428] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.003s
I20260925 16:48:25.780540 20809 raft_consensus.cc:348] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.784133 20809 raft_consensus.cc:374] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.784770 20809 raft_consensus.cc:729] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.784972 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:25.785741 20620 raft_consensus.cc:2454] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:25.786487 20809 consensus_queue.cc:260] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.788687 20732 leader_election.cc:302] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.788757 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:25.789695 20620 raft_consensus.cc:2454] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:25.789932 20586 leader_election.cc:302] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.790763 20813 raft_consensus.cc:2781] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:25.791175 20813 raft_consensus.cc:482] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.791388 20809 ts_tablet_manager.cc:1428] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.013s	user 0.010s	sys 0.001s
I20260925 16:48:25.791498 20813 raft_consensus.cc:3037] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.795349 20809 tablet_bootstrap.cc:492] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.796067 20838 raft_consensus.cc:2781] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:25.796609 20838 raft_consensus.cc:686] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:25.796725 20732 leader_election.cc:302] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.797488 20838 consensus_queue.cc:237] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.798934 20811 ts_tablet_manager.cc:1428] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.062s	user 0.005s	sys 0.002s
I20260925 16:48:25.800040 20811 tablet_bootstrap.cc:492] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.803200 20810 tablet_bootstrap.cc:492] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:25.804852 20809 tablet_bootstrap.cc:654] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.805989 20813 raft_consensus.cc:504] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.808260 20518 catalog_manager.cc:5495] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 0 to 1, leader changed from <none> to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 1 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:25.812258 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
W20260925 16:48:25.813879 20733 leader_election.cc:341] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.814992 20813 leader_election.cc:288] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.815582 20813 raft_consensus.cc:2781] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:25.816030 20813 raft_consensus.cc:482] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.816465 20813 raft_consensus.cc:3037] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.825599 20811 tablet_bootstrap.cc:654] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.829254 20810 tablet_bootstrap.cc:654] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.832929 20813 raft_consensus.cc:504] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.833292 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:25.833993 20620 raft_consensus.cc:3037] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.834657 20809 tablet_bootstrap.cc:492] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.835542 20809 ts_tablet_manager.cc:1397] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.042s	user 0.022s	sys 0.010s
I20260925 16:48:25.836122 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
W20260925 16:48:25.837574 20733 leader_election.cc:341] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.838084 20813 leader_election.cc:288] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.839753 20809 raft_consensus.cc:348] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.840534 20809 raft_consensus.cc:374] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.840809 20809 raft_consensus.cc:729] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.841482 20809 consensus_queue.cc:260] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.841881 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:25.842733 20619 raft_consensus.cc:3037] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.843447 20809 ts_tablet_manager.cc:1428] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260925 16:48:25.844508 20809 tablet_bootstrap.cc:492] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.853808 20809 tablet_bootstrap.cc:654] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.855949 20619 raft_consensus.cc:2454] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:25.858897 20620 raft_consensus.cc:2454] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:25.858543 20732 leader_election.cc:302] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.860469 20813 raft_consensus.cc:2781] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:25.860916 20813 raft_consensus.cc:686] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:25.860945 20732 leader_election.cc:302] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.862525 20813 consensus_queue.cc:237] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.863471 20840 raft_consensus.cc:2781] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:25.864081 20840 raft_consensus.cc:686] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:25.865082 20809 tablet_bootstrap.cc:492] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.864933 20840 consensus_queue.cc:237] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.865585 20809 ts_tablet_manager.cc:1397] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.021s	user 0.007s	sys 0.005s
I20260925 16:48:25.866026 20810 tablet_bootstrap.cc:492] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:25.866529 20810 ts_tablet_manager.cc:1397] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.064s	user 0.009s	sys 0.015s
I20260925 16:48:25.873520 20810 raft_consensus.cc:348] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.874514 20810 raft_consensus.cc:374] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.874856 20810 raft_consensus.cc:729] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.875952 20809 raft_consensus.cc:348] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.876600 20809 raft_consensus.cc:374] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.876857 20809 raft_consensus.cc:729] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.877882 20810 consensus_queue.cc:260] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.878968 20811 tablet_bootstrap.cc:492] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.880227 20811 ts_tablet_manager.cc:1397] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.080s	user 0.016s	sys 0.007s
I20260925 16:48:25.879954 20809 consensus_queue.cc:260] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.882931 20809 ts_tablet_manager.cc:1428] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.000s
I20260925 16:48:25.883976 20809 tablet_bootstrap.cc:492] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.883875 20811 raft_consensus.cc:348] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.884974 20811 raft_consensus.cc:374] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.885299 20811 raft_consensus.cc:729] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.886025 20810 ts_tablet_manager.cc:1428] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.019s	user 0.008s	sys 0.003s
I20260925 16:48:25.891431 20810 tablet_bootstrap.cc:492] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:25.886328 20811 consensus_queue.cc:260] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.894769 20811 ts_tablet_manager.cc:1428] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.004s
I20260925 16:48:25.897145 20809 tablet_bootstrap.cc:654] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.898401 20811 tablet_bootstrap.cc:492] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.905393 20811 tablet_bootstrap.cc:654] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.907305 20515 catalog_manager.cc:5495] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:25.910408 20810 tablet_bootstrap.cc:654] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.916271 20838 raft_consensus.cc:482] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.916965 20838 raft_consensus.cc:504] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.919245 20838 leader_election.cc:288] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.919741 20811 tablet_bootstrap.cc:492] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.920506 20811 ts_tablet_manager.cc:1397] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.003s
I20260925 16:48:25.921455 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:25.922416 20769 raft_consensus.cc:2454] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 0.
I20260925 16:48:25.924415 20809 tablet_bootstrap.cc:492] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.924957 20809 ts_tablet_manager.cc:1397] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.000s
I20260925 16:48:25.925015 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
W20260925 16:48:25.926668 20584 leader_election.cc:341] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.927582 20811 raft_consensus.cc:348] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.928162 20809 raft_consensus.cc:348] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.928522 20811 raft_consensus.cc:374] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.928885 20809 raft_consensus.cc:374] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.929018 20811 raft_consensus.cc:729] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.929193 20809 raft_consensus.cc:729] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.929929 20809 consensus_queue.cc:260] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.929929 20811 consensus_queue.cc:260] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.928224 20586 leader_election.cc:302] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.931865 20815 raft_consensus.cc:2781] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:25.932202 20815 raft_consensus.cc:482] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.932281 20809 ts_tablet_manager.cc:1428] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260925 16:48:25.932556 20815 raft_consensus.cc:3037] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.933259 20809 tablet_bootstrap.cc:492] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:25.937337 20518 catalog_manager.cc:5495] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 0 to 1, leader changed from <none> to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 1 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:25.940531 20809 tablet_bootstrap.cc:654] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.942158 20815 raft_consensus.cc:504] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.944919 20811 ts_tablet_manager.cc:1428] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260925 16:48:25.945116 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:25.945441 20809 tablet_bootstrap.cc:492] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:25.945953 20811 tablet_bootstrap.cc:492] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:25.946077 20809 ts_tablet_manager.cc:1397] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.005s
W20260925 16:48:25.946551 20584 leader_election.cc:341] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.948536 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:25.949177 20769 raft_consensus.cc:3037] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.949043 20809 raft_consensus.cc:348] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.949986 20809 raft_consensus.cc:374] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.950311 20809 raft_consensus.cc:729] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.951027 20809 consensus_queue.cc:260] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.951884 20811 tablet_bootstrap.cc:654] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.951262 20517 catalog_manager.cc:5495] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:25.953365 20809 ts_tablet_manager.cc:1428] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260925 16:48:25.955956 20815 leader_election.cc:288] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:25.949654 20810 tablet_bootstrap.cc:492] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:25.958871 20813 raft_consensus.cc:482] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.959929 20813 raft_consensus.cc:504] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.964321 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cc4ec6889c494fb84f818e8695994b" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:25.965243 20620 raft_consensus.cc:2454] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:25.966558 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cc4ec6889c494fb84f818e8695994b" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
W20260925 16:48:25.968374 20733 leader_election.cc:341] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:25.969561 20732 leader_election.cc:302] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.970602 20813 leader_election.cc:288] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.970634 20840 raft_consensus.cc:2781] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:25.972186 20810 ts_tablet_manager.cc:1397] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.081s	user 0.003s	sys 0.009s
I20260925 16:48:25.971433 20840 raft_consensus.cc:482] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.975647 20840 raft_consensus.cc:3037] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.958454 20769 raft_consensus.cc:2454] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 1.
I20260925 16:48:25.975783 20810 raft_consensus.cc:348] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.977819 20810 raft_consensus.cc:374] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.978127 20810 raft_consensus.cc:729] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.978892 20810 consensus_queue.cc:260] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.980707 20586 leader_election.cc:302] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:25.981433 20810 ts_tablet_manager.cc:1428] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260925 16:48:25.982661 20810 tablet_bootstrap.cc:492] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:25.986337 20815 raft_consensus.cc:2781] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:25.987991 20813 raft_consensus.cc:482] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:25.988536 20813 raft_consensus.cc:504] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.988830 20815 raft_consensus.cc:686] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:25.989871 20815 consensus_queue.cc:237] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.991169 20811 tablet_bootstrap.cc:492] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:25.991369 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:25.991761 20811 ts_tablet_manager.cc:1397] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.027s
I20260925 16:48:25.992086 20620 raft_consensus.cc:2454] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:25.993463 20732 leader_election.cc:302] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:25.990993 20840 raft_consensus.cc:504] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:25.994391 20811 raft_consensus.cc:348] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:25.989034 20810 tablet_bootstrap.cc:654] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:25.994422 20848 raft_consensus.cc:2781] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:25.992072 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:25.995559 20848 raft_consensus.cc:482] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:25.995959 20848 raft_consensus.cc:3037] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:25.996037 20693 raft_consensus.cc:2454] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:25.990623 20813 leader_election.cc:288] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:25.995253 20811 raft_consensus.cc:374] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:25.997069 20811 raft_consensus.cc:729] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:25.997753 20811 consensus_queue.cc:260] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:26.000074 20811 ts_tablet_manager.cc:1428] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260925 16:48:25.999919 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cc4ec6889c494fb84f818e8695994b" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:26.001032 20620 raft_consensus.cc:3037] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.007620 20810 tablet_bootstrap.cc:492] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:26.008373 20810 ts_tablet_manager.cc:1397] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.008s
I20260925 16:48:26.008468 20848 raft_consensus.cc:504] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.009438 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cc4ec6889c494fb84f818e8695994b" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:26.010588 20848 leader_election.cc:288] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:26.011258 20840 leader_election.cc:288] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:26.011291 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
W20260925 16:48:26.011332 20733 leader_election.cc:341] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:26.012125 20619 raft_consensus.cc:3037] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.012605 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:26.013190 20693 raft_consensus.cc:3037] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.014128 20620 raft_consensus.cc:2454] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:26.015563 20732 leader_election.cc:302] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.016933 20840 raft_consensus.cc:2781] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:26.019651 20840 raft_consensus.cc:686] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.021291 20840 consensus_queue.cc:237] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.022938 20518 catalog_manager.cc:5495] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 0 to 1, leader changed from <none> to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 1 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.025516 20619 raft_consensus.cc:2454] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:26.026060 20693 raft_consensus.cc:2454] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:26.027189 20732 leader_election.cc:302] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:26.028731 20848 raft_consensus.cc:2781] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:26.029268 20848 raft_consensus.cc:686] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.024308 20810 raft_consensus.cc:348] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.031234 20810 raft_consensus.cc:374] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:26.030058 20848 consensus_queue.cc:237] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.031570 20810 raft_consensus.cc:729] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:26.032423 20810 consensus_queue.cc:260] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.033941 20516 catalog_manager.cc:5495] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:26.034940 20810 ts_tablet_manager.cc:1428] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260925 16:48:26.036445 20810 tablet_bootstrap.cc:492] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:26.038331 20815 raft_consensus.cc:482] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:26.038841 20815 raft_consensus.cc:504] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.040851 20815 leader_election.cc:288] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.043017 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fad3381a04e4380875352097dea373f" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:26.044044 20769 raft_consensus.cc:2454] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 0.
I20260925 16:48:26.042855 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fad3381a04e4380875352097dea373f" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:26.044745 20693 raft_consensus.cc:2454] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 0.
I20260925 16:48:26.045481 20586 leader_election.cc:302] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:26.045900 20810 tablet_bootstrap.cc:654] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:26.046283 20815 raft_consensus.cc:2781] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:26.046658 20815 raft_consensus.cc:482] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:26.046974 20815 raft_consensus.cc:3037] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.052726 20815 raft_consensus.cc:504] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.053884 20810 tablet_bootstrap.cc:492] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:26.054522 20810 ts_tablet_manager.cc:1397] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.018s	user 0.013s	sys 0.001s
I20260925 16:48:26.056013 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fad3381a04e4380875352097dea373f" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.056653 20769 raft_consensus.cc:3037] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.057624 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fad3381a04e4380875352097dea373f" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:26.057731 20810 raft_consensus.cc:348] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.058761 20810 raft_consensus.cc:374] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:26.058602 20693 raft_consensus.cc:3037] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.059201 20810 raft_consensus.cc:729] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:26.060215 20815 leader_election.cc:288] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.060062 20810 consensus_queue.cc:260] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.062741 20769 raft_consensus.cc:2454] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 1.
I20260925 16:48:26.064159 20586 leader_election.cc:302] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:26.062789 20516 catalog_manager.cc:5495] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:26.065158 20815 raft_consensus.cc:2781] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:26.065688 20810 ts_tablet_manager.cc:1428] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260925 16:48:26.066103 20693 raft_consensus.cc:2454] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 1.
I20260925 16:48:26.066572 20815 raft_consensus.cc:686] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:26.066721 20810 tablet_bootstrap.cc:492] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:26.067569 20815 consensus_queue.cc:237] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.073910 20810 tablet_bootstrap.cc:654] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:26.081975 20517 catalog_manager.cc:5495] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 0 to 1, leader changed from <none> to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 1 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.082772 20810 tablet_bootstrap.cc:492] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:26.083477 20810 ts_tablet_manager.cc:1397] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.017s	user 0.014s	sys 0.000s
I20260925 16:48:26.086400 20810 raft_consensus.cc:348] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.087033 20810 raft_consensus.cc:374] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:26.087276 20810 raft_consensus.cc:729] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:26.087937 20810 consensus_queue.cc:260] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.089639 20810 ts_tablet_manager.cc:1428] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260925 16:48:26.090621 20810 tablet_bootstrap.cc:492] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:26.094605 20810 tablet_bootstrap.cc:654] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:26.098955 20810 tablet_bootstrap.cc:492] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:26.099402 20810 ts_tablet_manager.cc:1397] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.009s	user 0.006s	sys 0.000s
I20260925 16:48:26.101343 20810 raft_consensus.cc:348] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.102039 20810 raft_consensus.cc:374] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:26.102273 20810 raft_consensus.cc:729] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:26.102898 20810 consensus_queue.cc:260] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.105088 20810 ts_tablet_manager.cc:1428] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.005s	user 0.006s	sys 0.000s
I20260925 16:48:26.115492 20821 raft_consensus.cc:482] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:26.116235 20821 raft_consensus.cc:504] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.118018 20821 leader_election.cc:288] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.119282 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cc4ec6889c494fb84f818e8695994b" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:26.119546 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8cc4ec6889c494fb84f818e8695994b" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:26.120484 20619 raft_consensus.cc:2379] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdd45a4da6b84bd1a3f73af6485ec02f in current term 1: Already voted for candidate c9deceb1876d42faa203fdc9a23c7f8f in this term.
I20260925 16:48:26.121925 20658 leader_election.cc:302] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:26.122696 20821 raft_consensus.cc:3037] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.128567 20821 raft_consensus.cc:2726] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:26.167097 20848 raft_consensus.cc:482] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:26.167621 20848 raft_consensus.cc:504] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.169191 20848 leader_election.cc:288] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:26.170231 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:26.170231 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:26.171154 20693 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:26.171175 20619 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:26.172674 20733 leader_election.cc:302] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:26.173627 20848 raft_consensus.cc:2781] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:26.174019 20848 raft_consensus.cc:482] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:26.174271 20848 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.179687 20848 raft_consensus.cc:504] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.181177 20848 leader_election.cc:288] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:26.182250 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:26.182331 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:26.182858 20693 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.183159 20619 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.188024 20619 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:26.188457 20693 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:26.188989 20732 leader_election.cc:302] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:26.189841 20848 raft_consensus.cc:2781] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:26.190313 20848 raft_consensus.cc:686] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.191111 20848 consensus_queue.cc:237] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.195398 20815 consensus_queue.cc:1035] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:26.199939 20518 catalog_manager.cc:5495] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:26.206187 20821 raft_consensus.cc:482] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:26.206741 20821 raft_consensus.cc:504] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.206197 20693 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.208824 20821 leader_election.cc:288] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.211493 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:26.212841 20619 raft_consensus.cc:2379] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdd45a4da6b84bd1a3f73af6485ec02f in current term 1: Already voted for candidate c9deceb1876d42faa203fdc9a23c7f8f in this term.
I20260925 16:48:26.212617 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:26.215691 20661 leader_election.cc:302] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:26.216615 20821 raft_consensus.cc:3037] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.218243 20815 consensus_queue.cc:1035] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.225996 20821 raft_consensus.cc:2726] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:26.230448 20848 raft_consensus.cc:482] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:26.231003 20848 raft_consensus.cc:504] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } }
I20260925 16:48:26.233134 20848 leader_election.cc:288] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529)
I20260925 16:48:26.234689 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ee8bf70b67447fb9984a35c0e20075" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:26.234530 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "91ee8bf70b67447fb9984a35c0e20075" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:26.235875 20693 raft_consensus.cc:2379] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9deceb1876d42faa203fdc9a23c7f8f in current term 1: Already voted for candidate 386b91628c2841c0b0fd0d4f33c5633a in this term.
I20260925 16:48:26.236941 20733 leader_election.cc:302] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.237780 20848 raft_consensus.cc:3037] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.244835 20848 raft_consensus.cc:2726] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:26.258852 20821 raft_consensus.cc:482] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:26.259413 20821 raft_consensus.cc:504] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.261137 20821 leader_election.cc:288] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.262069 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:26.262208 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:26.263036 20769 raft_consensus.cc:2379] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdd45a4da6b84bd1a3f73af6485ec02f in current term 1: Already voted for candidate 386b91628c2841c0b0fd0d4f33c5633a in this term.
I20260925 16:48:26.264063 20661 leader_election.cc:302] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:26.265003 20821 raft_consensus.cc:3037] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.270473 20821 raft_consensus.cc:2726] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:26.288968 20848 consensus_queue.cc:1035] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.302085 20813 consensus_queue.cc:1035] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.316373 20815 consensus_queue.cc:1035] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.329887 20876 consensus_queue.cc:1035] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:26.339468 20693 raft_consensus.cc:3037] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:26.348433 20813 consensus_queue.cc:1035] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.360095 20813 consensus_queue.cc:1035] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.391237 20769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:26.391983 20769 raft_consensus.cc:595] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:26.401170 20769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "218625d375ee426abed709faede5fe55"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:26.401868 20769 raft_consensus.cc:595] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:26.409802 20876 consensus_queue.cc:1035] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.422771 20876 consensus_queue.cc:1035] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.426585 20813 consensus_queue.cc:1035] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.433296 20619 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:43362
I20260925 16:48:26.433911 20619 raft_consensus.cc:595] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.436877 20876 raft_consensus.cc:979] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.437310 20876 raft_consensus.cc:1067] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.439013 20693 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50290
I20260925 16:48:26.439585 20693 raft_consensus.cc:482] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:26.440007 20693 raft_consensus.cc:3037] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.440925 20769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:26.441843 20769 raft_consensus.cc:595] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.446597 20848 consensus_queue.cc:1035] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.450573 20693 raft_consensus.cc:504] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.453951 20619 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "87f458328ca14f06b2900558a057dbab"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:43362
I20260925 16:48:26.455123 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:26.455662 20619 raft_consensus.cc:595] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.455852 20618 raft_consensus.cc:3032] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:26.456081 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f975ac9ac5854adb83e3bd7f14e3c17a" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.456284 20618 raft_consensus.cc:729] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:26.456717 20769 raft_consensus.cc:3037] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.457325 20618 consensus_queue.cc:260] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.458874 20618 raft_consensus.cc:3037] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.461652 20768 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:26.462172 20768 raft_consensus.cc:595] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.467193 20618 raft_consensus.cc:2454] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.468132 20769 raft_consensus.cc:2454] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.468464 20658 leader_election.cc:302] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:26.454157 20693 leader_election.cc:288] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.469295 20821 raft_consensus.cc:2781] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:26.469905 20821 raft_consensus.cc:686] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:26.470907 20821 consensus_queue.cc:237] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.478543 20516 catalog_manager.cc:5495] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.487100 20848 consensus_queue.cc:1035] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.493906 20840 raft_consensus.cc:979] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.494484 20873 raft_consensus.cc:1067] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.496462 20694 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50304
I20260925 16:48:26.497136 20694 raft_consensus.cc:482] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:26.497546 20694 raft_consensus.cc:3037] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.499333 20813 consensus_queue.cc:1035] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.505996 20694 raft_consensus.cc:504] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.508952 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:26.509588 20618 raft_consensus.cc:3037] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.513381 20694 leader_election.cc:288] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.514595 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53e44bb9909441df971f01c2fe28cd4f" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.515287 20769 raft_consensus.cc:3032] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:26.515642 20769 raft_consensus.cc:729] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.516501 20769 consensus_queue.cc:260] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.517339 20618 raft_consensus.cc:2454] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.517828 20769 raft_consensus.cc:3037] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.518602 20658 leader_election.cc:302] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:26.519589 20821 raft_consensus.cc:2781] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:26.520093 20821 raft_consensus.cc:686] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:26.520915 20821 consensus_queue.cc:237] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.524564 20769 raft_consensus.cc:2454] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.528705 20516 catalog_manager.cc:5495] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.562211 20838 consensus_queue.cc:1035] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.573701 20838 consensus_queue.cc:1035] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.680387 20876 raft_consensus.cc:979] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.680964 20838 raft_consensus.cc:1067] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.682708 20694 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "87f458328ca14f06b2900558a057dbab"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50290
I20260925 16:48:26.683415 20694 raft_consensus.cc:482] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:26.683851 20694 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.692047 20694 raft_consensus.cc:504] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.693670 20694 leader_election.cc:288] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.694341 20813 consensus_queue.cc:1035] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.694628 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:26.695137 20618 raft_consensus.cc:3032] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:26.694907 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.695410 20618 raft_consensus.cc:729] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:26.695590 20769 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.696256 20618 consensus_queue.cc:260] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.697582 20618 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.704950 20840 raft_consensus.cc:979] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:26.705461 20769 raft_consensus.cc:2454] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.705474 20840 raft_consensus.cc:1067] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:26.707028 20661 leader_election.cc:302] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:26.707656 20619 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:43352
I20260925 16:48:26.708066 20821 raft_consensus.cc:2781] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:26.708370 20619 raft_consensus.cc:482] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:26.708642 20821 raft_consensus.cc:686] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:26.708842 20619 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.709669 20821 consensus_queue.cc:237] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.713925 20840 consensus_queue.cc:1035] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:26.715731 20618 raft_consensus.cc:2454] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.719425 20619 raft_consensus.cc:504] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.720748 20620 raft_consensus.cc:1226] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Rejecting Update request from peer c9deceb1876d42faa203fdc9a23c7f8f for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:26.721379 20515 catalog_manager.cc:5495] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.725165 20840 consensus_queue.cc:1046] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:26.726244 20840 raft_consensus.cc:3032] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:26.726579 20840 raft_consensus.cc:729] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.727829 20840 consensus_queue.cc:260] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.730509 20840 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.738487 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:26.738889 20619 leader_election.cc:288] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.741689 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.748821 20769 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:26.749861 20586 leader_election.cc:302] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:26.750970 20815 raft_consensus.cc:2781] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:26.751366 20815 raft_consensus.cc:686] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:26.752174 20815 consensus_queue.cc:237] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.756168 20873 raft_consensus.cc:979] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:26.756794 20840 raft_consensus.cc:1067] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:26.758306 20619 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "218625d375ee426abed709faede5fe55"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:43352
I20260925 16:48:26.758869 20619 raft_consensus.cc:482] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:26.759527 20619 raft_consensus.cc:3037] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.759667 20516 catalog_manager.cc:5495] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 2 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.767781 20619 raft_consensus.cc:504] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.770061 20619 leader_election.cc:288] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.771248 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.771386 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "218625d375ee426abed709faede5fe55" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:26.771916 20769 raft_consensus.cc:3032] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:26.772109 20694 raft_consensus.cc:3037] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.772264 20769 raft_consensus.cc:729] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.773099 20769 consensus_queue.cc:260] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.774127 20769 raft_consensus.cc:3037] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.777550 20694 raft_consensus.cc:2454] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:26.778851 20584 leader_election.cc:302] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:26.779341 20769 raft_consensus.cc:2454] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:26.779928 20815 raft_consensus.cc:2781] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:26.780532 20815 raft_consensus.cc:686] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:26.781349 20815 consensus_queue.cc:237] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.786814 20873 raft_consensus.cc:979] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.787286 20873 raft_consensus.cc:1067] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:26.788784 20694 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50304
I20260925 16:48:26.789266 20694 raft_consensus.cc:482] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:26.789755 20694 raft_consensus.cc:3037] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.789270 20516 catalog_manager.cc:5495] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 2 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.795557 20694 raft_consensus.cc:504] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.798163 20694 leader_election.cc:288] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:26.798785 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:26.798786 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6a8d661b42a540c89c4c0dd42988c531" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:26.799683 20619 raft_consensus.cc:3037] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.799823 20769 raft_consensus.cc:3032] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:26.800251 20769 raft_consensus.cc:729] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:26.800961 20769 consensus_queue.cc:260] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.801928 20769 raft_consensus.cc:3037] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:26.805733 20619 raft_consensus.cc:2454] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.806452 20769 raft_consensus.cc:2454] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:26.806977 20658 leader_election.cc:302] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:26.808049 20821 raft_consensus.cc:2781] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:26.808496 20821 raft_consensus.cc:686] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:26.809124 20821 consensus_queue.cc:237] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:26.816326 20516 catalog_manager.cc:5495] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:26.941051 20769 raft_consensus.cc:1261] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:26.942368 20821 consensus_queue.cc:1035] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:26.951603 20619 raft_consensus.cc:1261] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:26.953378 20821 consensus_queue.cc:1035] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:26.978509 20619 raft_consensus.cc:1261] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:26.981284 20821 consensus_queue.cc:1035] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:26.990025 20769 raft_consensus.cc:1261] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:26.991804 20893 consensus_queue.cc:1035] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:27.181762 20769 raft_consensus.cc:1261] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.183472 20815 consensus_queue.cc:1035] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:27.192060 20694 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:27.195250 20693 raft_consensus.cc:1261] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.197768 20815 consensus_queue.cc:1035] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:27.201529 20694 raft_consensus.cc:1261] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.203424 20815 consensus_queue.cc:1035] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:27.211334 20769 raft_consensus.cc:1261] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.212950 20876 consensus_queue.cc:1035] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:27.252086 20619 raft_consensus.cc:1261] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.253480 20893 consensus_queue.cc:1035] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:27.262887 20620 raft_consensus.cc:1261] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.264456 20821 consensus_queue.cc:1035] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:27.265908 20769 raft_consensus.cc:1261] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.267357 20821 consensus_queue.cc:1035] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:27.275609 20769 raft_consensus.cc:1261] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:27.277837 20869 consensus_queue.cc:1035] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:29.466949  7803 test_util.cc:268] Using random seed: 2087096571
I20260925 16:48:29.509771 20518 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38328:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260925 16:48:29.512177 20518 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260925 16:48:29.564850 20609 tablet_service.cc:1467] Processing CreateTablet for tablet 01569f025e1c4d90b8555845828c7695 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:29.565754 20678 tablet_service.cc:1467] Processing CreateTablet for tablet 01569f025e1c4d90b8555845828c7695 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:29.566195 20609 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01569f025e1c4d90b8555845828c7695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.567049 20678 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01569f025e1c4d90b8555845828c7695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.570403 20602 tablet_service.cc:1467] Processing CreateTablet for tablet f18fe21fe411419e98c7e084671a39e1 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:29.571739 20602 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f18fe21fe411419e98c7e084671a39e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.574882 20684 tablet_service.cc:1467] Processing CreateTablet for tablet bdb5d2b981e74e468a2a34e7deb6df53 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:29.576611 20684 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb5d2b981e74e468a2a34e7deb6df53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.576735 20681 tablet_service.cc:1467] Processing CreateTablet for tablet f18fe21fe411419e98c7e084671a39e1 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:29.576890 20677 tablet_service.cc:1467] Processing CreateTablet for tablet 59137035566043358ed91e98d1564014 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:29.578002 20681 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f18fe21fe411419e98c7e084671a39e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.579630 20606 tablet_service.cc:1467] Processing CreateTablet for tablet bdb5d2b981e74e468a2a34e7deb6df53 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:29.580374 20608 tablet_service.cc:1467] Processing CreateTablet for tablet 59137035566043358ed91e98d1564014 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:29.580955 20606 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb5d2b981e74e468a2a34e7deb6df53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.581594 20608 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59137035566043358ed91e98d1564014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.582326 20679 tablet_service.cc:1467] Processing CreateTablet for tablet f434cf77e1614176af2315f837ce5422 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:29.584158 20759 tablet_service.cc:1467] Processing CreateTablet for tablet 01569f025e1c4d90b8555845828c7695 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260925 16:48:29.585207 20677 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59137035566043358ed91e98d1564014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.584954 20754 tablet_service.cc:1467] Processing CreateTablet for tablet bdb5d2b981e74e468a2a34e7deb6df53 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260925 16:48:29.585588 20759 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 01569f025e1c4d90b8555845828c7695. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.586347 20754 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet bdb5d2b981e74e468a2a34e7deb6df53. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.587261 20679 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f434cf77e1614176af2315f837ce5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.587970 20758 tablet_service.cc:1467] Processing CreateTablet for tablet f18fe21fe411419e98c7e084671a39e1 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260925 16:48:29.588855 20757 tablet_service.cc:1467] Processing CreateTablet for tablet 59137035566043358ed91e98d1564014 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260925 16:48:29.589090 20607 tablet_service.cc:1467] Processing CreateTablet for tablet f434cf77e1614176af2315f837ce5422 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:29.589821 20758 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f18fe21fe411419e98c7e084671a39e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.590372 20607 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f434cf77e1614176af2315f837ce5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.590515 20757 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 59137035566043358ed91e98d1564014. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.592964 20605 tablet_service.cc:1467] Processing CreateTablet for tablet 90d8a80efa714775911440469e319f70 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:29.594589 20605 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90d8a80efa714775911440469e319f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.604808 20682 tablet_service.cc:1467] Processing CreateTablet for tablet 90d8a80efa714775911440469e319f70 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:29.606223 20682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90d8a80efa714775911440469e319f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.613811 20756 tablet_service.cc:1467] Processing CreateTablet for tablet f434cf77e1614176af2315f837ce5422 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260925 16:48:29.615222 20756 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f434cf77e1614176af2315f837ce5422. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.618269 20755 tablet_service.cc:1467] Processing CreateTablet for tablet 90d8a80efa714775911440469e319f70 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260925 16:48:29.619591 20755 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 90d8a80efa714775911440469e319f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.622538 20603 tablet_service.cc:1467] Processing CreateTablet for tablet 9a0bb279906a4bfdb0fc5d2ce21ca7e1 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:29.623926 20603 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a0bb279906a4bfdb0fc5d2ce21ca7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.637249 20680 tablet_service.cc:1467] Processing CreateTablet for tablet 9a0bb279906a4bfdb0fc5d2ce21ca7e1 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:29.638652 20680 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a0bb279906a4bfdb0fc5d2ce21ca7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.639501 20753 tablet_service.cc:1467] Processing CreateTablet for tablet 9a0bb279906a4bfdb0fc5d2ce21ca7e1 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260925 16:48:29.640771 20753 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9a0bb279906a4bfdb0fc5d2ce21ca7e1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.646286 20610 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9c6896081345518028e0055172e6a8 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:29.647636 20610 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9c6896081345518028e0055172e6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.647773 20751 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9c6896081345518028e0055172e6a8 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:29.648506 20604 tablet_service.cc:1467] Processing CreateTablet for tablet f1119adaeaa74dea956ff2de41338c18 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:29.649060 20751 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9c6896081345518028e0055172e6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.649677 20604 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1119adaeaa74dea956ff2de41338c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.656473 20683 tablet_service.cc:1467] Processing CreateTablet for tablet 7e9c6896081345518028e0055172e6a8 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260925 16:48:29.658038 20683 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 7e9c6896081345518028e0055172e6a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.662240 20685 tablet_service.cc:1467] Processing CreateTablet for tablet f1119adaeaa74dea956ff2de41338c18 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:29.663533 20685 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1119adaeaa74dea956ff2de41338c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.689597 20752 tablet_service.cc:1467] Processing CreateTablet for tablet f1119adaeaa74dea956ff2de41338c18 (DEFAULT_TABLE table=soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260925 16:48:29.691474 20752 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet f1119adaeaa74dea956ff2de41338c18. 1 dirs total, 0 dirs full, 0 dirs failed
I20260925 16:48:29.750627 20908 tablet_bootstrap.cc:492] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
W20260925 16:48:29.768752 20566 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260925 16:48:29.777935 20908 tablet_bootstrap.cc:654] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.783663 20909 tablet_bootstrap.cc:492] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:29.790313 20910 tablet_bootstrap.cc:492] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:29.796855 20909 tablet_bootstrap.cc:654] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.797765 20910 tablet_bootstrap.cc:654] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.820760 20909 tablet_bootstrap.cc:492] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:29.821272 20909 ts_tablet_manager.cc:1397] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.038s	user 0.017s	sys 0.004s
I20260925 16:48:29.823171 20908 tablet_bootstrap.cc:492] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:29.823864 20908 ts_tablet_manager.cc:1397] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.074s	user 0.025s	sys 0.021s
I20260925 16:48:29.824168 20909 raft_consensus.cc:348] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.824987 20909 raft_consensus.cc:374] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.825265 20909 raft_consensus.cc:729] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.826097 20909 consensus_queue.cc:260] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.827497 20910 tablet_bootstrap.cc:492] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:29.827407 20908 raft_consensus.cc:348] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.828217 20910 ts_tablet_manager.cc:1397] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.038s	user 0.029s	sys 0.008s
I20260925 16:48:29.828595 20908 raft_consensus.cc:374] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.828693 20909 ts_tablet_manager.cc:1428] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.007s	user 0.009s	sys 0.000s
I20260925 16:48:29.829067 20908 raft_consensus.cc:729] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.829952 20909 tablet_bootstrap.cc:492] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:29.829955 20908 consensus_queue.cc:260] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.831027 20910 raft_consensus.cc:348] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.831962 20910 raft_consensus.cc:374] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.832302 20910 raft_consensus.cc:729] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.833182 20908 ts_tablet_manager.cc:1428] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260925 16:48:29.834350 20908 tablet_bootstrap.cc:492] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:29.833081 20910 consensus_queue.cc:260] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.838863 20910 ts_tablet_manager.cc:1428] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260925 16:48:29.839954 20910 tablet_bootstrap.cc:492] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:29.840309 20909 tablet_bootstrap.cc:654] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.841809 20908 tablet_bootstrap.cc:654] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.846668 20910 tablet_bootstrap.cc:654] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.855932 20909 tablet_bootstrap.cc:492] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:29.856547 20909 ts_tablet_manager.cc:1397] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260925 16:48:29.858229 20910 tablet_bootstrap.cc:492] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:29.858781 20910 ts_tablet_manager.cc:1397] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.004s
I20260925 16:48:29.858887 20908 tablet_bootstrap.cc:492] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:29.859546 20908 ts_tablet_manager.cc:1397] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.011s
I20260925 16:48:29.859437 20909 raft_consensus.cc:348] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.860356 20909 raft_consensus.cc:374] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.860673 20909 raft_consensus.cc:729] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.861578 20909 consensus_queue.cc:260] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.861660 20910 raft_consensus.cc:348] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.862563 20910 raft_consensus.cc:374] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.862885 20910 raft_consensus.cc:729] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.863070 20908 raft_consensus.cc:348] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.864051 20908 raft_consensus.cc:374] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.863675 20910 consensus_queue.cc:260] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.864178 20909 ts_tablet_manager.cc:1428] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:48:29.864444 20908 raft_consensus.cc:729] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.865597 20909 tablet_bootstrap.cc:492] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:29.865306 20908 consensus_queue.cc:260] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.866179 20910 ts_tablet_manager.cc:1428] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260925 16:48:29.867192 20910 tablet_bootstrap.cc:492] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:29.868188 20908 ts_tablet_manager.cc:1428] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260925 16:48:29.869511 20908 tablet_bootstrap.cc:492] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:29.872886 20909 tablet_bootstrap.cc:654] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.873318 20910 tablet_bootstrap.cc:654] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.877688 20908 tablet_bootstrap.cc:654] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.886149 20910 tablet_bootstrap.cc:492] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:29.886862 20910 ts_tablet_manager.cc:1397] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.009s
I20260925 16:48:29.888185 20909 tablet_bootstrap.cc:492] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:29.888808 20909 ts_tablet_manager.cc:1397] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.006s
I20260925 16:48:29.890107 20910 raft_consensus.cc:348] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.890920 20910 raft_consensus.cc:374] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.891085 20908 tablet_bootstrap.cc:492] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:29.891182 20910 raft_consensus.cc:729] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.892657 20908 ts_tablet_manager.cc:1397] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.023s	user 0.009s	sys 0.011s
I20260925 16:48:29.892979 20910 consensus_queue.cc:260] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.895939 20910 ts_tablet_manager.cc:1428] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260925 16:48:29.896976 20910 tablet_bootstrap.cc:492] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:29.897719 20909 raft_consensus.cc:348] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.898490 20909 raft_consensus.cc:374] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.898754 20909 raft_consensus.cc:729] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.899449 20909 consensus_queue.cc:260] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.901736 20909 ts_tablet_manager.cc:1428] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260925 16:48:29.902750 20909 tablet_bootstrap.cc:492] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:29.901162 20908 raft_consensus.cc:348] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.904032 20910 tablet_bootstrap.cc:654] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.904062 20908 raft_consensus.cc:374] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.904749 20908 raft_consensus.cc:729] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.905539 20908 consensus_queue.cc:260] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.907989 20908 ts_tablet_manager.cc:1428] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.003s
I20260925 16:48:29.912855 20909 tablet_bootstrap.cc:654] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.917165 20910 tablet_bootstrap.cc:492] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:29.917716 20910 ts_tablet_manager.cc:1397] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.013s
I20260925 16:48:29.918128 20908 tablet_bootstrap.cc:492] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:29.918658 20909 tablet_bootstrap.cc:492] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:29.919152 20909 ts_tablet_manager.cc:1397] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.000s
I20260925 16:48:29.921303 20910 raft_consensus.cc:348] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.922224 20910 raft_consensus.cc:374] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.922557 20910 raft_consensus.cc:729] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.922021 20909 raft_consensus.cc:348] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.923461 20909 raft_consensus.cc:374] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.923305 20910 consensus_queue.cc:260] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.925709 20910 ts_tablet_manager.cc:1428] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.002s
I20260925 16:48:29.926625 20908 tablet_bootstrap.cc:654] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.926964 20910 tablet_bootstrap.cc:492] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:29.923804 20909 raft_consensus.cc:729] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.928269 20840 raft_consensus.cc:482] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:29.930421 20840 raft_consensus.cc:504] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.932605 20840 leader_election.cc:288] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:29.933291 20876 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:29.933776 20876 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.934247 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
W20260925 16:48:29.935799 20733 leader_election.cc:341] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:29.935930 20876 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:29.937985 20910 tablet_bootstrap.cc:654] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.938942 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:29.939970 20768 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 0.
I20260925 16:48:29.940920 20840 raft_consensus.cc:482] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:29.941377 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:29.941468 20840 raft_consensus.cc:504] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.942564 20620 raft_consensus.cc:2454] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:29.944468 20840 leader_election.cc:288] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:29.944535 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
W20260925 16:48:29.946166 20584 leader_election.cc:341] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:29.946882 20908 tablet_bootstrap.cc:492] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:29.947530 20908 ts_tablet_manager.cc:1397] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.030s	user 0.008s	sys 0.010s
I20260925 16:48:29.949288 20732 leader_election.cc:302] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:29.950054 20910 tablet_bootstrap.cc:492] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:29.950557 20910 ts_tablet_manager.cc:1397] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.008s
I20260925 16:48:29.950801 20586 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:29.951990 20876 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:29.952476 20876 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:29.952049 20908 raft_consensus.cc:348] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.952826 20876 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:29.953141 20908 raft_consensus.cc:374] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.953514 20908 raft_consensus.cc:729] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.953366 20910 raft_consensus.cc:348] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.954324 20910 raft_consensus.cc:374] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.954622 20910 raft_consensus.cc:729] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:29.954648 20908 consensus_queue.cc:260] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.955379 20910 consensus_queue.cc:260] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.957525 20924 raft_consensus.cc:2781] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:29.957906 20924 raft_consensus.cc:482] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:29.958033 20908 ts_tablet_manager.cc:1428] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260925 16:48:29.959369 20908 tablet_bootstrap.cc:492] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:29.960214 20910 ts_tablet_manager.cc:1428] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260925 16:48:29.958233 20924 raft_consensus.cc:3037] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:29.962091 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
W20260925 16:48:29.964154 20733 leader_election.cc:341] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:29.965344 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:29.968652 20910 tablet_bootstrap.cc:492] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:29.973940 20908 tablet_bootstrap.cc:654] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.974249 20876 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.975508 20910 tablet_bootstrap.cc:654] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:29.976574 20924 raft_consensus.cc:504] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.976276 20909 consensus_queue.cc:260] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.984153 20620 raft_consensus.cc:2454] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:29.985051 20924 leader_election.cc:288] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:29.986618 20910 tablet_bootstrap.cc:492] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:29.987188 20910 ts_tablet_manager.cc:1397] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.003s
I20260925 16:48:29.987183 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:29.994532 20910 raft_consensus.cc:348] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:29.995357 20910 raft_consensus.cc:374] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:29.995684 20910 raft_consensus.cc:729] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
W20260925 16:48:29.996125 20733 leader_election.cc:341] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.001470 20910 consensus_queue.cc:260] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.004233 20876 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.006402 20910 ts_tablet_manager.cc:1428] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260925 16:48:30.007570 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.008291 20768 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.007504 20910 tablet_bootstrap.cc:492] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:30.019455 20768 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 1.
I20260925 16:48:30.020937 20910 tablet_bootstrap.cc:654] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.021164 20586 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:30.022437 20876 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.023030 20876 raft_consensus.cc:686] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:30.024147 20876 consensus_queue.cc:237] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.028836 20909 ts_tablet_manager.cc:1428] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.109s	user 0.019s	sys 0.025s
W20260925 16:48:30.029210 20584 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.194:43371, user_credentials={real_user=slave}} blocked reactor thread for 67531.7us
I20260925 16:48:30.030068 20909 tablet_bootstrap.cc:492] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:30.030877 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.032261 20908 tablet_bootstrap.cc:492] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:30.032456 20732 leader_election.cc:302] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.033046 20908 ts_tablet_manager.cc:1397] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.074s	user 0.019s	sys 0.013s
I20260925 16:48:30.033412 20924 raft_consensus.cc:2781] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.033804 20924 raft_consensus.cc:482] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.034122 20924 raft_consensus.cc:3037] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.034580 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.035199 20620 raft_consensus.cc:3037] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.037523 20893 raft_consensus.cc:482] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.038003 20893 raft_consensus.cc:504] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.040969 20893 leader_election.cc:288] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.041837 20893 raft_consensus.cc:482] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.042379 20893 raft_consensus.cc:504] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.043717 20908 raft_consensus.cc:348] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.042639 20924 raft_consensus.cc:504] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.045071 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.045814 20769 raft_consensus.cc:2454] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 0.
I20260925 16:48:30.044782 20908 raft_consensus.cc:374] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.046645 20908 raft_consensus.cc:729] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.047505 20661 leader_election.cc:302] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.050180 20909 tablet_bootstrap.cc:654] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.049108 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.047677 20908 consensus_queue.cc:260] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.047968 20924 leader_election.cc:288] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
W20260925 16:48:30.052186 20733 leader_election.cc:341] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.053392 20931 raft_consensus.cc:2781] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.055166 20931 raft_consensus.cc:482] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.055641 20931 raft_consensus.cc:3037] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.058264 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f434cf77e1614176af2315f837ce5422" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.061404 20893 leader_election.cc:288] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
W20260925 16:48:30.062438 20661 leader_election.cc:341] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.065716 20924 raft_consensus.cc:482] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.066362 20924 raft_consensus.cc:504] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.068014 20620 raft_consensus.cc:2454] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:30.069221 20924 leader_election.cc:288] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:30.070137 20732 leader_election.cc:302] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.071048 20924 raft_consensus.cc:2781] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.071555 20924 raft_consensus.cc:686] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:30.071688 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1119adaeaa74dea956ff2de41338c18" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:30.072439 20694 raft_consensus.cc:2454] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:30.072479 20908 ts_tablet_manager.cc:1428] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.039s	user 0.015s	sys 0.002s
I20260925 16:48:30.072499 20924 consensus_queue.cc:237] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.073868 20733 leader_election.cc:302] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.074126 20908 tablet_bootstrap.cc:492] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:30.074806 20840 raft_consensus.cc:2781] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.075429 20840 raft_consensus.cc:482] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.076088 20840 raft_consensus.cc:3037] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.080027 20909 tablet_bootstrap.cc:492] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:30.080953 20909 ts_tablet_manager.cc:1397] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.051s	user 0.010s	sys 0.005s
I20260925 16:48:30.083339 20908 tablet_bootstrap.cc:654] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.083936 20932 raft_consensus.cc:482] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.084513 20932 raft_consensus.cc:504] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.088411 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f434cf77e1614176af2315f837ce5422" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.089128 20619 raft_consensus.cc:2454] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 0.
I20260925 16:48:30.089435 20932 leader_election.cc:288] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.091305 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.092367 20931 raft_consensus.cc:504] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.085855 20840 raft_consensus.cc:504] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
W20260925 16:48:30.093510 20584 leader_election.cc:341] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.089983 20909 raft_consensus.cc:348] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.097636 20908 tablet_bootstrap.cc:492] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:30.098452 20908 ts_tablet_manager.cc:1397] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.009s
I20260925 16:48:30.098861 20909 raft_consensus.cc:374] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.099490 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1119adaeaa74dea956ff2de41338c18" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.100137 20909 raft_consensus.cc:729] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.100267 20694 raft_consensus.cc:3037] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.108589 20909 consensus_queue.cc:260] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.102278 20908 raft_consensus.cc:348] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.103008 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1119adaeaa74dea956ff2de41338c18" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.103348 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1119adaeaa74dea956ff2de41338c18" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.111038 20618 raft_consensus.cc:2454] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:30.109961 20910 tablet_bootstrap.cc:492] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:30.110184 20931 leader_election.cc:288] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.101796 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.111940 20910 ts_tablet_manager.cc:1397] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.105s	user 0.031s	sys 0.052s
I20260925 16:48:30.111944 20908 raft_consensus.cc:374] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.112433 20619 raft_consensus.cc:3037] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.112602 20908 raft_consensus.cc:729] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.113077 20909 ts_tablet_manager.cc:1428] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.002s
I20260925 16:48:30.113695 20908 consensus_queue.cc:260] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.114343 20909 tablet_bootstrap.cc:492] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:30.115343 20910 raft_consensus.cc:348] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.116226 20910 raft_consensus.cc:374] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.116402 20908 ts_tablet_manager.cc:1428] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.018s	user 0.003s	sys 0.008s
I20260925 16:48:30.116677 20910 raft_consensus.cc:729] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.117764 20908 tablet_bootstrap.cc:492] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:30.117630 20910 consensus_queue.cc:260] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.120388 20910 ts_tablet_manager.cc:1428] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260925 16:48:30.121501 20910 tablet_bootstrap.cc:492] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:30.124503 20909 tablet_bootstrap.cc:654] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.125538 20908 tablet_bootstrap.cc:654] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.126796 20619 raft_consensus.cc:2454] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:30.127513 20931 raft_consensus.cc:482] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.128021 20931 raft_consensus.cc:504] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.128259 20910 tablet_bootstrap.cc:654] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.130000 20931 leader_election.cc:288] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.133116 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.134061 20769 raft_consensus.cc:2454] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 0.
I20260925 16:48:30.135936 20661 leader_election.cc:302] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.136914 20931 raft_consensus.cc:2781] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.137253 20931 raft_consensus.cc:482] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.137552 20931 raft_consensus.cc:3037] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.144110 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.144758 20768 raft_consensus.cc:3037] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.145519 20931 raft_consensus.cc:504] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.148944 20931 leader_election.cc:288] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.149187 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.149887 20769 raft_consensus.cc:3037] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.148545 20694 raft_consensus.cc:2454] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:30.152930 20733 leader_election.cc:302] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.153918 20924 raft_consensus.cc:2781] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.103791 20840 leader_election.cc:288] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:30.163982 20658 leader_election.cc:302] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:30.166185 20931 raft_consensus.cc:2781] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.166639 20931 raft_consensus.cc:482] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.167088 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.172984 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.142611 20517 catalog_manager.cc:5495] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:30.177373 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.167093 20931 raft_consensus.cc:3037] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.183338 20769 raft_consensus.cc:2454] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 1.
I20260925 16:48:30.198958 20732 leader_election.cc:302] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.185827 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.205094 20619 raft_consensus.cc:2379] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdd45a4da6b84bd1a3f73af6485ec02f in current term 1: Already voted for candidate c9deceb1876d42faa203fdc9a23c7f8f in this term.
I20260925 16:48:30.205906 20840 raft_consensus.cc:2781] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.206511 20840 raft_consensus.cc:686] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:30.207589 20661 leader_election.cc:302] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.208503 20932 raft_consensus.cc:2781] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.209103 20932 raft_consensus.cc:686] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:30.207569 20840 consensus_queue.cc:237] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.209857 20932 consensus_queue.cc:237] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.213794 20943 raft_consensus.cc:482] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.187065 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
W20260925 16:48:30.216607 20658 leader_election.cc:341] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:30.217667 20658 leader_election.cc:341] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
W20260925 16:48:30.218921 20658 leader_election.cc:341] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.222074 20516 catalog_manager.cc:5495] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 0 to 1, leader changed from <none> to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 1 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:30.214515 20943 raft_consensus.cc:504] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.226902 20658 leader_election.cc:302] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:30.232471 20932 raft_consensus.cc:3037] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.234759 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:30.235780 20694 raft_consensus.cc:2454] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:30.237185 20733 leader_election.cc:302] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.231278 20943 leader_election.cc:288] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
W20260925 16:48:30.240350 20658 leader_election.cc:341] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.241207 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.251273 20910 tablet_bootstrap.cc:492] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:30.251843 20910 ts_tablet_manager.cc:1397] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.131s	user 0.028s	sys 0.066s
I20260925 16:48:30.241240 20931 raft_consensus.cc:504] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.247364 20924 raft_consensus.cc:686] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:30.255581 20908 tablet_bootstrap.cc:492] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:30.260133 20908 ts_tablet_manager.cc:1397] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.143s	user 0.046s	sys 0.058s
I20260925 16:48:30.259922 20924 consensus_queue.cc:237] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.254110 20515 catalog_manager.cc:5495] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 0 to 1, leader changed from <none> to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 1 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:30.263425 20908 raft_consensus.cc:348] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.264201 20908 raft_consensus.cc:374] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.264467 20908 raft_consensus.cc:729] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.265321 20908 consensus_queue.cc:260] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.243446 20840 raft_consensus.cc:2781] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.246038 20909 tablet_bootstrap.cc:492] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:30.268429 20840 raft_consensus.cc:482] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.268662 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f434cf77e1614176af2315f837ce5422" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.269196 20840 raft_consensus.cc:3037] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.254437 20910 raft_consensus.cc:348] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.270593 20910 raft_consensus.cc:374] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.270988 20910 raft_consensus.cc:729] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.239671 20932 raft_consensus.cc:2726] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:30.267829 20908 ts_tablet_manager.cc:1428] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
W20260925 16:48:30.270764 20661 leader_election.cc:341] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.268759 20909 ts_tablet_manager.cc:1397] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.020s
W20260925 16:48:30.272017 20732 leader_election.cc:341] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.268848 20931 leader_election.cc:288] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.272547 20910 consensus_queue.cc:260] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.246197 20768 raft_consensus.cc:2454] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 1.
I20260925 16:48:30.276221 20908 tablet_bootstrap.cc:492] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:30.278019 20909 raft_consensus.cc:348] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.278272 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f434cf77e1614176af2315f837ce5422" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.278748 20909 raft_consensus.cc:374] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.278900 20620 raft_consensus.cc:3037] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.279086 20909 raft_consensus.cc:729] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.279191 20661 leader_election.cc:302] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:30.279599 20910 ts_tablet_manager.cc:1428] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.027s	user 0.004s	sys 0.002s
I20260925 16:48:30.279820 20909 consensus_queue.cc:260] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.280375 20893 raft_consensus.cc:2781] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.280560 20910 tablet_bootstrap.cc:492] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: Bootstrap starting.
I20260925 16:48:30.302309 20910 tablet_bootstrap.cc:654] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.302565 20840 raft_consensus.cc:504] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.305886 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.306144 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.306687 20694 raft_consensus.cc:3037] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
W20260925 16:48:30.307302 20732 leader_election.cc:341] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Illegal state: must be running to vote when last-logged opid is not known
I20260925 16:48:30.308075 20620 raft_consensus.cc:2454] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 1.
I20260925 16:48:30.297042 20893 raft_consensus.cc:686] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:30.311014 20658 leader_election.cc:302] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:30.316406 20950 raft_consensus.cc:2781] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.311288 20893 consensus_queue.cc:237] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.316918 20950 raft_consensus.cc:686] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:30.314864 20694 raft_consensus.cc:2454] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:30.318562 20950 consensus_queue.cc:237] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.309505 20840 leader_election.cc:288] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:30.320132 20909 ts_tablet_manager.cc:1428] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260925 16:48:30.317559 20517 catalog_manager.cc:5495] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:30.325350 20733 leader_election.cc:302] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:30.327397 20840 raft_consensus.cc:2781] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.327930 20840 raft_consensus.cc:686] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:30.328161 20909 tablet_bootstrap.cc:492] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:30.327214 20517 catalog_manager.cc:5495] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:30.329061 20840 consensus_queue.cc:237] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.339203 20909 tablet_bootstrap.cc:654] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.325304 20908 tablet_bootstrap.cc:654] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.342171 20910 tablet_bootstrap.cc:492] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: No bootstrap required, opened a new log
I20260925 16:48:30.342805 20910 ts_tablet_manager.cc:1397] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent bootstrapping tablet: real 0.062s	user 0.010s	sys 0.012s
I20260925 16:48:30.342877 20893 raft_consensus.cc:482] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.343520 20893 raft_consensus.cc:504] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.346177 20910 raft_consensus.cc:348] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.346976 20910 raft_consensus.cc:374] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.347245 20910 raft_consensus.cc:729] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.347688 20893 leader_election.cc:288] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.349326 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.350271 20620 raft_consensus.cc:2379] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate cdd45a4da6b84bd1a3f73af6485ec02f in current term 1: Already voted for candidate c9deceb1876d42faa203fdc9a23c7f8f in this term.
I20260925 16:48:30.347983 20910 consensus_queue.cc:260] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.350385 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.353156 20910 ts_tablet_manager.cc:1428] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.001s
I20260925 16:48:30.353847 20661 leader_election.cc:302] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:30.354563 20950 raft_consensus.cc:3037] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.354727 20516 catalog_manager.cc:5495] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 0 to 1, leader changed from <none> to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 1 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:30.361789 20950 raft_consensus.cc:2726] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:30.362298 20840 raft_consensus.cc:482] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.362753 20908 tablet_bootstrap.cc:492] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:30.362833 20840 raft_consensus.cc:504] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.363380 20908 ts_tablet_manager.cc:1397] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.000s
I20260925 16:48:30.365501 20840 leader_election.cc:288] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:30.366020 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59137035566043358ed91e98d1564014" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.366849 20620 raft_consensus.cc:2454] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:30.366393 20908 raft_consensus.cc:348] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.367455 20908 raft_consensus.cc:374] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.367834 20908 raft_consensus.cc:729] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.368225 20517 catalog_manager.cc:5495] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:30.369082 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59137035566043358ed91e98d1564014" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:30.368727 20908 consensus_queue.cc:260] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.370491 20732 leader_election.cc:302] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:30.371441 20840 raft_consensus.cc:2781] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260925 16:48:30.371678 20908 ts_tablet_manager.cc:1428] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260925 16:48:30.371872 20840 raft_consensus.cc:482] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:30.372380 20840 raft_consensus.cc:3037] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.373054 20908 tablet_bootstrap.cc:492] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: Bootstrap starting.
I20260925 16:48:30.379528 20694 raft_consensus.cc:2454] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 0.
I20260925 16:48:30.383523 20909 tablet_bootstrap.cc:492] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:30.384088 20909 ts_tablet_manager.cc:1397] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.056s	user 0.020s	sys 0.008s
I20260925 16:48:30.385342 20908 tablet_bootstrap.cc:654] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.386492 20840 raft_consensus.cc:504] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.387027 20909 raft_consensus.cc:348] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.387801 20909 raft_consensus.cc:374] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.389014 20909 raft_consensus.cc:729] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.389848 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59137035566043358ed91e98d1564014" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.389709 20909 consensus_queue.cc:260] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.390427 20620 raft_consensus.cc:3037] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.392149 20516 catalog_manager.cc:5495] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 0 to 1, leader changed from <none> to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 1 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:30.399577 20620 raft_consensus.cc:2454] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:30.393270 20909 ts_tablet_manager.cc:1428] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260925 16:48:30.402267 20909 tablet_bootstrap.cc:492] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:30.408041 20840 leader_election.cc:288] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:30.409162 20732 leader_election.cc:302] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:30.409936 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59137035566043358ed91e98d1564014" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.410642 20694 raft_consensus.cc:3037] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.415766 20909 tablet_bootstrap.cc:654] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.419453 20908 tablet_bootstrap.cc:492] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: No bootstrap required, opened a new log
I20260925 16:48:30.420099 20908 ts_tablet_manager.cc:1397] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent bootstrapping tablet: real 0.047s	user 0.013s	sys 0.027s
I20260925 16:48:30.421363 20694 raft_consensus.cc:2454] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 1.
I20260925 16:48:30.422307 20840 raft_consensus.cc:2781] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader election won for term 1
I20260925 16:48:30.422818 20840 raft_consensus.cc:686] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:30.423421 20908 raft_consensus.cc:348] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.423592 20840 consensus_queue.cc:237] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.424227 20908 raft_consensus.cc:374] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.424651 20908 raft_consensus.cc:729] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.425563 20909 tablet_bootstrap.cc:492] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:30.425269 20908 consensus_queue.cc:260] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.426324 20909 ts_tablet_manager.cc:1397] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.025s	user 0.004s	sys 0.011s
I20260925 16:48:30.427569 20908 ts_tablet_manager.cc:1428] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260925 16:48:30.429425 20909 raft_consensus.cc:348] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.430272 20909 raft_consensus.cc:374] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.430544 20909 raft_consensus.cc:729] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.431262 20909 consensus_queue.cc:260] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.437786 20909 ts_tablet_manager.cc:1428] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.011s	user 0.010s	sys 0.001s
I20260925 16:48:30.439085 20909 tablet_bootstrap.cc:492] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: Bootstrap starting.
I20260925 16:48:30.444712 20909 tablet_bootstrap.cc:654] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: Neither blocks nor log segments found. Creating new log.
I20260925 16:48:30.447597 20516 catalog_manager.cc:5495] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 0 to 1, leader changed from <none> to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 1 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:30.454679 20909 tablet_bootstrap.cc:492] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: No bootstrap required, opened a new log
I20260925 16:48:30.455180 20909 ts_tablet_manager.cc:1397] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent bootstrapping tablet: real 0.016s	user 0.007s	sys 0.007s
I20260925 16:48:30.458292 20909 raft_consensus.cc:348] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.458973 20909 raft_consensus.cc:374] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260925 16:48:30.459224 20909 raft_consensus.cc:729] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Initialized, Role: FOLLOWER
I20260925 16:48:30.460359 20909 consensus_queue.cc:260] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.462144 20909 ts_tablet_manager.cc:1428] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260925 16:48:30.493261 20840 raft_consensus.cc:482] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.493760 20840 raft_consensus.cc:504] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.495249 20840 leader_election.cc:288] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:30.496770 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f434cf77e1614176af2315f837ce5422" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:30.496878 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f434cf77e1614176af2315f837ce5422" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.497872 20620 raft_consensus.cc:2379] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9deceb1876d42faa203fdc9a23c7f8f in current term 1: Already voted for candidate cdd45a4da6b84bd1a3f73af6485ec02f in this term.
I20260925 16:48:30.498824 20732 leader_election.cc:302] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.499473 20840 raft_consensus.cc:3037] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.505633 20840 raft_consensus.cc:2726] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:30.518530 20840 consensus_queue.cc:1035] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:30.531985 20939 consensus_queue.cc:1035] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.554296 20694 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
mode: GRACEFUL
new_leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:52340
I20260925 16:48:30.554908 20694 raft_consensus.cc:595] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Received request to transfer leadership to TS 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:30.560132 20694 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
mode: GRACEFUL
new_leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:52340
I20260925 16:48:30.560698 20694 raft_consensus.cc:595] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Received request to transfer leadership to TS 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:30.566176 20768 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "59137035566043358ed91e98d1564014"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:30.566715 20768 raft_consensus.cc:595] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS 386b91628c2841c0b0fd0d4f33c5633a
I20260925 16:48:30.576530 20769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "90d8a80efa714775911440469e319f70"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:30.577423 20769 raft_consensus.cc:595] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.583951 20769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:30.584548 20769 raft_consensus.cc:595] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.590302 20769 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7e9c6896081345518028e0055172e6a8"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
mode: GRACEFUL
new_leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:59080
I20260925 16:48:30.590994 20769 raft_consensus.cc:595] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Received request to transfer leadership to TS cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.598872 20694 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.660475 20950 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.662088 20876 raft_consensus.cc:482] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.662389 20950 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.664979 20925 consensus_queue.cc:1035] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.663390 20876 raft_consensus.cc:504] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.670822 20620 raft_consensus.cc:3037] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.671556 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.671891 20619 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:30.673095 20769 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 1.
I20260925 16:48:30.674136 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:30.674726 20661 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:30.676651 20876 leader_election.cc:288] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.677235 20950 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.678745 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.680219 20769 raft_consensus.cc:2379] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386b91628c2841c0b0fd0d4f33c5633a in current term 1: Already voted for candidate cdd45a4da6b84bd1a3f73af6485ec02f in this term.
I20260925 16:48:30.683984 20584 leader_election.cc:302] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a; no voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.690917 20932 consensus_queue.cc:1035] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.692552 20876 raft_consensus.cc:3037] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.697600 20932 consensus_queue.cc:1035] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.702666 20893 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:48:30.705855 20893 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 386b91628c2841c0b0fd0d4f33c5633a)
I20260925 16:48:30.706475 20893 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.732293 20925 consensus_queue.cc:1035] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.740324 20876 raft_consensus.cc:2726] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:30.748852 20924 consensus_queue.cc:1035] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.749787 20950 raft_consensus.cc:979] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: : Instructing follower 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:30.750334 20950 raft_consensus.cc:1067] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Signalling peer 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:30.747831 20893 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.751717 20694 raft_consensus.cc:1226] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Rejecting Update request from peer 386b91628c2841c0b0fd0d4f33c5633a for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:30.752840 20893 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.754844 20618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.755921 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.756156 20876 consensus_queue.cc:1046] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:30.757052 20876 raft_consensus.cc:3032] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:30.757428 20876 raft_consensus.cc:729] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:30.758325 20876 consensus_queue.cc:260] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.759847 20876 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.762725 20619 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:43340
I20260925 16:48:30.763772 20619 raft_consensus.cc:482] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:30.764328 20619 raft_consensus.cc:3037] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.766088 20658 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:30.767254 20931 raft_consensus.cc:2726] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260925 16:48:30.766079 20924 consensus_queue.cc:1035] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260925 16:48:30.778007 20939 consensus_queue.cc:1035] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.779354 20924 raft_consensus.cc:979] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:30.781055 20840 raft_consensus.cc:1067] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:30.784603 20617 raft_consensus.cc:3037] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.787591 20931 consensus_queue.cc:1035] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.794423 20695 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7e9c6896081345518028e0055172e6a8"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50304
I20260925 16:48:30.795099 20695 raft_consensus.cc:482] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:30.795586 20695 raft_consensus.cc:3037] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.806984 20932 consensus_queue.cc:1035] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.809067 20619 raft_consensus.cc:504] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.820205 20620 raft_consensus.cc:1226] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Rejecting Update request from peer cdd45a4da6b84bd1a3f73af6485ec02f for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:30.821244 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.821933 20693 raft_consensus.cc:3032] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:30.822209 20693 raft_consensus.cc:729] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:30.822477 20932 consensus_queue.cc:1046] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:30.823904 20693 consensus_queue.cc:260] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.825191 20693 raft_consensus.cc:3037] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.830092 20950 consensus_queue.cc:1035] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.839305 20619 leader_election.cc:288] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.839797 20925 raft_consensus.cc:482] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:30.841723 20925 raft_consensus.cc:504] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.844156 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f18fe21fe411419e98c7e084671a39e1" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.844575 20925 leader_election.cc:288] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.844843 20769 raft_consensus.cc:3037] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.845981 20692 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:30.846992 20692 raft_consensus.cc:2379] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 386b91628c2841c0b0fd0d4f33c5633a in current term 1: Already voted for candidate c9deceb1876d42faa203fdc9a23c7f8f in this term.
I20260925 16:48:30.848676 20893 raft_consensus.cc:979] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: : Instructing follower 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:30.850410 20950 raft_consensus.cc:1067] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Signalling peer 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:30.852218 20768 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:30.852586 20618 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:43340
I20260925 16:48:30.853324 20618 raft_consensus.cc:482] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:30.853719 20618 raft_consensus.cc:3037] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.854086 20586 leader_election.cc:302] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a; no voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:30.856271 20925 raft_consensus.cc:3037] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 0 FOLLOWER]: Advancing to term 1
I20260925 16:48:30.863732 20925 raft_consensus.cc:2726] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260925 16:48:30.868395 20769 raft_consensus.cc:2454] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:30.869282 20976 consensus_queue.cc:1035] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.870771 20693 raft_consensus.cc:2454] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:30.870940 20586 leader_election.cc:302] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
W20260925 16:48:30.871928 20931 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260925 16:48:30.874922 20695 raft_consensus.cc:504] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.883512 20969 raft_consensus.cc:2781] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:30.889228 20969 raft_consensus.cc:686] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:30.889490 20694 raft_consensus.cc:1226] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Rejecting Update request from peer c9deceb1876d42faa203fdc9a23c7f8f for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:30.890509 20969 consensus_queue.cc:237] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.895747 20976 consensus_queue.cc:1046] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.896994 20976 raft_consensus.cc:3032] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:30.897303 20976 raft_consensus.cc:729] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:30.899246 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:30.900136 20617 raft_consensus.cc:3037] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.898062 20618 raft_consensus.cc:504] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.902716 20616 raft_consensus.cc:1226] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Rejecting Update request from peer cdd45a4da6b84bd1a3f73af6485ec02f for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:30.904238 20695 leader_election.cc:288] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.907182 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.907846 20769 raft_consensus.cc:3037] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.914570 20767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e9c6896081345518028e0055172e6a8" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:30.916738 20924 consensus_queue.cc:1035] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:30.919216 20950 consensus_queue.cc:1035] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260925 16:48:30.922166 20924 consensus_queue.cc:1035] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.922890 20931 consensus_queue.cc:1046] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.918787 20618 leader_election.cc:288] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:30.930552 20924 consensus_queue.cc:1035] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.918347 20694 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bdb5d2b981e74e468a2a34e7deb6df53" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:30.900207 20976 consensus_queue.cc:260] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.940224 20924 consensus_queue.cc:1035] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260925 16:48:30.942286 20976 raft_consensus.cc:3037] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:30.941007 20517 catalog_manager.cc:5495] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 1 to 2, leader changed from cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194) to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 2 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:30.937088 20769 raft_consensus.cc:2454] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:30.950094 20768 raft_consensus.cc:1226] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Rejecting Update request from peer cdd45a4da6b84bd1a3f73af6485ec02f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260925 16:48:30.958935 20586 leader_election.cc:302] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:30.965821 20969 raft_consensus.cc:2781] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:30.966583 20969 raft_consensus.cc:686] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:30.969682 20981 consensus_queue.cc:1046] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20260925 16:48:30.971962 20969 consensus_queue.cc:237] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:30.974956 20947 raft_consensus.cc:979] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:30.975718 20947 raft_consensus.cc:1067] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:30.984499 20947 raft_consensus.cc:979] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:30.981571 20694 raft_consensus.cc:3032] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:30.990871 20939 raft_consensus.cc:1067] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer 386b91628c2841c0b0fd0d4f33c5633a to start an election
I20260925 16:48:30.991484 20692 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "90d8a80efa714775911440469e319f70"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50304
I20260925 16:48:30.992463 20692 raft_consensus.cc:482] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:30.989720 20694 raft_consensus.cc:729] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:30.996675 20694 consensus_queue.cc:260] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.004093 20617 raft_consensus.cc:2454] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:31.004303 20619 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "59137035566043358ed91e98d1564014"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
 from {username='slave'} at 127.0.0.1:43352
I20260925 16:48:31.005187 20692 raft_consensus.cc:3037] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.005927 20658 leader_election.cc:302] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:31.007507 20931 raft_consensus.cc:2781] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:31.008533 20931 raft_consensus.cc:686] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:31.009577 20694 raft_consensus.cc:3037] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.009784 20931 consensus_queue.cc:237] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.019801 20692 raft_consensus.cc:504] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.024044 20840 raft_consensus.cc:979] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: : Instructing follower cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:31.024622 20840 raft_consensus.cc:1067] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Signalling peer cdd45a4da6b84bd1a3f73af6485ec02f to start an election
I20260925 16:48:31.024139 20617 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:31.026906 20617 raft_consensus.cc:3037] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.031023 20695 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
 from {username='slave'} at 127.0.0.1:50304
I20260925 16:48:31.031282 20619 raft_consensus.cc:482] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:31.031733 20619 raft_consensus.cc:3037] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.032658 20695 raft_consensus.cc:482] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:31.033464 20695 raft_consensus.cc:3037] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.035787 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90d8a80efa714775911440469e319f70" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:31.036666 20769 raft_consensus.cc:3032] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:31.036986 20769 raft_consensus.cc:729] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:31.037894 20769 consensus_queue.cc:260] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.038913 20767 raft_consensus.cc:2454] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:31.041386 20694 raft_consensus.cc:2454] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
W20260925 16:48:31.041945 20893 raft_consensus.cc:922] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260925 16:48:31.044574 20692 leader_election.cc:288] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:31.046335 20769 raft_consensus.cc:3037] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.048169 20695 raft_consensus.cc:504] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.049427 20693 raft_consensus.cc:1226] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Rejecting Update request from peer c9deceb1876d42faa203fdc9a23c7f8f for earlier term 1. Current term is 2. Ops: []
I20260925 16:48:31.051965 20616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:31.052755 20616 raft_consensus.cc:3037] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.053349 20769 raft_consensus.cc:2454] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:31.054579 20661 leader_election.cc:302] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:31.055619 20893 raft_consensus.cc:2781] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:31.056149 20893 raft_consensus.cc:686] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:31.057219 20976 consensus_queue.cc:1046] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:31.058219 20976 raft_consensus.cc:3032] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:31.058529 20976 raft_consensus.cc:729] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:31.059521 20617 raft_consensus.cc:2454] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:31.057293 20893 consensus_queue.cc:237] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.065435 20976 consensus_queue.cc:260] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.066913 20976 raft_consensus.cc:3037] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.062673 20619 raft_consensus.cc:504] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.074144 20695 leader_election.cc:288] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:31.074446 20616 raft_consensus.cc:2454] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:31.075476 20619 leader_election.cc:288] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Requested vote from peers cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:31.076932 20767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9a0bb279906a4bfdb0fc5d2ce21ca7e1" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:31.078334 20695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59137035566043358ed91e98d1564014" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:31.078558 20658 leader_election.cc:302] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:31.079085 20695 raft_consensus.cc:3037] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.079849 20769 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "59137035566043358ed91e98d1564014" candidate_uuid: "386b91628c2841c0b0fd0d4f33c5633a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:31.083034 20769 raft_consensus.cc:3032] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Stepping down as leader of term 1
I20260925 16:48:31.083974 20769 raft_consensus.cc:729] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:31.083528 20893 raft_consensus.cc:2781] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:31.085022 20893 raft_consensus.cc:686] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:31.086081 20769 consensus_queue.cc:260] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.087466 20893 consensus_queue.cc:237] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.088639 20769 raft_consensus.cc:3037] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:31.087466 20695 raft_consensus.cc:2454] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:31.092289 20584 leader_election.cc:302] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:31.093209 20925 raft_consensus.cc:2781] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:31.093701 20925 raft_consensus.cc:686] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Becoming Leader. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:31.094715 20925 consensus_queue.cc:237] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:31.097518 20767 raft_consensus.cc:2454] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:31.102674 20769 raft_consensus.cc:2454] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 386b91628c2841c0b0fd0d4f33c5633a in term 2.
I20260925 16:48:31.108157 20516 catalog_manager.cc:5495] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:31.109968 20516 catalog_manager.cc:5495] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:31.124622 20515 catalog_manager.cc:5495] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 2 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:31.126219 20515 catalog_manager.cc:5495] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a reported cstate change: term changed from 1 to 2, leader changed from cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194) to 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193). New cstate: current_term: 2 leader_uuid: "386b91628c2841c0b0fd0d4f33c5633a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:31.135901 20516 catalog_manager.cc:5495] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 1 to 2, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 2 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:31.296936 20769 raft_consensus.cc:1261] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.298554 20925 consensus_queue.cc:1035] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.307276 20695 raft_consensus.cc:1261] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.309092 20925 consensus_queue.cc:1035] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.389194 20695 raft_consensus.cc:1261] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.390501 20925 consensus_queue.cc:1035] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.399689 20769 raft_consensus.cc:1261] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.401129 20925 consensus_queue.cc:1035] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260925 16:48:31.529392 20619 raft_consensus.cc:1261] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.531239 20931 consensus_queue.cc:1035] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.535804 20769 raft_consensus.cc:1261] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.537426 20950 consensus_queue.cc:1035] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.555001 20769 raft_consensus.cc:1261] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.556528 20969 consensus_queue.cc:1035] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.562095 20769 raft_consensus.cc:1261] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.564590 20893 consensus_queue.cc:1035] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.569416 20695 raft_consensus.cc:1261] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Refusing update from remote peer 386b91628c2841c0b0fd0d4f33c5633a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.571204 20926 consensus_queue.cc:1035] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:31.592545 20616 raft_consensus.cc:1261] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.594188 20950 consensus_queue.cc:1035] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.601734 20619 raft_consensus.cc:1261] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.603370 20950 consensus_queue.cc:1035] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:31.619289 20767 raft_consensus.cc:1261] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260925 16:48:31.620760 20893 consensus_queue.cc:1035] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:32.237905 20924 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 386b91628c2841c0b0fd0d4f33c5633a)
I20260925 16:48:32.238826 20924 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.243042 20924 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:32.243963 20616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:32.244248 20695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" is_pre_election: true
I20260925 16:48:32.244926 20695 raft_consensus.cc:2379] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c9deceb1876d42faa203fdc9a23c7f8f in current term 2: Already voted for candidate cdd45a4da6b84bd1a3f73af6485ec02f in this term.
I20260925 16:48:32.244776 20616 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 2.
I20260925 16:48:32.246331 20732 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:32.247244 20924 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260925 16:48:32.247686 20924 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 386b91628c2841c0b0fd0d4f33c5633a)
I20260925 16:48:32.248066 20924 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Advancing to term 2
I20260925 16:48:32.258045 20924 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.260601 20924 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 2 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:32.261762 20616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:32.261742 20695 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:32.262980 20695 raft_consensus.cc:2379] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c9deceb1876d42faa203fdc9a23c7f8f in current term 2: Already voted for candidate cdd45a4da6b84bd1a3f73af6485ec02f in this term.
I20260925 16:48:32.270182 20616 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 2.
I20260925 16:48:32.272161 20732 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: cdd45a4da6b84bd1a3f73af6485ec02f
I20260925 16:48:32.273383 20924 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Leader election won for term 2
I20260925 16:48:32.274415 20924 raft_consensus.cc:686] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:32.275375 20924 consensus_queue.cc:237] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.285854 20517 catalog_manager.cc:5495] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 1 to 2, leader changed from 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193) to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 2 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:32.304105 20893 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260925 16:48:32.304688 20893 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.306632 20893 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:32.307607 20767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" is_pre_election: true
I20260925 16:48:32.307801 20616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a" is_pre_election: true
I20260925 16:48:32.308718 20616 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 2.
I20260925 16:48:32.310218 20658 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:32.311095 20893 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260925 16:48:32.311921 20893 raft_consensus.cc:482] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260925 16:48:32.312179 20893 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:32.319586 20893 raft_consensus.cc:504] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.321280 20893 leader_election.cc:288] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 3 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195:37719)
I20260925 16:48:32.322628 20616 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:32.322757 20767 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "01569f025e1c4d90b8555845828c7695" candidate_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
I20260925 16:48:32.323249 20616 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:32.329921 20616 raft_consensus.cc:2454] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate cdd45a4da6b84bd1a3f73af6485ec02f in term 3.
I20260925 16:48:32.331194 20658 leader_election.cc:302] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:32.332188 20893 raft_consensus.cc:2781] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:48:32.332871 20893 raft_consensus.cc:686] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 LEADER]: Becoming Leader. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:32.333688 20893 consensus_queue.cc:237] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.341055 20517 catalog_manager.cc:5495] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f reported cstate change: term changed from 2 to 3, leader changed from c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195) to cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194). New cstate: current_term: 3 leader_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: UNKNOWN } } }
I20260925 16:48:32.657804 20616 raft_consensus.cc:1226] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Rejecting Update request from peer c9deceb1876d42faa203fdc9a23c7f8f for earlier term 2. Current term is 3. Ops: []
I20260925 16:48:32.659030 20924 consensus_queue.cc:1046] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:32.660220 20995 raft_consensus.cc:3032] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:48:32.660691 20995 raft_consensus.cc:729] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:32.661428 20995 consensus_queue.cc:260] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:32.662333 20995 raft_consensus.cc:3037] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:32.793987 20767 raft_consensus.cc:1261] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20260925 16:48:32.794445 20767 pending_rounds.cc:76] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Aborting all ops after (but not including) 1
I20260925 16:48:32.794935 20767 pending_rounds.cc:97] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20260925 16:48:32.795193 20767 raft_consensus.cc:2866] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260925 16:48:32.796475 20893 consensus_queue.cc:1035] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260925 16:48:32.804911 20616 raft_consensus.cc:1261] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Refusing update from remote peer cdd45a4da6b84bd1a3f73af6485ec02f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260925 16:48:32.806669 21003 consensus_queue.cc:1035] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260925 16:48:33.598758 20516 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:38328:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260925 16:48:33.619588 20516 catalog_manager.cc:3333] Servicing AlterTable request from {username='slave'} at 127.0.0.1:38328:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260925 16:48:33.639117  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:33.688565 21027 tablet.cc:1722] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.862848 21049 tablet.cc:1722] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.927975 21052 tablet.cc:1722] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.938179 21060 tablet.cc:1722] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.928007 21027 tablet.cc:1722] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.932662 20695 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "87f458328ca14f06b2900558a057dbab"
dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
mode: GRACEFUL
new_leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
 from {username='slave'} at 127.0.0.1:52354
I20260925 16:48:33.955008 21054 tablet.cc:1722] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.908839 21053 tablet.cc:1722] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:33.956573 20695 raft_consensus.cc:595] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Received request to transfer leadership to TS c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:33.953346 21059 tablet.cc:1722] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260925 16:48:33.993966 20658 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.193:39529, user_credentials={real_user=slave}} blocked reactor thread for 86233.7us
W20260925 16:48:34.019326 21051 log.cc:924] Time spent T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: Append to log took a long time: real 0.097s	user 0.002s	sys 0.001s
W20260925 16:48:34.030016 21050 log.cc:924] Time spent T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260925 16:48:34.029762 21068 tablet.cc:1722] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260925 16:48:34.002507 20661 outbound_call.cc:322] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.7.158.195:37719, user_credentials={real_user=slave}} blocked reactor thread for 60938.5us
I20260925 16:48:34.041383 21049 tablet.cc:1722] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.046314 21027 tablet.cc:1722] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.064637 21065 tablet.cc:1722] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.081929 21071 tablet.cc:1722] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.085633 21072 tablet.cc:1722] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.051563 21059 tablet.cc:1722] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.050820 21054 tablet.cc:1722] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.089141 21069 tablet.cc:1722] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.077795 21052 tablet.cc:1722] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.093356 21053 tablet.cc:1722] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.164417 21053 tablet.cc:1722] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.166772 21054 tablet.cc:1722] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.170487 21060 tablet.cc:1722] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260925 16:48:34.175668 20502 outbound_call.cc:322] RPC callback for RPC call kudu.tserver.TabletServerAdminService.AlterSchema -> {remote=127.7.158.193:39529, user_credentials={real_user=slave}} blocked reactor thread for 72130.8us
I20260925 16:48:34.181348 21053 tablet.cc:1722] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.191385 21049 tablet.cc:1722] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.196187 21072 tablet.cc:1722] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.199486 21068 tablet.cc:1722] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.202773 21064 raft_consensus.cc:979] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: : Instructing follower c9deceb1876d42faa203fdc9a23c7f8f to start an election
I20260925 16:48:34.203437 20931 raft_consensus.cc:1067] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Signalling peer c9deceb1876d42faa203fdc9a23c7f8f to start an election
I20260925 16:48:34.205323 20767 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "87f458328ca14f06b2900558a057dbab"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
 from {username='slave'} at 127.0.0.1:59078
I20260925 16:48:34.205922 20767 raft_consensus.cc:482] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:34.205669 21059 tablet.cc:1722] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260925 16:48:34.206336 20767 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:34.213222 20767 raft_consensus.cc:504] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:34.216361 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:34.217016 20620 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:34.217264 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "87f458328ca14f06b2900558a057dbab" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:34.217895 20693 raft_consensus.cc:3032] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:48:34.218197 20693 raft_consensus.cc:729] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: cdd45a4da6b84bd1a3f73af6485ec02f, State: Running, Role: LEADER
I20260925 16:48:34.218959 20693 consensus_queue.cc:260] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:34.220162 20693 raft_consensus.cc:3037] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:34.221328 20767 leader_election.cc:288] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 3 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:34.226646 20620 raft_consensus.cc:2454] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 3.
I20260925 16:48:34.229090 20732 leader_election.cc:302] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 386b91628c2841c0b0fd0d4f33c5633a, c9deceb1876d42faa203fdc9a23c7f8f; no voters: 
I20260925 16:48:34.230070 20995 raft_consensus.cc:2781] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:48:34.230806 20995 raft_consensus.cc:686] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:34.230975 20617 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9"
dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
mode: GRACEFUL
new_leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
 from {username='slave'} at 127.0.0.1:44980
I20260925 16:48:34.231666 20617 raft_consensus.cc:595] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Received request to transfer leadership to TS c9deceb1876d42faa203fdc9a23c7f8f
I20260925 16:48:34.232445 20995 consensus_queue.cc:237] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:34.233210  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260925 16:48:34.233951  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:34.227716 20693 raft_consensus.cc:2454] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 3.
I20260925 16:48:34.251019 20517 catalog_manager.cc:6040] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: soft_deleted_table [id=d8d472fdc8074e9b81d16721c4f52a1f] alter complete (version 1)
I20260925 16:48:34.266315 20515 catalog_manager.cc:5495] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 2 to 3, leader changed from cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194) to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 3 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:34.287279 20926 raft_consensus.cc:979] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: : Instructing follower c9deceb1876d42faa203fdc9a23c7f8f to start an election
I20260925 16:48:34.287947 21028 raft_consensus.cc:1067] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Signalling peer c9deceb1876d42faa203fdc9a23c7f8f to start an election
I20260925 16:48:34.289630 20767 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9"
dest_uuid: "c9deceb1876d42faa203fdc9a23c7f8f"
 from {username='slave'} at 127.0.0.1:59062
I20260925 16:48:34.290148 20767 raft_consensus.cc:482] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260925 16:48:34.290459 20767 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:34.295324 20767 raft_consensus.cc:504] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:34.297163 20767 leader_election.cc:288] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 3 election: Requested vote from peers 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529), cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371)
I20260925 16:48:34.298034 20620 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "386b91628c2841c0b0fd0d4f33c5633a"
I20260925 16:48:34.298311 20693 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "de0038eadee24d768982d1a1e63bf6c9" candidate_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f"
I20260925 16:48:34.298671 20620 raft_consensus.cc:3032] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Stepping down as leader of term 2
I20260925 16:48:34.298970 20693 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:34.299129 20620 raft_consensus.cc:729] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 386b91628c2841c0b0fd0d4f33c5633a, State: Running, Role: LEADER
I20260925 16:48:34.300035 20620 consensus_queue.cc:260] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:34.301118 20620 raft_consensus.cc:3037] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Advancing to term 3
I20260925 16:48:34.306552 20693 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 3.
I20260925 16:48:34.307361 20620 raft_consensus.cc:2454] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c9deceb1876d42faa203fdc9a23c7f8f in term 3.
I20260925 16:48:34.308306 20733 leader_election.cc:302] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c9deceb1876d42faa203fdc9a23c7f8f, cdd45a4da6b84bd1a3f73af6485ec02f; no voters: 
I20260925 16:48:34.309255 20995 raft_consensus.cc:2781] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Leader election won for term 3
I20260925 16:48:34.309746 20995 raft_consensus.cc:686] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 LEADER]: Becoming Leader. State: Replica: c9deceb1876d42faa203fdc9a23c7f8f, State: Running, Role: LEADER
I20260925 16:48:34.310545 20995 consensus_queue.cc:237] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } }
I20260925 16:48:34.319984 20515 catalog_manager.cc:5495] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f reported cstate change: term changed from 2 to 3, leader changed from 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193) to c9deceb1876d42faa203fdc9a23c7f8f (127.7.158.195). New cstate: current_term: 3 leader_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c9deceb1876d42faa203fdc9a23c7f8f" member_type: VOTER last_known_addr { host: "127.7.158.195" port: 37719 } health_report { overall_health: HEALTHY } } }
I20260925 16:48:34.634371 20693 raft_consensus.cc:1261] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Refusing update from remote peer c9deceb1876d42faa203fdc9a23c7f8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:48:34.635605 20995 consensus_queue.cc:1035] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:34.650053 20617 raft_consensus.cc:1261] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Refusing update from remote peer c9deceb1876d42faa203fdc9a23c7f8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:48:34.652494 21081 consensus_queue.cc:1035] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:34.765671 20693 raft_consensus.cc:1261] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Refusing update from remote peer c9deceb1876d42faa203fdc9a23c7f8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:48:34.766942 21081 consensus_queue.cc:1035] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "cdd45a4da6b84bd1a3f73af6485ec02f" member_type: VOTER last_known_addr { host: "127.7.158.194" port: 43371 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260925 16:48:34.776649 20617 raft_consensus.cc:1261] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Refusing update from remote peer c9deceb1876d42faa203fdc9a23c7f8f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260925 16:48:34.779953 21085 consensus_queue.cc:1035] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [LEADER]: Connected to new peer: Peer: permanent_uuid: "386b91628c2841c0b0fd0d4f33c5633a" member_type: VOTER last_known_addr { host: "127.7.158.193" port: 39529 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260925 16:48:35.235355  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:35.241861  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:35.242451  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:36.243319  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:36.248786  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:36.249125  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:37.250155  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:37.255610  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:37.256186  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:38.257283  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:38.263350  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:38.263931  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:39.264925  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:39.270937  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:39.271349  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:40.272106  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:40.276712  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:40.277104  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:41.278263  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:41.284647  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:41.285127  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:42.286103  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:42.293951  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:42.294507  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20260925 16:48:43.295768  7803 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20260925 16:48:43.302203  7803 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260925 16:48:43.302742  7803 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:596: Failure
Expected: (leader.second) != (3), actual: 3 vs 3
I20260925 16:48:44.364614  7803 tablet_server.cc:178] TabletServer@127.7.158.193:0 shutting down...
W20260925 16:48:44.394400 20658 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 11 similar messages]
W20260925 16:48:44.402277 20658 consensus_peers.cc:487] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:44.403996 20732 consensus_peers.cc:487] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.414422  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:44.415400  7803 tablet_replica.cc:330] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.416392  7803 raft_consensus.cc:2229] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.417172  7803 raft_consensus.cc:2258] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.420598  7803 tablet_replica.cc:330] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.421243  7803 raft_consensus.cc:2229] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.422242  7803 raft_consensus.cc:2258] T bdb5d2b981e74e468a2a34e7deb6df53 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.425303  7803 tablet_replica.cc:330] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.426232  7803 raft_consensus.cc:2229] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.427372  7803 raft_consensus.cc:2258] T f18fe21fe411419e98c7e084671a39e1 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.431447  7803 tablet_replica.cc:330] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.433866  7803 raft_consensus.cc:2229] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.436408  7803 raft_consensus.cc:2258] T 59137035566043358ed91e98d1564014 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.438308 20658 consensus_peers.cc:487] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:44.440590 20732 consensus_peers.cc:487] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.440713  7803 tablet_replica.cc:330] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.441936  7803 raft_consensus.cc:2229] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.442760  7803 raft_consensus.cc:2258] T f1119adaeaa74dea956ff2de41338c18 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.445351 20658 consensus_peers.cc:487] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.446405  7803 tablet_replica.cc:330] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.447070  7803 raft_consensus.cc:2229] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.447898  7803 raft_consensus.cc:2258] T 7e9c6896081345518028e0055172e6a8 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.450592  7803 tablet_replica.cc:330] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.451216  7803 raft_consensus.cc:2229] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.452103  7803 raft_consensus.cc:2258] T 01569f025e1c4d90b8555845828c7695 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.454972  7803 tablet_replica.cc:330] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.455754  7803 raft_consensus.cc:2229] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
W20260925 16:48:44.455842 20658 consensus_peers.cc:487] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.456482  7803 raft_consensus.cc:2258] T 90d8a80efa714775911440469e319f70 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.459124  7803 tablet_replica.cc:330] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.459951  7803 raft_consensus.cc:2229] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.460654  7803 raft_consensus.cc:2258] T f975ac9ac5854adb83e3bd7f14e3c17a P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.461867 20732 consensus_peers.cc:487] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.463860  7803 tablet_replica.cc:330] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.464461  7803 raft_consensus.cc:2229] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.465284  7803 raft_consensus.cc:2258] T 3fad3381a04e4380875352097dea373f P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.467789  7803 tablet_replica.cc:330] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.468552  7803 raft_consensus.cc:2229] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.469630  7803 raft_consensus.cc:2258] T 91ee8bf70b67447fb9984a35c0e20075 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.472280  7803 tablet_replica.cc:330] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.472903  7803 raft_consensus.cc:2229] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.473363  7803 raft_consensus.cc:2258] T de0038eadee24d768982d1a1e63bf6c9 P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.475867  7803 tablet_replica.cc:330] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.476750  7803 raft_consensus.cc:2229] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.477703  7803 raft_consensus.cc:2258] T 218625d375ee426abed709faede5fe55 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.480345  7803 tablet_replica.cc:330] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.480937  7803 raft_consensus.cc:2229] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.481643  7803 raft_consensus.cc:2258] T 87f458328ca14f06b2900558a057dbab P 386b91628c2841c0b0fd0d4f33c5633a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260925 16:48:44.483884 20658 consensus_peers.cc:487] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.484807  7803 tablet_replica.cc:330] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.485489  7803 raft_consensus.cc:2229] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.486109  7803 raft_consensus.cc:2258] T 53e44bb9909441df971f01c2fe28cd4f P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.488792  7803 tablet_replica.cc:330] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.489341  7803 raft_consensus.cc:2229] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.489884  7803 raft_consensus.cc:2258] T f434cf77e1614176af2315f837ce5422 P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.492328  7803 tablet_replica.cc:330] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.492882  7803 raft_consensus.cc:2229] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.493363  7803 raft_consensus.cc:2258] T 6a8d661b42a540c89c4c0dd42988c531 P 386b91628c2841c0b0fd0d4f33c5633a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.495915  7803 tablet_replica.cc:330] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a: stopping tablet replica
I20260925 16:48:44.496444  7803 raft_consensus.cc:2229] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.496927  7803 raft_consensus.cc:2258] T d8cc4ec6889c494fb84f818e8695994b P 386b91628c2841c0b0fd0d4f33c5633a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.547803  7803 tablet_server.cc:194] TabletServer@127.7.158.193:0 shutdown complete.
I20260925 16:48:44.595155  7803 tablet_server.cc:178] TabletServer@127.7.158.194:0 shutting down...
W20260925 16:48:44.606195 20732 consensus_peers.cc:487] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260925 16:48:44.625967 20658 consensus_peers.cc:487] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f -> Peer 386b91628c2841c0b0fd0d4f33c5633a (127.7.158.193:39529): Couldn't send request to peer 386b91628c2841c0b0fd0d4f33c5633a. Status: Network error: Client connection negotiation failed: client connection to 127.7.158.193:39529: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.631037  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:44.631850  7803 tablet_replica.cc:330] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.632854  7803 raft_consensus.cc:2229] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.633615  7803 raft_consensus.cc:2258] T 59137035566043358ed91e98d1564014 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.637188  7803 tablet_replica.cc:330] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
W20260925 16:48:44.637404 20733 consensus_peers.cc:487] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f -> Peer cdd45a4da6b84bd1a3f73af6485ec02f (127.7.158.194:43371): Couldn't send request to peer cdd45a4da6b84bd1a3f73af6485ec02f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260925 16:48:44.637881  7803 raft_consensus.cc:2229] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.638854  7803 raft_consensus.cc:2258] T 7e9c6896081345518028e0055172e6a8 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.641270  7803 tablet_replica.cc:330] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.641837  7803 raft_consensus.cc:2229] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.642767  7803 raft_consensus.cc:2258] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.645032  7803 tablet_replica.cc:330] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.645673  7803 raft_consensus.cc:2229] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.646559  7803 raft_consensus.cc:2258] T 01569f025e1c4d90b8555845828c7695 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.648936  7803 tablet_replica.cc:330] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.649520  7803 raft_consensus.cc:2229] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.650349  7803 raft_consensus.cc:2258] T 90d8a80efa714775911440469e319f70 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.652496  7803 tablet_replica.cc:330] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.653112  7803 raft_consensus.cc:2229] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.653613  7803 raft_consensus.cc:2258] T f1119adaeaa74dea956ff2de41338c18 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.655817  7803 tablet_replica.cc:330] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.656358  7803 raft_consensus.cc:2229] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.656920  7803 raft_consensus.cc:2258] T bdb5d2b981e74e468a2a34e7deb6df53 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.659066  7803 tablet_replica.cc:330] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.659584  7803 raft_consensus.cc:2229] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.660142  7803 raft_consensus.cc:2258] T f18fe21fe411419e98c7e084671a39e1 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.662216  7803 tablet_replica.cc:330] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.662739  7803 raft_consensus.cc:2229] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.663612  7803 raft_consensus.cc:2258] T f975ac9ac5854adb83e3bd7f14e3c17a P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.665879  7803 tablet_replica.cc:330] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.666401  7803 raft_consensus.cc:2229] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.667263  7803 raft_consensus.cc:2258] T f434cf77e1614176af2315f837ce5422 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.669661  7803 tablet_replica.cc:330] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.670200  7803 raft_consensus.cc:2229] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.671049  7803 raft_consensus.cc:2258] T 6a8d661b42a540c89c4c0dd42988c531 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.673223  7803 tablet_replica.cc:330] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.673942  7803 raft_consensus.cc:2229] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.674373  7803 raft_consensus.cc:2258] T 218625d375ee426abed709faede5fe55 P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.676734  7803 tablet_replica.cc:330] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.677284  7803 raft_consensus.cc:2229] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.677731  7803 raft_consensus.cc:2258] T 87f458328ca14f06b2900558a057dbab P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.679787  7803 tablet_replica.cc:330] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.680246  7803 raft_consensus.cc:2229] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.680647  7803 raft_consensus.cc:2258] T 91ee8bf70b67447fb9984a35c0e20075 P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.682552  7803 tablet_replica.cc:330] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.682998  7803 raft_consensus.cc:2229] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.683449  7803 raft_consensus.cc:2258] T de0038eadee24d768982d1a1e63bf6c9 P cdd45a4da6b84bd1a3f73af6485ec02f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.685478  7803 tablet_replica.cc:330] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.686026  7803 raft_consensus.cc:2229] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.687000  7803 raft_consensus.cc:2258] T 53e44bb9909441df971f01c2fe28cd4f P cdd45a4da6b84bd1a3f73af6485ec02f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.689324  7803 tablet_replica.cc:330] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.689837  7803 raft_consensus.cc:2229] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.690237  7803 raft_consensus.cc:2258] T 3fad3381a04e4380875352097dea373f P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.692298  7803 tablet_replica.cc:330] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f: stopping tablet replica
I20260925 16:48:44.692829  7803 raft_consensus.cc:2229] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.693286  7803 raft_consensus.cc:2258] T d8cc4ec6889c494fb84f818e8695994b P cdd45a4da6b84bd1a3f73af6485ec02f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.737293  7803 tablet_server.cc:194] TabletServer@127.7.158.194:0 shutdown complete.
I20260925 16:48:44.775091  7803 tablet_server.cc:178] TabletServer@127.7.158.195:0 shutting down...
I20260925 16:48:44.809592  7803 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20260925 16:48:44.810361  7803 tablet_replica.cc:330] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.811149  7803 raft_consensus.cc:2229] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.811955  7803 raft_consensus.cc:2258] T f434cf77e1614176af2315f837ce5422 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.814419  7803 tablet_replica.cc:330] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.815029  7803 raft_consensus.cc:2229] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.815586  7803 raft_consensus.cc:2258] T 59137035566043358ed91e98d1564014 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.817827  7803 tablet_replica.cc:330] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.818352  7803 raft_consensus.cc:2229] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.818861  7803 raft_consensus.cc:2258] T f18fe21fe411419e98c7e084671a39e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.820982  7803 tablet_replica.cc:330] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.821569  7803 raft_consensus.cc:2229] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.822041  7803 raft_consensus.cc:2258] T bdb5d2b981e74e468a2a34e7deb6df53 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.824124  7803 tablet_replica.cc:330] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.824667  7803 raft_consensus.cc:2229] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.825493  7803 raft_consensus.cc:2258] T f1119adaeaa74dea956ff2de41338c18 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.827426  7803 tablet_replica.cc:330] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.828027  7803 raft_consensus.cc:2229] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.828531  7803 raft_consensus.cc:2258] T 7e9c6896081345518028e0055172e6a8 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.830513  7803 tablet_replica.cc:330] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.831044  7803 raft_consensus.cc:2229] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.831548  7803 raft_consensus.cc:2258] T 01569f025e1c4d90b8555845828c7695 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.833638  7803 tablet_replica.cc:330] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.834141  7803 raft_consensus.cc:2229] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.834805  7803 raft_consensus.cc:2258] T 90d8a80efa714775911440469e319f70 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.837015  7803 tablet_replica.cc:330] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.837551  7803 raft_consensus.cc:2229] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.837931  7803 raft_consensus.cc:2258] T 3fad3381a04e4380875352097dea373f P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.839938  7803 tablet_replica.cc:330] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.840389  7803 raft_consensus.cc:2229] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.841166  7803 raft_consensus.cc:2258] T de0038eadee24d768982d1a1e63bf6c9 P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.843119  7803 tablet_replica.cc:330] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.843613  7803 raft_consensus.cc:2229] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.844067  7803 raft_consensus.cc:2258] T 91ee8bf70b67447fb9984a35c0e20075 P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.845880  7803 tablet_replica.cc:330] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.846307  7803 raft_consensus.cc:2229] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.847098  7803 raft_consensus.cc:2258] T d8cc4ec6889c494fb84f818e8695994b P c9deceb1876d42faa203fdc9a23c7f8f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.849150  7803 tablet_replica.cc:330] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.849639  7803 raft_consensus.cc:2229] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.850059  7803 raft_consensus.cc:2258] T 53e44bb9909441df971f01c2fe28cd4f P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.851994  7803 tablet_replica.cc:330] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.852442  7803 raft_consensus.cc:2229] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.853184  7803 raft_consensus.cc:2258] T 87f458328ca14f06b2900558a057dbab P c9deceb1876d42faa203fdc9a23c7f8f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.855293  7803 tablet_replica.cc:330] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.855798  7803 raft_consensus.cc:2229] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.856194  7803 raft_consensus.cc:2258] T 218625d375ee426abed709faede5fe55 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.858039  7803 tablet_replica.cc:330] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.858470  7803 raft_consensus.cc:2229] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.858894  7803 raft_consensus.cc:2258] T 9a0bb279906a4bfdb0fc5d2ce21ca7e1 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.860852  7803 tablet_replica.cc:330] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.861243  7803 raft_consensus.cc:2229] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.861613  7803 raft_consensus.cc:2258] T f975ac9ac5854adb83e3bd7f14e3c17a P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.863432  7803 tablet_replica.cc:330] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f: stopping tablet replica
I20260925 16:48:44.863843  7803 raft_consensus.cc:2229] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260925 16:48:44.864274  7803 raft_consensus.cc:2258] T 6a8d661b42a540c89c4c0dd42988c531 P c9deceb1876d42faa203fdc9a23c7f8f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.906908  7803 tablet_server.cc:194] TabletServer@127.7.158.195:0 shutdown complete.
I20260925 16:48:44.947517  7803 master.cc:537] Master@127.7.158.254:33515 shutting down...
I20260925 16:48:44.970469  7803 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 LEADER]: Raft consensus shutting down.
I20260925 16:48:44.971091  7803 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260925 16:48:44.971429  7803 tablet_replica.cc:330] T 00000000000000000000000000000000 P 9e870c6e171946239b7a2a76ce63db68: stopping tablet replica
I20260925 16:48:44.991104  7803 master.cc:552] Master@127.7.158.254:33515 shutdown complete.
I20260925 16:48:45.027029  7803 test_util.cc:175] -----------------------------------------------
I20260925 16:48:45.027245  7803 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskrd_EUb/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1790354474930402-7803-0
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true (20471 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (41969 ms total)

[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (449941 ms total)
[  PASSED  ] 4 tests.
[  SKIPPED ] 1 test, listed below:
[  SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[  FAILED  ] 2 tests, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver
[  FAILED  ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1, where GetParam() = true

 2 FAILED TESTS
I20260925 16:48:45.033763  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:221: suppressed but not reported on 2222 messages since previous log ~31 seconds ago
I20260925 16:48:45.033998  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:305: suppressed but not reported on 2222 messages since previous log ~31 seconds ago
I20260925 16:48:45.034216  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet_mm_ops.cc:140: suppressed but not reported on 2209 messages since previous log ~31 seconds ago
I20260925 16:48:45.034430  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 44 messages since previous log ~61 seconds ago
I20260925 16:48:45.034618  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 44 messages since previous log ~61 seconds ago
I20260925 16:48:45.034920  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260925 16:48:45.035209  7803 logging.cc:424] LogThrottler /data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/tablet/tablet.cc:2369: suppressed but not reported on 106 messages since previous log ~40 seconds ago
ThreadSanitizer: reported 2 warnings